2024-02-21T07:27:59.105 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-21T07:27:59.105 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} --archive /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301 --owner scheduled_vshankar@teuthology --verbose --name vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/orig.config.yaml 2024-02-21T07:27:59.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:27:59.249 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301 branch: wip-vshankar-testing-20240216.060239 description: fs:workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} email: vshankar@redhat.com first_in_suite: false job_id: '7569301' kernel: client: branch: testing flavor: default kdb: true sha1: 1130e053228021b1be9cac260b5ed52c5a9027c5 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240216.060239 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240216.060239 sha1: e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9275 sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 sleep_before_teardown: 0 subset: 805/1024 suite: fs:workload suite_branch: wip-vshankar-testing-20240216.060239 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBHqD5EK2yCiwOjAZxCfdzCeP4fXnHVdzOm305i/XJOfBihHKusmYaV/m0rfq90k9SjzILGIZzwRHuWAMZzQxyY= smithi174.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyl1QxUPZ2qST+PVV1yvkS7iRSEfafL4VLsc9yLcB6dsuwUMrAWlKY6pOfhPOkGdSD/h/UkclT3yuRPz72pnrs= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQUfEnugbQAcMUc0mD6LDCzK6L+jT7U5qrbfNZAmYYVekRdSqMWqEYZfytwXlcGkG0AGTfViiq3xaq5vCI3QxA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - kernel_untar_build.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-21_07:17:34 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-21T07:27:59.249 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa; will attempt to use it 2024-02-21T07:27:59.250 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks 2024-02-21T07:27:59.250 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-21T07:27:59.252 INFO:teuthology.task.internal:Checking packages... 2024-02-21T07:27:59.277 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '25296a8f176256aea5ed8b5850b25167dce0ae33' 2024-02-21T07:27:59.277 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-21T07:27:59.277 INFO:teuthology.packaging:ref: None 2024-02-21T07:27:59.277 INFO:teuthology.packaging:tag: None 2024-02-21T07:27:59.277 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240216.060239 2024-02-21T07:27:59.277 INFO:teuthology.packaging:sha1: 25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:27:59.277 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240216.060239 2024-02-21T07:27:59.496 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1514.g25296a8f 2024-02-21T07:27:59.497 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-21T07:27:59.504 INFO:teuthology.task.internal:no buildpackages task found 2024-02-21T07:27:59.504 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-21T07:27:59.545 INFO:teuthology.task.internal:Saving configuration 2024-02-21T07:27:59.565 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-21T07:27:59.622 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T07:27:59.646 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:22:52.272506', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBHqD5EK2yCiwOjAZxCfdzCeP4fXnHVdzOm305i/XJOfBihHKusmYaV/m0rfq90k9SjzILGIZzwRHuWAMZzQxyY='} 2024-02-21T07:27:59.666 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:22:52.276349', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyl1QxUPZ2qST+PVV1yvkS7iRSEfafL4VLsc9yLcB6dsuwUMrAWlKY6pOfhPOkGdSD/h/UkclT3yuRPz72pnrs='} 2024-02-21T07:27:59.683 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:22:52.277621', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQUfEnugbQAcMUc0mD6LDCzK6L+jT7U5qrbfNZAmYYVekRdSqMWqEYZfytwXlcGkG0AGTfViiq3xaq5vCI3QxA='} 2024-02-21T07:27:59.683 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-21T07:27:59.689 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-02-21T07:27:59.690 INFO:teuthology.task.internal:roles: ubuntu@smithi174.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-02-21T07:27:59.690 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-02-21T07:27:59.690 INFO:teuthology.run_tasks:Running task console_log... 2024-02-21T07:27:59.800 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f718b5010d0>, signals=[15]) 2024-02-21T07:27:59.801 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-21T07:27:59.810 INFO:teuthology.task.internal:Opening connections... 2024-02-21T07:27:59.810 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:27:59.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:27:59.910 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:27:59.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:28:00.001 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:28:00.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:28:00.089 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-21T07:28:00.095 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2024-02-21T07:28:00.113 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2024-02-21T07:28:00.114 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-02-21T07:28:00.171 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-02-21T07:28:00.171 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-02-21T07:28:00.171 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-02-21T07:28:00.171 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:28:00.171 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-02-21T07:28:00.171 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:28:00.171 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:28:00.171 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-02-21T07:28:00.171 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:28:00.172 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:28:00.172 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:28:00.172 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:28:00.172 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:28:00.172 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:28:00.172 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-02-21T07:28:00.194 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2024-02-21T07:28:00.212 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2024-02-21T07:28:00.212 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-02-21T07:28:00.269 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2024-02-21T07:28:00.269 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2024-02-21T07:28:00.269 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2024-02-21T07:28:00.269 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:28:00.269 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2024-02-21T07:28:00.269 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:28:00.269 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:28:00.270 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2024-02-21T07:28:00.270 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:28:00.270 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:28:00.270 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:28:00.270 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:28:00.270 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:28:00.270 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:28:00.271 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-02-21T07:28:00.293 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-02-21T07:28:00.311 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-02-21T07:28:00.311 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-02-21T07:28:00.368 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-02-21T07:28:00.368 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-02-21T07:28:00.368 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-02-21T07:28:00.368 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:28:00.368 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-02-21T07:28:00.368 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:28:00.368 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:28:00.369 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-02-21T07:28:00.369 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:28:00.369 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:28:00.369 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:28:00.369 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:28:00.369 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:28:00.369 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:28:00.369 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-02-21T07:28:00.394 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-21T07:28:00.403 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-21T07:28:00.429 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-21T07:28:00.430 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2024-02-21T07:28:00.432 DEBUG:teuthology.orchestra.run.smithi174:> test '!' -e /home/ubuntu/cephtest 2024-02-21T07:28:00.434 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-02-21T07:28:00.451 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-21T07:28:00.462 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-21T07:28:00.462 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2024-02-21T07:28:00.488 DEBUG:teuthology.orchestra.run.smithi174:> test -z $(ls -A /var/lib/ceph) 2024-02-21T07:28:00.491 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-02-21T07:28:00.516 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-21T07:28:00.590 INFO:teuthology.run_tasks:Running task kernel... 2024-02-21T07:28:00.605 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1130e053228021b1be9cac260b5ed52c5a9027c5'} 2024-02-21T07:28:00.605 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-02-21T07:28:00.605 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-02-21T07:28:00.605 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T07:28:00.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:28:00.622 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-02-21T07:28:00.814 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1130e053228021b1be9cac260b5ed52c5a9027c5 2024-02-21T07:28:00.814 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1130e053228021b1be9cac260b5ed52c5a9027c5"... 2024-02-21T07:28:00.814 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2024-02-21T07:28:00.831 INFO:teuthology.orchestra.run.smithi069.stdout:5.14.0-361.el9.x86_64 2024-02-21T07:28:00.832 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1130e053228021b1be9cac260b5ed52c5a9027c5 2024-02-21T07:28:00.832 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-21T07:28:00.832 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum upgrade -y linux-firmware 2024-02-21T07:28:03.021 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS-9 - AppStream 15 MB/s | 6.7 MB 00:00 2024-02-21T07:28:04.413 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-02-21T07:28:05.437 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-02-21T07:28:59.223 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 371 kB/s | 19 MB 00:52 2024-02-21T07:29:04.189 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.1 MB 00:01 2024-02-21T07:29:05.574 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 15 kB 00:00 2024-02-21T07:29:12.341 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 3.1 MB/s | 20 MB 00:06 2024-02-21T07:29:17.282 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 9.8 kB/s | 1.7 kB 00:00 2024-02-21T07:29:19.634 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-02-21T07:29:19.645 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-02-21T07:29:19.645 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-02-21T07:29:19.645 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-02-21T07:29:19.645 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2024-02-21T07:29:19.645 INFO:teuthology.orchestra.run.smithi069.stdout: linux-firmware noarch 20240109-142.el9 CentOS-BaseOS 375 M 2024-02-21T07:29:19.645 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:29:19.646 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-02-21T07:29:19.646 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-02-21T07:29:19.646 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 1 Package 2024-02-21T07:29:19.646 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:29:19.646 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 375 M 2024-02-21T07:29:19.646 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-02-21T07:29:29.174 INFO:teuthology.orchestra.run.smithi069.stdout:linux-firmware-20240109-142.el9.noarch.rpm 39 MB/s | 375 MB 00:09 2024-02-21T07:29:29.175 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-02-21T07:29:29.175 INFO:teuthology.orchestra.run.smithi069.stdout:Total 39 MB/s | 375 MB 00:09 2024-02-21T07:29:29.176 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-02-21T07:29:29.273 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-02-21T07:29:29.273 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-02-21T07:29:31.715 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-02-21T07:29:31.715 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-02-21T07:29:38.194 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-02-21T07:29:38.431 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : linux-firmware-20240109-142.el9.noarch 1/2 2024-02-21T07:29:38.505 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-21T07:29:39.698 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-21T07:29:39.698 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : linux-firmware-20240109-142.el9.noarch 1/2 2024-02-21T07:29:40.119 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-21T07:29:40.120 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:29:40.120 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2024-02-21T07:29:40.120 INFO:teuthology.orchestra.run.smithi069.stdout: linux-firmware-20240109-142.el9.noarch 2024-02-21T07:29:40.120 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:29:40.120 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-02-21T07:29:40.428 INFO:teuthology.task.kernel:Downloading kernel 1130e053228021b1be9cac260b5ed52c5a9027c5 on client.0... 2024-02-21T07:29:40.429 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1130e053228021b1be9cac260b5ed52c5a9027c5 2024-02-21T07:29:40.659 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1130e053228021b1be9cac260b5ed52c5a9027c5/centos/9/flavors/default/x86_64/ 2024-02-21T07:29:40.659 DEBUG:teuthology.orchestra.run.smithi069:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc4_g1130e0532280-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1130e053228021b1be9cac260b5ed52c5a9027c5/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-21T07:29:40.662 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi069.front.sepia.ceph.com to complete... 2024-02-21T07:29:55.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21 07:29:55 URL:https://3.chacra.ceph.com/r/kernel/testing/1130e053228021b1be9cac260b5ed52c5a9027c5/centos/9/flavors/default/x86_64/kernel-6.8.0_rc4_g1130e0532280-1.x86_64.rpm [332924888/332924888] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-21T07:29:55.724 INFO:teuthology.orchestra.run.smithi069.stderr:FINISHED --2024-02-21 07:29:55-- 2024-02-21T07:29:55.724 INFO:teuthology.orchestra.run.smithi069.stderr:Total wall clock time: 15s 2024-02-21T07:29:55.724 INFO:teuthology.orchestra.run.smithi069.stderr:Downloaded: 1 files, 318M in 15s (21.5 MB/s) 2024-02-21T07:29:55.727 INFO:teuthology.task.kernel:Installing kernel 1130e053228021b1be9cac260b5ed52c5a9027c5 on client.0... 2024-02-21T07:29:55.728 DEBUG:teuthology.orchestra.run.smithi069:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-21T07:29:57.649 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying... ######################################## 2024-02-21T07:29:57.707 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing... ######################################## 2024-02-21T07:29:57.785 INFO:teuthology.orchestra.run.smithi069.stdout:Updating / installing... 2024-02-21T07:30:05.241 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-6.8.0_rc4_g1130e0532280-1 ######################################## 2024-02-21T07:30:21.032 INFO:teuthology.orchestra.run.smithi069.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-21T07:30:43.163 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi069.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-21T07:30:43.163 DEBUG:teuthology.orchestra.run.smithi069:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-21T07:30:43.240 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280 2024-02-21T07:30:43.240 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/System.map 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/config 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-21T07:30:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel/cpu 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel/cpu/mce 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm 2024-02-21T07:30:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm/kvm.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/ansi_cprng.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/anubis.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/arc4.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_memcpy.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_pq.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_tx.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_xor.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/raid6test.ko 2024-02-21T07:30:43.243 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/authenc.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/authencesn.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/blake2b_generic.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/blowfish_common.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/blowfish_generic.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/camellia_generic.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cast5_generic.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cast6_generic.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cast_common.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/ccm.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cmac.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/crc32_generic.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/crypto_engine.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/crypto_user.ko 2024-02-21T07:30:43.244 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cts.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/des_generic.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/dh_generic.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/echainiv.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/essiv.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/fcrypt.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/khazad.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/lz4.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/lz4hc.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/md4.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/michael_mic.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/pcbc.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/pcrypt.ko 2024-02-21T07:30:43.245 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/rmd160.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/seed.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/serpent_generic.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/tcrypt.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/tea.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/twofish_common.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/twofish_generic.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/vmac.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/wp512.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/xcbc.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/xor.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/xxhash_generic.ko 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi 2024-02-21T07:30:43.246 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/acpi_pad.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/custom_method.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/ec_sys.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/platform_profile.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/sbs.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/sbshc.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/video.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/acard-ahci.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/ahci_platform.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/ata_generic.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/libahci_platform.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_acpi.ko 2024-02-21T07:30:43.247 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ali.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_amd.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_artop.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_atiixp.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_atp867x.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_cmd640.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_cmd64x.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_cypress.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_efar.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt366.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt37x.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_it8213.ko 2024-02-21T07:30:43.248 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_it821x.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_jmicron.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_marvell.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_mpiix.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_netcell.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ninja32.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ns87410.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ns87415.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_oldpiix.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_opti.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_optidma.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_pcmcia.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-21T07:30:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_piccolo.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_rdc.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sch.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_serverworks.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sil680.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sis.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sl82c105.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_triflex.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_via.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pdc_adma.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_inic162x.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_mv.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_nv.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_promise.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_qstor.ko 2024-02-21T07:30:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sil.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sil24.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sis.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_svw.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sx4.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_uli.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_via.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_vsc.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/auxdisplay 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/auxdisplay/ks0108.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base/regmap 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/bcma 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/bcma/bcma.ko 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block 2024-02-21T07:30:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/aoe 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/aoe/aoe.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/brd.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/drbd 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/drbd/drbd.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/floppy.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/loop.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/mtip32xx 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/nbd.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/null_blk 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/null_blk/null_blk.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/pktcdvd.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/rbd.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/virtio_blk.ko 2024-02-21T07:30:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/xen-blkback 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/xen-blkfront.ko 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/zram 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/zram/zram.ko 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hangcheck-timer.ko 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/via-rng.ko 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi 2024-02-21T07:30:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/lp.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/mwave 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/mwave/mwave.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ppdev.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tlclk.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-21T07:30:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/uv_mmtimer.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/virtio_console.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/ccp 2024-02-21T07:30:43.255 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/ccp/ccp.ko 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_common 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/padlock-aes.ko 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/padlock-sha.ko 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/virtio 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dca 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dca/dca.ko 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/devfreq 2024-02-21T07:30:43.256 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/dw 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/ioat 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/amd64_edac.ko 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/e752x_edac.ko 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/edac_mce_amd.ko 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i3000_edac.ko 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i3200_edac.ko 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i5100_edac.ko 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i5400_edac.ko 2024-02-21T07:30:43.257 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i7300_edac.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i7core_edac.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i82975x_edac.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/ie31200_edac.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/sb_edac.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/x38_edac.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/firmware 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/firmware/edd.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/gpio 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/gpio/gpio-ich.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-appleir.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-aureal.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-axff.ko 2024-02-21T07:30:43.258 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-dr.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-elecom.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-elo.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-emsff.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-gaff.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-gt683r.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-gyration.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-holtekff.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-hyperv.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-icade.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-keytouch.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-kye.ko 2024-02-21T07:30:43.259 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-lcpower.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-led.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-lenovo.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-multitouch.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-ortek.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-penmount.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-petalynx.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-picolcd.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-pl.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-plantronics.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-primax.ko 2024-02-21T07:30:43.260 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-rmi.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-common.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-saitek.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-samsung.ko 2024-02-21T07:30:43.261 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sjoy.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sony.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-speedlink.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-steelseries.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sunplus.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-tivo.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-tmff.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-topseed.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-twinhan.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-uclogic.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-waltop.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-wiimote.ko 2024-02-21T07:30:43.262 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-xinmo.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-zpff.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-zydacron.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/uhid.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/wacom.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv/hv_balloon.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv/hv_utils.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv/hv_vmbus.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/abituguru.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/abituguru3.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ad7414.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ad7418.ko 2024-02-21T07:30:43.263 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adc128d818.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1025.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1026.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1029.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1031.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm9240.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ads7828.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7410.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7411.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7462.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7470.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7475.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7x10.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/amc6821.ko 2024-02-21T07:30:43.264 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/applesmc.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/asb100.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/asc7621.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/atxp1.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/coretemp.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/dme1737.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ds1621.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ds620.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/emc1403.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/emc6w201.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/f71805f.ko 2024-02-21T07:30:43.265 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/f71882fg.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/f75375s.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/fam15h_power.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/fschmd.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/g760a.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/g762.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/gl518sm.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/gl520sm.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/i5500_temp.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/i5k_amb.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ibmaem.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ibmpex.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ina209.ko 2024-02-21T07:30:43.266 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ina2xx.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/it87.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/k10temp.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/k8temp.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lineage-pem.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm63.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm73.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm75.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm77.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm78.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm80.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm83.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm85.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm87.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm90.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm92.ko 2024-02-21T07:30:43.267 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm93.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm95234.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm95241.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm95245.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc2945.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4151.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4215.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4222.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4245.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4260.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4261.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max16065.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max1619.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max1668.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max197.ko 2024-02-21T07:30:43.268 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max6639.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max6650.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max6697.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/mcp3021.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct6683.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct6775-core.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct6775.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct7802.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pc87360.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pc87427.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pcf8591.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-21T07:30:43.269 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/powr1220.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sch5627.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sch5636.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sht15.ko 2024-02-21T07:30:43.270 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sht21.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/shtc1.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sis5595.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/smsc47b397.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/smsc47m1.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/smsc47m192.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/thmc50.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp102.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp103.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp401.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp421.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/via-cputemp.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/via686a.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/vt1211.ko 2024-02-21T07:30:43.271 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/vt8231.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83627ehf.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83627hf.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83781d.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83791d.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83792d.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83793.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83795.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83l785ts.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83l786ng.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/algos 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-21T07:30:43.272 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-21T07:30:43.273 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-dev.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-mux.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-smbus.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-stub.ko 2024-02-21T07:30:43.274 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_core.ko 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/cxgb4 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx4 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-21T07:30:43.275 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx5 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mthca 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/ipoib 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/iser 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/isert 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srp 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srpt 2024-02-21T07:30:43.276 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport/gameport.ko 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/joydev.ko 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/keyboard 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/appletouch.ko 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/bcm5974.ko 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/cyapatp.ko 2024-02-21T07:30:43.277 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/sermouse.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/rmi4 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/altera_ps2.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/arc_ps2.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/serio_raw.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/sparse-keymap.ko 2024-02-21T07:30:43.278 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-blinkm.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-lm3530.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-lp3944.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-ss4200.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-21T07:30:43.279 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/bcache 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/bcache/bcache.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-bio-prison.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-cache-smq.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-cache.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-crypt.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-delay.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-flakey.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-log-userspace.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-multipath.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-queue-length.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-raid.ko 2024-02-21T07:30:43.280 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-round-robin.ko 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-service-time.ko 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-switch.ko 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-thin-pool.ko 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-verity.ko 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/persistent-data 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid0.ko 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid1.ko 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid10.ko 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid456.ko 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion 2024-02-21T07:30:43.281 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptbase.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptctl.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptfc.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptlan.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptsas.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptscsih.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptspi.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/lpc_ich.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/lpc_sch.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/mfd-core.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/sm501.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/viperboard.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/vx855.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/wl1273-core.ko 2024-02-21T07:30:43.282 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/altera-stapl 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/apds9802als.ko 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/apds990x.ko 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/bh1770glc.ko 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/cb710 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/cb710/cb710.ko 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom/at24.ko 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom/max6875.ko 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/enclosure.ko 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/hpilo.ko 2024-02-21T07:30:43.283 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/isl29003.ko 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/isl29020.ko 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/lis3lv02d 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei/mei-me.ko 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei/mei-txe.ko 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei/mei.ko 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-gru 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-21T07:30:43.284 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/tifm_7xx1.ko 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/tifm_core.ko 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/tsl2550.ko 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/vmw_balloon.ko 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/vmw_vmci 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/bonding 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/bonding/bonding.ko 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/b53 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-21T07:30:43.285 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/mv88e6xxx 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dummy.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/eql.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-21T07:30:43.286 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/adaptec 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/agere 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/alteon 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/altera 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/alx 2024-02-21T07:30:43.287 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atlx 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/genet 2024-02-21T07:30:43.288 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/brocade 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/brocade/bna 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-21T07:30:43.289 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/cisco 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/cisco/enic 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dlink 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-21T07:30:43.290 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dnet.ko 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/emulex 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/emulex/benet 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/ethoc.ko 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/fealnx.ko 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000e 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/fm10k 2024-02-21T07:30:43.291 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/i40e 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/iavf 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igb 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igbvf 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-21T07:30:43.292 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/jme.ko 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/micrel 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-21T07:30:43.293 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/myricom 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/natsemi 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/neterion 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/nvidia 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/packetengines 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-21T07:30:43.294 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rdc 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rocker 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sfc 2024-02-21T07:30:43.295 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/silan 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sis 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-21T07:30:43.296 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/tehuti 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/ti 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/via 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/wiznet 2024-02-21T07:30:43.297 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/xircom 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/geneve.ko 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/hyperv 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ieee802154 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ifb.ko 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ipvlan 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/macvlan.ko 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/macvtap.ko 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio 2024-02-21T07:30:43.298 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mii.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/net_failover.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/netconsole.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/nlmon.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/pcs 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/amd.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-21T07:30:43.299 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm87xx.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/broadcom.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/cicada.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/davicom.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/dp83640.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/et1011c.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/icplus.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/lxt.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/marvell.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/micrel.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/national.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/phylink.ko 2024-02-21T07:30:43.300 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/qsemi.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/realtek.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/smsc.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/ste10Xp.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/vitesse.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_async.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/pppoe.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/pppox.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/pptp.ko 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/slip 2024-02-21T07:30:43.301 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/slip/slhc.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/slip/slip.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/sungem_phy.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/tap.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_random.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/tun.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/veth.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/virtio_net.ko 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vmxnet3 2024-02-21T07:30:43.302 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vxlan 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vxlan/vxlan.ko 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/xen-netback 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/xen-netfront.ko 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ntb 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ntb/ntb.ko 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme/host 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme/host/nvme-core.ko 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme/host/nvme.ko 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport 2024-02-21T07:30:43.303 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport.ko 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport_cs.ko 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport_pc.ko 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport_serial.ko 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/hotplug 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/pcie 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/xen-pcifront.ko 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia/i82092.ko 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia/pd6729.ko 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-21T07:30:43.304 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pinctrl 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pinctrl/intel 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/acerhdf.ko 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-21T07:30:43.305 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/hdaps.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/intel 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/intel_ips.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-21T07:30:43.306 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/wmi.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/powercap 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients/pps_parport.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/pps_core.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ptp 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ptp/ptp.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ptp/ptp_kvm.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-21T07:30:43.307 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-em3027.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-21T07:30:43.308 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-max6900.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-21T07:30:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-x1205.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/3w-9xxx.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/3w-sas.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/3w-xxxx.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/BusLogic.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/a100u2w.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aacraid 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/advansys.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aic7xxx 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/am53c974.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/arcmsr 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-21T07:30:43.310 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/atp870u.ko 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/be2iscsi 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bfa 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bfa/bfa.ko 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2fc 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2i 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ch.ko 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/csiostor 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-21T07:30:43.311 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/dc395x.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/dmx3191d.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/esas2r 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/esp_scsi.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fcoe 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-21T07:30:43.312 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fnic 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fnic/fnic.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/hpsa.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/hptiop.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/hv_storvsc.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/initio.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ipr.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ips.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/isci 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/isci/isci.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libfc 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libfc/libfc.ko 2024-02-21T07:30:43.313 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libiscsi.ko 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libsas 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libsas/libsas.ko 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/lpfc 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid.ko 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mpt3sas 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mvsas 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-21T07:30:43.314 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mvumi.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/pm8001 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/pmcraid.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla1280.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla2xxx 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla4xxx 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/raid_class.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_debug.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-21T07:30:43.315 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ses.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/st.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/stex.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/sym53c8xx_2 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/virtio_scsi.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/wd719x.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ssb 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ssb/ssb.ko 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target 2024-02-21T07:30:43.316 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/iscsi 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/loopback 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_file.ko 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_iblock.ko 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_mod.ko 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_pscsi.ko 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_user.ko 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/tcm_fc 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal 2024-02-21T07:30:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-21T07:30:43.318 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/ipwireless 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/n_gsm.ko 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/n_hdlc.ko 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/nozomi.ko 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/8250 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/arc_uart.ko 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/jsm 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-21T07:30:43.319 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/core 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/host 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio.ko 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_aec.ko 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_cif.ko 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_pci_generic.ko 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_sercos3.ko 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class 2024-02-21T07:30:43.320 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/cdc-acm.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/usblp.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/usbtmc.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/host 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/image 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/image/mdc800.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/image/microtek.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/adutux.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/appledisplay.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/emi26.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/emi62.ko 2024-02-21T07:30:43.321 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/ezusb.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/idmouse.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/iowarrior.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/ldusb.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/legousbtower.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/sisusbvga 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/usb3503.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/usblcd.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/uss720.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/yurex.ko 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/phy 2024-02-21T07:30:43.322 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/phy/phy-generic.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/aircable.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ark3116.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ch341.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/cp210x.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/cyberjack.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/empeg.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-21T07:30:43.323 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/io_ti.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ipaq.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ipw.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ir-usb.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/keyspan.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/mct_u232.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/mos7720.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/mos7840.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/navman.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/omninet.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/opticon.ko 2024-02-21T07:30:43.324 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/option.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/oti6858.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/pl2303.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/qcaux.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/qcserial.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/quatech2.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/safe_serial.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/sierra.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ssu100.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/symbolserial.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/usb_debug.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-21T07:30:43.325 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/visor.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/whiteheat.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/uas.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-karma.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-21T07:30:43.326 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/usb-storage.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/pci 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/vfio.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-21T07:30:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost.ko 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost_net.ko 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost_scsi.ko 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight/apple_bl.ko 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight/lcd.ko 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio.ko 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_balloon.ko 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_mmio.ko 2024-02-21T07:30:43.328 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_pci.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_ring.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/masters 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/masters/ds2482.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/masters/ds2490.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-21T07:30:43.329 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/wire.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/hpwdt.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/i6300esb.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/ib700wdt.ko 2024-02-21T07:30:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/ibmasr.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/it87_wdt.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/machzwd.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/nv_tco.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/softdog.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/via_wdt.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-21T07:30:43.331 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/wdt_pci.ko 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/xen_wdt.ko 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-evtchn.ko 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-gntalloc.ko 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-gntdev.ko 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-pciback 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-privcmd.ko 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xenfs 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/9p 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/9p/9p.ko 2024-02-21T07:30:43.332 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/affs 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/affs/affs.ko 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/befs 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/befs/befs.ko 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/binfmt_misc.ko 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/btrfs 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/btrfs/btrfs.ko 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cachefiles 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cachefiles/cachefiles.ko 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ceph 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ceph/ceph.ko 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/coda 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/coda/coda.ko 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cramfs 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cramfs/cramfs.ko 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/dlm 2024-02-21T07:30:43.333 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/dlm/dlm.ko 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ecryptfs 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/f2fs 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/f2fs/f2fs.ko 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat/fat.ko 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat/msdos.ko 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat/vfat.ko 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fuse 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fuse/cuse.ko 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fuse/fuse.ko 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/gfs2 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/gfs2/gfs2.ko 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfs 2024-02-21T07:30:43.334 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfs/hfs.ko 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfsplus 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfsplus/hfsplus.ko 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/isofs 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/isofs/isofs.ko 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/jfs 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/jfs/jfs.ko 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/lockd 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/lockd/lockd.ko 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/minix 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/minix/minix.ko 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/netfs 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/netfs/netfs.ko 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/blocklayout 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-21T07:30:43.335 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/filelayout 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/flexfilelayout 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/nfs.ko 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/nfsv3.ko 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/nfsv4.ko 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs_common 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs_common/grace.ko 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs_common/nfs_acl.ko 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfsd 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfsd/nfsd.ko 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nilfs2 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nilfs2/nilfs2.ko 2024-02-21T07:30:43.336 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-celtic.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-centeuro.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-croatian.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-cyrillic.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-gaelic.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-greek.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-iceland.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-inuit.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-roman.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-romanian.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-turkish.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp1250.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp1251.ko 2024-02-21T07:30:43.337 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp1255.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp737.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp775.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp850.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp852.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp855.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp857.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp860.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp861.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp862.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp863.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp864.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp865.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp866.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp869.ko 2024-02-21T07:30:43.338 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp874.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp932.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp936.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp949.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp950.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_euc-jp.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-1.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-13.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-14.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-15.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-2.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-3.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-4.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-5.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-6.ko 2024-02-21T07:30:43.339 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-7.ko 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-9.ko 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_koi8-r.ko 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_koi8-ru.ko 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_koi8-u.ko 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_utf8.ko 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/cluster 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlm 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlmfs 2024-02-21T07:30:43.340 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2.ko 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/overlayfs 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/overlayfs/overlay.ko 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/pstore 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/pstore/ramoops.ko 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/reiserfs 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/reiserfs/reiserfs.ko 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/romfs 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/romfs/romfs.ko 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/client 2024-02-21T07:30:43.341 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/client/cifs.ko 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/common 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/common/cifs_arc4.ko 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/common/cifs_md4.ko 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/squashfs 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/squashfs/squashfs.ko 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/sysv 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/sysv/sysv.ko 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/udf 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/udf/udf.ko 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ufs 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ufs/ufs.ko 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/xfs 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/xfs/xfs.ko 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel 2024-02-21T07:30:43.342 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/rcu 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/rcu/rcutorture.ko 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/torture.ko 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/trace 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/asn1_encoder.ko 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crc-itu-t.ko 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crc8.ko 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crypto 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crypto/libarc4.ko 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crypto/libdes.ko 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/libcrc32c.ko 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lru_cache.ko 2024-02-21T07:30:43.343 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lz4 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lz4/lz4_compress.ko 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lz4/lz4hc_compress.ko 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/math 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/math/cordic.ko 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/raid6 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/raid6/raid6_pq.ko 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/reed_solomon 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/ts_bm.ko 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/ts_fsm.ko 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/ts_kmp.ko 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/zstd 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/zstd/zstd_compress.ko 2024-02-21T07:30:43.344 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/mm 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/mm/hwpoison-inject.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/6lowpan.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_dest.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_fragment.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_hop.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_mobility.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_routing.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_udp.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/garp.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/mrp.ko 2024-02-21T07:30:43.345 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/p8022.ko 2024-02-21T07:30:43.346 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/psnap.ko 2024-02-21T07:30:43.346 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/stp.ko 2024-02-21T07:30:43.346 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/8021q 2024-02-21T07:30:43.346 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/8021q/8021q.ko 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet.ko 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet_fd.ko 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet_rdma.ko 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet_virtio.ko 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/batman-adv 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/batman-adv/batman-adv.ko 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/br_netfilter.ko 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/bridge.ko 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-21T07:30:43.348 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-21T07:30:43.349 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtables.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ceph 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ceph/libceph.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/core 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/core/failover.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/core/pktgen.ko 2024-02-21T07:30:43.350 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp.ko 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp_diag.ko 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp_ipv4.ko 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp_ipv6.ko 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dns_resolver 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dns_resolver/dns_resolver.ko 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/dsa_core.ko 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_brcm.ko 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_dsa.ko 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_none.ko 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_trailer.ko 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/6lowpan 2024-02-21T07:30:43.351 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/ieee802154.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ah4.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/esp4.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/fou.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/gre.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/inet_diag.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ip_gre.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ip_tunnel.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ip_vti.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ipcomp.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ipip.ko 2024-02-21T07:30:43.352 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-21T07:30:43.353 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_bic.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_dctcp.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_diag.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_highspeed.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_htcp.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_hybla.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_illinois.ko 2024-02-21T07:30:43.354 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_lp.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_scalable.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_vegas.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_veno.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_westwood.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_yeah.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tunnel4.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/udp_diag.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/udp_tunnel.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ah6.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/esp6.ko 2024-02-21T07:30:43.355 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/fou6.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ip6_tunnel.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ip6_vti.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ipcomp6.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-21T07:30:43.356 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-21T07:30:43.357 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/sit.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/tunnel6.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/key 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/key/af_key.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_core.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_eth.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_ip.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_ip6.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_netlink.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_ppp.ko 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/llc 2024-02-21T07:30:43.358 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/llc/llc.ko 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mac802154 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mac802154/mac802154.ko 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mpls 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mpls/mpls_gso.ko 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set.ko 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-21T07:30:43.359 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-21T07:30:43.360 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conncount.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-21T07:30:43.361 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_flow_table.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_log_syslog.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-21T07:30:43.362 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_irc.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_sip.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_tables.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_log.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_chain_nat.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_compat.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_ct.ko 2024-02-21T07:30:43.363 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_fib.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_hash.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_limit.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_log.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_masq.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_nat.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_numgen.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_queue.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_quota.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_redir.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_reject.ko 2024-02-21T07:30:43.364 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_reject_inet.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_socket.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_tunnel.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_AUDIT.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CT.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_DSCP.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_HL.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_HMARK.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_LED.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_LOG.ko 2024-02-21T07:30:43.365 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_NETMAP.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_NFLOG.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_RATEEST.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_SECMARK.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TEE.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TPROXY.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TRACE.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_addrtype.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_bpf.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_cgroup.ko 2024-02-21T07:30:43.366 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_cluster.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_comment.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connbytes.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connlabel.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connlimit.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connmark.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_conntrack.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_cpu.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_dccp.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_devgroup.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_dscp.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_ecn.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_esp.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_hashlimit.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_helper.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_hl.ko 2024-02-21T07:30:43.367 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_ipcomp.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_iprange.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_ipvs.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_l2tp.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_length.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_limit.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_mac.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_mark.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_multiport.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_nat.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_nfacct.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_osf.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_owner.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_physdev.ko 2024-02-21T07:30:43.368 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_pkttype.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_policy.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_quota.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_rateest.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_realm.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_recent.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_sctp.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_set.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_socket.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_state.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_statistic.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_string.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_tcpmss.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_time.ko 2024-02-21T07:30:43.369 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_u32.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netlink 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netlink/netlink_diag.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/nsh 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/nsh/nsh.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/openvswitch.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/vport-geneve.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/vport-gre.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/vport-vxlan.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/packet 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/packet/af_packet_diag.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds/rds.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds/rds_rdma.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds/rds_tcp.ko 2024-02-21T07:30:43.370 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_csum.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_gact.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_mirred.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_nat.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_pedit.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_police.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_simple.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_skbedit.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_vlan.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_basic.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_bpf.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_flow.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_fw.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_route.ko 2024-02-21T07:30:43.371 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_u32.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_cmp.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_ipset.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_meta.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_nbyte.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_text.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_u32.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_choke.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_codel.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_drr.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_fq.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_gred.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_hfsc.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_hhf.ko 2024-02-21T07:30:43.372 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_htb.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_ingress.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_mqprio.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_mqprio_lib.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_multiq.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_netem.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_pie.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_plug.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_prio.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_qfq.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_red.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_sfb.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_sfq.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_tbf.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_teql.ko 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sctp 2024-02-21T07:30:43.373 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sctp/sctp.ko 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sctp/sctp_diag.ko 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/auth_gss 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/sunrpc.ko 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/xprtrdma 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/tipc 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/tipc/diag.ko 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/tipc/tipc.ko 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/unix 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/unix/unix_diag.ko 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-21T07:30:43.374 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vsock.ko 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/xfrm 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/encrypted-keys 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/trusted-keys 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/trusted-keys/trusted.ko 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/virt 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/virt/lib 2024-02-21T07:30:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/virt/lib/irqbypass.ko 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.alias 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.alias.bin 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin.alias.bin 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin.bin 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin.modinfo 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.dep 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.dep.bin 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.devname 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.order 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.softdep 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.symbols 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.symbols.bin 2024-02-21T07:30:43.376 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/vmlinuz 2024-02-21T07:30:43.381 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc4-g1130e0532280 2024-02-21T07:30:43.381 DEBUG:teuthology.orchestra.run.smithi069:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-21T07:30:43.403 INFO:teuthology.orchestra.run.smithi069.stdout:postinstall scriptlet (using /bin/sh): 2024-02-21T07:30:43.403 INFO:teuthology.orchestra.run.smithi069.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout: /usr/bin/kernel-install add 6.8.0-rc4-g1130e0532280 /lib/modules/6.8.0-rc4-g1130e0532280/vmlinuz 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout:fi 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout:for file in vmlinuz System.map config; do 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc4-g1130e0532280/${file}" "/boot/${file}-6.8.0-rc4-g1130e0532280"; then 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout: cp "/lib/modules/6.8.0-rc4-g1130e0532280/${file}" "/boot/${file}-6.8.0-rc4-g1130e0532280" 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout: fi 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout:done 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout:new-kernel-pkg --remove 6.8.0-rc4-g1130e0532280 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc4-g1130e0532280.img 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-install remove 6.8.0-rc4-g1130e0532280 2024-02-21T07:30:43.404 INFO:teuthology.orchestra.run.smithi069.stdout:fi 2024-02-21T07:30:43.405 INFO:teuthology.orchestra.run.smithi069.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-21T07:30:43.405 INFO:teuthology.orchestra.run.smithi069.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-21T07:30:43.405 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/update-bootloader --remove 6.8.0-rc4-g1130e0532280 2024-02-21T07:30:43.405 INFO:teuthology.orchestra.run.smithi069.stdout:fi 2024-02-21T07:30:43.405 DEBUG:teuthology.orchestra.run.smithi069:> sudo rpm -qi grub2-tools 2024-02-21T07:30:43.478 INFO:teuthology.orchestra.run.smithi069.stdout:Name : grub2-tools 2024-02-21T07:30:43.478 INFO:teuthology.orchestra.run.smithi069.stdout:Epoch : 1 2024-02-21T07:30:43.478 INFO:teuthology.orchestra.run.smithi069.stdout:Version : 2.06 2024-02-21T07:30:43.478 INFO:teuthology.orchestra.run.smithi069.stdout:Release : 68.el9 2024-02-21T07:30:43.478 INFO:teuthology.orchestra.run.smithi069.stdout:Architecture: x86_64 2024-02-21T07:30:43.478 INFO:teuthology.orchestra.run.smithi069.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-21T07:30:43.478 INFO:teuthology.orchestra.run.smithi069.stdout:Group : Unspecified 2024-02-21T07:30:43.478 INFO:teuthology.orchestra.run.smithi069.stdout:Size : 8264254 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:License : GPLv3+ 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:Packager : builder@centos.org 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:Vendor : CentOS 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:Summary : Support tools for GRUB. 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:Description : 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-21T07:30:43.479 INFO:teuthology.orchestra.run.smithi069.stdout:hardware devices. 2024-02-21T07:30:43.480 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:30:43.480 INFO:teuthology.orchestra.run.smithi069.stdout:This subpackage provides tools for support of all platforms. 2024-02-21T07:30:43.480 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-21T07:30:43.481 INFO:teuthology.task.kernel:Updating grub on smithi069 to boot 6.8.0-rc4-g1130e0532280 2024-02-21T07:30:43.481 DEBUG:teuthology.orchestra.run.smithi069:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-21T07:30:44.094 INFO:teuthology.orchestra.run.smithi069.stderr:Generating grub configuration file ... 2024-02-21T07:30:45.567 INFO:teuthology.orchestra.run.smithi069.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-21T07:30:45.598 INFO:teuthology.orchestra.run.smithi069.stderr:done 2024-02-21T07:30:45.613 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2024-02-21T07:30:45.627 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.mS2haQen66 2024-02-21T07:30:45.628 DEBUG:teuthology.orchestra.run.smithi069:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mS2haQen66 2024-02-21T07:30:45.696 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.mS2haQen66 2024-02-21T07:30:45.840 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.mS2haQen66 is 6KB 2024-02-21T07:30:45.889 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.mS2haQen66 2024-02-21T07:30:45.903 DEBUG:teuthology.orchestra.run.smithi069:> sudo /bin/ls /boot/loader/entries || true 2024-02-21T07:30:45.968 INFO:teuthology.orchestra.run.smithi069.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-21T07:30:45.968 INFO:teuthology.orchestra.run.smithi069.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-21T07:30:45.968 INFO:teuthology.orchestra.run.smithi069.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-21T07:30:45.969 INFO:teuthology.orchestra.run.smithi069.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc4-g1130e0532280.conf 2024-02-21T07:30:45.970 DEBUG:teuthology.orchestra.run.smithi069:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc4-g1130e0532280 2024-02-21T07:30:46.118 DEBUG:teuthology.orchestra.run.smithi069:> sudo shutdown -r now 2024-02-21T07:31:16.121 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-21T07:31:16.122 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-02-21T07:31:16.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:31:34.588 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-02-21T07:31:43.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-02-21T07:31:43.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:31:46.652 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-02-21T07:31:58.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-02-21T07:31:58.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:32:30.610 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-02-21T07:32:31.349 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-02-21T07:32:31.349 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc4-g1130e0532280"... 2024-02-21T07:32:31.349 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2024-02-21T07:32:31.391 INFO:teuthology.orchestra.run.smithi069.stdout:6.8.0-rc4-g1130e0532280 2024-02-21T07:32:31.391 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc4-g1130e0532280 vs 6.8.0-rc4-g1130e0532280 2024-02-21T07:32:31.391 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-21T07:32:31.392 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-21T07:32:32.392 DEBUG:teuthology.parallel:result is None 2024-02-21T07:32:32.393 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-21T07:32:32.399 INFO:teuthology.task.internal:Creating test directory... 2024-02-21T07:32:32.399 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T07:32:32.405 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T07:32:32.408 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T07:32:32.445 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-21T07:32:32.451 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-21T07:32:32.484 INFO:teuthology.task.internal:Creating archive directory... 2024-02-21T07:32:32.484 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T07:32:32.490 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T07:32:32.492 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T07:32:32.807 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-21T07:32:32.814 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-21T07:32:32.814 DEBUG:teuthology.orchestra.run.smithi174:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T07:32:32.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:32:32.830 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T07:32:32.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:32:32.847 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T07:32:32.852 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T07:32:32.873 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T07:32:32.914 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:32:32.931 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:32:32.949 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:32:32.969 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:32:32.974 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:32:33.031 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T07:32:33.035 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-21T07:32:33.042 INFO:teuthology.task.internal:Configuring sudo... 2024-02-21T07:32:33.042 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T07:32:33.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T07:32:33.049 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T07:32:33.118 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-21T07:32:33.127 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-21T07:32:33.127 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T07:32:33.131 DEBUG:teuthology.orchestra.run.smithi174:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T07:32:33.133 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T07:32:33.169 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:32:33.285 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:32:33.367 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:32:33.434 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:32:33.524 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:32:33.524 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T07:32:33.597 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:32:33.638 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:32:33.690 DEBUG:teuthology.orchestra.run.smithi174:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:32:33.773 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:32:33.816 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:32:33.817 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T07:32:33.884 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:32:33.929 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T07:32:33.987 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:32:34.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T07:32:34.118 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:32:34.118 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T07:32:34.187 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2024-02-21T07:32:34.193 DEBUG:teuthology.orchestra.run.smithi174:> sudo service rsyslog restart 2024-02-21T07:32:34.195 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-02-21T07:32:34.230 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T07:32:34.266 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T07:32:34.320 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T07:32:34.673 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-21T07:32:34.681 INFO:teuthology.task.internal:Starting timer... 2024-02-21T07:32:34.681 INFO:teuthology.run_tasks:Running task pcp... 2024-02-21T07:32:34.731 INFO:teuthology.run_tasks:Running task selinux... 2024-02-21T07:32:34.779 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2024-02-21T07:32:34.878 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: 2024-02-21T07:32:34.882 DEBUG:teuthology.orchestra.run.smithi174:> sudo service auditd rotate 2024-02-21T07:32:34.931 INFO:teuthology.orchestra.run.smithi174.stdout:Rotating logs: 2024-02-21T07:32:34.933 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2024-02-21T07:32:34.994 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2024-02-21T07:32:34.996 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-21T07:32:34.996 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2024-02-21T07:32:35.041 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2024-02-21T07:32:35.042 DEBUG:teuthology.orchestra.run.smithi174:> /usr/sbin/getenforce 2024-02-21T07:32:35.066 INFO:teuthology.orchestra.run.smithi174.stdout:Permissive 2024-02-21T07:32:35.067 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2024-02-21T07:32:35.099 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2024-02-21T07:32:35.099 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi069.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi174.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2024-02-21T07:32:35.099 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T07:32:35.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:32:35.182 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T07:32:35.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:32:35.210 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T07:32:35.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:32:35.238 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-21T07:32:35.238 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2024-02-21T07:32:35.363 DEBUG:teuthology.orchestra.run.smithi174:> sudo /usr/sbin/setenforce permissive 2024-02-21T07:32:35.402 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2024-02-21T07:32:35.443 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-21T07:32:35.453 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-21T07:32:35.460 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-21T07:32:35.592 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-21T07:32:35.607 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-21T07:32:35.608 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi069.front.sepia.ceph.com,smithi174.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-21T07:38:27.979 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi069.front.sepia.ceph.com'), Remote(name='ubuntu@smithi174.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-02-21T07:38:27.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-02-21T07:38:27.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:38:28.135 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-02-21T07:38:28.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-02-21T07:38:28.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-02-21T07:38:28.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:38:28.377 DEBUG:teuthology.orchestra.run.smithi174:> true 2024-02-21T07:38:28.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2024-02-21T07:38:28.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-21T07:38:28.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:38:28.531 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-02-21T07:38:28.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-21T07:38:28.600 INFO:teuthology.run_tasks:Running task clock... 2024-02-21T07:38:28.613 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-21T07:38:28.613 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T07:38:28.614 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T07:38:28.621 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T07:38:28.621 DEBUG:teuthology.orchestra.run.smithi174:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T07:38:28.623 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T07:38:28.623 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T07:38:28.655 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T07:38:28.672 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T07:38:28.673 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T07:38:28.691 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T07:38:28.702 INFO:teuthology.orchestra.run.smithi174.stderr:sudo: ntpd: command not found 2024-02-21T07:38:28.716 INFO:teuthology.orchestra.run.smithi174.stdout:506 Cannot talk to daemon 2024-02-21T07:38:28.720 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T07:38:28.720 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2024-02-21T07:38:28.733 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T07:38:28.734 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2024-02-21T07:38:28.749 INFO:teuthology.orchestra.run.smithi174.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T07:38:28.751 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T07:38:28.767 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T07:38:28.771 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T07:38:28.792 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-02-21T07:38:28.796 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T07:38:28.796 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-02-21T07:38:28.796 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:28.796 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:28.796 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:28.797 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:28.811 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-02-21T07:38:28.814 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T07:38:28.814 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-02-21T07:38:28.814 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:28.814 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:28.814 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:28.814 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:28.857 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2024-02-21T07:38:28.899 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2024-02-21T07:38:28.951 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T07:38:29.002 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T07:38:29.125 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2024-02-21T07:38:29.132 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T07:38:29.132 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2024-02-21T07:38:29.132 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:29.132 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:29.132 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:29.132 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:38:29.134 INFO:teuthology.run_tasks:Running task install... 2024-02-21T07:38:29.142 DEBUG:teuthology.task.install:project ceph 2024-02-21T07:38:29.142 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}} 2024-02-21T07:38:29.142 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'} 2024-02-21T07:38:29.143 INFO:teuthology.task.install:Using flavor: default 2024-02-21T07:38:29.148 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-21T07:38:29.148 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-21T07:38:29.149 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'tag': None, 'wait_for_package': False} 2024-02-21T07:38:29.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:38:29.151 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'tag': None, 'wait_for_package': False} 2024-02-21T07:38:29.152 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:38:29.153 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'tag': None, 'wait_for_package': False} 2024-02-21T07:38:29.153 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:38:29.295 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/ 2024-02-21T07:38:29.295 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1514.g25296a8f 2024-02-21T07:38:29.372 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/ 2024-02-21T07:38:29.372 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1514.g25296a8f 2024-02-21T07:38:29.385 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/ 2024-02-21T07:38:29.385 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1514.g25296a8f 2024-02-21T07:38:29.474 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T07:38:29.475 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:38:29.475 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T07:38:29.546 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T07:38:29.546 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:38:29.546 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T07:38:29.557 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240216.060239/25296a8f176256aea5ed8b5850b25167dce0ae33/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T07:38:29.558 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:38:29.558 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T07:38:29.565 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T07:38:29.565 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/25296a8f176256aea5ed8b5850b25167dce0ae33/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T07:38:29.577 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T07:38:29.577 DEBUG:teuthology.orchestra.run.smithi174:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/25296a8f176256aea5ed8b5850b25167dce0ae33/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T07:38:29.589 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T07:38:29.590 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/25296a8f176256aea5ed8b5850b25167dce0ae33/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T07:38:29.649 DEBUG:teuthology.orchestra.run.smithi174:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T07:38:29.661 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T07:38:29.705 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T07:38:29.731 DEBUG:teuthology.orchestra.run.smithi174:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T07:38:29.744 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T07:38:29.798 INFO:teuthology.orchestra.run.smithi174.stdout:check_obsoletes = 1 2024-02-21T07:38:29.800 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum clean all 2024-02-21T07:38:29.812 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2024-02-21T07:38:29.814 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2024-02-21T07:38:29.838 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T07:38:29.929 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2024-02-21T07:38:29.933 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2024-02-21T07:38:30.036 INFO:teuthology.orchestra.run.smithi174.stdout:74 files removed 2024-02-21T07:38:30.050 INFO:teuthology.orchestra.run.smithi184.stdout:74 files removed 2024-02-21T07:38:30.063 DEBUG:teuthology.orchestra.run.smithi174:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T07:38:30.077 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T07:38:30.298 INFO:teuthology.orchestra.run.smithi069.stdout:74 files removed 2024-02-21T07:38:30.337 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T07:38:30.751 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 214 kB/s | 82 kB 00:00 2024-02-21T07:38:30.824 INFO:teuthology.orchestra.run.smithi174.stdout:ceph packages for x86_64 174 kB/s | 82 kB 00:00 2024-02-21T07:38:31.101 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 32 kB/s | 10 kB 00:00 2024-02-21T07:38:31.191 INFO:teuthology.orchestra.run.smithi174.stdout:ceph noarch packages 30 kB/s | 10 kB 00:00 2024-02-21T07:38:31.358 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 159 kB/s | 82 kB 00:00 2024-02-21T07:38:31.418 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 6.6 kB/s | 1.9 kB 00:00 2024-02-21T07:38:31.492 INFO:teuthology.orchestra.run.smithi174.stdout:ceph source packages 7.0 kB/s | 1.9 kB 00:00 2024-02-21T07:38:31.863 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-02-21T07:38:31.934 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 21 kB/s | 10 kB 00:00 2024-02-21T07:38:31.936 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-02-21T07:38:32.450 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 4.3 kB/s | 1.9 kB 00:00 2024-02-21T07:38:33.045 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-02-21T07:38:33.320 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2024-02-21T07:38:33.330 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2024-02-21T07:38:34.655 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2024-02-21T07:38:35.537 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.0 MB 00:01 2024-02-21T07:38:37.980 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-02-21T07:38:38.359 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.0 MB 00:03 2024-02-21T07:38:40.360 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-02-21T07:38:42.151 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - BaseOS 961 kB/s | 8.0 MB 00:08 2024-02-21T07:38:44.122 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.1 MB 00:02 2024-02-21T07:38:44.171 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-02-21T07:38:45.489 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 15 kB 00:00 2024-02-21T07:38:45.510 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.1 MB 00:01 2024-02-21T07:38:46.928 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 87 kB/s | 15 kB 00:00 2024-02-21T07:38:47.765 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 31 MB/s | 20 MB 00:00 2024-02-21T07:38:48.282 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 20 MB 00:02 2024-02-21T07:38:49.919 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.1 MB 00:02 2024-02-21T07:38:51.513 INFO:teuthology.orchestra.run.smithi174.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2024-02-21T07:38:52.338 INFO:teuthology.orchestra.run.smithi174.stdout:Extra Packages for Enterprise Linux 29 MB/s | 20 MB 00:00 2024-02-21T07:38:53.140 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-02-21T07:38:53.448 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-02-21T07:38:55.621 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:38:55.622 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:38:55.636 INFO:teuthology.orchestra.run.smithi184.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T07:38:55.637 INFO:teuthology.orchestra.run.smithi184.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T07:38:55.638 INFO:teuthology.orchestra.run.smithi184.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T07:38:55.639 INFO:teuthology.orchestra.run.smithi184.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T07:38:55.642 INFO:teuthology.orchestra.run.smithi184.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T07:38:55.645 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T07:38:55.646 INFO:teuthology.orchestra.run.smithi184.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T07:38:55.725 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================ 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================ 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 6.6 k 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.3 M 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 886 k 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 145 k 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 1.5 M 2024-02-21T07:38:55.750 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 138 k 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 1.8 M 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 7.4 M 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 52 k 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 9.7 M 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 47 M 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 264 k 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 748 k 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 217 k 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 27 k 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 18 k 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-21T07:38:55.751 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-21T07:38:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 31 k 2024-02-21T07:38:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 743 k 2024-02-21T07:38:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 127 k 2024-02-21T07:38:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-21T07:38:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-21T07:38:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-21T07:38:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-21T07:38:55.752 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-21T07:38:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-21T07:38:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 161 k 2024-02-21T07:38:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 320 k 2024-02-21T07:38:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 298 k 2024-02-21T07:38:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 99 k 2024-02-21T07:38:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 85 k 2024-02-21T07:38:55.753 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 171 k 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-21T07:38:55.754 INFO:teuthology.orchestra.run.smithi184.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.4 M 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-21T07:38:55.755 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 20 M 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 31 k 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 2.1 M 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 247 k 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 4.7 M 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 17 M 2024-02-21T07:38:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 15 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 25 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 163 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T07:38:55.757 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 498 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.1 M 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-21T07:38:55.758 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 45 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 131 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-21T07:38:55.759 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T07:38:55.760 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-21T07:38:55.761 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T07:38:55.762 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-21T07:38:55.763 INFO:teuthology.orchestra.run.smithi184.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T07:38:55.764 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-21T07:38:55.764 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T07:38:55.764 INFO:teuthology.orchestra.run.smithi184.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-21T07:38:55.764 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-21T07:38:55.764 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-21T07:38:55.764 INFO:teuthology.orchestra.run.smithi184.stdout:Installing weak dependencies: 2024-02-21T07:38:55.764 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-21T07:38:55.764 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:38:55.765 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-21T07:38:55.765 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================ 2024-02-21T07:38:55.765 INFO:teuthology.orchestra.run.smithi184.stdout:Install 150 Packages 2024-02-21T07:38:55.765 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 26 Packages 2024-02-21T07:38:55.765 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:38:55.766 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 223 M 2024-02-21T07:38:55.766 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-21T07:38:56.222 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:38:56.223 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:38:56.242 INFO:teuthology.orchestra.run.smithi069.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T07:38:56.243 INFO:teuthology.orchestra.run.smithi069.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T07:38:56.244 INFO:teuthology.orchestra.run.smithi069.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T07:38:56.246 INFO:teuthology.orchestra.run.smithi069.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T07:38:56.248 INFO:teuthology.orchestra.run.smithi069.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T07:38:56.251 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T07:38:56.252 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T07:38:56.340 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-02-21T07:38:56.358 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================================ 2024-02-21T07:38:56.358 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-02-21T07:38:56.358 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================================ 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 6.6 k 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.3 M 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 886 k 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 145 k 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 1.5 M 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 138 k 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 1.8 M 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 7.4 M 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 52 k 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 9.7 M 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 47 M 2024-02-21T07:38:56.359 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 264 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 748 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 217 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-shell x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 27 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 18 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 31 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 743 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 127 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-21T07:38:56.360 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-21T07:38:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-21T07:38:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-21T07:38:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-21T07:38:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 161 k 2024-02-21T07:38:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 320 k 2024-02-21T07:38:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 298 k 2024-02-21T07:38:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 99 k 2024-02-21T07:38:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 85 k 2024-02-21T07:38:56.361 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 171 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-21T07:38:56.362 INFO:teuthology.orchestra.run.smithi069.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-21T07:38:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-21T07:38:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-21T07:38:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-21T07:38:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.4 M 2024-02-21T07:38:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:38:56.363 INFO:teuthology.orchestra.run.smithi069.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-21T07:38:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-21T07:38:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-21T07:38:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-21T07:38:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-21T07:38:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-21T07:38:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-21T07:38:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-21T07:38:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:38:56.364 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-02-21T07:38:56.364 INFO:teuthology.orchestra.run.smithi069.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 20 M 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 31 k 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 2.1 M 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 247 k 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 4.7 M 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 17 M 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 15 k 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 25 k 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-21T07:38:56.365 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 163 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 498 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.1 M 2024-02-21T07:38:56.366 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T07:38:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-21T07:38:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-21T07:38:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-21T07:38:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T07:38:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T07:38:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-21T07:38:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-21T07:38:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-21T07:38:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T07:38:56.367 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-21T07:38:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-21T07:38:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T07:38:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T07:38:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-21T07:38:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-21T07:38:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T07:38:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T07:38:56.368 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 45 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 131 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T07:38:56.369 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-21T07:38:56.370 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T07:38:56.371 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T07:38:56.372 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout:Installing weak dependencies: 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-21T07:38:56.373 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:38:56.374 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-02-21T07:38:56.374 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================================ 2024-02-21T07:38:56.374 INFO:teuthology.orchestra.run.smithi069.stdout:Install 150 Packages 2024-02-21T07:38:56.374 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 26 Packages 2024-02-21T07:38:56.374 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:38:56.375 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 223 M 2024-02-21T07:38:56.375 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-02-21T07:38:56.475 INFO:teuthology.orchestra.run.smithi184.stdout:(1/176): ceph-19.0.0-1514.g25296a8f.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-02-21T07:38:56.775 INFO:teuthology.orchestra.run.smithi184.stdout:(2/176): ceph-fuse-19.0.0-1514.g25296a8f.el9.x8 2.9 MB/s | 886 kB 00:00 2024-02-21T07:38:56.850 INFO:teuthology.orchestra.run.smithi184.stdout:(3/176): ceph-immutable-object-cache-19.0.0-151 1.9 MB/s | 145 kB 00:00 2024-02-21T07:38:57.068 INFO:teuthology.orchestra.run.smithi184.stdout:(4/176): ceph-mds-19.0.0-1514.g25296a8f.el9.x86 9.8 MB/s | 2.1 MB 00:00 2024-02-21T07:38:57.234 INFO:teuthology.orchestra.run.smithi184.stdout:(5/176): ceph-mgr-19.0.0-1514.g25296a8f.el9.x86 8.9 MB/s | 1.5 MB 00:00 2024-02-21T07:38:57.238 INFO:teuthology.orchestra.run.smithi174.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-02-21T07:38:57.433 INFO:teuthology.orchestra.run.smithi069.stdout:(1/176): ceph-19.0.0-1514.g25296a8f.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-02-21T07:38:57.551 INFO:teuthology.orchestra.run.smithi184.stdout:(6/176): ceph-mon-19.0.0-1514.g25296a8f.el9.x86 15 MB/s | 4.7 MB 00:00 2024-02-21T07:38:58.357 INFO:teuthology.orchestra.run.smithi069.stdout:(2/176): ceph-fuse-19.0.0-1514.g25296a8f.el9.x8 959 kB/s | 886 kB 00:00 2024-02-21T07:38:58.574 INFO:teuthology.orchestra.run.smithi069.stdout:(3/176): ceph-immutable-object-cache-19.0.0-151 673 kB/s | 145 kB 00:00 2024-02-21T07:38:59.035 INFO:teuthology.orchestra.run.smithi184.stdout:(7/176): ceph-osd-19.0.0-1514.g25296a8f.el9.x86 11 MB/s | 17 MB 00:01 2024-02-21T07:38:59.100 INFO:teuthology.orchestra.run.smithi069.stdout:(4/176): ceph-common-19.0.0-1514.g25296a8f.el9. 10 MB/s | 20 MB 00:01 2024-02-21T07:38:59.292 INFO:teuthology.orchestra.run.smithi069.stdout:(5/176): ceph-mgr-19.0.0-1514.g25296a8f.el9.x86 7.8 MB/s | 1.5 MB 00:00 2024-02-21T07:38:59.528 INFO:teuthology.orchestra.run.smithi069.stdout:(6/176): ceph-mds-19.0.0-1514.g25296a8f.el9.x86 2.2 MB/s | 2.1 MB 00:00 2024-02-21T07:38:59.741 INFO:teuthology.orchestra.run.smithi174.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:38:59.742 INFO:teuthology.orchestra.run.smithi174.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T07:38:59.757 INFO:teuthology.orchestra.run.smithi174.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T07:38:59.758 INFO:teuthology.orchestra.run.smithi174.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T07:38:59.759 INFO:teuthology.orchestra.run.smithi174.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T07:38:59.760 INFO:teuthology.orchestra.run.smithi174.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T07:38:59.762 INFO:teuthology.orchestra.run.smithi174.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T07:38:59.765 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T07:38:59.766 INFO:teuthology.orchestra.run.smithi174.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T07:38:59.800 INFO:teuthology.orchestra.run.smithi069.stdout:(7/176): ceph-mon-19.0.0-1514.g25296a8f.el9.x86 9.2 MB/s | 4.7 MB 00:00 2024-02-21T07:38:59.818 INFO:teuthology.orchestra.run.smithi184.stdout:(8/176): ceph-radosgw-19.0.0-1514.g25296a8f.el9 12 MB/s | 9.7 MB 00:00 2024-02-21T07:38:59.845 INFO:teuthology.orchestra.run.smithi174.stdout:Dependencies resolved. 2024-02-21T07:38:59.860 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================================ 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: Package Arch Version Repository Size 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================================ 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout:Installing: 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: ceph x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 6.6 k 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.3 M 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 886 k 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 145 k 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 1.5 M 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 138 k 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 1.8 M 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 7.4 M 2024-02-21T07:38:59.861 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 52 k 2024-02-21T07:38:59.862 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 9.7 M 2024-02-21T07:38:59.862 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 47 M 2024-02-21T07:38:59.862 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 264 k 2024-02-21T07:38:59.862 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 748 k 2024-02-21T07:38:59.862 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 217 k 2024-02-21T07:38:59.862 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 27 k 2024-02-21T07:38:59.862 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 18 k 2024-02-21T07:38:59.862 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-02-21T07:38:59.862 INFO:teuthology.orchestra.run.smithi174.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-02-21T07:38:59.862 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-02-21T07:38:59.863 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 31 k 2024-02-21T07:38:59.863 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 743 k 2024-02-21T07:38:59.863 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 127 k 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel x86_64 2.37.4-18.el9 CentOS-AppStream 24 k 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 161 k 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 320 k 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 298 k 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 99 k 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 85 k 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:38:59.864 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 171 k 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrading: 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager x86_64 1:1.45.91-1.el9 CentOS-BaseOS 2.3 M 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 CentOS-BaseOS 1.8 M 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 CentOS-BaseOS 41 k 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 CentOS-BaseOS 246 k 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: iproute x86_64 6.7.0-2.el9 CentOS-BaseOS 802 k 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: iproute-tc x86_64 6.7.0-2.el9 CentOS-BaseOS 433 k 2024-02-21T07:38:59.865 INFO:teuthology.orchestra.run.smithi174.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid x86_64 2.37.4-18.el9 CentOS-BaseOS 107 k 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: libfdisk x86_64 2.37.4-18.el9 CentOS-BaseOS 154 k 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: libmount x86_64 2.37.4-18.el9 CentOS-BaseOS 135 k 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: librados2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.4 M 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 3.1 M 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: libsmartcols x86_64 2.37.4-18.el9 CentOS-BaseOS 63 k 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid x86_64 2.37.4-18.el9 CentOS-BaseOS 28 k 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux x86_64 2.37.4-18.el9 CentOS-BaseOS 2.2 M 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-core x86_64 2.37.4-18.el9 CentOS-BaseOS 438 k 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-user x86_64 2.37.4-18.el9 CentOS-BaseOS 30 k 2024-02-21T07:38:59.866 INFO:teuthology.orchestra.run.smithi174.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout:Installing dependencies: 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 20 M 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 31 k 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 2.1 M 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 247 k 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 4.7 M 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 17 M 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1514.g25296a8f.el9 ceph-noarch 15 k 2024-02-21T07:38:59.867 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 25 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 163 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T07:38:59.868 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 498 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2 x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 5.1 M 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-21T07:38:59.869 INFO:teuthology.orchestra.run.smithi174.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 45 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common x86_64 2:19.0.0-1514.g25296a8f.el9 ceph 131 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-21T07:38:59.870 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T07:38:59.871 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T07:38:59.872 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T07:38:59.873 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib x86_64 23.11.0-1.el9 CentOS-AppStream 215 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs x86_64 1.1.2-2.el9 CentOS-AppStream 43 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T07:38:59.874 INFO:teuthology.orchestra.run.smithi174.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout:Installing weak dependencies: 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service x86_64 23.11.0-1.el9 CentOS-AppStream 34 k 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction Summary 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout:============================================================================================ 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout:Install 150 Packages 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout:Upgrade 26 Packages 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:38:59.875 INFO:teuthology.orchestra.run.smithi174.stdout:Total download size: 223 M 2024-02-21T07:38:59.876 INFO:teuthology.orchestra.run.smithi174.stdout:Downloading Packages: 2024-02-21T07:38:59.893 INFO:teuthology.orchestra.run.smithi184.stdout:(9/176): ceph-selinux-19.0.0-1514.g25296a8f.el9 337 kB/s | 25 kB 00:00 2024-02-21T07:39:00.781 INFO:teuthology.orchestra.run.smithi174.stdout:(1/176): ceph-19.0.0-1514.g25296a8f.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-02-21T07:39:00.876 INFO:teuthology.orchestra.run.smithi069.stdout:(8/176): ceph-radosgw-19.0.0-1514.g25296a8f.el9 9.1 MB/s | 9.7 MB 00:01 2024-02-21T07:39:00.959 INFO:teuthology.orchestra.run.smithi069.stdout:(9/176): ceph-selinux-19.0.0-1514.g25296a8f.el9 306 kB/s | 25 kB 00:00 2024-02-21T07:39:01.573 INFO:teuthology.orchestra.run.smithi174.stdout:(2/176): ceph-fuse-19.0.0-1514.g25296a8f.el9.x8 1.1 MB/s | 886 kB 00:00 2024-02-21T07:39:01.706 INFO:teuthology.orchestra.run.smithi174.stdout:(3/176): ceph-immutable-object-cache-19.0.0-151 1.1 MB/s | 145 kB 00:00 2024-02-21T07:39:02.451 INFO:teuthology.orchestra.run.smithi069.stdout:(10/176): ceph-base-19.0.0-1514.g25296a8f.el9.x 1.0 MB/s | 5.3 MB 00:05 2024-02-21T07:39:02.768 INFO:teuthology.orchestra.run.smithi069.stdout:(11/176): cephfs-mirror-19.0.0-1514.g25296a8f.e 689 kB/s | 217 kB 00:00 2024-02-21T07:39:02.893 INFO:teuthology.orchestra.run.smithi069.stdout:(12/176): cephfs-shell-19.0.0-1514.g25296a8f.el 218 kB/s | 27 kB 00:00 2024-02-21T07:39:03.010 INFO:teuthology.orchestra.run.smithi069.stdout:(13/176): libcephfs-devel-19.0.0-1514.g25296a8f 269 kB/s | 31 kB 00:00 2024-02-21T07:39:03.148 INFO:teuthology.orchestra.run.smithi174.stdout:(4/176): ceph-mds-19.0.0-1514.g25296a8f.el9.x86 1.5 MB/s | 2.1 MB 00:01 2024-02-21T07:39:03.294 INFO:teuthology.orchestra.run.smithi069.stdout:(14/176): ceph-osd-19.0.0-1514.g25296a8f.el9.x8 4.5 MB/s | 17 MB 00:03 2024-02-21T07:39:03.427 INFO:teuthology.orchestra.run.smithi069.stdout:(15/176): libcephsqlite-19.0.0-1514.g25296a8f.e 1.2 MB/s | 163 kB 00:00 2024-02-21T07:39:03.577 INFO:teuthology.orchestra.run.smithi069.stdout:(16/176): librados-devel-19.0.0-1514.g25296a8f. 850 kB/s | 127 kB 00:00 2024-02-21T07:39:03.802 INFO:teuthology.orchestra.run.smithi069.stdout:(17/176): libradosstriper1-19.0.0-1514.g25296a8 2.2 MB/s | 498 kB 00:00 2024-02-21T07:39:03.815 INFO:teuthology.orchestra.run.smithi174.stdout:(5/176): ceph-mgr-19.0.0-1514.g25296a8f.el9.x86 2.2 MB/s | 1.5 MB 00:00 2024-02-21T07:39:03.836 INFO:teuthology.orchestra.run.smithi069.stdout:(18/176): libcephfs2-19.0.0-1514.g25296a8f.el9. 901 kB/s | 743 kB 00:00 2024-02-21T07:39:03.978 INFO:teuthology.orchestra.run.smithi069.stdout:(19/176): python3-ceph-argparse-19.0.0-1514.g25 319 kB/s | 45 kB 00:00 2024-02-21T07:39:04.228 INFO:teuthology.orchestra.run.smithi069.stdout:(20/176): python3-ceph-common-19.0.0-1514.g2529 528 kB/s | 131 kB 00:00 2024-02-21T07:39:04.412 INFO:teuthology.orchestra.run.smithi069.stdout:(21/176): python3-cephfs-19.0.0-1514.g25296a8f. 882 kB/s | 161 kB 00:00 2024-02-21T07:39:04.754 INFO:teuthology.orchestra.run.smithi069.stdout:(22/176): python3-rados-19.0.0-1514.g25296a8f.e 939 kB/s | 320 kB 00:00 2024-02-21T07:39:04.979 INFO:teuthology.orchestra.run.smithi069.stdout:(23/176): librgw2-19.0.0-1514.g25296a8f.el9.x86 4.3 MB/s | 5.1 MB 00:01 2024-02-21T07:39:05.010 INFO:teuthology.orchestra.run.smithi184.stdout:(10/176): ceph-test-19.0.0-1514.g25296a8f.el9.x 9.2 MB/s | 47 MB 00:05 2024-02-21T07:39:05.013 INFO:teuthology.orchestra.run.smithi069.stdout:(24/176): python3-rbd-19.0.0-1514.g25296a8f.el9 1.1 MB/s | 298 kB 00:00 2024-02-21T07:39:05.055 INFO:teuthology.orchestra.run.smithi069.stdout:(25/176): python3-rgw-19.0.0-1514.g25296a8f.el9 1.3 MB/s | 99 kB 00:00 2024-02-21T07:39:05.076 INFO:teuthology.orchestra.run.smithi184.stdout:(11/176): ceph-base-19.0.0-1514.g25296a8f.el9.x 613 kB/s | 5.3 MB 00:08 2024-02-21T07:39:05.102 INFO:teuthology.orchestra.run.smithi184.stdout:(12/176): cephfs-mirror-19.0.0-1514.g25296a8f.e 2.3 MB/s | 217 kB 00:00 2024-02-21T07:39:05.105 INFO:teuthology.orchestra.run.smithi069.stdout:(26/176): rbd-fuse-19.0.0-1514.g25296a8f.el9.x8 934 kB/s | 85 kB 00:00 2024-02-21T07:39:05.169 INFO:teuthology.orchestra.run.smithi184.stdout:(13/176): cephfs-shell-19.0.0-1514.g25296a8f.el 295 kB/s | 27 kB 00:00 2024-02-21T07:39:05.194 INFO:teuthology.orchestra.run.smithi184.stdout:(14/176): libcephfs-devel-19.0.0-1514.g25296a8f 339 kB/s | 31 kB 00:00 2024-02-21T07:39:05.248 INFO:teuthology.orchestra.run.smithi174.stdout:(6/176): ceph-base-19.0.0-1514.g25296a8f.el9.x8 1.1 MB/s | 5.3 MB 00:04 2024-02-21T07:39:05.264 INFO:teuthology.orchestra.run.smithi069.stdout:(27/176): rbd-nbd-19.0.0-1514.g25296a8f.el9.x86 1.1 MB/s | 171 kB 00:00 2024-02-21T07:39:05.286 INFO:teuthology.orchestra.run.smithi184.stdout:(15/176): libcephsqlite-19.0.0-1514.g25296a8f.e 1.7 MB/s | 163 kB 00:00 2024-02-21T07:39:05.364 INFO:teuthology.orchestra.run.smithi069.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1514.g 317 kB/s | 31 kB 00:00 2024-02-21T07:39:05.386 INFO:teuthology.orchestra.run.smithi184.stdout:(16/176): librados-devel-19.0.0-1514.g25296a8f. 1.2 MB/s | 127 kB 00:00 2024-02-21T07:39:05.503 INFO:teuthology.orchestra.run.smithi184.stdout:(17/176): libradosstriper1-19.0.0-1514.g25296a8 4.2 MB/s | 498 kB 00:00 2024-02-21T07:39:05.589 INFO:teuthology.orchestra.run.smithi069.stdout:(29/176): ceph-mgr-cephadm-19.0.0-1514.g25296a8 617 kB/s | 138 kB 00:00 2024-02-21T07:39:05.748 INFO:teuthology.orchestra.run.smithi069.stdout:(30/176): rbd-mirror-19.0.0-1514.g25296a8f.el9. 4.5 MB/s | 3.1 MB 00:00 2024-02-21T07:39:05.820 INFO:teuthology.orchestra.run.smithi184.stdout:(18/176): libcephfs2-19.0.0-1514.g25296a8f.el9. 1.1 MB/s | 743 kB 00:00 2024-02-21T07:39:05.873 INFO:teuthology.orchestra.run.smithi174.stdout:(7/176): ceph-mon-19.0.0-1514.g25296a8f.el9.x86 2.3 MB/s | 4.7 MB 00:02 2024-02-21T07:39:05.937 INFO:teuthology.orchestra.run.smithi184.stdout:(19/176): python3-ceph-argparse-19.0.0-1514.g25 388 kB/s | 45 kB 00:00 2024-02-21T07:39:06.070 INFO:teuthology.orchestra.run.smithi184.stdout:(20/176): python3-ceph-common-19.0.0-1514.g2529 986 kB/s | 131 kB 00:00 2024-02-21T07:39:06.238 INFO:teuthology.orchestra.run.smithi184.stdout:(21/176): librgw2-19.0.0-1514.g25296a8f.el9.x86 6.9 MB/s | 5.1 MB 00:00 2024-02-21T07:39:06.296 INFO:teuthology.orchestra.run.smithi184.stdout:(22/176): python3-cephfs-19.0.0-1514.g25296a8f. 716 kB/s | 161 kB 00:00 2024-02-21T07:39:06.371 INFO:teuthology.orchestra.run.smithi184.stdout:(23/176): python3-rados-19.0.0-1514.g25296a8f.e 2.3 MB/s | 320 kB 00:00 2024-02-21T07:39:06.497 INFO:teuthology.orchestra.run.smithi184.stdout:(24/176): python3-rgw-19.0.0-1514.g25296a8f.el9 795 kB/s | 99 kB 00:00 2024-02-21T07:39:06.589 INFO:teuthology.orchestra.run.smithi184.stdout:(25/176): rbd-fuse-19.0.0-1514.g25296a8f.el9.x8 931 kB/s | 85 kB 00:00 2024-02-21T07:39:06.680 INFO:teuthology.orchestra.run.smithi184.stdout:(26/176): python3-rbd-19.0.0-1514.g25296a8f.el9 776 kB/s | 298 kB 00:00 2024-02-21T07:39:06.856 INFO:teuthology.orchestra.run.smithi184.stdout:(27/176): rbd-nbd-19.0.0-1514.g25296a8f.el9.x86 974 kB/s | 171 kB 00:00 2024-02-21T07:39:06.940 INFO:teuthology.orchestra.run.smithi184.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1514.g 377 kB/s | 31 kB 00:00 2024-02-21T07:39:07.023 INFO:teuthology.orchestra.run.smithi184.stdout:(29/176): rbd-mirror-19.0.0-1514.g25296a8f.el9. 7.1 MB/s | 3.1 MB 00:00 2024-02-21T07:39:07.115 INFO:teuthology.orchestra.run.smithi184.stdout:(30/176): ceph-mgr-cephadm-19.0.0-1514.g25296a8 788 kB/s | 138 kB 00:00 2024-02-21T07:39:07.140 INFO:teuthology.orchestra.run.smithi069.stdout:(31/176): ceph-test-19.0.0-1514.g25296a8f.el9.x 7.6 MB/s | 47 MB 00:06 2024-02-21T07:39:07.140 INFO:teuthology.orchestra.run.smithi174.stdout:(8/176): ceph-common-19.0.0-1514.g25296a8f.el9. 3.0 MB/s | 20 MB 00:06 2024-02-21T07:39:07.215 INFO:teuthology.orchestra.run.smithi069.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1514.g25 3.3 MB/s | 247 kB 00:00 2024-02-21T07:39:07.249 INFO:teuthology.orchestra.run.smithi174.stdout:(9/176): ceph-selinux-19.0.0-1514.g25296a8f.el9 233 kB/s | 25 kB 00:00 2024-02-21T07:39:07.257 INFO:teuthology.orchestra.run.smithi069.stdout:(33/176): ceph-mgr-rook-19.0.0-1514.g25296a8f.e 1.3 MB/s | 52 kB 00:00 2024-02-21T07:39:07.316 INFO:teuthology.orchestra.run.smithi069.stdout:(34/176): ceph-mgr-dashboard-19.0.0-1514.g25296 1.0 MB/s | 1.8 MB 00:01 2024-02-21T07:39:07.333 INFO:teuthology.orchestra.run.smithi069.stdout:(35/176): ceph-prometheus-alerts-19.0.0-1514.g2 206 kB/s | 15 kB 00:00 2024-02-21T07:39:07.357 INFO:teuthology.orchestra.run.smithi184.stdout:(31/176): ceph-mgr-dashboard-19.0.0-1514.g25296 5.3 MB/s | 1.8 MB 00:00 2024-02-21T07:39:07.466 INFO:teuthology.orchestra.run.smithi184.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1514.g25 2.2 MB/s | 247 kB 00:00 2024-02-21T07:39:07.478 INFO:teuthology.orchestra.run.smithi069.stdout:(36/176): cephadm-19.0.0-1514.g25296a8f.el9.noa 5.1 MB/s | 748 kB 00:00 2024-02-21T07:39:07.525 INFO:teuthology.orchestra.run.smithi069.stdout:(37/176): cephfs-top-19.0.0-1514.g25296a8f.el9. 403 kB/s | 18 kB 00:00 2024-02-21T07:39:07.541 INFO:teuthology.orchestra.run.smithi184.stdout:(33/176): ceph-mgr-rook-19.0.0-1514.g25296a8f.e 699 kB/s | 52 kB 00:00 2024-02-21T07:39:07.600 INFO:teuthology.orchestra.run.smithi184.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1514.g2 262 kB/s | 15 kB 00:00 2024-02-21T07:39:07.650 INFO:teuthology.orchestra.run.smithi069.stdout:(38/176): ceph-volume-19.0.0-1514.g25296a8f.el9 792 kB/s | 264 kB 00:00 2024-02-21T07:39:07.700 INFO:teuthology.orchestra.run.smithi184.stdout:(35/176): ceph-volume-19.0.0-1514.g25296a8f.el9 2.6 MB/s | 264 kB 00:00 2024-02-21T07:39:07.775 INFO:teuthology.orchestra.run.smithi069.stdout:(39/176): ceph-mgr-diskprediction-local-19.0.0- 3.7 MB/s | 7.4 MB 00:02 2024-02-21T07:39:07.867 INFO:teuthology.orchestra.run.smithi184.stdout:(36/176): cephadm-19.0.0-1514.g25296a8f.el9.noa 4.4 MB/s | 748 kB 00:00 2024-02-21T07:39:07.967 INFO:teuthology.orchestra.run.smithi184.stdout:(37/176): cephfs-top-19.0.0-1514.g25296a8f.el9. 182 kB/s | 18 kB 00:00 2024-02-21T07:39:07.999 INFO:teuthology.orchestra.run.smithi174.stdout:(10/176): ceph-radosgw-19.0.0-1514.g25296a8f.el 4.6 MB/s | 9.7 MB 00:02 2024-02-21T07:39:08.066 INFO:teuthology.orchestra.run.smithi174.stdout:(11/176): cephfs-mirror-19.0.0-1514.g25296a8f.e 3.2 MB/s | 217 kB 00:00 2024-02-21T07:39:08.108 INFO:teuthology.orchestra.run.smithi174.stdout:(12/176): cephfs-shell-19.0.0-1514.g25296a8f.el 650 kB/s | 27 kB 00:00 2024-02-21T07:39:08.150 INFO:teuthology.orchestra.run.smithi174.stdout:(13/176): libcephfs-devel-19.0.0-1514.g25296a8f 748 kB/s | 31 kB 00:00 2024-02-21T07:39:08.292 INFO:teuthology.orchestra.run.smithi174.stdout:(14/176): libcephfs2-19.0.0-1514.g25296a8f.el9. 5.1 MB/s | 743 kB 00:00 2024-02-21T07:39:08.343 INFO:teuthology.orchestra.run.smithi184.stdout:(38/176): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 662 kB 00:00 2024-02-21T07:39:08.384 INFO:teuthology.orchestra.run.smithi174.stdout:(15/176): libcephsqlite-19.0.0-1514.g25296a8f.e 1.7 MB/s | 163 kB 00:00 2024-02-21T07:39:08.434 INFO:teuthology.orchestra.run.smithi174.stdout:(16/176): librados-devel-19.0.0-1514.g25296a8f. 2.5 MB/s | 127 kB 00:00 2024-02-21T07:39:08.525 INFO:teuthology.orchestra.run.smithi069.stdout:(40/176): automake-1.16.2-8.el9.noarch.rpm 662 kB/s | 662 kB 00:00 2024-02-21T07:39:08.526 INFO:teuthology.orchestra.run.smithi174.stdout:(17/176): libradosstriper1-19.0.0-1514.g25296a8 5.3 MB/s | 498 kB 00:00 2024-02-21T07:39:08.568 INFO:teuthology.orchestra.run.smithi184.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 4.0 MB/s | 920 kB 00:00 2024-02-21T07:39:08.643 INFO:teuthology.orchestra.run.smithi184.stdout:(40/176): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 106 kB 00:00 2024-02-21T07:39:08.694 INFO:teuthology.orchestra.run.smithi184.stdout:(41/176): elfutils-libelf-devel-0.190-2.el9.x86 403 kB/s | 20 kB 00:00 2024-02-21T07:39:08.769 INFO:teuthology.orchestra.run.smithi184.stdout:(42/176): flex-2.6.4-9.el9.x86_64.rpm 4.0 MB/s | 307 kB 00:00 2024-02-21T07:39:08.828 INFO:teuthology.orchestra.run.smithi184.stdout:(43/176): flexiblas-3.0.4-8.el9.x86_64.rpm 543 kB/s | 32 kB 00:00 2024-02-21T07:39:09.028 INFO:teuthology.orchestra.run.smithi184.stdout:(44/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-02-21T07:39:09.087 INFO:teuthology.orchestra.run.smithi184.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 292 kB/s | 17 kB 00:00 2024-02-21T07:39:09.138 INFO:teuthology.orchestra.run.smithi184.stdout:(46/176): libaio-devel-0.3.111-13.el9.x86_64.rp 202 kB/s | 10 kB 00:00 2024-02-21T07:39:09.159 INFO:teuthology.orchestra.run.smithi174.stdout:(18/176): librgw2-19.0.0-1514.g25296a8f.el9.x86 8.1 MB/s | 5.1 MB 00:00 2024-02-21T07:39:09.188 INFO:teuthology.orchestra.run.smithi184.stdout:(47/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-02-21T07:39:09.201 INFO:teuthology.orchestra.run.smithi174.stdout:(19/176): python3-ceph-argparse-19.0.0-1514.g25 1.1 MB/s | 45 kB 00:00 2024-02-21T07:39:09.238 INFO:teuthology.orchestra.run.smithi184.stdout:(48/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2024-02-21T07:39:09.251 INFO:teuthology.orchestra.run.smithi174.stdout:(20/176): python3-ceph-common-19.0.0-1514.g2529 2.6 MB/s | 131 kB 00:00 2024-02-21T07:39:09.302 INFO:teuthology.orchestra.run.smithi174.stdout:(21/176): python3-cephfs-19.0.0-1514.g25296a8f. 3.1 MB/s | 161 kB 00:00 2024-02-21T07:39:09.313 INFO:teuthology.orchestra.run.smithi184.stdout:(49/176): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-02-21T07:39:09.325 INFO:teuthology.orchestra.run.smithi069.stdout:(41/176): boost-program-options-1.75.0-8.el9.x8 68 kB/s | 106 kB 00:01 2024-02-21T07:39:09.369 INFO:teuthology.orchestra.run.smithi174.stdout:(22/176): python3-rados-19.0.0-1514.g25296a8f.e 4.7 MB/s | 320 kB 00:00 2024-02-21T07:39:09.389 INFO:teuthology.orchestra.run.smithi184.stdout:(50/176): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2024-02-21T07:39:09.436 INFO:teuthology.orchestra.run.smithi174.stdout:(23/176): python3-rbd-19.0.0-1514.g25296a8f.el9 4.4 MB/s | 298 kB 00:00 2024-02-21T07:39:09.464 INFO:teuthology.orchestra.run.smithi184.stdout:(51/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 324 kB/s | 24 kB 00:00 2024-02-21T07:39:09.467 INFO:teuthology.orchestra.run.smithi069.stdout:(42/176): bison-3.7.4-5.el9.x86_64.rpm 508 kB/s | 920 kB 00:01 2024-02-21T07:39:09.478 INFO:teuthology.orchestra.run.smithi174.stdout:(24/176): python3-rgw-19.0.0-1514.g25296a8f.el9 2.3 MB/s | 99 kB 00:00 2024-02-21T07:39:09.509 INFO:teuthology.orchestra.run.smithi069.stdout:(43/176): elfutils-libelf-devel-0.190-2.el9.x86 21 kB/s | 20 kB 00:00 2024-02-21T07:39:09.523 INFO:teuthology.orchestra.run.smithi184.stdout:(52/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 797 kB/s | 46 kB 00:00 2024-02-21T07:39:09.528 INFO:teuthology.orchestra.run.smithi174.stdout:(25/176): rbd-fuse-19.0.0-1514.g25296a8f.el9.x8 1.7 MB/s | 85 kB 00:00 2024-02-21T07:39:09.581 INFO:teuthology.orchestra.run.smithi184.stdout:(53/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-02-21T07:39:09.640 INFO:teuthology.orchestra.run.smithi184.stdout:(54/176): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-02-21T07:39:09.709 INFO:teuthology.orchestra.run.smithi069.stdout:(44/176): flex-2.6.4-9.el9.x86_64.rpm 802 kB/s | 307 kB 00:00 2024-02-21T07:39:09.732 INFO:teuthology.orchestra.run.smithi184.stdout:(55/176): openblas-0.3.21-2.el9.x86_64.rpm 373 kB/s | 34 kB 00:00 2024-02-21T07:39:09.743 INFO:teuthology.orchestra.run.smithi069.stdout:(45/176): flexiblas-3.0.4-8.el9.x86_64.rpm 115 kB/s | 32 kB 00:00 2024-02-21T07:39:09.904 INFO:teuthology.orchestra.run.smithi174.stdout:(26/176): rbd-mirror-19.0.0-1514.g25296a8f.el9. 8.2 MB/s | 3.1 MB 00:00 2024-02-21T07:39:09.953 INFO:teuthology.orchestra.run.smithi174.stdout:(27/176): rbd-nbd-19.0.0-1514.g25296a8f.el9.x86 3.4 MB/s | 171 kB 00:00 2024-02-21T07:39:09.974 INFO:teuthology.orchestra.run.smithi184.stdout:(56/176): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-02-21T07:39:09.995 INFO:teuthology.orchestra.run.smithi174.stdout:(28/176): ceph-grafana-dashboards-19.0.0-1514.g 753 kB/s | 31 kB 00:00 2024-02-21T07:39:10.037 INFO:teuthology.orchestra.run.smithi174.stdout:(29/176): ceph-mgr-cephadm-19.0.0-1514.g25296a8 3.2 MB/s | 138 kB 00:00 2024-02-21T07:39:10.174 INFO:teuthology.orchestra.run.smithi184.stdout:(57/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 15 MB/s | 3.0 MB 00:00 2024-02-21T07:39:10.263 INFO:teuthology.orchestra.run.smithi174.stdout:(30/176): ceph-mgr-dashboard-19.0.0-1514.g25296 7.9 MB/s | 1.8 MB 00:00 2024-02-21T07:39:10.408 INFO:teuthology.orchestra.run.smithi184.stdout:(58/176): postgresql-13.11-1.el9.x86_64.rpm 6.5 MB/s | 1.5 MB 00:00 2024-02-21T07:39:10.525 INFO:teuthology.orchestra.run.smithi184.stdout:(59/176): postgresql-contrib-13.11-1.el9.x86_64 6.8 MB/s | 811 kB 00:00 2024-02-21T07:39:10.600 INFO:teuthology.orchestra.run.smithi184.stdout:(60/176): postgresql-private-libs-13.11-1.el9.x 1.7 MB/s | 134 kB 00:00 2024-02-21T07:39:10.652 INFO:teuthology.orchestra.run.smithi069.stdout:(46/176): flexiblas-openblas-openmp-3.0.4-8.el9 18 kB/s | 17 kB 00:00 2024-02-21T07:39:10.685 INFO:teuthology.orchestra.run.smithi069.stdout:(47/176): libaio-devel-0.3.111-13.el9.x86_64.rp 11 kB/s | 10 kB 00:00 2024-02-21T07:39:10.984 INFO:teuthology.orchestra.run.smithi184.stdout:(61/176): postgresql-server-13.11-1.el9.x86_64. 15 MB/s | 5.7 MB 00:00 2024-02-21T07:39:11.038 INFO:teuthology.orchestra.run.smithi174.stdout:(31/176): ceph-mgr-diskprediction-local-19.0.0- 9.6 MB/s | 7.4 MB 00:00 2024-02-21T07:39:11.093 INFO:teuthology.orchestra.run.smithi184.stdout:(62/176): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-02-21T07:39:11.105 INFO:teuthology.orchestra.run.smithi174.stdout:(32/176): ceph-mgr-modules-core-19.0.0-1514.g25 3.7 MB/s | 247 kB 00:00 2024-02-21T07:39:11.147 INFO:teuthology.orchestra.run.smithi174.stdout:(33/176): ceph-mgr-rook-19.0.0-1514.g25296a8f.e 1.2 MB/s | 52 kB 00:00 2024-02-21T07:39:11.151 INFO:teuthology.orchestra.run.smithi184.stdout:(63/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-02-21T07:39:11.189 INFO:teuthology.orchestra.run.smithi174.stdout:(34/176): ceph-prometheus-alerts-19.0.0-1514.g2 367 kB/s | 15 kB 00:00 2024-02-21T07:39:11.256 INFO:teuthology.orchestra.run.smithi174.stdout:(35/176): ceph-volume-19.0.0-1514.g25296a8f.el9 3.9 MB/s | 264 kB 00:00 2024-02-21T07:39:11.364 INFO:teuthology.orchestra.run.smithi174.stdout:(36/176): cephadm-19.0.0-1514.g25296a8f.el9.noa 6.7 MB/s | 748 kB 00:00 2024-02-21T07:39:11.406 INFO:teuthology.orchestra.run.smithi174.stdout:(37/176): cephfs-top-19.0.0-1514.g25296a8f.el9. 439 kB/s | 18 kB 00:00 2024-02-21T07:39:11.527 INFO:teuthology.orchestra.run.smithi184.stdout:(64/176): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 5.8 MB 00:00 2024-02-21T07:39:11.619 INFO:teuthology.orchestra.run.smithi184.stdout:(65/176): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 227 kB 00:00 2024-02-21T07:39:11.669 INFO:teuthology.orchestra.run.smithi184.stdout:(66/176): python3-jsonpatch-1.21-16.el9.noarch. 488 kB/s | 24 kB 00:00 2024-02-21T07:39:11.702 INFO:teuthology.orchestra.run.smithi184.stdout:(67/176): python3-jsonpointer-2.0-4.el9.noarch. 547 kB/s | 18 kB 00:00 2024-02-21T07:39:11.723 INFO:teuthology.orchestra.run.smithi174.stdout:(38/176): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 662 kB 00:00 2024-02-21T07:39:11.752 INFO:teuthology.orchestra.run.smithi069.stdout:(48/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 149 kB/s | 159 kB 00:01 2024-02-21T07:39:11.753 INFO:teuthology.orchestra.run.smithi184.stdout:(68/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-02-21T07:39:11.780 INFO:teuthology.orchestra.run.smithi069.stdout:(49/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 40 kB/s | 44 kB 00:01 2024-02-21T07:39:11.790 INFO:teuthology.orchestra.run.smithi174.stdout:(39/176): bison-3.7.4-5.el9.x86_64.rpm 13 MB/s | 920 kB 00:00 2024-02-21T07:39:11.803 INFO:teuthology.orchestra.run.smithi184.stdout:(69/176): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2024-02-21T07:39:11.849 INFO:teuthology.orchestra.run.smithi174.stdout:(40/176): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-02-21T07:39:11.911 INFO:teuthology.orchestra.run.smithi069.stdout:(50/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.2 MB/s | 3.0 MB 00:02 2024-02-21T07:39:11.916 INFO:teuthology.orchestra.run.smithi174.stdout:(41/176): elfutils-libelf-devel-0.190-2.el9.x86 306 kB/s | 20 kB 00:00 2024-02-21T07:39:11.999 INFO:teuthology.orchestra.run.smithi174.stdout:(42/176): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2024-02-21T07:39:12.058 INFO:teuthology.orchestra.run.smithi174.stdout:(43/176): flexiblas-3.0.4-8.el9.x86_64.rpm 543 kB/s | 32 kB 00:00 2024-02-21T07:39:12.170 INFO:teuthology.orchestra.run.smithi069.stdout:(51/176): librdkafka-1.6.1-102.el9.x86_64.rpm 1.6 MB/s | 661 kB 00:00 2024-02-21T07:39:12.220 INFO:teuthology.orchestra.run.smithi184.stdout:(70/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 4.8 MB 00:00 2024-02-21T07:39:12.256 INFO:teuthology.orchestra.run.smithi174.stdout:(44/176): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-02-21T07:39:12.279 INFO:teuthology.orchestra.run.smithi184.stdout:(71/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 217 kB 00:00 2024-02-21T07:39:12.307 INFO:teuthology.orchestra.run.smithi174.stdout:(45/176): flexiblas-openblas-openmp-3.0.4-8.el9 343 kB/s | 17 kB 00:00 2024-02-21T07:39:12.337 INFO:teuthology.orchestra.run.smithi184.stdout:(72/176): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 174 kB 00:00 2024-02-21T07:39:12.357 INFO:teuthology.orchestra.run.smithi174.stdout:(46/176): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-02-21T07:39:12.370 INFO:teuthology.orchestra.run.smithi069.stdout:(52/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 53 kB/s | 24 kB 00:00 2024-02-21T07:39:12.407 INFO:teuthology.orchestra.run.smithi174.stdout:(47/176): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-02-21T07:39:12.411 INFO:teuthology.orchestra.run.smithi069.stdout:(53/176): libtool-2.4.6-45.el9.x86_64.rpm 914 kB/s | 578 kB 00:00 2024-02-21T07:39:12.437 INFO:teuthology.orchestra.run.smithi069.stdout:(54/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 174 kB/s | 46 kB 00:00 2024-02-21T07:39:12.458 INFO:teuthology.orchestra.run.smithi174.stdout:(48/176): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-02-21T07:39:12.525 INFO:teuthology.orchestra.run.smithi174.stdout:(49/176): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-02-21T07:39:12.529 INFO:teuthology.orchestra.run.smithi069.stdout:(55/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 282 kB 00:00 2024-02-21T07:39:12.563 INFO:teuthology.orchestra.run.smithi184.stdout:(73/176): python3-packaging-20.9-5.el9.noarch.r 305 kB/s | 69 kB 00:00 2024-02-21T07:39:12.596 INFO:teuthology.orchestra.run.smithi069.stdout:(56/176): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-02-21T07:39:12.600 INFO:teuthology.orchestra.run.smithi174.stdout:(50/176): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2024-02-21T07:39:12.613 INFO:teuthology.orchestra.run.smithi069.stdout:(57/176): openblas-0.3.21-2.el9.x86_64.rpm 196 kB/s | 34 kB 00:00 2024-02-21T07:39:12.621 INFO:teuthology.orchestra.run.smithi184.stdout:(74/176): python3-prettytable-0.7.2-27.el9.noar 706 kB/s | 41 kB 00:00 2024-02-21T07:39:12.651 INFO:teuthology.orchestra.run.smithi174.stdout:(51/176): libuuid-devel-2.37.4-18.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-02-21T07:39:12.688 INFO:teuthology.orchestra.run.smithi184.stdout:(75/176): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 238 kB 00:00 2024-02-21T07:39:12.701 INFO:teuthology.orchestra.run.smithi174.stdout:(52/176): libzstd-devel-1.5.1-2.el9.x86_64.rpm 926 kB/s | 46 kB 00:00 2024-02-21T07:39:12.747 INFO:teuthology.orchestra.run.smithi184.stdout:(76/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-02-21T07:39:12.768 INFO:teuthology.orchestra.run.smithi174.stdout:(53/176): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.1 MB/s | 282 kB 00:00 2024-02-21T07:39:12.800 INFO:teuthology.orchestra.run.smithi184.stdout:(77/176): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-02-21T07:39:12.818 INFO:teuthology.orchestra.run.smithi174.stdout:(54/176): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-02-21T07:39:12.839 INFO:teuthology.orchestra.run.smithi184.stdout:(78/176): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-02-21T07:39:12.860 INFO:teuthology.orchestra.run.smithi174.stdout:(55/176): openblas-0.3.21-2.el9.x86_64.rpm 825 kB/s | 34 kB 00:00 2024-02-21T07:39:12.881 INFO:teuthology.orchestra.run.smithi184.stdout:(79/176): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 43 kB 00:00 2024-02-21T07:39:13.094 INFO:teuthology.orchestra.run.smithi174.stdout:(56/176): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-02-21T07:39:13.277 INFO:teuthology.orchestra.run.smithi174.stdout:(57/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-02-21T07:39:13.386 INFO:teuthology.orchestra.run.smithi174.stdout:(58/176): postgresql-13.11-1.el9.x86_64.rpm 14 MB/s | 1.5 MB 00:00 2024-02-21T07:39:13.503 INFO:teuthology.orchestra.run.smithi174.stdout:(59/176): postgresql-contrib-13.11-1.el9.x86_64 6.8 MB/s | 811 kB 00:00 2024-02-21T07:39:13.553 INFO:teuthology.orchestra.run.smithi174.stdout:(60/176): postgresql-private-libs-13.11-1.el9.x 2.6 MB/s | 134 kB 00:00 2024-02-21T07:39:13.887 INFO:teuthology.orchestra.run.smithi174.stdout:(61/176): postgresql-server-13.11-1.el9.x86_64. 17 MB/s | 5.7 MB 00:00 2024-02-21T07:39:13.995 INFO:teuthology.orchestra.run.smithi174.stdout:(62/176): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-02-21T07:39:14.045 INFO:teuthology.orchestra.run.smithi174.stdout:(63/176): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 78 kB 00:00 2024-02-21T07:39:14.406 INFO:teuthology.orchestra.run.smithi184.stdout:(80/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-02-21T07:39:14.448 INFO:teuthology.orchestra.run.smithi184.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 934 kB/s | 39 kB 00:00 2024-02-21T07:39:14.454 INFO:teuthology.orchestra.run.smithi174.stdout:(64/176): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2024-02-21T07:39:14.490 INFO:teuthology.orchestra.run.smithi184.stdout:(82/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 985 kB/s | 41 kB 00:00 2024-02-21T07:39:14.504 INFO:teuthology.orchestra.run.smithi174.stdout:(65/176): python3-jinja2-2.11.3-5.el9.noarch.rp 4.4 MB/s | 227 kB 00:00 2024-02-21T07:39:14.546 INFO:teuthology.orchestra.run.smithi174.stdout:(66/176): python3-jsonpatch-1.21-16.el9.noarch. 587 kB/s | 24 kB 00:00 2024-02-21T07:39:14.549 INFO:teuthology.orchestra.run.smithi184.stdout:(83/176): qatlib-23.11.0-1.el9.x86_64.rpm 3.6 MB/s | 215 kB 00:00 2024-02-21T07:39:14.588 INFO:teuthology.orchestra.run.smithi174.stdout:(67/176): python3-jsonpointer-2.0-4.el9.noarch. 435 kB/s | 18 kB 00:00 2024-02-21T07:39:14.591 INFO:teuthology.orchestra.run.smithi184.stdout:(84/176): qatlib-service-23.11.0-1.el9.x86_64.r 816 kB/s | 34 kB 00:00 2024-02-21T07:39:14.638 INFO:teuthology.orchestra.run.smithi174.stdout:(68/176): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-02-21T07:39:14.641 INFO:teuthology.orchestra.run.smithi184.stdout:(85/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 867 kB/s | 43 kB 00:00 2024-02-21T07:39:14.688 INFO:teuthology.orchestra.run.smithi069.stdout:(58/176): postgresql-13.11-1.el9.x86_64.rpm 751 kB/s | 1.5 MB 00:02 2024-02-21T07:39:14.688 INFO:teuthology.orchestra.run.smithi174.stdout:(69/176): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2024-02-21T07:39:14.725 INFO:teuthology.orchestra.run.smithi184.stdout:(86/176): socat-1.7.4.1-5.el9.x86_64.rpm 3.5 MB/s | 300 kB 00:00 2024-02-21T07:39:14.783 INFO:teuthology.orchestra.run.smithi184.stdout:(87/176): uuid-1.6.2-55.el9.x86_64.rpm 968 kB/s | 56 kB 00:00 2024-02-21T07:39:14.842 INFO:teuthology.orchestra.run.smithi184.stdout:(88/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2024-02-21T07:39:14.914 INFO:teuthology.orchestra.run.smithi184.stdout:(89/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 877 kB/s | 63 kB 00:00 2024-02-21T07:39:14.973 INFO:teuthology.orchestra.run.smithi184.stdout:(90/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 760 kB/s | 44 kB 00:00 2024-02-21T07:39:15.031 INFO:teuthology.orchestra.run.smithi184.stdout:(91/176): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-02-21T07:39:15.072 INFO:teuthology.orchestra.run.smithi174.stdout:(70/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 4.8 MB 00:00 2024-02-21T07:39:15.090 INFO:teuthology.orchestra.run.smithi184.stdout:(92/176): jq-1.6-16.el9.x86_64.rpm 3.1 MB/s | 186 kB 00:00 2024-02-21T07:39:15.131 INFO:teuthology.orchestra.run.smithi174.stdout:(71/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 217 kB 00:00 2024-02-21T07:39:15.198 INFO:teuthology.orchestra.run.smithi174.stdout:(72/176): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2024-02-21T07:39:15.215 INFO:teuthology.orchestra.run.smithi184.stdout:(93/176): libgfortran-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 802 kB 00:00 2024-02-21T07:39:15.248 INFO:teuthology.orchestra.run.smithi174.stdout:(73/176): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-02-21T07:39:15.282 INFO:teuthology.orchestra.run.smithi184.stdout:(94/176): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 194 kB 00:00 2024-02-21T07:39:15.298 INFO:teuthology.orchestra.run.smithi174.stdout:(74/176): python3-prettytable-0.7.2-27.el9.noar 823 kB/s | 41 kB 00:00 2024-02-21T07:39:15.330 INFO:teuthology.orchestra.run.smithi069.stdout:(59/176): openssl-devel-3.0.7-25.el9.x86_64.rpm 1.1 MB/s | 3.0 MB 00:02 2024-02-21T07:39:15.357 INFO:teuthology.orchestra.run.smithi174.stdout:(75/176): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-02-21T07:39:15.416 INFO:teuthology.orchestra.run.smithi174.stdout:(76/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-02-21T07:39:15.484 INFO:teuthology.orchestra.run.smithi174.stdout:(77/176): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-02-21T07:39:15.497 INFO:teuthology.orchestra.run.smithi069.stdout:(60/176): postgresql-contrib-13.11-1.el9.x86_64 1.0 MB/s | 811 kB 00:00 2024-02-21T07:39:15.509 INFO:teuthology.orchestra.run.smithi184.stdout:(95/176): ceph-common-19.0.0-1514.g25296a8f.el9 1.0 MB/s | 20 MB 00:19 2024-02-21T07:39:15.533 INFO:teuthology.orchestra.run.smithi184.stdout:(96/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 867 kB/s | 217 kB 00:00 2024-02-21T07:39:15.536 INFO:teuthology.orchestra.run.smithi174.stdout:(78/176): python3-pytz-2021.1-5.el9.noarch.rpm 952 kB/s | 47 kB 00:00 2024-02-21T07:39:15.583 INFO:teuthology.orchestra.run.smithi174.stdout:(79/176): python3-requests-oauthlib-1.3.0-12.el 854 kB/s | 43 kB 00:00 2024-02-21T07:39:15.584 INFO:teuthology.orchestra.run.smithi184.stdout:(97/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2024-02-21T07:39:15.655 INFO:teuthology.orchestra.run.smithi069.stdout:(61/176): openblas-openmp-0.3.21-2.el9.x86_64.r 1.5 MB/s | 4.7 MB 00:03 2024-02-21T07:39:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:(62/176): postgresql-private-libs-13.11-1.el9.x 376 kB/s | 134 kB 00:00 2024-02-21T07:39:15.700 INFO:teuthology.orchestra.run.smithi184.stdout:(98/176): python3-cryptography-36.0.1-4.el9.x86 6.9 MB/s | 1.1 MB 00:00 2024-02-21T07:39:15.726 INFO:teuthology.orchestra.run.smithi184.stdout:(99/176): python3-ply-3.11-14.el9.noarch.rpm 728 kB/s | 103 kB 00:00 2024-02-21T07:39:15.759 INFO:teuthology.orchestra.run.smithi184.stdout:(100/176): python3-pycparser-2.20-6.el9.noarch. 2.1 MB/s | 124 kB 00:00 2024-02-21T07:39:15.793 INFO:teuthology.orchestra.run.smithi184.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 1.7 MB/s | 113 kB 00:00 2024-02-21T07:39:15.826 INFO:teuthology.orchestra.run.smithi184.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 2.7 MB/s | 187 kB 00:00 2024-02-21T07:39:15.968 INFO:teuthology.orchestra.run.smithi184.stdout:(103/176): ceph-mgr-diskprediction-local-19.0.0 857 kB/s | 7.4 MB 00:08 2024-02-21T07:39:16.114 INFO:teuthology.orchestra.run.smithi069.stdout:(63/176): python3-attrs-20.3.0-7.el9.noarch.rpm 184 kB/s | 78 kB 00:00 2024-02-21T07:39:16.143 INFO:teuthology.orchestra.run.smithi184.stdout:(104/176): python3-devel-3.9.17-2.el9.x86_64.rp 701 kB/s | 245 kB 00:00 2024-02-21T07:39:16.185 INFO:teuthology.orchestra.run.smithi184.stdout:(105/176): lua-devel-5.4.4-4.el9.x86_64.rpm 62 kB/s | 22 kB 00:00 2024-02-21T07:39:16.356 INFO:teuthology.orchestra.run.smithi069.stdout:(64/176): protobuf-3.14.0-13.el9.x86_64.rpm 1.4 MB/s | 1.0 MB 00:00 2024-02-21T07:39:16.460 INFO:teuthology.orchestra.run.smithi184.stdout:(106/176): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-02-21T07:39:16.494 INFO:teuthology.orchestra.run.smithi184.stdout:(107/176): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-02-21T07:39:16.527 INFO:teuthology.orchestra.run.smithi184.stdout:(108/176): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-02-21T07:39:16.594 INFO:teuthology.orchestra.run.smithi184.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 388 kB/s | 26 kB 00:00 2024-02-21T07:39:16.661 INFO:teuthology.orchestra.run.smithi184.stdout:(110/176): liboath-2.6.7-2.el9.x86_64.rpm 731 kB/s | 49 kB 00:00 2024-02-21T07:39:16.728 INFO:teuthology.orchestra.run.smithi184.stdout:(111/176): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-02-21T07:39:16.787 INFO:teuthology.orchestra.run.smithi184.stdout:(112/176): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-02-21T07:39:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:(65/176): python3-jinja2-2.11.3-5.el9.noarch.rp 528 kB/s | 227 kB 00:00 2024-02-21T07:39:16.812 INFO:teuthology.orchestra.run.smithi184.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-02-21T07:39:16.838 INFO:teuthology.orchestra.run.smithi184.stdout:(114/176): protobuf-compiler-3.14.0-13.el9.x86_ 993 kB/s | 863 kB 00:00 2024-02-21T07:39:16.896 INFO:teuthology.orchestra.run.smithi184.stdout:(115/176): python3-asyncssh-2.13.2-4.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-02-21T07:39:16.948 INFO:teuthology.orchestra.run.smithi069.stdout:(66/176): postgresql-server-13.11-1.el9.x86_64. 3.9 MB/s | 5.7 MB 00:01 2024-02-21T07:39:16.963 INFO:teuthology.orchestra.run.smithi184.stdout:(116/176): python3-cachetools-4.2.4-1.el9.noarc 483 kB/s | 32 kB 00:00 2024-02-21T07:39:16.989 INFO:teuthology.orchestra.run.smithi184.stdout:(117/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2024-02-21T07:39:17.017 INFO:teuthology.orchestra.run.smithi174.stdout:(80/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-02-21T07:39:17.022 INFO:teuthology.orchestra.run.smithi184.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-02-21T07:39:17.039 INFO:teuthology.orchestra.run.smithi184.stdout:(119/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 216 kB/s | 43 kB 00:00 2024-02-21T07:39:17.059 INFO:teuthology.orchestra.run.smithi174.stdout:(81/176): python3-toml-0.10.2-6.el9.noarch.rpm 937 kB/s | 39 kB 00:00 2024-02-21T07:39:17.064 INFO:teuthology.orchestra.run.smithi184.stdout:(120/176): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-02-21T07:39:17.092 INFO:teuthology.orchestra.run.smithi184.stdout:(121/176): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-02-21T07:39:17.101 INFO:teuthology.orchestra.run.smithi174.stdout:(82/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 985 kB/s | 41 kB 00:00 2024-02-21T07:39:17.115 INFO:teuthology.orchestra.run.smithi069.stdout:(67/176): python3-jsonpatch-1.21-16.el9.noarch. 76 kB/s | 24 kB 00:00 2024-02-21T07:39:17.123 INFO:teuthology.orchestra.run.smithi184.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 603 kB/s | 35 kB 00:00 2024-02-21T07:39:17.157 INFO:teuthology.orchestra.run.smithi184.stdout:(123/176): python3-google-auth-2.27.0-1.el9.noa 3.0 MB/s | 203 kB 00:00 2024-02-21T07:39:17.176 INFO:teuthology.orchestra.run.smithi174.stdout:(83/176): qatlib-23.11.0-1.el9.x86_64.rpm 2.8 MB/s | 215 kB 00:00 2024-02-21T07:39:17.190 INFO:teuthology.orchestra.run.smithi184.stdout:(124/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.0 MB/s | 303 kB 00:00 2024-02-21T07:39:17.215 INFO:teuthology.orchestra.run.smithi069.stdout:(68/176): python3-jsonpointer-2.0-4.el9.noarch. 71 kB/s | 18 kB 00:00 2024-02-21T07:39:17.224 INFO:teuthology.orchestra.run.smithi184.stdout:(125/176): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-02-21T07:39:17.226 INFO:teuthology.orchestra.run.smithi174.stdout:(84/176): qatlib-service-23.11.0-1.el9.x86_64.r 677 kB/s | 34 kB 00:00 2024-02-21T07:39:17.266 INFO:teuthology.orchestra.run.smithi184.stdout:(126/176): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-02-21T07:39:17.268 INFO:teuthology.orchestra.run.smithi174.stdout:(85/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-02-21T07:39:17.291 INFO:teuthology.orchestra.run.smithi184.stdout:(127/176): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-02-21T07:39:17.316 INFO:teuthology.orchestra.run.smithi184.stdout:(128/176): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-02-21T07:39:17.327 INFO:teuthology.orchestra.run.smithi174.stdout:(86/176): socat-1.7.4.1-5.el9.x86_64.rpm 5.0 MB/s | 300 kB 00:00 2024-02-21T07:39:17.341 INFO:teuthology.orchestra.run.smithi184.stdout:(129/176): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-02-21T07:39:17.367 INFO:teuthology.orchestra.run.smithi184.stdout:(130/176): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-02-21T07:39:17.368 INFO:teuthology.orchestra.run.smithi174.stdout:(87/176): uuid-1.6.2-55.el9.x86_64.rpm 1.3 MB/s | 56 kB 00:00 2024-02-21T07:39:17.374 INFO:teuthology.orchestra.run.smithi069.stdout:(69/176): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 5.8 MB 00:01 2024-02-21T07:39:17.392 INFO:teuthology.orchestra.run.smithi184.stdout:(131/176): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2024-02-21T07:39:17.407 INFO:teuthology.orchestra.run.smithi069.stdout:(70/176): python3-mako-1.1.4-6.el9.noarch.rpm 499 kB/s | 144 kB 00:00 2024-02-21T07:39:17.424 INFO:teuthology.orchestra.run.smithi069.stdout:(71/176): python3-markupsafe-1.1.1-12.el9.x86_6 155 kB/s | 32 kB 00:00 2024-02-21T07:39:17.434 INFO:teuthology.orchestra.run.smithi184.stdout:(132/176): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-02-21T07:39:17.435 INFO:teuthology.orchestra.run.smithi174.stdout:(88/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2024-02-21T07:39:17.459 INFO:teuthology.orchestra.run.smithi184.stdout:(133/176): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2024-02-21T07:39:17.494 INFO:teuthology.orchestra.run.smithi174.stdout:(89/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2024-02-21T07:39:17.543 INFO:teuthology.orchestra.run.smithi184.stdout:(134/176): python3-more-itertools-8.12.0-2.el9. 524 kB/s | 79 kB 00:00 2024-02-21T07:39:17.544 INFO:teuthology.orchestra.run.smithi174.stdout:(90/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2024-02-21T07:39:17.568 INFO:teuthology.orchestra.run.smithi184.stdout:(135/176): python3-natsort-7.1.1-5.el9.noarch.r 431 kB/s | 58 kB 00:00 2024-02-21T07:39:17.593 INFO:teuthology.orchestra.run.smithi184.stdout:(136/176): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-02-21T07:39:17.603 INFO:teuthology.orchestra.run.smithi174.stdout:(91/176): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-02-21T07:39:17.619 INFO:teuthology.orchestra.run.smithi184.stdout:(137/176): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-02-21T07:39:17.644 INFO:teuthology.orchestra.run.smithi184.stdout:(138/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-02-21T07:39:17.669 INFO:teuthology.orchestra.run.smithi184.stdout:(139/176): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-02-21T07:39:17.670 INFO:teuthology.orchestra.run.smithi174.stdout:(92/176): jq-1.6-16.el9.x86_64.rpm 2.7 MB/s | 186 kB 00:00 2024-02-21T07:39:17.694 INFO:teuthology.orchestra.run.smithi184.stdout:(140/176): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-02-21T07:39:17.728 INFO:teuthology.orchestra.run.smithi184.stdout:(141/176): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-02-21T07:39:17.741 INFO:teuthology.orchestra.run.smithi069.stdout:(72/176): python3-numpy-f2py-1.20.1-5.el9.x86_6 691 kB/s | 217 kB 00:00 2024-02-21T07:39:17.753 INFO:teuthology.orchestra.run.smithi184.stdout:(142/176): python3-rsa-4.9-2.el9.noarch.rpm 704 kB/s | 59 kB 00:00 2024-02-21T07:39:17.766 INFO:teuthology.orchestra.run.smithi069.stdout:(73/176): python3-oauthlib-3.1.1-5.el9.noarch.r 514 kB/s | 174 kB 00:00 2024-02-21T07:39:17.787 INFO:teuthology.orchestra.run.smithi184.stdout:(143/176): python3-tempora-5.0.0-2.el9.noarch.r 387 kB/s | 36 kB 00:00 2024-02-21T07:39:17.812 INFO:teuthology.orchestra.run.smithi184.stdout:(144/176): python3-typing-extensions-4.4.0-2.el 607 kB/s | 51 kB 00:00 2024-02-21T07:39:17.813 INFO:teuthology.orchestra.run.smithi174.stdout:(93/176): libgfortran-11.4.1-3.el9.x86_64.rpm 5.5 MB/s | 802 kB 00:00 2024-02-21T07:39:17.837 INFO:teuthology.orchestra.run.smithi184.stdout:(145/176): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-02-21T07:39:17.863 INFO:teuthology.orchestra.run.smithi184.stdout:(146/176): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-02-21T07:39:17.879 INFO:teuthology.orchestra.run.smithi174.stdout:(94/176): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 194 kB 00:00 2024-02-21T07:39:17.888 INFO:teuthology.orchestra.run.smithi184.stdout:(147/176): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-02-21T07:39:17.913 INFO:teuthology.orchestra.run.smithi184.stdout:(148/176): python3-zc-lockfile-2.0-10.el9.noarc 264 kB/s | 20 kB 00:00 2024-02-21T07:39:17.933 INFO:teuthology.orchestra.run.smithi069.stdout:(74/176): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.6 MB/s | 4.8 MB 00:00 2024-02-21T07:39:17.939 INFO:teuthology.orchestra.run.smithi184.stdout:(149/176): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-02-21T07:39:17.955 INFO:teuthology.orchestra.run.smithi174.stdout:(95/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-02-21T07:39:17.958 INFO:teuthology.orchestra.run.smithi069.stdout:(75/176): python3-packaging-20.9-5.el9.noarch.r 319 kB/s | 69 kB 00:00 2024-02-21T07:39:18.001 INFO:teuthology.orchestra.run.smithi069.stdout:(76/176): python3-prettytable-0.7.2-27.el9.noar 179 kB/s | 41 kB 00:00 2024-02-21T07:39:18.030 INFO:teuthology.orchestra.run.smithi174.stdout:(96/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-02-21T07:39:18.034 INFO:teuthology.orchestra.run.smithi069.stdout:(77/176): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 238 kB 00:00 2024-02-21T07:39:18.056 INFO:teuthology.orchestra.run.smithi184.stdout:(150/176): thrift-0.15.0-2.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-02-21T07:39:18.068 INFO:teuthology.orchestra.run.smithi069.stdout:(78/176): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2024-02-21T07:39:18.093 INFO:teuthology.orchestra.run.smithi069.stdout:(79/176): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2024-02-21T07:39:18.118 INFO:teuthology.orchestra.run.smithi069.stdout:(80/176): python3-pytz-2021.1-5.el9.noarch.rpm 565 kB/s | 47 kB 00:00 2024-02-21T07:39:18.122 INFO:teuthology.orchestra.run.smithi184.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 68 kB 00:00 2024-02-21T07:39:18.144 INFO:teuthology.orchestra.run.smithi069.stdout:(81/176): python3-requests-oauthlib-1.3.0-12.el 588 kB/s | 43 kB 00:00 2024-02-21T07:39:18.231 INFO:teuthology.orchestra.run.smithi174.stdout:(97/176): python3-cryptography-36.0.1-4.el9.x86 5.7 MB/s | 1.1 MB 00:00 2024-02-21T07:39:18.406 INFO:teuthology.orchestra.run.smithi174.stdout:(98/176): ceph-osd-19.0.0-1514.g25296a8f.el9.x8 1.3 MB/s | 17 MB 00:13 2024-02-21T07:39:18.431 INFO:teuthology.orchestra.run.smithi174.stdout:(99/176): python3-ply-3.11-14.el9.noarch.rpm 514 kB/s | 103 kB 00:00 2024-02-21T07:39:18.456 INFO:teuthology.orchestra.run.smithi184.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 6.8 MB/s | 2.3 MB 00:00 2024-02-21T07:39:18.482 INFO:teuthology.orchestra.run.smithi174.stdout:(100/176): python3-pycparser-2.20-6.el9.noarch. 1.6 MB/s | 124 kB 00:00 2024-02-21T07:39:18.494 INFO:teuthology.orchestra.run.smithi069.stdout:(82/176): python3-toml-0.10.2-6.el9.noarch.rpm 103 kB/s | 39 kB 00:00 2024-02-21T07:39:18.507 INFO:teuthology.orchestra.run.smithi174.stdout:(101/176): python3-requests-2.25.1-8.el9.noarch 1.5 MB/s | 113 kB 00:00 2024-02-21T07:39:18.519 INFO:teuthology.orchestra.run.smithi069.stdout:(83/176): python3-wcwidth-0.2.5-8.el9.noarch.rp 110 kB/s | 41 kB 00:00 2024-02-21T07:39:18.557 INFO:teuthology.orchestra.run.smithi174.stdout:(102/176): python3-urllib3-1.26.5-5.el9.noarch. 2.4 MB/s | 187 kB 00:00 2024-02-21T07:39:18.599 INFO:teuthology.orchestra.run.smithi174.stdout:(103/176): python3-devel-3.9.17-2.el9.x86_64.rp 2.6 MB/s | 245 kB 00:00 2024-02-21T07:39:18.732 INFO:teuthology.orchestra.run.smithi184.stdout:(153/176): NetworkManager-libnm-1.45.91-1.el9.x 6.6 MB/s | 1.8 MB 00:00 2024-02-21T07:39:18.794 INFO:teuthology.orchestra.run.smithi069.stdout:(84/176): qatlib-23.11.0-1.el9.x86_64.rpm 720 kB/s | 215 kB 00:00 2024-02-21T07:39:18.798 INFO:teuthology.orchestra.run.smithi184.stdout:(154/176): NetworkManager-team-1.45.91-1.el9.x8 622 kB/s | 41 kB 00:00 2024-02-21T07:39:18.820 INFO:teuthology.orchestra.run.smithi069.stdout:(85/176): qatlib-service-23.11.0-1.el9.x86_64.r 114 kB/s | 34 kB 00:00 2024-02-21T07:39:18.874 INFO:teuthology.orchestra.run.smithi184.stdout:(155/176): NetworkManager-tui-1.45.91-1.el9.x86 3.2 MB/s | 246 kB 00:00 2024-02-21T07:39:18.932 INFO:teuthology.orchestra.run.smithi184.stdout:(156/176): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2024-02-21T07:39:18.991 INFO:teuthology.orchestra.run.smithi184.stdout:(157/176): elfutils-debuginfod-client-0.190-2.e 609 kB/s | 35 kB 00:00 2024-02-21T07:39:19.058 INFO:teuthology.orchestra.run.smithi184.stdout:(158/176): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 191 kB 00:00 2024-02-21T07:39:19.059 INFO:teuthology.orchestra.run.smithi174.stdout:(104/176): lua-devel-5.4.4-4.el9.x86_64.rpm 44 kB/s | 22 kB 00:00 2024-02-21T07:39:19.070 INFO:teuthology.orchestra.run.smithi069.stdout:(86/176): qatzip-libs-1.1.2-2.el9.x86_64.rpm 158 kB/s | 43 kB 00:00 2024-02-21T07:39:19.103 INFO:teuthology.orchestra.run.smithi069.stdout:(87/176): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2024-02-21T07:39:19.125 INFO:teuthology.orchestra.run.smithi184.stdout:(159/176): elfutils-libs-0.190-2.el9.x86_64.rpm 3.7 MB/s | 254 kB 00:00 2024-02-21T07:39:19.233 INFO:teuthology.orchestra.run.smithi184.stdout:(160/176): iproute-6.7.0-2.el9.x86_64.rpm 7.2 MB/s | 802 kB 00:00 2024-02-21T07:39:19.308 INFO:teuthology.orchestra.run.smithi184.stdout:(161/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 5.7 MB/s | 433 kB 00:00 2024-02-21T07:39:19.350 INFO:teuthology.orchestra.run.smithi184.stdout:(162/176): libacl-2.3.1-4.el9.x86_64.rpm 527 kB/s | 22 kB 00:00 2024-02-21T07:39:19.366 INFO:teuthology.orchestra.run.smithi174.stdout:(105/176): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-02-21T07:39:19.400 INFO:teuthology.orchestra.run.smithi174.stdout:(106/176): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-02-21T07:39:19.400 INFO:teuthology.orchestra.run.smithi184.stdout:(163/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-02-21T07:39:19.445 INFO:teuthology.orchestra.run.smithi069.stdout:(88/176): python3-scipy-1.6.2-8.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-02-21T07:39:19.451 INFO:teuthology.orchestra.run.smithi184.stdout:(164/176): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 154 kB 00:00 2024-02-21T07:39:19.467 INFO:teuthology.orchestra.run.smithi174.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-02-21T07:39:19.471 INFO:teuthology.orchestra.run.smithi069.stdout:(89/176): uuid-1.6.2-55.el9.x86_64.rpm 142 kB/s | 56 kB 00:00 2024-02-21T07:39:19.496 INFO:teuthology.orchestra.run.smithi069.stdout:(90/176): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 226 kB/s | 87 kB 00:00 2024-02-21T07:39:19.501 INFO:teuthology.orchestra.run.smithi184.stdout:(165/176): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-02-21T07:39:19.521 INFO:teuthology.orchestra.run.smithi069.stdout:(91/176): xmlstarlet-1.6.1-20.el9.x86_64.rpm 853 kB/s | 63 kB 00:00 2024-02-21T07:39:19.546 INFO:teuthology.orchestra.run.smithi069.stdout:(92/176): zlib-devel-1.2.11-40.el9.x86_64.rpm 902 kB/s | 44 kB 00:00 2024-02-21T07:39:19.551 INFO:teuthology.orchestra.run.smithi184.stdout:(166/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-02-21T07:39:19.571 INFO:teuthology.orchestra.run.smithi069.stdout:(93/176): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-02-21T07:39:19.597 INFO:teuthology.orchestra.run.smithi069.stdout:(94/176): jq-1.6-16.el9.x86_64.rpm 2.5 MB/s | 186 kB 00:00 2024-02-21T07:39:19.601 INFO:teuthology.orchestra.run.smithi184.stdout:(167/176): libuuid-2.37.4-18.el9.x86_64.rpm 555 kB/s | 28 kB 00:00 2024-02-21T07:39:19.642 INFO:teuthology.orchestra.run.smithi174.stdout:(108/176): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-02-21T07:39:19.655 INFO:teuthology.orchestra.run.smithi069.stdout:(95/176): libgfortran-11.4.1-3.el9.x86_64.rpm 7.4 MB/s | 802 kB 00:00 2024-02-21T07:39:19.709 INFO:teuthology.orchestra.run.smithi174.stdout:(109/176): libarrow-9.0.0-10.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-02-21T07:39:19.714 INFO:teuthology.orchestra.run.smithi069.stdout:(96/176): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 194 kB 00:00 2024-02-21T07:39:19.734 INFO:teuthology.orchestra.run.smithi174.stdout:(110/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-02-21T07:39:19.739 INFO:teuthology.orchestra.run.smithi069.stdout:(97/176): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.5 MB/s | 217 kB 00:00 2024-02-21T07:39:19.760 INFO:teuthology.orchestra.run.smithi184.stdout:(168/176): openssl-3.0.7-25.el9.x86_64.rpm 7.3 MB/s | 1.2 MB 00:00 2024-02-21T07:39:19.773 INFO:teuthology.orchestra.run.smithi069.stdout:(98/176): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 241 kB 00:00 2024-02-21T07:39:19.776 INFO:teuthology.orchestra.run.smithi174.stdout:(111/176): liboath-2.6.7-2.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-02-21T07:39:19.801 INFO:teuthology.orchestra.run.smithi174.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-02-21T07:39:19.810 INFO:teuthology.orchestra.run.smithi184.stdout:(169/176): librados2-19.0.0-1514.g25296a8f.el9. 1.8 MB/s | 3.4 MB 00:01 2024-02-21T07:39:19.843 INFO:teuthology.orchestra.run.smithi174.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-02-21T07:39:19.873 INFO:teuthology.orchestra.run.smithi069.stdout:(99/176): python3-cryptography-36.0.1-4.el9.x86 8.8 MB/s | 1.1 MB 00:00 2024-02-21T07:39:19.898 INFO:teuthology.orchestra.run.smithi069.stdout:(100/176): python3-ply-3.11-14.el9.noarch.rpm 661 kB/s | 103 kB 00:00 2024-02-21T07:39:19.923 INFO:teuthology.orchestra.run.smithi069.stdout:(101/176): python3-pycparser-2.20-6.el9.noarch. 834 kB/s | 124 kB 00:00 2024-02-21T07:39:19.927 INFO:teuthology.orchestra.run.smithi174.stdout:(114/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 838 kB 00:00 2024-02-21T07:39:19.952 INFO:teuthology.orchestra.run.smithi069.stdout:(102/176): python3-requests-2.25.1-8.el9.noarch 1.5 MB/s | 113 kB 00:00 2024-02-21T07:39:19.952 INFO:teuthology.orchestra.run.smithi174.stdout:(115/176): python3-asyncssh-2.13.2-4.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-02-21T07:39:19.982 INFO:teuthology.orchestra.run.smithi069.stdout:(103/176): python3-urllib3-1.26.5-5.el9.noarch. 3.2 MB/s | 187 kB 00:00 2024-02-21T07:39:19.994 INFO:teuthology.orchestra.run.smithi174.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 649 kB/s | 43 kB 00:00 2024-02-21T07:39:20.002 INFO:teuthology.orchestra.run.smithi184.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 8.9 MB/s | 2.1 MB 00:00 2024-02-21T07:39:20.019 INFO:teuthology.orchestra.run.smithi174.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 481 kB/s | 32 kB 00:00 2024-02-21T07:39:20.061 INFO:teuthology.orchestra.run.smithi174.stdout:(118/176): python3-certifi-2021.10.8-2.el9.noar 225 kB/s | 15 kB 00:00 2024-02-21T07:39:20.086 INFO:teuthology.orchestra.run.smithi174.stdout:(119/176): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-02-21T07:39:20.120 INFO:teuthology.orchestra.run.smithi184.stdout:(171/176): librbd1-19.0.0-1514.g25296a8f.el9.x8 1.4 MB/s | 3.1 MB 00:02 2024-02-21T07:39:20.129 INFO:teuthology.orchestra.run.smithi174.stdout:(120/176): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-02-21T07:39:20.154 INFO:teuthology.orchestra.run.smithi174.stdout:(121/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-02-21T07:39:20.186 INFO:teuthology.orchestra.run.smithi184.stdout:(172/176): util-linux-2.37.4-18.el9.x86_64.rpm 5.8 MB/s | 2.2 MB 00:00 2024-02-21T07:39:20.196 INFO:teuthology.orchestra.run.smithi174.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 529 kB/s | 35 kB 00:00 2024-02-21T07:39:20.199 INFO:teuthology.orchestra.run.smithi069.stdout:(104/176): python3-devel-3.9.17-2.el9.x86_64.rp 898 kB/s | 245 kB 00:00 2024-02-21T07:39:20.212 INFO:teuthology.orchestra.run.smithi184.stdout:(173/176): util-linux-core-2.37.4-18.el9.x86_64 2.1 MB/s | 438 kB 00:00 2024-02-21T07:39:20.221 INFO:teuthology.orchestra.run.smithi174.stdout:(123/176): python3-google-auth-2.27.0-1.el9.noa 3.0 MB/s | 203 kB 00:00 2024-02-21T07:39:20.237 INFO:teuthology.orchestra.run.smithi184.stdout:(174/176): util-linux-user-2.37.4-18.el9.x86_64 259 kB/s | 30 kB 00:00 2024-02-21T07:39:20.271 INFO:teuthology.orchestra.run.smithi184.stdout:(175/176): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2024-02-21T07:39:20.291 INFO:teuthology.orchestra.run.smithi069.stdout:(105/176): lua-devel-5.4.4-4.el9.x86_64.rpm 65 kB/s | 22 kB 00:00 2024-02-21T07:39:20.296 INFO:teuthology.orchestra.run.smithi174.stdout:(124/176): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-02-21T07:39:20.338 INFO:teuthology.orchestra.run.smithi174.stdout:(125/176): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-02-21T07:39:20.355 INFO:teuthology.orchestra.run.smithi174.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-02-21T07:39:20.379 INFO:teuthology.orchestra.run.smithi184.stdout:(176/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.5 MB/s | 1.1 MB 00:00 2024-02-21T07:39:20.384 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-21T07:39:20.384 INFO:teuthology.orchestra.run.smithi184.stdout:Total 9.0 MB/s | 223 MB 00:24 2024-02-21T07:39:20.397 INFO:teuthology.orchestra.run.smithi174.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 303 kB/s | 18 kB 00:00 2024-02-21T07:39:20.414 INFO:teuthology.orchestra.run.smithi174.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-02-21T07:39:20.433 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-21T07:39:20.456 INFO:teuthology.orchestra.run.smithi174.stdout:(129/176): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-02-21T07:39:20.473 INFO:teuthology.orchestra.run.smithi174.stdout:(130/176): python3-jaraco-text-3.2.0-6.el9.noar 337 kB/s | 20 kB 00:00 2024-02-21T07:39:20.500 INFO:teuthology.orchestra.run.smithi069.stdout:(106/176): protobuf-compiler-3.14.0-13.el9.x86_ 1.6 MB/s | 863 kB 00:00 2024-02-21T07:39:20.540 INFO:teuthology.orchestra.run.smithi174.stdout:(131/176): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-02-21T07:39:20.565 INFO:teuthology.orchestra.run.smithi174.stdout:(132/176): python3-logutils-0.3.5-21.el9.noarch 503 kB/s | 46 kB 00:00 2024-02-21T07:39:20.607 INFO:teuthology.orchestra.run.smithi174.stdout:(133/176): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-02-21T07:39:20.633 INFO:teuthology.orchestra.run.smithi174.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 859 kB/s | 58 kB 00:00 2024-02-21T07:39:20.675 INFO:teuthology.orchestra.run.smithi174.stdout:(135/176): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-02-21T07:39:20.700 INFO:teuthology.orchestra.run.smithi174.stdout:(136/176): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-02-21T07:39:20.709 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-21T07:39:20.709 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-21T07:39:20.742 INFO:teuthology.orchestra.run.smithi174.stdout:(137/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-02-21T07:39:20.767 INFO:teuthology.orchestra.run.smithi174.stdout:(138/176): python3-pyperclip-1.8.2-2.el9.noarch 423 kB/s | 28 kB 00:00 2024-02-21T07:39:20.809 INFO:teuthology.orchestra.run.smithi174.stdout:(139/176): python3-repoze-lru-0.7-16.el9.noarch 461 kB/s | 31 kB 00:00 2024-02-21T07:39:20.817 INFO:teuthology.orchestra.run.smithi069.stdout:(107/176): grpc-data-1.46.7-10.el9.noarch.rpm 61 kB/s | 19 kB 00:00 2024-02-21T07:39:20.834 INFO:teuthology.orchestra.run.smithi174.stdout:(140/176): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-02-21T07:39:20.876 INFO:teuthology.orchestra.run.smithi174.stdout:(141/176): python3-rsa-4.9-2.el9.noarch.rpm 884 kB/s | 59 kB 00:00 2024-02-21T07:39:20.902 INFO:teuthology.orchestra.run.smithi174.stdout:(142/176): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2024-02-21T07:39:20.944 INFO:teuthology.orchestra.run.smithi174.stdout:(143/176): python3-typing-extensions-4.4.0-2.el 763 kB/s | 51 kB 00:00 2024-02-21T07:39:20.969 INFO:teuthology.orchestra.run.smithi174.stdout:(144/176): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-02-21T07:39:21.011 INFO:teuthology.orchestra.run.smithi174.stdout:(145/176): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-02-21T07:39:21.044 INFO:teuthology.orchestra.run.smithi174.stdout:(146/176): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-02-21T07:39:21.050 INFO:teuthology.orchestra.run.smithi069.stdout:(108/176): gperftools-libs-2.9.1-2.el9.x86_64.r 407 kB/s | 309 kB 00:00 2024-02-21T07:39:21.078 INFO:teuthology.orchestra.run.smithi174.stdout:(147/176): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-02-21T07:39:21.112 INFO:teuthology.orchestra.run.smithi174.stdout:(148/176): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-02-21T07:39:21.170 INFO:teuthology.orchestra.run.smithi069.stdout:(109/176): libarrow-doc-9.0.0-10.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2024-02-21T07:39:21.210 INFO:teuthology.orchestra.run.smithi069.stdout:(110/176): abseil-cpp-20211102.0-3.el9.x86_64.r 543 kB/s | 548 kB 00:01 2024-02-21T07:39:21.279 INFO:teuthology.orchestra.run.smithi174.stdout:(149/176): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-02-21T07:39:21.300 INFO:teuthology.orchestra.run.smithi069.stdout:(111/176): liboath-2.6.7-2.el9.x86_64.rpm 389 kB/s | 49 kB 00:00 2024-02-21T07:39:21.335 INFO:teuthology.orchestra.run.smithi069.stdout:(112/176): libunwind-1.6.2-1.el9.x86_64.rpm 540 kB/s | 67 kB 00:00 2024-02-21T07:39:21.604 INFO:teuthology.orchestra.run.smithi174.stdout:(150/176): librados2-19.0.0-1514.g25296a8f.el9. 6.9 MB/s | 3.4 MB 00:00 2024-02-21T07:39:21.627 INFO:teuthology.orchestra.run.smithi069.stdout:(113/176): luarocks-3.9.2-1.el9.noarch.rpm 454 kB/s | 151 kB 00:00 2024-02-21T07:39:21.687 INFO:teuthology.orchestra.run.smithi174.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 812 kB/s | 68 kB 00:00 2024-02-21T07:39:22.013 INFO:teuthology.orchestra.run.smithi174.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 6.9 MB/s | 2.3 MB 00:00 2024-02-21T07:39:22.102 INFO:teuthology.orchestra.run.smithi069.stdout:(114/176): libarrow-9.0.0-10.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-02-21T07:39:22.144 INFO:teuthology.orchestra.run.smithi069.stdout:(115/176): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.0 MB/s | 838 kB 00:00 2024-02-21T07:39:22.203 INFO:teuthology.orchestra.run.smithi069.stdout:(116/176): python3-bcrypt-3.2.2-1.el9.x86_64.rp 437 kB/s | 43 kB 00:00 2024-02-21T07:39:22.213 INFO:teuthology.orchestra.run.smithi174.stdout:(153/176): NetworkManager-libnm-1.45.91-1.el9.x 9.0 MB/s | 1.8 MB 00:00 2024-02-21T07:39:22.253 INFO:teuthology.orchestra.run.smithi069.stdout:(117/176): python3-cachetools-4.2.4-1.el9.noarc 298 kB/s | 32 kB 00:00 2024-02-21T07:39:22.254 INFO:teuthology.orchestra.run.smithi174.stdout:(154/176): NetworkManager-team-1.45.91-1.el9.x8 994 kB/s | 41 kB 00:00 2024-02-21T07:39:22.295 INFO:teuthology.orchestra.run.smithi069.stdout:(118/176): python3-asyncssh-2.13.2-4.el9.noarch 821 kB/s | 548 kB 00:00 2024-02-21T07:39:22.320 INFO:teuthology.orchestra.run.smithi069.stdout:(119/176): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-02-21T07:39:22.321 INFO:teuthology.orchestra.run.smithi174.stdout:(155/176): NetworkManager-tui-1.45.91-1.el9.x86 3.6 MB/s | 246 kB 00:00 2024-02-21T07:39:22.372 INFO:teuthology.orchestra.run.smithi174.stdout:(156/176): acl-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 69 kB 00:00 2024-02-21T07:39:22.375 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-21T07:39:22.375 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-21T07:39:22.430 INFO:teuthology.orchestra.run.smithi174.stdout:(157/176): elfutils-debuginfod-client-0.190-2.e 607 kB/s | 35 kB 00:00 2024-02-21T07:39:22.445 INFO:teuthology.orchestra.run.smithi069.stdout:(120/176): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-02-21T07:39:22.470 INFO:teuthology.orchestra.run.smithi069.stdout:(121/176): python3-cheroot-8.6.0-4.el9.noarch.r 792 kB/s | 172 kB 00:00 2024-02-21T07:39:22.514 INFO:teuthology.orchestra.run.smithi174.stdout:(158/176): elfutils-libelf-0.190-2.el9.x86_64.r 2.2 MB/s | 191 kB 00:00 2024-02-21T07:39:22.579 INFO:teuthology.orchestra.run.smithi069.stdout:(122/176): python3-colorama-0.4.4-12.el9.noarch 265 kB/s | 35 kB 00:00 2024-02-21T07:39:22.598 INFO:teuthology.orchestra.run.smithi174.stdout:(159/176): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 254 kB 00:00 2024-02-21T07:39:22.724 INFO:teuthology.orchestra.run.smithi069.stdout:(123/176): python3-google-auth-2.27.0-1.el9.noa 802 kB/s | 203 kB 00:00 2024-02-21T07:39:22.731 INFO:teuthology.orchestra.run.smithi174.stdout:(160/176): iproute-6.7.0-2.el9.x86_64.rpm 5.9 MB/s | 802 kB 00:00 2024-02-21T07:39:22.755 INFO:teuthology.orchestra.run.smithi069.stdout:(124/176): python3-cherrypy-18.6.1-2.el9.noarch 781 kB/s | 358 kB 00:00 2024-02-21T07:39:22.815 INFO:teuthology.orchestra.run.smithi174.stdout:(161/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 5.1 MB/s | 433 kB 00:00 2024-02-21T07:39:22.838 INFO:teuthology.orchestra.run.smithi069.stdout:(125/176): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-02-21T07:39:22.857 INFO:teuthology.orchestra.run.smithi174.stdout:(162/176): libacl-2.3.1-4.el9.x86_64.rpm 524 kB/s | 22 kB 00:00 2024-02-21T07:39:22.863 INFO:teuthology.orchestra.run.smithi069.stdout:(126/176): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-02-21T07:39:22.908 INFO:teuthology.orchestra.run.smithi174.stdout:(163/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-02-21T07:39:22.955 INFO:teuthology.orchestra.run.smithi069.stdout:(127/176): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-02-21T07:39:22.966 INFO:teuthology.orchestra.run.smithi174.stdout:(164/176): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 154 kB 00:00 2024-02-21T07:39:22.980 INFO:teuthology.orchestra.run.smithi069.stdout:(128/176): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2024-02-21T07:39:23.041 INFO:teuthology.orchestra.run.smithi174.stdout:(165/176): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 135 kB 00:00 2024-02-21T07:39:23.092 INFO:teuthology.orchestra.run.smithi174.stdout:(166/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 63 kB 00:00 2024-02-21T07:39:23.097 INFO:teuthology.orchestra.run.smithi069.stdout:(129/176): python3-grpcio-1.46.7-10.el9.x86_64. 3.9 MB/s | 2.0 MB 00:00 2024-02-21T07:39:23.123 INFO:teuthology.orchestra.run.smithi069.stdout:(130/176): python3-jaraco-functools-3.5.0-2.el9 117 kB/s | 19 kB 00:00 2024-02-21T07:39:23.134 INFO:teuthology.orchestra.run.smithi174.stdout:(167/176): libuuid-2.37.4-18.el9.x86_64.rpm 663 kB/s | 28 kB 00:00 2024-02-21T07:39:23.148 INFO:teuthology.orchestra.run.smithi069.stdout:(131/176): python3-jaraco-text-3.2.0-6.el9.noar 118 kB/s | 20 kB 00:00 2024-02-21T07:39:23.265 INFO:teuthology.orchestra.run.smithi069.stdout:(132/176): python3-more-itertools-8.12.0-2.el9. 682 kB/s | 79 kB 00:00 2024-02-21T07:39:23.290 INFO:teuthology.orchestra.run.smithi069.stdout:(133/176): python3-logutils-0.3.5-21.el9.noarch 328 kB/s | 46 kB 00:00 2024-02-21T07:39:23.301 INFO:teuthology.orchestra.run.smithi174.stdout:(168/176): openssl-3.0.7-25.el9.x86_64.rpm 6.9 MB/s | 1.2 MB 00:00 2024-02-21T07:39:23.374 INFO:teuthology.orchestra.run.smithi069.stdout:(134/176): python3-natsort-7.1.1-5.el9.noarch.r 535 kB/s | 58 kB 00:00 2024-02-21T07:39:23.432 INFO:teuthology.orchestra.run.smithi069.stdout:(135/176): python3-kubernetes-26.1.0-2.el9.noar 3.1 MB/s | 1.0 MB 00:00 2024-02-21T07:39:23.459 INFO:teuthology.orchestra.run.smithi174.stdout:(169/176): librbd1-19.0.0-1514.g25296a8f.el9.x8 1.4 MB/s | 3.1 MB 00:02 2024-02-21T07:39:23.491 INFO:teuthology.orchestra.run.smithi069.stdout:(136/176): python3-portend-3.1.0-2.el9.noarch.r 141 kB/s | 16 kB 00:00 2024-02-21T07:39:23.550 INFO:teuthology.orchestra.run.smithi069.stdout:(137/176): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2024-02-21T07:39:23.575 INFO:teuthology.orchestra.run.smithi069.stdout:(138/176): python3-pyOpenSSL-21.0.0-1.el9.noarc 635 kB/s | 90 kB 00:00 2024-02-21T07:39:23.600 INFO:teuthology.orchestra.run.smithi069.stdout:(139/176): python3-pyperclip-1.8.2-2.el9.noarch 260 kB/s | 28 kB 00:00 2024-02-21T07:39:23.601 INFO:teuthology.orchestra.run.smithi174.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 7.2 MB/s | 2.1 MB 00:00 2024-02-21T07:39:23.667 INFO:teuthology.orchestra.run.smithi069.stdout:(140/176): python3-repoze-lru-0.7-16.el9.noarch 264 kB/s | 31 kB 00:00 2024-02-21T07:39:23.701 INFO:teuthology.orchestra.run.smithi069.stdout:(141/176): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-02-21T07:39:23.749 INFO:teuthology.orchestra.run.smithi069.stdout:(142/176): python3-rsa-4.9-2.el9.noarch.rpm 399 kB/s | 59 kB 00:00 2024-02-21T07:39:23.785 INFO:teuthology.orchestra.run.smithi069.stdout:(143/176): python3-tempora-5.0.0-2.el9.noarch.r 306 kB/s | 36 kB 00:00 2024-02-21T07:39:23.785 INFO:teuthology.orchestra.run.smithi174.stdout:(171/176): util-linux-2.37.4-18.el9.x86_64.rpm 6.7 MB/s | 2.2 MB 00:00 2024-02-21T07:39:23.810 INFO:teuthology.orchestra.run.smithi069.stdout:(144/176): python3-typing-extensions-4.4.0-2.el 471 kB/s | 51 kB 00:00 2024-02-21T07:39:23.810 INFO:teuthology.orchestra.run.smithi174.stdout:(172/176): util-linux-core-2.37.4-18.el9.x86_64 2.1 MB/s | 438 kB 00:00 2024-02-21T07:39:23.836 INFO:teuthology.orchestra.run.smithi174.stdout:(173/176): util-linux-user-2.37.4-18.el9.x86_64 609 kB/s | 30 kB 00:00 2024-02-21T07:39:23.886 INFO:teuthology.orchestra.run.smithi174.stdout:(174/176): xfsdump-3.1.12-4.el9.x86_64.rpm 4.2 MB/s | 321 kB 00:00 2024-02-21T07:39:23.901 INFO:teuthology.orchestra.run.smithi069.stdout:(145/176): python3-websocket-client-1.2.3-2.el9 772 kB/s | 90 kB 00:00 2024-02-21T07:39:23.944 INFO:teuthology.orchestra.run.smithi069.stdout:(146/176): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-02-21T07:39:23.977 INFO:teuthology.orchestra.run.smithi069.stdout:(147/176): python3-webob-1.8.7-6.el9.noarch.rpm 1.0 MB/s | 230 kB 00:00 2024-02-21T07:39:23.978 INFO:teuthology.orchestra.run.smithi174.stdout:(175/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.5 MB/s | 1.1 MB 00:00 2024-02-21T07:39:24.011 INFO:teuthology.orchestra.run.smithi069.stdout:(148/176): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-02-21T07:39:24.053 INFO:teuthology.orchestra.run.smithi069.stdout:(149/176): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-02-21T07:39:24.903 INFO:teuthology.orchestra.run.smithi069.stdout:(150/176): thrift-0.15.0-2.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2024-02-21T07:39:24.961 INFO:teuthology.orchestra.run.smithi069.stdout:(151/176): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 68 kB 00:00 2024-02-21T07:39:25.162 INFO:teuthology.orchestra.run.smithi069.stdout:(152/176): NetworkManager-1.45.91-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-02-21T07:39:25.320 INFO:teuthology.orchestra.run.smithi069.stdout:(153/176): NetworkManager-libnm-1.45.91-1.el9.x 11 MB/s | 1.8 MB 00:00 2024-02-21T07:39:25.371 INFO:teuthology.orchestra.run.smithi069.stdout:(154/176): NetworkManager-team-1.45.91-1.el9.x8 841 kB/s | 41 kB 00:00 2024-02-21T07:39:25.472 INFO:teuthology.orchestra.run.smithi069.stdout:(155/176): librados2-19.0.0-1514.g25296a8f.el9. 2.3 MB/s | 3.4 MB 00:01 2024-02-21T07:39:25.514 INFO:teuthology.orchestra.run.smithi069.stdout:(156/176): NetworkManager-tui-1.45.91-1.el9.x86 1.7 MB/s | 246 kB 00:00 2024-02-21T07:39:25.539 INFO:teuthology.orchestra.run.smithi069.stdout:(157/176): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 69 kB 00:00 2024-02-21T07:39:25.564 INFO:teuthology.orchestra.run.smithi069.stdout:(158/176): elfutils-debuginfod-client-0.190-2.e 724 kB/s | 35 kB 00:00 2024-02-21T07:39:25.598 INFO:teuthology.orchestra.run.smithi069.stdout:(159/176): elfutils-libelf-0.190-2.el9.x86_64.r 3.2 MB/s | 191 kB 00:00 2024-02-21T07:39:25.632 INFO:teuthology.orchestra.run.smithi069.stdout:(160/176): elfutils-libs-0.190-2.el9.x86_64.rpm 3.8 MB/s | 254 kB 00:00 2024-02-21T07:39:25.682 INFO:teuthology.orchestra.run.smithi069.stdout:(161/176): iproute-6.7.0-2.el9.x86_64.rpm 9.7 MB/s | 802 kB 00:00 2024-02-21T07:39:25.716 INFO:teuthology.orchestra.run.smithi069.stdout:(162/176): iproute-tc-6.7.0-2.el9.x86_64.rpm 5.4 MB/s | 433 kB 00:00 2024-02-21T07:39:25.742 INFO:teuthology.orchestra.run.smithi069.stdout:(163/176): libacl-2.3.1-4.el9.x86_64.rpm 405 kB/s | 22 kB 00:00 2024-02-21T07:39:25.766 INFO:teuthology.orchestra.run.smithi069.stdout:(164/176): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-02-21T07:39:25.817 INFO:teuthology.orchestra.run.smithi069.stdout:(165/176): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 154 kB 00:00 2024-02-21T07:39:25.842 INFO:teuthology.orchestra.run.smithi069.stdout:(166/176): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 135 kB 00:00 2024-02-21T07:39:25.867 INFO:teuthology.orchestra.run.smithi069.stdout:(167/176): libsmartcols-2.37.4-18.el9.x86_64.rp 1.3 MB/s | 63 kB 00:00 2024-02-21T07:39:25.893 INFO:teuthology.orchestra.run.smithi069.stdout:(168/176): libuuid-2.37.4-18.el9.x86_64.rpm 567 kB/s | 28 kB 00:00 2024-02-21T07:39:26.152 INFO:teuthology.orchestra.run.smithi069.stdout:(169/176): openssl-3.0.7-25.el9.x86_64.rpm 4.1 MB/s | 1.2 MB 00:00 2024-02-21T07:39:26.243 INFO:teuthology.orchestra.run.smithi069.stdout:(170/176): openssl-libs-3.0.7-25.el9.x86_64.rpm 6.2 MB/s | 2.1 MB 00:00 2024-02-21T07:39:26.327 INFO:teuthology.orchestra.run.smithi069.stdout:(171/176): librbd1-19.0.0-1514.g25296a8f.el9.x8 1.4 MB/s | 3.1 MB 00:02 2024-02-21T07:39:26.402 INFO:teuthology.orchestra.run.smithi069.stdout:(172/176): util-linux-2.37.4-18.el9.x86_64.rpm 9.4 MB/s | 2.2 MB 00:00 2024-02-21T07:39:26.435 INFO:teuthology.orchestra.run.smithi069.stdout:(173/176): util-linux-core-2.37.4-18.el9.x86_64 2.4 MB/s | 438 kB 00:00 2024-02-21T07:39:26.452 INFO:teuthology.orchestra.run.smithi069.stdout:(174/176): util-linux-user-2.37.4-18.el9.x86_64 266 kB/s | 30 kB 00:00 2024-02-21T07:39:26.519 INFO:teuthology.orchestra.run.smithi069.stdout:(175/176): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2024-02-21T07:39:26.578 INFO:teuthology.orchestra.run.smithi069.stdout:(176/176): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.5 MB/s | 1.1 MB 00:00 2024-02-21T07:39:26.586 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-02-21T07:39:26.586 INFO:teuthology.orchestra.run.smithi069.stdout:Total 7.4 MB/s | 223 MB 00:30 2024-02-21T07:39:26.716 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-02-21T07:39:27.091 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-02-21T07:39:27.091 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-02-21T07:39:29.391 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-02-21T07:39:29.391 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-02-21T07:39:29.629 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-21T07:39:29.741 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-21T07:39:29.767 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-21T07:39:29.798 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:39:29.824 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:39:29.868 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-21T07:39:29.906 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-21T07:39:29.960 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-21T07:39:29.993 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-21T07:39:30.011 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-21T07:39:30.053 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-21T07:39:30.369 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-21T07:39:30.420 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:39:30.525 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:39:30.555 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:39:30.645 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:39:30.675 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:39:30.824 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-21T07:39:30.872 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-21T07:39:30.900 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:39:31.002 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:39:31.026 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:39:31.090 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:39:31.138 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-21T07:39:31.169 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:39:31.187 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:39:31.361 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:39:31.392 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:39:31.415 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-21T07:39:31.510 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-21T07:39:31.597 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:39:31.644 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:39:31.703 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:39:31.762 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:39:31.964 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:39:32.066 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-21T07:39:32.161 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-21T07:39:32.192 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-21T07:39:32.277 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-21T07:39:32.331 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-21T07:39:32.361 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-21T07:39:32.397 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-21T07:39:32.437 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-21T07:39:32.486 INFO:teuthology.orchestra.run.smithi174.stdout:(176/176): ceph-test-19.0.0-1514.g25296a8f.el9. 1.9 MB/s | 47 MB 00:25 2024-02-21T07:39:32.491 INFO:teuthology.orchestra.run.smithi174.stdout:-------------------------------------------------------------------------------- 2024-02-21T07:39:32.491 INFO:teuthology.orchestra.run.smithi174.stdout:Total 6.8 MB/s | 223 MB 00:32 2024-02-21T07:39:32.502 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-21T07:39:32.539 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction check 2024-02-21T07:39:32.544 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-21T07:39:32.588 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-21T07:39:32.620 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-21T07:39:32.648 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-21T07:39:32.718 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-21T07:39:32.754 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 39/202 2024-02-21T07:39:32.796 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 40/202 2024-02-21T07:39:32.813 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction check succeeded. 2024-02-21T07:39:32.813 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction test 2024-02-21T07:39:32.826 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 41/202 2024-02-21T07:39:32.913 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-21T07:39:32.957 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-21T07:39:33.030 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-21T07:39:33.172 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-21T07:39:33.226 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-21T07:39:33.752 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-21T07:39:33.829 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-21T07:39:33.901 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-21T07:39:33.958 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:39:33.965 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:39:34.013 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-21T07:39:34.051 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 52/202 2024-02-21T07:39:34.082 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-21T07:39:34.178 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-21T07:39:34.233 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-21T07:39:34.464 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-21T07:39:34.466 INFO:teuthology.orchestra.run.smithi174.stdout:Transaction test succeeded. 2024-02-21T07:39:34.466 INFO:teuthology.orchestra.run.smithi174.stdout:Running transaction 2024-02-21T07:39:34.646 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-21T07:39:34.726 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-21T07:39:34.772 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-21T07:39:34.918 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-21T07:39:34.974 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-21T07:39:35.029 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-21T07:39:35.102 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-21T07:39:35.133 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-21T07:39:35.170 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-21T07:39:35.215 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-21T07:39:35.252 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-21T07:39:35.295 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-21T07:39:35.337 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-21T07:39:35.468 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-21T07:39:35.517 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-21T07:39:35.548 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-21T07:39:35.589 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-21T07:39:35.683 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-21T07:39:35.723 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-21T07:39:35.763 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-21T07:39:35.789 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-21T07:39:35.814 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-21T07:39:35.888 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-21T07:39:36.012 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-21T07:39:36.121 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-21T07:39:36.163 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-21T07:39:36.212 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-21T07:39:36.266 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-21T07:39:36.449 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-21T07:39:36.500 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-21T07:39:36.628 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-21T07:39:36.665 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-21T07:39:36.698 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-21T07:39:36.730 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-21T07:39:36.765 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-21T07:39:36.796 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-21T07:39:36.824 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-21T07:39:36.858 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-21T07:39:36.897 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-21T07:39:36.929 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-21T07:39:36.959 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-21T07:39:37.034 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-21T07:39:37.070 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-21T07:39:37.084 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-02-21T07:39:37.103 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-21T07:39:37.144 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-21T07:39:37.171 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-21T07:39:37.185 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-21T07:39:37.241 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-21T07:39:37.259 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-21T07:39:37.288 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:39:37.341 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-21T07:39:37.377 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:39:37.409 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-21T07:39:37.441 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-21T07:39:37.457 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-21T07:39:37.489 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-21T07:39:37.535 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-21T07:39:37.586 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-21T07:39:37.635 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-21T07:39:37.644 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-21T07:39:37.714 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-21T07:39:37.746 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-21T07:39:37.849 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-21T07:39:38.260 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-21T07:39:38.302 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:39:38.364 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-21T07:39:38.406 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-21T07:39:38.441 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-21T07:39:38.445 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:39:38.469 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:39:38.489 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-21T07:39:38.571 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:39:38.576 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-21T07:39:38.600 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:39:38.616 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-21T07:39:38.795 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-21T07:39:38.822 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-21T07:39:38.828 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-21T07:39:38.890 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-21T07:39:38.900 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-21T07:39:38.915 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:39:39.078 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:39:39.108 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:39:39.197 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:39:39.251 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-21T07:39:39.276 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:39:39.338 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:39:39.533 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-21T07:39:39.594 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:39:39.642 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:39:39.645 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-21T07:39:39.724 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-21T07:39:40.066 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-21T07:39:40.260 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:39:40.346 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:39:40.524 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:39:40.577 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:39:40.862 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-21T07:39:40.934 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-21T07:39:40.961 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-21T07:39:40.968 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:39:41.145 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-21T07:39:41.268 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-21T07:39:41.277 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-21T07:39:41.299 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:39:41.309 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-21T07:39:41.382 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:39:41.389 INFO:teuthology.orchestra.run.smithi174.stdout: Preparing : 1/1 2024-02-21T07:39:41.406 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-21T07:39:41.412 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 126/202 2024-02-21T07:39:41.448 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-21T07:39:41.472 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-21T07:39:41.505 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/202 2024-02-21T07:39:41.520 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-21T07:39:41.539 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/202 2024-02-21T07:39:41.570 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:39:41.601 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/202 2024-02-21T07:39:41.602 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-21T07:39:41.650 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 4/202 2024-02-21T07:39:41.663 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-21T07:39:41.688 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/202 2024-02-21T07:39:41.741 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/202 2024-02-21T07:39:41.774 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-21T07:39:41.775 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : thrift-0.15.0-2.el9.x86_64 7/202 2024-02-21T07:39:41.801 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/202 2024-02-21T07:39:41.823 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-21T07:39:41.843 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/202 2024-02-21T07:39:41.889 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-21T07:39:41.904 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-21T07:39:41.936 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-21T07:39:41.944 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:39:41.967 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-21T07:39:42.008 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:39:42.039 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 130/202 2024-02-21T07:39:42.064 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-21T07:39:42.103 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 39/202 2024-02-21T07:39:42.151 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 40/202 2024-02-21T07:39:42.158 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 10/202 2024-02-21T07:39:42.185 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 41/202 2024-02-21T07:39:42.218 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:39:42.296 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-21T07:39:42.339 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:39:42.370 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-21T07:39:42.377 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:39:42.468 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:39:42.495 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-21T07:39:42.506 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:39:42.665 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-21T07:39:42.671 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 14/202 2024-02-21T07:39:42.720 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/202 2024-02-21T07:39:42.724 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-21T07:39:42.748 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:39:42.834 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:39:42.857 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:39:42.904 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 17/202 2024-02-21T07:39:42.936 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/202 2024-02-21T07:39:42.959 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:39:42.973 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/202 2024-02-21T07:39:43.142 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:39:43.172 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/202 2024-02-21T07:39:43.204 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/202 2024-02-21T07:39:43.310 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/202 2024-02-21T07:39:43.406 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:39:43.417 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-21T07:39:43.450 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 23/202 2024-02-21T07:39:43.510 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:39:43.512 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-21T07:39:43.584 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:39:43.627 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-21T07:39:43.681 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:39:43.706 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:39:43.776 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-21T07:39:43.803 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 24/202 2024-02-21T07:39:43.827 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 52/202 2024-02-21T07:39:43.889 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-21T07:39:43.906 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/202 2024-02-21T07:39:44.005 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/202 2024-02-21T07:39:44.039 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/202 2024-02-21T07:39:44.074 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-21T07:39:44.110 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/202 2024-02-21T07:39:44.160 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-21T07:39:44.166 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 29/202 2024-02-21T07:39:44.222 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:39:44.258 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:39:44.328 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 30/202 2024-02-21T07:39:44.453 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 31/202 2024-02-21T07:39:44.553 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-21T07:39:44.594 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 32/202 2024-02-21T07:39:44.668 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/202 2024-02-21T07:39:44.717 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/202 2024-02-21T07:39:44.762 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-21T07:39:44.769 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/202 2024-02-21T07:39:44.799 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:39:44.801 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/202 2024-02-21T07:39:44.829 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/202 2024-02-21T07:39:44.837 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:39:44.889 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-21T07:39:44.901 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/202 2024-02-21T07:39:44.918 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:39:44.918 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T07:39:44.918 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T07:39:44.918 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:39:44.942 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 39/202 2024-02-21T07:39:44.947 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:39:44.954 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-21T07:39:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 40/202 2024-02-21T07:39:45.015 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 41/202 2024-02-21T07:39:45.087 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/202 2024-02-21T07:39:45.129 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/202 2024-02-21T07:39:45.149 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-21T07:39:45.206 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/202 2024-02-21T07:39:45.219 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-21T07:39:45.293 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-21T07:39:45.353 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/202 2024-02-21T07:39:45.389 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-21T07:39:45.408 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/202 2024-02-21T07:39:45.427 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-21T07:39:45.491 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-21T07:39:45.562 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-21T07:39:45.609 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-21T07:39:45.671 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-21T07:39:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-21T07:39:45.960 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/202 2024-02-21T07:39:45.962 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-21T07:39:46.014 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-21T07:39:46.037 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/202 2024-02-21T07:39:46.052 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-21T07:39:46.109 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-21T07:39:46.115 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/202 2024-02-21T07:39:46.163 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:39:46.170 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/202 2024-02-21T07:39:46.227 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/202 2024-02-21T07:39:46.265 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 52/202 2024-02-21T07:39:46.266 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-21T07:39:46.296 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 53/202 2024-02-21T07:39:46.308 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-21T07:39:46.355 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-21T07:39:46.392 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-21T07:39:46.406 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 54/202 2024-02-21T07:39:46.484 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-21T07:39:46.484 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : iproute-6.7.0-2.el9.x86_64 55/202 2024-02-21T07:39:46.624 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-21T07:39:46.716 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 56/202 2024-02-21T07:39:46.795 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-21T07:39:46.929 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 57/202 2024-02-21T07:39:46.950 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-21T07:39:47.001 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-21T07:39:47.004 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 58/202 2024-02-21T07:39:47.049 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 59/202 2024-02-21T07:39:47.063 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-21T07:39:47.138 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-21T07:39:47.195 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 60/202 2024-02-21T07:39:47.243 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 61/202 2024-02-21T07:39:47.299 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/202 2024-02-21T07:39:47.373 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 63/202 2024-02-21T07:39:47.404 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-21T07:39:47.410 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 64/202 2024-02-21T07:39:47.447 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 65/202 2024-02-21T07:39:47.489 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-21T07:39:47.494 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/202 2024-02-21T07:39:47.529 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/202 2024-02-21T07:39:47.581 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/202 2024-02-21T07:39:47.633 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/202 2024-02-21T07:39:47.675 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-21T07:39:47.727 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-21T07:39:47.769 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-21T07:39:47.771 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 70/202 2024-02-21T07:39:47.810 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-21T07:39:47.837 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 71/202 2024-02-21T07:39:47.867 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 72/202 2024-02-21T07:39:47.883 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-21T07:39:47.917 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 73/202 2024-02-21T07:39:47.920 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-21T07:39:47.963 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-21T07:39:48.016 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-21T07:39:48.024 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 74/202 2024-02-21T07:39:48.067 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 75/202 2024-02-21T07:39:48.093 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-21T07:39:48.107 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 76/202 2024-02-21T07:39:48.132 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 77/202 2024-02-21T07:39:48.147 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-21T07:39:48.157 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 78/202 2024-02-21T07:39:48.214 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-21T07:39:48.231 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 79/202 2024-02-21T07:39:48.356 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-21T07:39:48.360 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 80/202 2024-02-21T07:39:48.400 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-21T07:39:48.451 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-21T07:39:48.480 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 81/202 2024-02-21T07:39:48.524 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 82/202 2024-02-21T07:39:48.549 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-21T07:39:48.581 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-ply-3.11-14.el9.noarch 83/202 2024-02-21T07:39:48.599 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-21T07:39:48.637 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 84/202 2024-02-21T07:39:48.745 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-21T07:39:48.827 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 85/202 2024-02-21T07:39:48.864 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-21T07:39:48.877 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 86/202 2024-02-21T07:39:48.925 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-21T07:39:48.970 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-21T07:39:49.028 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/202 2024-02-21T07:39:49.035 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-21T07:39:49.075 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 88/202 2024-02-21T07:39:49.108 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 89/202 2024-02-21T07:39:49.139 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 90/202 2024-02-21T07:39:49.175 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : jq-1.6-16.el9.x86_64 91/202 2024-02-21T07:39:49.186 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-21T07:39:49.206 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : fuse-2.9.9-15.el9.x86_64 92/202 2024-02-21T07:39:49.234 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 93/202 2024-02-21T07:39:49.251 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-21T07:39:49.268 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/202 2024-02-21T07:39:49.307 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : uuid-1.6.2-55.el9.x86_64 95/202 2024-02-21T07:39:49.339 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 96/202 2024-02-21T07:39:49.377 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 97/202 2024-02-21T07:39:49.464 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 98/202 2024-02-21T07:39:49.504 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 99/202 2024-02-21T07:39:49.537 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 100/202 2024-02-21T07:39:49.580 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 101/202 2024-02-21T07:39:49.613 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 102/202 2024-02-21T07:39:49.706 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 103/202 2024-02-21T07:39:49.795 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/202 2024-02-21T07:39:49.836 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 105/202 2024-02-21T07:39:49.875 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 106/202 2024-02-21T07:39:49.924 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 107/202 2024-02-21T07:39:50.033 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-packaging-20.9-5.el9.noarch 108/202 2024-02-21T07:39:50.086 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 109/202 2024-02-21T07:39:50.202 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-21T07:39:50.259 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-21T07:39:50.293 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-21T07:39:50.358 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-21T07:39:50.479 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-21T07:39:50.549 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-21T07:39:50.789 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-21T07:39:50.824 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-21T07:39:50.858 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 110/202 2024-02-21T07:39:50.907 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 111/202 2024-02-21T07:39:50.916 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-21T07:39:50.941 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 112/202 2024-02-21T07:39:50.990 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 113/202 2024-02-21T07:39:51.079 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 114/202 2024-02-21T07:39:51.116 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 115/202 2024-02-21T07:39:51.293 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-0.3.21-2.el9.x86_64 116/202 2024-02-21T07:39:51.322 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 117/202 2024-02-21T07:39:51.400 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 118/202 2024-02-21T07:39:51.704 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-21T07:39:51.843 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-21T07:39:52.076 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 119/202 2024-02-21T07:39:52.182 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 120/202 2024-02-21T07:39:53.370 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-21T07:39:53.455 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-21T07:39:53.473 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 121/202 2024-02-21T07:39:53.490 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-21T07:39:53.567 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 122/202 2024-02-21T07:39:53.593 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 123/202 2024-02-21T07:39:53.846 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-21T07:39:53.876 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:39:53.903 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 124/202 2024-02-21T07:39:53.931 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:39:54.013 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:39:54.014 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 125/202 2024-02-21T07:39:54.045 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 126/202 2024-02-21T07:39:54.049 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 126/202 2024-02-21T07:39:54.081 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-21T07:39:54.104 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 127/202 2024-02-21T07:39:54.544 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-21T07:39:54.585 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:39:54.646 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 128/202 2024-02-21T07:39:54.655 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:39:54.678 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 130/202 2024-02-21T07:39:54.679 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:39:54.779 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 129/202 2024-02-21T07:39:54.806 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 130/202 2024-02-21T07:39:56.813 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:39:56.865 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:39:56.931 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:39:56.931 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2024-02-21T07:39:56.931 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2024-02-21T07:39:56.931 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2024-02-21T07:39:56.931 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2024-02-21T07:39:56.931 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2024-02-21T07:39:56.932 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /root 2024-02-21T07:39:56.932 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2024-02-21T07:39:56.932 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:39:57.094 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:39:57.110 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:39:57.110 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:39:57.110 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T07:39:57.110 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:39:57.367 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:39:57.402 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:39:57.411 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:39:57.444 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:39:57.524 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:39:57.525 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T07:39:57.525 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T07:39:57.525 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:39:57.553 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:39:58.027 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 131/202 2024-02-21T07:39:58.072 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:39:58.259 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 132/202 2024-02-21T07:39:58.259 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T07:39:58.259 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T07:39:58.260 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:39:58.332 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:39:58.572 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:39:58.598 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:39:58.598 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:39:58.598 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T07:39:58.598 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:39:58.598 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:39:58.599 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:39:58.806 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:39:58.828 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:39:58.829 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:39:58.829 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T07:39:58.829 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:39:58.829 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:39:58.829 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:39:59.257 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:39:59.279 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:39:59.280 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:39:59.280 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T07:39:59.280 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:39:59.280 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:39:59.280 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:39:59.375 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-21T07:39:59.760 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:39:59.790 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:39:59.821 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 140/202 2024-02-21T07:39:59.896 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 141/202 2024-02-21T07:39:59.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:40:00.153 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:40:00.189 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:40:01.154 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:40:01.181 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:40:01.283 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:40:01.443 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 145/202 2024-02-21T07:40:01.475 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:40:01.499 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:40:01.499 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:01.499 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T07:40:01.499 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:40:01.499 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:40:01.500 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:01.559 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:40:01.570 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:40:01.615 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 148/202 2024-02-21T07:40:02.463 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-21T07:40:02.502 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:40:02.525 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:40:02.526 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:02.526 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T07:40:02.526 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:40:02.526 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:40:02.526 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:02.569 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:40:02.592 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:40:02.592 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:02.592 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T07:40:02.592 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:02.649 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:40:02.667 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:40:02.667 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:02.668 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T07:40:02.668 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:40:02.668 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:40:02.668 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:02.971 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:40:02.993 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:40:02.994 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:02.994 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T07:40:02.994 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:40:02.994 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:40:02.994 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:07.392 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 154/202 2024-02-21T07:40:07.433 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 155/202 2024-02-21T07:40:07.463 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 156/202 2024-02-21T07:40:07.491 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-21T07:40:07.669 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 158/202 2024-02-21T07:40:07.789 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-21T07:40:07.830 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 160/202 2024-02-21T07:40:07.869 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-21T07:40:07.930 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-21T07:40:08.007 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-21T07:40:08.053 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-21T07:40:08.084 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-21T07:40:08.114 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 166/202 2024-02-21T07:40:08.144 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-21T07:40:08.215 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-21T07:40:08.265 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-21T07:40:08.309 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-21T07:40:08.871 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:40:08.907 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:40:08.927 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:40:09.099 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:40:09.100 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /sys 2024-02-21T07:40:09.100 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /proc 2024-02-21T07:40:09.100 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /mnt 2024-02-21T07:40:09.100 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /var/tmp 2024-02-21T07:40:09.100 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /home 2024-02-21T07:40:09.100 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /root 2024-02-21T07:40:09.100 INFO:teuthology.orchestra.run.smithi174.stdout:skipping the directory /tmp 2024-02-21T07:40:09.100 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:09.274 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:40:09.289 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:40:09.289 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:09.290 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T07:40:09.290 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:09.736 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 172/202 2024-02-21T07:40:09.803 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-21T07:40:09.842 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-21T07:40:09.922 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-21T07:40:09.964 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-21T07:40:09.989 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-21T07:40:10.014 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-21T07:40:10.040 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-21T07:40:10.040 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:40:10.117 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:40:10.144 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-21T07:40:10.183 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-21T07:40:10.183 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:40:10.251 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:40:10.277 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-21T07:40:10.311 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-21T07:40:10.336 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-21T07:40:10.363 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-21T07:40:10.404 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-21T07:40:10.436 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-21T07:40:10.476 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-21T07:40:10.509 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-21T07:40:10.534 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-21T07:40:10.559 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-21T07:40:10.576 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:40:10.601 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-21T07:40:10.608 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:40:10.608 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:40:10.777 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:40:10.802 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:40:10.802 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:10.802 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T07:40:10.802 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:40:10.802 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:40:10.802 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:10.804 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:40:10.804 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:40:10.896 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:40:10.920 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:40:10.944 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-21T07:40:10.971 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-21T07:40:10.997 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-21T07:40:11.011 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:40:11.035 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:40:11.035 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:11.036 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T07:40:11.036 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:40:11.036 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:40:11.036 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:11.060 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:40:11.479 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:40:11.500 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:40:11.500 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:11.501 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T07:40:11.501 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:40:11.501 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:40:11.501 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:11.556 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 133/202 2024-02-21T07:40:11.556 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2024-02-21T07:40:11.556 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2024-02-21T07:40:11.556 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2024-02-21T07:40:11.556 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2024-02-21T07:40:11.556 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2024-02-21T07:40:11.556 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /root 2024-02-21T07:40:11.556 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2024-02-21T07:40:11.556 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:11.597 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-21T07:40:11.782 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:40:11.833 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 134/202 2024-02-21T07:40:11.834 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:11.834 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T07:40:11.834 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:11.989 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:40:12.020 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:40:12.051 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 140/202 2024-02-21T07:40:12.113 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 141/202 2024-02-21T07:40:12.151 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:40:12.387 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:40:12.418 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:40:13.385 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:40:13.410 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:40:13.440 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:40:13.516 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:40:13.518 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 135/202 2024-02-21T07:40:13.518 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:13.518 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T07:40:13.518 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:40:13.518 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T07:40:13.518 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:13.672 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 145/202 2024-02-21T07:40:13.696 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:40:13.719 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:40:13.719 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:13.719 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T07:40:13.719 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:40:13.719 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:40:13.719 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:13.757 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:40:13.780 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:40:13.790 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:40:13.827 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 136/202 2024-02-21T07:40:13.827 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:13.827 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T07:40:13.828 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:40:13.828 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T07:40:13.828 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:13.836 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 148/202 2024-02-21T07:40:14.316 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:40:14.409 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 137/202 2024-02-21T07:40:14.409 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:14.409 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T07:40:14.409 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:40:14.409 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T07:40:14.409 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:14.518 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : automake-1.16.2-8.el9.noarch 138/202 2024-02-21T07:40:14.705 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-21T07:40:14.740 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:40:14.762 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:40:14.762 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:14.762 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T07:40:14.762 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:40:14.762 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:40:14.762 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:14.807 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:40:14.828 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:40:14.829 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:14.829 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T07:40:14.829 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:14.883 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:40:14.905 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:40:14.905 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:14.905 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T07:40:14.905 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:40:14.905 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:40:14.905 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:15.209 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:40:15.231 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:40:15.231 INFO:teuthology.orchestra.run.smithi174.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:15.231 INFO:teuthology.orchestra.run.smithi174.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T07:40:15.231 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:40:15.231 INFO:teuthology.orchestra.run.smithi174.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:40:15.231 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:15.247 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:40:15.318 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 139/202 2024-02-21T07:40:15.378 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 140/202 2024-02-21T07:40:15.481 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 141/202 2024-02-21T07:40:15.514 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:40:15.844 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 142/202 2024-02-21T07:40:15.882 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:40:15.975 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:40:15.975 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 1/202 2024-02-21T07:40:15.975 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2/202 2024-02-21T07:40:15.975 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 3/202 2024-02-21T07:40:15.975 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 4/202 2024-02-21T07:40:15.975 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1514.g25296 5/202 2024-02-21T07:40:15.975 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 6/202 2024-02-21T07:40:15.975 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 7/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 8/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 9/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 10/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 14/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 15/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 17/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 18/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 19/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 20/202 2024-02-21T07:40:15.976 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 21/202 2024-02-21T07:40:15.977 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 22/202 2024-02-21T07:40:15.977 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 23/202 2024-02-21T07:40:15.977 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 24/202 2024-02-21T07:40:15.977 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 25/202 2024-02-21T07:40:15.977 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 26/202 2024-02-21T07:40:15.977 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 27/202 2024-02-21T07:40:15.993 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 28/202 2024-02-21T07:40:15.993 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 29/202 2024-02-21T07:40:15.993 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 30/202 2024-02-21T07:40:15.993 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 31/202 2024-02-21T07:40:15.993 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 32/202 2024-02-21T07:40:15.993 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 33/202 2024-02-21T07:40:15.994 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 34/202 2024-02-21T07:40:15.994 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 35/202 2024-02-21T07:40:15.994 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 36/202 2024-02-21T07:40:15.994 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 37/202 2024-02-21T07:40:15.994 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 38/202 2024-02-21T07:40:15.994 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 39/202 2024-02-21T07:40:15.994 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-21T07:40:15.994 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-21T07:40:15.994 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-21T07:40:15.994 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-21T07:40:15.995 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-21T07:40:15.995 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-21T07:40:15.995 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-21T07:40:15.995 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-21T07:40:15.995 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-21T07:40:15.995 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-21T07:40:15.995 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-21T07:40:15.995 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-21T07:40:15.995 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-21T07:40:15.995 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-21T07:40:15.996 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-21T07:40:15.996 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-21T07:40:15.996 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-21T07:40:15.996 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-21T07:40:15.996 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-21T07:40:15.996 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-21T07:40:15.996 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-21T07:40:15.996 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-21T07:40:15.996 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-21T07:40:15.996 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-21T07:40:15.997 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-21T07:40:15.998 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-21T07:40:15.998 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-21T07:40:15.998 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-21T07:40:15.998 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-21T07:40:15.998 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-21T07:40:15.998 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-21T07:40:15.998 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-21T07:40:15.998 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-21T07:40:15.998 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-21T07:40:15.998 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-21T07:40:15.999 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-21T07:40:15.999 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-21T07:40:15.999 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-21T07:40:15.999 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-21T07:40:15.999 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-21T07:40:15.999 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-21T07:40:15.999 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-21T07:40:15.999 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-21T07:40:15.999 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-21T07:40:15.999 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-21T07:40:16.000 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-21T07:40:16.001 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-21T07:40:16.002 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-21T07:40:16.003 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 151/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-21T07:40:16.004 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-21T07:40:16.005 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-21T07:40:16.006 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-21T07:40:16.007 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-21T07:40:16.007 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-21T07:40:16.007 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:40:16.007 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-21T07:40:16.007 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-21T07:40:16.007 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-21T07:40:16.007 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:40:16.007 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-21T07:40:16.007 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-21T07:40:16.007 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-21T07:40:17.009 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 143/202 2024-02-21T07:40:17.041 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:40:17.184 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 144/202 2024-02-21T07:40:17.362 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 145/202 2024-02-21T07:40:17.393 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:40:17.462 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 146/202 2024-02-21T07:40:17.462 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:17.462 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T07:40:17.462 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:40:17.462 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T07:40:17.463 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:17.518 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:40:17.555 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 147/202 2024-02-21T07:40:17.615 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 148/202 2024-02-21T07:40:18.565 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libtool-2.4.6-45.el9.x86_64 149/202 2024-02-21T07:40:18.596 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:40:18.668 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 150/202 2024-02-21T07:40:18.668 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:18.668 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T07:40:18.668 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:40:18.668 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T07:40:18.668 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:18.721 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:40:18.792 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1514.g25296 151/202 2024-02-21T07:40:18.792 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:18.792 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T07:40:18.792 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:18.855 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:40:18.920 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T07:40:18.921 INFO:teuthology.orchestra.run.smithi184.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T07:40:18.922 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.923 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:18.924 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:18.925 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.925 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.925 INFO:teuthology.orchestra.run.smithi184.stdout: cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:18.925 INFO:teuthology.orchestra.run.smithi184.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T07:40:18.925 INFO:teuthology.orchestra.run.smithi184.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T07:40:18.925 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T07:40:18.925 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T07:40:18.925 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: jq-1.6-16.el9.x86_64 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T07:40:18.926 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T07:40:18.927 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T07:40:18.927 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T07:40:18.927 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T07:40:18.928 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T07:40:18.929 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T07:40:18.930 INFO:teuthology.orchestra.run.smithi184.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T07:40:18.930 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T07:40:18.930 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T07:40:18.930 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T07:40:18.930 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.930 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.930 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.930 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T07:40:18.930 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T07:40:18.930 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T07:40:18.931 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T07:40:18.931 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T07:40:18.931 INFO:teuthology.orchestra.run.smithi184.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T07:40:18.931 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T07:40:18.931 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T07:40:18.931 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T07:40:18.931 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T07:40:18.932 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T07:40:18.932 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T07:40:18.932 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T07:40:18.932 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T07:40:18.932 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T07:40:18.932 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T07:40:18.932 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T07:40:18.932 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T07:40:18.932 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T07:40:18.932 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T07:40:18.933 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T07:40:18.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T07:40:18.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T07:40:18.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T07:40:18.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T07:40:18.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T07:40:18.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T07:40:18.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T07:40:18.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T07:40:18.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T07:40:18.936 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T07:40:18.936 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T07:40:18.936 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T07:40:18.936 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T07:40:18.936 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T07:40:18.936 INFO:teuthology.orchestra.run.smithi184.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T07:40:18.936 INFO:teuthology.orchestra.run.smithi184.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T07:40:18.936 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.936 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.937 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:18.937 INFO:teuthology.orchestra.run.smithi184.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T07:40:18.937 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T07:40:18.937 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T07:40:18.937 INFO:teuthology.orchestra.run.smithi184.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T07:40:18.937 INFO:teuthology.orchestra.run.smithi184.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T07:40:18.937 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T07:40:18.938 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 152/202 2024-02-21T07:40:18.939 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:18.939 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T07:40:18.939 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:40:18.939 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T07:40:18.939 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:18.939 INFO:teuthology.orchestra.run.smithi184.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T07:40:18.940 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:18.940 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-21T07:40:19.281 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:40:19.346 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:40:19.346 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T07:40:19.346 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T07:40:19.346 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:40:19.347 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T07:40:19.347 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:19.520 DEBUG:teuthology.parallel:result is None 2024-02-21T07:40:19.654 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 154/202 2024-02-21T07:40:19.695 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 155/202 2024-02-21T07:40:19.726 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 156/202 2024-02-21T07:40:19.762 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-21T07:40:19.959 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 158/202 2024-02-21T07:40:20.094 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-21T07:40:20.143 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 160/202 2024-02-21T07:40:20.182 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-21T07:40:20.236 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-21T07:40:20.320 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-21T07:40:20.361 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-21T07:40:20.404 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-21T07:40:20.435 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 166/202 2024-02-21T07:40:20.465 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-21T07:40:20.530 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-21T07:40:20.583 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-21T07:40:20.621 INFO:teuthology.orchestra.run.smithi174.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-21T07:40:21.158 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:40:21.194 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:40:21.214 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:40:22.060 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 172/202 2024-02-21T07:40:22.130 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-21T07:40:22.172 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-21T07:40:22.255 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-21T07:40:22.292 INFO:teuthology.orchestra.run.smithi174.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-21T07:40:22.317 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-21T07:40:22.350 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-21T07:40:22.377 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-21T07:40:22.377 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:40:22.453 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:40:22.481 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-21T07:40:22.511 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-21T07:40:22.511 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:40:22.587 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:40:22.613 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-21T07:40:22.647 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-21T07:40:22.681 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-21T07:40:22.708 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-21T07:40:22.740 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-21T07:40:22.773 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-21T07:40:22.821 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-21T07:40:22.861 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-21T07:40:22.887 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-21T07:40:22.912 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-21T07:40:22.937 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:40:22.963 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-21T07:40:22.968 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:40:22.969 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:40:23.148 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:40:23.149 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:40:23.223 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:40:23.248 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:40:23.280 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-21T07:40:23.315 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-21T07:40:23.341 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-21T07:40:23.405 INFO:teuthology.orchestra.run.smithi174.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:40:24.120 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 154/202 2024-02-21T07:40:24.164 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 155/202 2024-02-21T07:40:24.201 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 156/202 2024-02-21T07:40:24.240 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/202 2024-02-21T07:40:24.515 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 158/202 2024-02-21T07:40:24.637 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/202 2024-02-21T07:40:24.693 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 160/202 2024-02-21T07:40:24.779 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 161/202 2024-02-21T07:40:24.852 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 162/202 2024-02-21T07:40:24.971 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 163/202 2024-02-21T07:40:25.012 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : iproute-tc-6.7.0-2.el9.x86_64 164/202 2024-02-21T07:40:25.067 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/202 2024-02-21T07:40:25.119 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 166/202 2024-02-21T07:40:25.181 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 167/202 2024-02-21T07:40:25.299 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 168/202 2024-02-21T07:40:25.358 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 169/202 2024-02-21T07:40:25.396 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 170/202 2024-02-21T07:40:26.432 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:40:26.477 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:40:26.538 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 171/202 2024-02-21T07:40:27.851 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 172/202 2024-02-21T07:40:27.931 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 173/202 2024-02-21T07:40:27.982 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 174/202 2024-02-21T07:40:28.107 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flex-2.6.4-9.el9.x86_64 175/202 2024-02-21T07:40:28.167 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : bison-3.7.4-5.el9.x86_64 176/202 2024-02-21T07:40:28.200 INFO:teuthology.orchestra.run.smithi174.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:40:28.200 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 1/202 2024-02-21T07:40:28.200 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2/202 2024-02-21T07:40:28.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 3/202 2024-02-21T07:40:28.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 4/202 2024-02-21T07:40:28.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1514.g25296 5/202 2024-02-21T07:40:28.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 6/202 2024-02-21T07:40:28.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 7/202 2024-02-21T07:40:28.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 8/202 2024-02-21T07:40:28.204 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 9/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 10/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 14/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 15/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 17/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 18/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 19/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 20/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 21/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 22/202 2024-02-21T07:40:28.205 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 23/202 2024-02-21T07:40:28.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 24/202 2024-02-21T07:40:28.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 25/202 2024-02-21T07:40:28.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 26/202 2024-02-21T07:40:28.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 27/202 2024-02-21T07:40:28.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 28/202 2024-02-21T07:40:28.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 29/202 2024-02-21T07:40:28.206 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 30/202 2024-02-21T07:40:28.207 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 177/202 2024-02-21T07:40:28.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 31/202 2024-02-21T07:40:28.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 32/202 2024-02-21T07:40:28.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 33/202 2024-02-21T07:40:28.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 34/202 2024-02-21T07:40:28.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 35/202 2024-02-21T07:40:28.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 36/202 2024-02-21T07:40:28.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 37/202 2024-02-21T07:40:28.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 38/202 2024-02-21T07:40:28.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 39/202 2024-02-21T07:40:28.222 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-21T07:40:28.223 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-21T07:40:28.224 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-21T07:40:28.225 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-21T07:40:28.226 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-21T07:40:28.227 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-21T07:40:28.228 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-21T07:40:28.229 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 151/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-21T07:40:28.230 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-21T07:40:28.231 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-21T07:40:28.232 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-21T07:40:28.233 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-21T07:40:28.234 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-21T07:40:28.235 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 178/202 2024-02-21T07:40:28.276 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 179/202 2024-02-21T07:40:28.277 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:40:28.393 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 180/202 2024-02-21T07:40:28.451 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 181/202 2024-02-21T07:40:28.497 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 182/202 2024-02-21T07:40:28.497 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:40:28.627 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 183/202 2024-02-21T07:40:28.679 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 184/202 2024-02-21T07:40:28.728 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 185/202 2024-02-21T07:40:28.767 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : iproute-tc-6.2.0-5.el9.x86_64 186/202 2024-02-21T07:40:28.852 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 187/202 2024-02-21T07:40:28.902 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : iproute-6.2.0-5.el9.x86_64 188/202 2024-02-21T07:40:28.985 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 189/202 2024-02-21T07:40:29.057 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 190/202 2024-02-21T07:40:29.106 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 191/202 2024-02-21T07:40:29.164 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 192/202 2024-02-21T07:40:29.207 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 193/202 2024-02-21T07:40:29.240 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:40:29.273 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 195/202 2024-02-21T07:40:29.311 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:40:29.311 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:40:29.648 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 196/202 2024-02-21T07:40:29.648 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:40:29.788 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 197/202 2024-02-21T07:40:29.851 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:40:29.906 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 199/202 2024-02-21T07:40:29.943 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 200/202 2024-02-21T07:40:29.987 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 201/202 2024-02-21T07:40:30.116 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:40:30.354 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openssl-libs-1:3.0.7-24.el9.x86_64 202/202 2024-02-21T07:40:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-21T07:40:30.354 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:31.198 INFO:teuthology.orchestra.run.smithi174.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-21T07:40:31.198 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:31.198 INFO:teuthology.orchestra.run.smithi174.stdout:Upgraded: 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-21T07:40:31.199 INFO:teuthology.orchestra.run.smithi174.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T07:40:31.200 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout:Installed: 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-immutable-object-cache-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.201 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:31.202 INFO:teuthology.orchestra.run.smithi174.stdout: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:31.203 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.203 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.203 INFO:teuthology.orchestra.run.smithi174.stdout: cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:31.203 INFO:teuthology.orchestra.run.smithi174.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T07:40:31.203 INFO:teuthology.orchestra.run.smithi174.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T07:40:31.203 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T07:40:31.203 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T07:40:31.203 INFO:teuthology.orchestra.run.smithi174.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T07:40:31.203 INFO:teuthology.orchestra.run.smithi174.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: jq-1.6-16.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T07:40:31.204 INFO:teuthology.orchestra.run.smithi174.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T07:40:31.205 INFO:teuthology.orchestra.run.smithi174.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T07:40:31.206 INFO:teuthology.orchestra.run.smithi174.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T07:40:31.207 INFO:teuthology.orchestra.run.smithi174.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T07:40:31.208 INFO:teuthology.orchestra.run.smithi174.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T07:40:31.209 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T07:40:31.210 INFO:teuthology.orchestra.run.smithi174.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.211 INFO:teuthology.orchestra.run.smithi174.stdout: rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:31.212 INFO:teuthology.orchestra.run.smithi174.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T07:40:31.212 INFO:teuthology.orchestra.run.smithi174.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T07:40:31.212 INFO:teuthology.orchestra.run.smithi174.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T07:40:31.212 INFO:teuthology.orchestra.run.smithi174.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T07:40:31.212 INFO:teuthology.orchestra.run.smithi174.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T07:40:31.212 INFO:teuthology.orchestra.run.smithi174.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T07:40:31.212 INFO:teuthology.orchestra.run.smithi174.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T07:40:31.213 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:31.213 INFO:teuthology.orchestra.run.smithi174.stdout:Complete! 2024-02-21T07:40:31.850 DEBUG:teuthology.parallel:result is None 2024-02-21T07:40:35.228 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 1/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 3/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 4/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1514.g25296 5/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 6/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 7/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 8/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 9/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 10/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 11/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 12/202 2024-02-21T07:40:35.229 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 13/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 14/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_ 15/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 16/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 17/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_6 18/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86 19/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 20/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el 21/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:19.0.0-1514.g25296a8f.el9. 22/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_6 23/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 24/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 25/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 26/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 27/202 2024-02-21T07:40:35.230 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 28/202 2024-02-21T07:40:35.231 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 29/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f. 30/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noa 31/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.n 32/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1514.g252 33/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el 34/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 35/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.e 36/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 37/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 38/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 39/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/202 2024-02-21T07:40:35.247 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 53/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/202 2024-02-21T07:40:35.248 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 64/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 65/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 67/202 2024-02-21T07:40:35.249 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 68/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 69/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 70/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 71/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 72/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 73/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 74/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 75/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 76/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 77/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/202 2024-02-21T07:40:35.250 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 84/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 85/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 86/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 87/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 88/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 89/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 90/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 91/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 92/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 93/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : jq-1.6-16.el9.x86_64 94/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 95/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 96/202 2024-02-21T07:40:35.251 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 97/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 98/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 99/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ply-3.11-14.el9.noarch 100/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 101/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 102/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 103/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 104/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/202 2024-02-21T07:40:35.252 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/202 2024-02-21T07:40:35.253 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/202 2024-02-21T07:40:35.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 151/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 153/202 2024-02-21T07:40:35.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 155/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 156/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 157/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 159/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 161/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 163/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/202 2024-02-21T07:40:35.256 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : iproute-6.7.0-2.el9.x86_64 173/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : iproute-6.2.0-5.el9.x86_64 174/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : iproute-tc-6.7.0-2.el9.x86_64 175/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : iproute-tc-6.2.0-5.el9.x86_64 176/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 177/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 178/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 179/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 180/202 2024-02-21T07:40:35.257 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 181/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 182/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 183/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 184/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 185/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 186/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 187/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 188/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 189/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 190/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 191/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 192/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 193/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 194/202 2024-02-21T07:40:35.258 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 195/202 2024-02-21T07:40:35.259 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 196/202 2024-02-21T07:40:35.259 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 197/202 2024-02-21T07:40:35.259 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 198/202 2024-02-21T07:40:35.259 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 199/202 2024-02-21T07:40:35.259 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 200/202 2024-02-21T07:40:35.259 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 201/202 2024-02-21T07:40:37.940 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 202/202 2024-02-21T07:40:37.940 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:37.940 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2024-02-21T07:40:37.940 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:37.940 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:37.940 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:37.940 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T07:40:37.940 INFO:teuthology.orchestra.run.smithi069.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T07:40:37.940 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T07:40:37.941 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T07:40:37.941 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T07:40:37.941 INFO:teuthology.orchestra.run.smithi069.stdout: iproute-6.7.0-2.el9.x86_64 2024-02-21T07:40:37.941 INFO:teuthology.orchestra.run.smithi069.stdout: iproute-tc-6.7.0-2.el9.x86_64 2024-02-21T07:40:37.941 INFO:teuthology.orchestra.run.smithi069.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T07:40:37.941 INFO:teuthology.orchestra.run.smithi069.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T07:40:37.941 INFO:teuthology.orchestra.run.smithi069.stdout: libblkid-2.37.4-18.el9.x86_64 2024-02-21T07:40:37.942 INFO:teuthology.orchestra.run.smithi069.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-02-21T07:40:37.942 INFO:teuthology.orchestra.run.smithi069.stdout: libmount-2.37.4-18.el9.x86_64 2024-02-21T07:40:37.942 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.942 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.942 INFO:teuthology.orchestra.run.smithi069.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-02-21T07:40:37.942 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-2.37.4-18.el9.x86_64 2024-02-21T07:40:37.942 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T07:40:37.942 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T07:40:37.942 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-2.37.4-18.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.943 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.944 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-shell-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top-2:19.0.0-1514.g25296a8f.el9.noarch 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T07:40:37.945 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: jq-1.6-16.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T07:40:37.946 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T07:40:37.947 INFO:teuthology.orchestra.run.smithi069.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T07:40:37.948 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T07:40:37.949 INFO:teuthology.orchestra.run.smithi069.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T07:40:37.949 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T07:40:37.949 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T07:40:37.949 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T07:40:37.949 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.949 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.949 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.949 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T07:40:37.949 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T07:40:37.949 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T07:40:37.950 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T07:40:37.951 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T07:40:37.952 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T07:40:37.953 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:19.0.0-1514.g25296a8f.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T07:40:37.954 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T07:40:37.955 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T07:40:37.955 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:37.955 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-02-21T07:40:38.660 DEBUG:teuthology.parallel:result is None 2024-02-21T07:40:38.661 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:40:38.803 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T07:40:38.858 INFO:teuthology.orchestra.run.smithi069.stdout:19.0.0-1514.g25296a8f.el9 2024-02-21T07:40:38.859 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1514.g25296a8f.el9 2024-02-21T07:40:38.859 INFO:teuthology.task.install:The correct ceph version 19.0.0-1514.g25296a8f is installed. 2024-02-21T07:40:38.861 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:40:39.008 DEBUG:teuthology.orchestra.run.smithi174:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T07:40:39.034 INFO:teuthology.orchestra.run.smithi174.stdout:19.0.0-1514.g25296a8f.el9 2024-02-21T07:40:39.035 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1514.g25296a8f.el9 2024-02-21T07:40:39.035 INFO:teuthology.task.install:The correct ceph version 19.0.0-1514.g25296a8f is installed. 2024-02-21T07:40:39.037 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=25296a8f176256aea5ed8b5850b25167dce0ae33 2024-02-21T07:40:39.337 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T07:40:39.363 INFO:teuthology.orchestra.run.smithi184.stdout:19.0.0-1514.g25296a8f.el9 2024-02-21T07:40:39.363 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1514.g25296a8f.el9 2024-02-21T07:40:39.363 INFO:teuthology.task.install:The correct ceph version 19.0.0-1514.g25296a8f is installed. 2024-02-21T07:40:39.365 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-21T07:40:39.365 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:39.365 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T07:40:39.444 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:40:39.444 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T07:40:39.479 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:40:39.480 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T07:40:39.514 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-21T07:40:39.514 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:39.514 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T07:40:39.586 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T07:40:39.697 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:40:39.697 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T07:40:39.729 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T07:40:39.800 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:40:39.800 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T07:40:39.827 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T07:40:39.894 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-21T07:40:39.894 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:39.895 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T07:40:39.971 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T07:40:40.082 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:40:40.083 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T07:40:40.114 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T07:40:40.185 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:40:40.185 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T07:40:40.212 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T07:40:40.280 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-21T07:40:40.280 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:40.280 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T07:40:40.361 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T07:40:40.479 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:40:40.479 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T07:40:40.510 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T07:40:40.581 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:40:40.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T07:40:40.608 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T07:40:40.673 INFO:teuthology.run_tasks:Running task ceph... 2024-02-21T07:40:40.759 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-21T07:40:40.759 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /var/log/ceph 2024-02-21T07:40:40.764 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 777 /var/log/ceph 2024-02-21T07:40:40.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /var/log/ceph 2024-02-21T07:40:40.838 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-21T07:40:40.838 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T07:40:40.842 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T07:40:40.844 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T07:40:40.908 INFO:tasks.ceph:Creating extra log directories... 2024-02-21T07:40:40.909 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T07:40:40.912 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T07:40:40.915 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T07:40:40.985 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-21T07:40:40.985 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-21T07:40:40.985 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-21T07:40:40.986 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:40.986 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T07:40:41.025 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T07:40:41.239 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T07:40:41.311 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:40:41.312 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T07:40:41.330 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T07:40:41.454 DEBUG:teuthology.orchestra.run.smithi174:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T07:40:41.484 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:40:41.484 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T07:40:41.499 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T07:40:41.623 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T07:40:41.658 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-21T07:40:41.658 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-21T07:40:41.658 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301', 'branch': 'wip-vshankar-testing-20240216.060239', 'description': 'fs:workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7569301', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1130e053228021b1be9cac260b5ed52c5a9027c5'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240216.060239'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'subvols': {'create': 2}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'mount_subvol_num': 0}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported', {'min': 3, 'name': 'mds_cache.dir_update'}, {'min': 3, 'name': 'mds_cache.dir_update_receipt'}, 'mds.dir_split']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}}, 'kclient': {'client.0': {'mount_subvol_num': 1}, 'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240216.060239', 'sha1': 'e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'seed': 9275, 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'sleep_before_teardown': 0, 'subset': '805/1024', 'suite': 'fs:workload', 'suite_branch': 'wip-vshankar-testing-20240216.060239', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': 'e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi069.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBHqD5EK2yCiwOjAZxCfdzCeP4fXnHVdzOm305i/XJOfBihHKusmYaV/m0rfq90k9SjzILGIZzwRHuWAMZzQxyY=', 'smithi174.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyl1QxUPZ2qST+PVV1yvkS7iRSEfafL4VLsc9yLcB6dsuwUMrAWlKY6pOfhPOkGdSD/h/UkclT3yuRPz72pnrs=', 'smithi184.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQUfEnugbQAcMUc0mD6LDCzK6L+jT7U5qrbfNZAmYYVekRdSqMWqEYZfytwXlcGkG0AGTfViiq3xaq5vCI3QxA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1130e053228021b1be9cac260b5ed52c5a9027c5'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '25296a8f176256aea5ed8b5850b25167dce0ae33', 'subvols': {'create': 2}, 'cluster': 'ceph'}}, {'kclient': None}, {'exec': {'mon.a': ['ceph fs set cephfs balance_automate false', 'ceph fs subvolumegroup pin cephfs qa random 0.10']}}, {'check-counter': {}}, {'fwd_scrub': {'scrub_timeout': 900, 'sleep_between_iterations': 1}}, {'background_exec': {'mon.a': ['while sleep 13; do ceph tell mds.cephfs:0 flush journal; done']}}, {'workunit': {'clients': {'all': ['kernel_untar_build.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-21_07:17:34', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-21T07:40:41.659 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T07:40:41.666 DEBUG:teuthology.orchestra.run.smithi174:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T07:40:41.669 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T07:40:41.706 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T07:40:41.750 DEBUG:teuthology.orchestra.run.smithi174:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T07:40:41.753 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T07:40:41.818 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:41.818 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T07:40:41.857 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T07:40:41.857 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2024-02-21T07:40:41.936 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T07:40:41.936 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:41.936 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-02-21T07:40:41.936 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:41.936 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:41.936 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-02-21 07:40:30.781102545 +0000 2024-02-21T07:40:41.936 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-02-21 07:37:56.737803580 +0000 2024-02-21T07:40:41.936 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-02-21 07:37:56.737803580 +0000 2024-02-21T07:40:41.937 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-02-21 07:37:56.737803580 +0000 2024-02-21T07:40:41.937 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T07:40:42.045 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-02-21T07:40:42.045 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-02-21T07:40:42.045 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000381679 s, 1.3 MB/s 2024-02-21T07:40:42.048 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T07:40:42.089 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2024-02-21T07:40:42.167 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T07:40:42.167 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:42.167 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-02-21T07:40:42.167 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:42.167 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:42.167 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-02-21 07:40:30.782102522 +0000 2024-02-21T07:40:42.167 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-02-21 07:37:57.298790644 +0000 2024-02-21T07:40:42.167 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-02-21 07:37:57.298790644 +0000 2024-02-21T07:40:42.167 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-02-21 07:37:57.298790644 +0000 2024-02-21T07:40:42.168 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T07:40:42.275 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-02-21T07:40:42.276 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-02-21T07:40:42.276 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000314752 s, 1.6 MB/s 2024-02-21T07:40:42.279 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T07:40:42.319 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2024-02-21T07:40:42.401 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T07:40:42.401 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:42.401 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-02-21T07:40:42.401 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:42.401 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:42.401 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-02-21 07:40:30.783102500 +0000 2024-02-21T07:40:42.401 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-02-21 07:37:57.865777570 +0000 2024-02-21T07:40:42.401 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-02-21 07:37:57.865777570 +0000 2024-02-21T07:40:42.401 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-02-21 07:37:57.865777570 +0000 2024-02-21T07:40:42.401 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T07:40:42.510 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-02-21T07:40:42.510 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-02-21T07:40:42.510 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000340914 s, 1.5 MB/s 2024-02-21T07:40:42.512 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T07:40:42.555 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2024-02-21T07:40:42.638 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T07:40:42.639 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:42.639 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-02-21T07:40:42.639 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:42.639 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:42.639 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-02-21 07:40:30.783102500 +0000 2024-02-21T07:40:42.639 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-02-21 07:37:58.425764658 +0000 2024-02-21T07:40:42.639 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-02-21 07:37:58.425764658 +0000 2024-02-21T07:40:42.639 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-02-21 07:37:58.425764658 +0000 2024-02-21T07:40:42.639 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T07:40:42.748 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-02-21T07:40:42.748 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-02-21T07:40:42.748 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.00030189 s, 1.7 MB/s 2024-02-21T07:40:42.751 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T07:40:42.791 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T07:40:42.791 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:40:42.791 DEBUG:teuthology.orchestra.run.smithi174:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T07:40:42.808 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T07:40:42.808 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_1 2024-02-21T07:40:42.864 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T07:40:42.865 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:42.865 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 657 Links: 1 2024-02-21T07:40:42.865 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:42.865 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:42.865 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-02-21 07:40:23.723319201 +0000 2024-02-21T07:40:42.865 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-02-21 07:36:51.884459941 +0000 2024-02-21T07:40:42.865 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-02-21 07:36:51.884459941 +0000 2024-02-21T07:40:42.865 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-02-21 07:36:51.884459941 +0000 2024-02-21T07:40:42.865 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T07:40:42.931 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-02-21T07:40:42.931 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-02-21T07:40:42.931 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000209776 s, 2.4 MB/s 2024-02-21T07:40:42.932 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T07:40:42.989 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_2 2024-02-21T07:40:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T07:40:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:43.046 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 676 Links: 1 2024-02-21T07:40:43.046 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:43.046 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:43.046 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-02-21 07:40:23.724319187 +0000 2024-02-21T07:40:43.046 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-02-21 07:36:52.227454857 +0000 2024-02-21T07:40:43.046 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-02-21 07:36:52.227454857 +0000 2024-02-21T07:40:43.046 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-02-21 07:36:52.227454857 +0000 2024-02-21T07:40:43.047 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T07:40:43.113 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-02-21T07:40:43.113 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-02-21T07:40:43.113 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000200673 s, 2.6 MB/s 2024-02-21T07:40:43.114 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T07:40:43.171 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_3 2024-02-21T07:40:43.226 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T07:40:43.227 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:43.227 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 693 Links: 1 2024-02-21T07:40:43.227 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:43.227 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:43.227 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-02-21 07:40:23.724319187 +0000 2024-02-21T07:40:43.227 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-02-21 07:36:52.571449759 +0000 2024-02-21T07:40:43.227 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-02-21 07:36:52.571449759 +0000 2024-02-21T07:40:43.227 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-02-21 07:36:52.571449759 +0000 2024-02-21T07:40:43.227 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T07:40:43.294 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-02-21T07:40:43.294 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-02-21T07:40:43.294 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.00017413 s, 2.9 MB/s 2024-02-21T07:40:43.295 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T07:40:43.352 DEBUG:teuthology.orchestra.run.smithi174:> stat /dev/vg_nvme/lv_4 2024-02-21T07:40:43.407 INFO:teuthology.orchestra.run.smithi174.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T07:40:43.407 INFO:teuthology.orchestra.run.smithi174.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:43.407 INFO:teuthology.orchestra.run.smithi174.stdout:Device: 5h/5d Inode: 714 Links: 1 2024-02-21T07:40:43.407 INFO:teuthology.orchestra.run.smithi174.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:43.407 INFO:teuthology.orchestra.run.smithi174.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:43.407 INFO:teuthology.orchestra.run.smithi174.stdout:Access: 2024-02-21 07:40:23.725319173 +0000 2024-02-21T07:40:43.407 INFO:teuthology.orchestra.run.smithi174.stdout:Modify: 2024-02-21 07:36:52.889445046 +0000 2024-02-21T07:40:43.407 INFO:teuthology.orchestra.run.smithi174.stdout:Change: 2024-02-21 07:36:52.889445046 +0000 2024-02-21T07:40:43.407 INFO:teuthology.orchestra.run.smithi174.stdout: Birth: 2024-02-21 07:36:52.889445046 +0000 2024-02-21T07:40:43.407 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T07:40:43.472 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records in 2024-02-21T07:40:43.472 INFO:teuthology.orchestra.run.smithi174.stderr:1+0 records out 2024-02-21T07:40:43.472 INFO:teuthology.orchestra.run.smithi174.stderr:512 bytes copied, 0.000187099 s, 2.7 MB/s 2024-02-21T07:40:43.473 DEBUG:teuthology.orchestra.run.smithi174:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T07:40:43.530 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T07:40:43.530 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:40:43.530 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T07:40:43.548 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T07:40:43.549 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-02-21T07:40:43.606 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T07:40:43.606 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:43.606 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-02-21T07:40:43.606 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:43.606 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:43.607 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-21 07:40:11.359610593 +0000 2024-02-21T07:40:43.607 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-21 07:37:10.435309489 +0000 2024-02-21T07:40:43.607 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-21 07:37:10.435309489 +0000 2024-02-21T07:40:43.607 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-21 07:37:10.435309489 +0000 2024-02-21T07:40:43.607 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T07:40:43.676 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-21T07:40:43.676 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-21T07:40:43.677 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000260299 s, 2.0 MB/s 2024-02-21T07:40:43.678 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T07:40:43.738 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-02-21T07:40:43.796 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T07:40:43.796 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:43.796 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-02-21T07:40:43.796 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:43.796 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:43.797 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-21 07:40:11.360610572 +0000 2024-02-21T07:40:43.797 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-21 07:37:10.770302253 +0000 2024-02-21T07:40:43.797 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-21 07:37:10.770302253 +0000 2024-02-21T07:40:43.797 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-21 07:37:10.770302253 +0000 2024-02-21T07:40:43.797 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T07:40:43.865 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-21T07:40:43.865 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-21T07:40:43.865 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000178328 s, 2.9 MB/s 2024-02-21T07:40:43.867 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T07:40:43.925 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-02-21T07:40:43.981 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T07:40:43.981 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:43.981 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-02-21T07:40:43.981 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:43.981 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:43.981 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-21 07:40:11.360610572 +0000 2024-02-21T07:40:43.981 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-21 07:37:11.113294845 +0000 2024-02-21T07:40:43.981 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-21 07:37:11.113294845 +0000 2024-02-21T07:40:43.981 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-21 07:37:11.113294845 +0000 2024-02-21T07:40:43.982 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T07:40:44.049 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-21T07:40:44.049 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-21T07:40:44.049 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000190557 s, 2.7 MB/s 2024-02-21T07:40:44.050 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T07:40:44.107 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-02-21T07:40:44.163 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T07:40:44.163 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T07:40:44.163 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-02-21T07:40:44.163 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:40:44.163 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T07:40:44.163 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-21 07:40:11.360610572 +0000 2024-02-21T07:40:44.163 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-21 07:37:11.445287674 +0000 2024-02-21T07:40:44.163 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-21 07:37:11.445287674 +0000 2024-02-21T07:40:44.163 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-21 07:37:11.445287674 +0000 2024-02-21T07:40:44.163 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T07:40:44.229 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-21T07:40:44.230 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-21T07:40:44.230 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000192579 s, 2.7 MB/s 2024-02-21T07:40:44.231 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T07:40:44.287 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T07:40:44.287 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2024-02-21T07:40:44.287 INFO:tasks.ceph:Generating config... 2024-02-21T07:40:44.289 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-21T07:40:44.289 INFO:tasks.ceph:[client] debug client = 20 2024-02-21T07:40:44.289 INFO:tasks.ceph:[client] debug ms = 1 2024-02-21T07:40:44.289 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-21T07:40:44.289 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-21T07:40:44.289 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-02-21T07:40:44.289 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-21T07:40:44.289 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-21T07:40:44.289 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-21T07:40:44.289 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-02-21T07:40:44.289 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-02-21T07:40:44.289 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mds] mds_bal_replicate_threshold = 1 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mds] mds_export_ephemeral_random_max = 0.1 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mgr] cephsqlite lock renewal timeout = 900000 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-21T07:40:44.290 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-21T07:40:44.291 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-21T07:40:44.291 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-21T07:40:44.291 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-02-21T07:40:44.292 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10 2024-02-21T07:40:44.292 INFO:tasks.ceph:Setting up mon.a... 2024-02-21T07:40:44.292 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-21T07:40:44.430 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.keyring 2024-02-21T07:40:44.439 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-21T07:40:44.559 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T07:40:44.654 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.69'), ('mon.b', '172.21.15.174'), ('mon.c', '172.21.15.184')] 2024-02-21T07:40:44.655 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.69,172.21.15.174,172.21.15.184', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'cephsqlite lock renewal timeout': 900000}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.d': {}, 'mds.g': {}, 'mds.j': {}, 'mds.b': {}, 'mds.e': {}, 'mds.h': {}, 'mds.k': {}, 'mds.c': {}, 'mds.f': {}, 'mds.i': {}, 'mds.l': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-21T07:40:44.656 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:44.656 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-21T07:40:44.708 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.69 --add b 172.21.15.174 --add c 172.21.15.184 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:40:44.859 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:40:44.859 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: generated fsid c8bdd735-83bd-400f-baca-e501b49b60ea 2024-02-21T07:40:44.859 INFO:teuthology.orchestra.run.smithi069.stdout:setting min_mon_release = quincy 2024-02-21T07:40:44.859 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 0 2024-02-21T07:40:44.859 INFO:teuthology.orchestra.run.smithi069.stdout:fsid c8bdd735-83bd-400f-baca-e501b49b60ea 2024-02-21T07:40:44.859 INFO:teuthology.orchestra.run.smithi069.stdout:last_changed 2024-02-21T07:40:44.854426+0000 2024-02-21T07:40:44.859 INFO:teuthology.orchestra.run.smithi069.stdout:created 2024-02-21T07:40:44.854426+0000 2024-02-21T07:40:44.859 INFO:teuthology.orchestra.run.smithi069.stdout:min_mon_release 17 (quincy) 2024-02-21T07:40:44.860 INFO:teuthology.orchestra.run.smithi069.stdout:election_strategy: 1 2024-02-21T07:40:44.860 INFO:teuthology.orchestra.run.smithi069.stdout:0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-02-21T07:40:44.860 INFO:teuthology.orchestra.run.smithi069.stdout:1: [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] mon.b 2024-02-21T07:40:44.860 INFO:teuthology.orchestra.run.smithi069.stdout:2: [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon.c 2024-02-21T07:40:44.860 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-21T07:40:44.862 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-21T07:40:44.912 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c8bdd735-83bd-400f-baca-e501b49b60ea... 2024-02-21T07:40:44.913 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T07:40:44.919 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T07:40:44.922 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T07:40:44.976 INFO:teuthology.orchestra.run.smithi174.stdout:[global] 2024-02-21T07:40:44.976 INFO:teuthology.orchestra.run.smithi174.stdout: chdir = "" 2024-02-21T07:40:44.976 INFO:teuthology.orchestra.run.smithi174.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: auth supported = cephx 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: filestore xattr use omap = true 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon clock drift allowed = 1.000 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: osd crush chooseleaf type = 0 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: auth debug = true 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on old message = true 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on bug = true 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: mon pg warn max object skew = 0 2024-02-21T07:40:44.977 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default size = 2 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow primary affinity = true 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd allow pg remap = true 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on legacy crush tunables = false 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on crush straw calc version zero = false 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on no sortbitwise = false 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on osd down out interval zero = false 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon warn on too few osds = false 2024-02-21T07:40:44.978 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T07:40:44.979 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T07:40:44.979 INFO:teuthology.orchestra.run.smithi174.stdout: mon_allow_pool_size_one = true 2024-02-21T07:40:44.979 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.979 INFO:teuthology.orchestra.run.smithi174.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T07:40:44.979 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.979 INFO:teuthology.orchestra.run.smithi174.stdout: osd default data pool replay window = 5 2024-02-21T07:40:44.979 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.979 INFO:teuthology.orchestra.run.smithi174.stdout: mon allow pool delete = true 2024-02-21T07:40:44.979 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.980 INFO:teuthology.orchestra.run.smithi174.stdout: mon cluster log file level = debug 2024-02-21T07:40:44.980 INFO:teuthology.orchestra.run.smithi174.stdout: debug asserts on shutdown = true 2024-02-21T07:40:44.980 INFO:teuthology.orchestra.run.smithi174.stdout: mon health detail to clog = false 2024-02-21T07:40:44.980 INFO:teuthology.orchestra.run.smithi174.stdout: mon host = "172.21.15.69,172.21.15.174,172.21.15.184" 2024-02-21T07:40:44.980 INFO:teuthology.orchestra.run.smithi174.stdout: ms die on skipped message = False 2024-02-21T07:40:44.980 INFO:teuthology.orchestra.run.smithi174.stdout: fsid = c8bdd735-83bd-400f-baca-e501b49b60ea 2024-02-21T07:40:44.980 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.981 INFO:teuthology.orchestra.run.smithi174.stdout:[osd] 2024-02-21T07:40:44.981 INFO:teuthology.orchestra.run.smithi174.stdout: osd journal size = 100 2024-02-21T07:40:44.981 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.981 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub load threshold = 5.0 2024-02-21T07:40:44.981 INFO:teuthology.orchestra.run.smithi174.stdout: osd scrub max interval = 600 2024-02-21T07:40:44.981 INFO:teuthology.orchestra.run.smithi174.stdout: osd mclock profile = high_recovery_ops 2024-02-21T07:40:44.981 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.981 INFO:teuthology.orchestra.run.smithi174.stdout: osd recover clone overlap = true 2024-02-21T07:40:44.981 INFO:teuthology.orchestra.run.smithi174.stdout: osd recovery max chunk = 1048576 2024-02-21T07:40:44.982 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.982 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug shutdown = true 2024-02-21T07:40:44.982 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug op order = true 2024-02-21T07:40:44.982 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug verify stray on activate = true 2024-02-21T07:40:44.982 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug trim objects = true 2024-02-21T07:40:44.982 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.982 INFO:teuthology.orchestra.run.smithi174.stdout: osd open classes on start = true 2024-02-21T07:40:44.982 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug pg log writeout = true 2024-02-21T07:40:44.983 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.983 INFO:teuthology.orchestra.run.smithi174.stdout: osd deep scrub update digest min age = 30 2024-02-21T07:40:44.983 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.983 INFO:teuthology.orchestra.run.smithi174.stdout: osd map max advance = 10 2024-02-21T07:40:44.983 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.983 INFO:teuthology.orchestra.run.smithi174.stdout: journal zero on create = true 2024-02-21T07:40:44.983 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.983 INFO:teuthology.orchestra.run.smithi174.stdout: filestore ondisk finisher threads = 3 2024-02-21T07:40:44.983 INFO:teuthology.orchestra.run.smithi174.stdout: filestore apply finisher threads = 3 2024-02-21T07:40:44.984 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.984 INFO:teuthology.orchestra.run.smithi174.stdout: bdev debug aio = true 2024-02-21T07:40:44.984 INFO:teuthology.orchestra.run.smithi174.stdout: osd debug misdirected ops = true 2024-02-21T07:40:44.984 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore block size = 96636764160 2024-02-21T07:40:44.984 INFO:teuthology.orchestra.run.smithi174.stdout: bluestore fsck on mount = True 2024-02-21T07:40:44.984 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluefs = 20 2024-02-21T07:40:44.984 INFO:teuthology.orchestra.run.smithi174.stdout: debug bluestore = 20 2024-02-21T07:40:44.984 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-02-21T07:40:44.984 INFO:teuthology.orchestra.run.smithi174.stdout: debug osd = 20 2024-02-21T07:40:44.985 INFO:teuthology.orchestra.run.smithi174.stdout: debug rocksdb = 10 2024-02-21T07:40:44.985 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T07:40:44.985 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd full ratio = 0.9 2024-02-21T07:40:44.985 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd nearfull ratio = 0.8 2024-02-21T07:40:44.985 INFO:teuthology.orchestra.run.smithi174.stdout: osd failsafe full ratio = 0.95 2024-02-21T07:40:44.985 INFO:teuthology.orchestra.run.smithi174.stdout: osd objectstore = bluestore 2024-02-21T07:40:44.985 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-02-21T07:40:44.985 INFO:teuthology.orchestra.run.smithi174.stdout: osd shutdown pgref assert = True 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: osd_max_omap_entries_per_request = 10 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr] 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: debug mgr = 20 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: mgr/telemetry/nag = false 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: cephsqlite lock renewal timeout = 900000 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.986 INFO:teuthology.orchestra.run.smithi174.stdout:[mon] 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: debug mon = 20 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: debug paxos = 20 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: debug auth = 20 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: mon data avail warn = 5 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: mon mgr mkfs grace = 240 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd reporter subtree level = osd 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: mon osd prime pg temp = true 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.987 INFO:teuthology.orchestra.run.smithi174.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: # 1m isn't quite enough 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: mon_down_mkfs_grace = 2m 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: mon_warn_on_filestore_osds = false 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: mon op complaint time = 120 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout:[client] 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: rgw cache enabled = true 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable ops log = true 2024-02-21T07:40:44.988 INFO:teuthology.orchestra.run.smithi174.stdout: rgw enable usage log = true 2024-02-21T07:40:44.989 INFO:teuthology.orchestra.run.smithi174.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T07:40:44.989 INFO:teuthology.orchestra.run.smithi174.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T07:40:44.989 INFO:teuthology.orchestra.run.smithi174.stdout: client mount timeout = 600 2024-02-21T07:40:44.989 INFO:teuthology.orchestra.run.smithi174.stdout: debug client = 20 2024-02-21T07:40:44.989 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-02-21T07:40:44.989 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-02-21T07:40:44.989 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-02-21T07:40:44.989 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.a] 2024-02-21T07:40:44.989 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.b] 2024-02-21T07:40:44.989 INFO:teuthology.orchestra.run.smithi174.stdout:[mon.c] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.g] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.j] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.e] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.h] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.k] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.f] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.i] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.l] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout:[mds] 2024-02-21T07:40:44.990 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds = 20 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: debug mds balancer = 20 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: debug ms = 1 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal fragment size max = 10000 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal merge size = 5 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal split bits = 3 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: mds bal split size = 100 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug frag = True 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: mds debug scatterstat = True 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: mds op complaint time = 180 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: mds verify scatter = True 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: mds_bal_replicate_threshold = 1 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: mds_export_ephemeral_random_max = 0.1 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: osd op complaint time = 180 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: rados mon op timeout = 900 2024-02-21T07:40:44.991 INFO:teuthology.orchestra.run.smithi174.stdout: rados osd op timeout = 900 2024-02-21T07:40:44.992 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2024-02-21T07:40:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: chdir = "" 2024-02-21T07:40:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T07:40:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: auth supported = cephx 2024-02-21T07:40:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: filestore xattr use omap = true 2024-02-21T07:40:44.992 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon clock drift allowed = 1.000 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: osd crush chooseleaf type = 0 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: auth debug = true 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on old message = true 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on bug = true 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: mon pg warn max object skew = 0 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.993 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default size = 2 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow primary affinity = true 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd allow pg remap = true 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on legacy crush tunables = false 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on crush straw calc version zero = false 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on no sortbitwise = false 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on osd down out interval zero = false 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon warn on too few osds = false 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: mon_allow_pool_size_one = true 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: osd default data pool replay window = 5 2024-02-21T07:40:44.994 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: mon allow pool delete = true 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: mon cluster log file level = debug 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: debug asserts on shutdown = true 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: mon health detail to clog = false 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: mon host = "172.21.15.69,172.21.15.174,172.21.15.184" 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: ms die on skipped message = False 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = c8bdd735-83bd-400f-baca-e501b49b60ea 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout:[osd] 2024-02-21T07:40:44.995 INFO:teuthology.orchestra.run.smithi184.stdout: osd journal size = 100 2024-02-21T07:40:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub load threshold = 5.0 2024-02-21T07:40:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: osd scrub max interval = 600 2024-02-21T07:40:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: osd mclock profile = high_recovery_ops 2024-02-21T07:40:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: osd recover clone overlap = true 2024-02-21T07:40:44.996 INFO:teuthology.orchestra.run.smithi184.stdout: osd recovery max chunk = 1048576 2024-02-21T07:40:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug shutdown = true 2024-02-21T07:40:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug op order = true 2024-02-21T07:40:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug verify stray on activate = true 2024-02-21T07:40:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug trim objects = true 2024-02-21T07:40:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.997 INFO:teuthology.orchestra.run.smithi184.stdout: osd open classes on start = true 2024-02-21T07:40:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug pg log writeout = true 2024-02-21T07:40:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: osd deep scrub update digest min age = 30 2024-02-21T07:40:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: osd map max advance = 10 2024-02-21T07:40:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.998 INFO:teuthology.orchestra.run.smithi184.stdout: journal zero on create = true 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: filestore ondisk finisher threads = 3 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: filestore apply finisher threads = 3 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: bdev debug aio = true 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: osd debug misdirected ops = true 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore block size = 96636764160 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: bluestore fsck on mount = True 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluefs = 20 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: debug bluestore = 20 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: debug osd = 20 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: debug rocksdb = 10 2024-02-21T07:40:44.999 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T07:40:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd full ratio = 0.9 2024-02-21T07:40:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd nearfull ratio = 0.8 2024-02-21T07:40:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: osd failsafe full ratio = 0.95 2024-02-21T07:40:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: osd objectstore = bluestore 2024-02-21T07:40:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2024-02-21T07:40:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: osd shutdown pgref assert = True 2024-02-21T07:40:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: osd_max_omap_entries_per_request = 10 2024-02-21T07:40:45.000 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:45.000 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr] 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: debug mgr = 20 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: mgr/telemetry/nag = false 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: cephsqlite lock renewal timeout = 900000 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout:[mon] 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: debug mon = 20 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: debug paxos = 20 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: debug auth = 20 2024-02-21T07:40:45.001 INFO:teuthology.orchestra.run.smithi184.stdout: mon data avail warn = 5 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: mon mgr mkfs grace = 240 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd reporter subtree level = osd 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: mon osd prime pg temp = true 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:45.002 INFO:teuthology.orchestra.run.smithi184.stdout: # 1m isn't quite enough 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: mon_down_mkfs_grace = 2m 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: mon_warn_on_filestore_osds = false 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: mon op complaint time = 120 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout:[client] 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: rgw cache enabled = true 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable ops log = true 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: rgw enable usage log = true 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: client mount timeout = 600 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: debug client = 20 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2024-02-21T07:40:45.003 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.a] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.b] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mon.c] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.g] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.j] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.e] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.h] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.k] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.f] 2024-02-21T07:40:45.004 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.i] 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.l] 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout:[mds] 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds = 20 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: debug mds balancer = 20 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: debug ms = 1 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: mds bal fragment size max = 10000 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: mds bal merge size = 5 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: mds bal split bits = 3 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: mds bal split size = 100 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug frag = True 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: mds debug scatterstat = True 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: mds op complaint time = 180 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: mds verify scatter = True 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: mds_bal_replicate_threshold = 1 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: mds_export_ephemeral_random_max = 0.1 2024-02-21T07:40:45.005 INFO:teuthology.orchestra.run.smithi184.stdout: osd op complaint time = 180 2024-02-21T07:40:45.006 INFO:teuthology.orchestra.run.smithi184.stdout: rados mon op timeout = 900 2024-02-21T07:40:45.006 INFO:teuthology.orchestra.run.smithi184.stdout: rados osd op timeout = 900 2024-02-21T07:40:45.078 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2024-02-21T07:40:45.078 INFO:teuthology.orchestra.run.smithi069.stdout: chdir = "" 2024-02-21T07:40:45.078 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: auth supported = cephx 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: filestore xattr use omap = true 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: mon clock drift allowed = 1.000 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: osd crush chooseleaf type = 0 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: auth debug = true 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on old message = true 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on bug = true 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T07:40:45.079 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn max object skew = 0 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default size = 2 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow primary affinity = true 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow pg remap = true 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on legacy crush tunables = false 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on crush straw calc version zero = false 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on no sortbitwise = false 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on osd down out interval zero = false 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on too few osds = false 2024-02-21T07:40:45.080 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: mon_allow_pool_size_one = true 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: osd default data pool replay window = 5 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: mon allow pool delete = true 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: mon cluster log file level = debug 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: debug asserts on shutdown = true 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: mon health detail to clog = false 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: mon host = "172.21.15.69,172.21.15.174,172.21.15.184" 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on skipped message = False 2024-02-21T07:40:45.081 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = c8bdd735-83bd-400f-baca-e501b49b60ea 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout:[osd] 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: osd journal size = 100 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub load threshold = 5.0 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub max interval = 600 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: osd mclock profile = high_recovery_ops 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: osd recover clone overlap = true 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: osd recovery max chunk = 1048576 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug shutdown = true 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug op order = true 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug verify stray on activate = true 2024-02-21T07:40:45.082 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug trim objects = true 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: osd open classes on start = true 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug pg log writeout = true 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: osd deep scrub update digest min age = 30 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: osd map max advance = 10 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: journal zero on create = true 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: filestore ondisk finisher threads = 3 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: filestore apply finisher threads = 3 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: bdev debug aio = true 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug misdirected ops = true 2024-02-21T07:40:45.083 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore block size = 96636764160 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore fsck on mount = True 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluefs = 20 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluestore = 20 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: debug osd = 20 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: debug rocksdb = 10 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd full ratio = 0.9 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd nearfull ratio = 0.8 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: osd failsafe full ratio = 0.95 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: osd objectstore = bluestore 2024-02-21T07:40:45.084 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout: osd shutdown pgref assert = True 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout: osd_max_omap_entries_per_request = 10 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr] 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout: debug mgr = 20 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:40:45.085 INFO:teuthology.orchestra.run.smithi069.stdout: mgr/telemetry/nag = false 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: cephsqlite lock renewal timeout = 900000 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout:[mon] 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: debug paxos = 20 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: mon data avail warn = 5 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: mon mgr mkfs grace = 240 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd reporter subtree level = osd 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd prime pg temp = true 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2024-02-21T07:40:45.086 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: # 1m isn't quite enough 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: mon_down_mkfs_grace = 2m 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_filestore_osds = false 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: mon op complaint time = 120 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout:[client] 2024-02-21T07:40:45.087 INFO:teuthology.orchestra.run.smithi069.stdout: rgw cache enabled = true 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable ops log = true 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable usage log = true 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout: client mount timeout = 600 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout: debug client = 20 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.a] 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.b] 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.c] 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2024-02-21T07:40:45.088 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.g] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.j] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.e] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.h] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.k] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.f] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.i] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.l] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout:[mds] 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds = 20 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds balancer = 20 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2024-02-21T07:40:45.089 INFO:teuthology.orchestra.run.smithi069.stdout: mds bal fragment size max = 10000 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: mds bal merge size = 5 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: mds bal split bits = 3 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: mds bal split size = 100 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug frag = True 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug scatterstat = True 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: mds op complaint time = 180 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: mds verify scatter = True 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: mds_bal_replicate_threshold = 1 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: mds_export_ephemeral_random_max = 0.1 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2024-02-21T07:40:45.090 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2024-02-21T07:40:45.122 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-21T07:40:45.123 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-21T07:40:45.267 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-21T07:40:45.268 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:45.268 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-21T07:40:45.318 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:45.319 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-21T07:40:45.365 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:40:45.366 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:45.366 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T07:40:45.366 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T07:40:45.549 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:40:45.549 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:40:45.647 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:40:45.647 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:40:45.647 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T07:40:45.647 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T07:40:45.692 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:40:45.692 DEBUG:teuthology.orchestra.run.smithi174:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:40:45.748 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:40:45.748 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:40:45.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T07:40:45.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T07:40:45.793 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:40:45.793 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:40:45.850 INFO:tasks.ceph:Setting up mon nodes... 2024-02-21T07:40:45.850 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-21T07:40:45.850 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-21T07:40:46.027 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-21T07:40:46.038 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-21T07:40:46.130 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-21T07:40:46.133 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2024-02-21T07:40:46.207 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2024-02-21T07:40:46.210 INFO:tasks.ceph:Setting up mds nodes... 2024-02-21T07:40:46.210 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-21T07:40:46.378 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-21T07:40:46.387 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-21T07:40:46.477 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-02-21T07:40:46.649 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-02-21T07:40:46.658 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-02-21T07:40:46.753 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-g && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.g /var/lib/ceph/mds/ceph-g/keyring 2024-02-21T07:40:46.934 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-g/keyring 2024-02-21T07:40:46.944 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-g 2024-02-21T07:40:47.033 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-j && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.j /var/lib/ceph/mds/ceph-j/keyring 2024-02-21T07:40:47.194 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-j/keyring 2024-02-21T07:40:47.202 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-j 2024-02-21T07:40:47.297 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-21T07:40:47.359 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-21T07:40:47.362 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-21T07:40:47.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-02-21T07:40:47.495 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-02-21T07:40:47.497 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-02-21T07:40:47.525 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-h && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.h /var/lib/ceph/mds/ceph-h/keyring 2024-02-21T07:40:47.621 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-h/keyring 2024-02-21T07:40:47.623 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-h 2024-02-21T07:40:47.650 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mds/ceph-k && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.k /var/lib/ceph/mds/ceph-k/keyring 2024-02-21T07:40:47.745 INFO:teuthology.orchestra.run.smithi174.stdout:creating /var/lib/ceph/mds/ceph-k/keyring 2024-02-21T07:40:47.748 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-k 2024-02-21T07:40:47.774 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-21T07:40:47.836 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-21T07:40:47.839 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-21T07:40:47.867 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-02-21T07:40:47.963 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-02-21T07:40:47.965 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-02-21T07:40:47.991 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-i && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.i /var/lib/ceph/mds/ceph-i/keyring 2024-02-21T07:40:48.086 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-i/keyring 2024-02-21T07:40:48.088 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-i 2024-02-21T07:40:48.114 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mds/ceph-l && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.l /var/lib/ceph/mds/ceph-l/keyring 2024-02-21T07:40:48.208 INFO:teuthology.orchestra.run.smithi184.stdout:creating /var/lib/ceph/mds/ceph-l/keyring 2024-02-21T07:40:48.212 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-l 2024-02-21T07:40:48.239 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-21T07:40:48.239 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-21T07:40:48.368 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-21T07:40:48.418 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-21T07:40:48.418 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi174.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi184.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2024-02-21T07:40:48.419 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-21T07:40:48.503 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T07:40:48.503 INFO:tasks.ceph:role: osd.0 2024-02-21T07:40:48.503 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:40:48.503 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T07:40:48.601 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:40:48.601 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:40:48.601 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:40:48.601 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:40:48.601 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:40:48.601 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:40:48.601 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:40:48.601 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:40:48.601 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:40:48.601 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:40:49.105 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2024-02-21T07:40:49.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2024-02-21T07:40:49.111 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-21T07:40:49.292 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-21T07:40:49.397 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-21T07:40:49.481 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T07:40:49.482 INFO:tasks.ceph:role: osd.3 2024-02-21T07:40:49.482 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:40:49.482 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T07:40:49.570 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:40:49.570 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:40:49.571 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:40:49.571 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:40:49.571 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:40:49.571 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:40:49.571 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:40:49.571 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:40:49.571 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:40:49.571 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:40:50.048 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2024-02-21T07:40:50.055 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2024-02-21T07:40:50.055 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-02-21T07:40:50.178 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-21T07:40:50.265 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-21T07:40:50.350 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T07:40:50.350 INFO:tasks.ceph:role: osd.6 2024-02-21T07:40:50.350 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:40:50.350 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T07:40:50.437 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:40:50.438 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:40:50.438 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:40:50.438 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:40:50.438 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:40:50.438 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:40:50.438 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:40:50.438 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:40:50.438 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:40:50.438 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:40:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2024-02-21T07:40:50.954 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2024-02-21T07:40:50.954 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-21T07:40:51.108 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-21T07:40:51.210 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2024-02-21T07:40:51.293 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T07:40:51.293 INFO:tasks.ceph:role: osd.9 2024-02-21T07:40:51.293 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:40:51.293 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T07:40:51.386 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:40:51.386 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:40:51.386 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:40:51.386 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:40:51.386 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:40:51.386 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:40:51.386 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:40:51.387 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:40:51.387 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:40:51.387 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:40:51.840 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2024-02-21T07:40:51.848 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2024-02-21T07:40:51.848 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2024-02-21T07:40:51.984 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2024-02-21T07:40:52.070 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:40:52.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:52.209+0000 7fb8f819a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-21T07:40:52.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:52.214+0000 7fb8f819a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-21T07:40:52.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:52.214+0000 7fb8f819a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T07:40:52.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:52.215+0000 7fb8f819a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T07:40:52.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:52.215+0000 7fb8f819a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T07:40:52.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:52.218+0000 7fb8f819a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-21T07:40:55.395 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-21T07:40:55.483 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:40:55.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:55.604+0000 7fdff2619640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-21T07:40:55.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:55.605+0000 7fdff2619640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-21T07:40:55.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:55.605+0000 7fdff2619640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T07:40:55.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:55.605+0000 7fdff2619640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T07:40:55.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:55.605+0000 7fdff2619640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T07:40:55.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:55.607+0000 7fdff2619640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-21T07:40:58.541 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-21T07:40:58.638 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:40:58.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:58.772+0000 7f40d6815640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-21T07:40:58.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:58.772+0000 7f40d6815640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-21T07:40:58.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:58.772+0000 7f40d6815640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T07:40:58.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:58.773+0000 7f40d6815640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T07:40:58.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:58.773+0000 7f40d6815640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T07:40:58.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:40:58.774+0000 7f40d6815640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-21T07:41:01.709 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-21T07:41:01.804 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:01.938+0000 7fb79d36f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2024-02-21T07:41:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:01.938+0000 7fb79d36f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2024-02-21T07:41:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:01.938+0000 7fb79d36f640 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-02-21T07:41:01.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:01.938+0000 7fb79d36f640 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-02-21T07:41:01.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:01.938+0000 7fb79d36f640 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-02-21T07:41:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:01.941+0000 7fb79d36f640 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2024-02-21T07:41:05.123 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2024-02-21T07:41:05.217 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-21T07:41:05.249 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T07:41:05.250 INFO:tasks.ceph:role: osd.1 2024-02-21T07:41:05.250 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:41:05.250 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T07:41:05.327 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:41:05.327 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:41:05.327 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:41:05.327 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:41:05.327 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:41:05.327 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:41:05.327 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:41:05.327 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:41:05.328 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:41:05.328 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:41:05.835 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-02-21T07:41:05.837 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-02-21T07:41:05.837 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-02-21T07:41:05.975 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-21T07:41:06.010 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-21T07:41:06.077 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T07:41:06.077 INFO:tasks.ceph:role: osd.4 2024-02-21T07:41:06.077 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:41:06.077 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T07:41:06.151 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:41:06.151 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:41:06.151 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:41:06.151 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:41:06.151 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:41:06.151 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:41:06.151 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:41:06.151 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:41:06.152 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:41:06.152 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:41:06.595 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-02-21T07:41:06.597 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-02-21T07:41:06.597 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-02-21T07:41:06.675 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-21T07:41:06.747 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-21T07:41:06.815 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T07:41:06.815 INFO:tasks.ceph:role: osd.7 2024-02-21T07:41:06.815 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:41:06.815 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T07:41:06.889 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:41:06.890 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:41:06.890 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:41:06.890 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:41:06.890 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:41:06.890 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:41:06.890 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:41:06.890 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:41:06.890 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:41:06.890 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:41:07.388 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-02-21T07:41:07.391 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-02-21T07:41:07.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2024-02-21T07:41:07.495 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-21T07:41:07.527 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2024-02-21T07:41:07.593 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T07:41:07.593 INFO:tasks.ceph:role: osd.10 2024-02-21T07:41:07.593 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:41:07.593 DEBUG:teuthology.orchestra.run.smithi174:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T07:41:07.667 INFO:teuthology.orchestra.run.smithi174.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:41:07.667 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:41:07.667 INFO:teuthology.orchestra.run.smithi174.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:41:07.667 INFO:teuthology.orchestra.run.smithi174.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:41:07.667 INFO:teuthology.orchestra.run.smithi174.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:41:07.667 INFO:teuthology.orchestra.run.smithi174.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:41:07.667 INFO:teuthology.orchestra.run.smithi174.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:41:07.667 INFO:teuthology.orchestra.run.smithi174.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:41:07.667 INFO:teuthology.orchestra.run.smithi174.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:41:07.667 INFO:teuthology.orchestra.run.smithi174.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:41:08.152 INFO:teuthology.orchestra.run.smithi174.stdout:Discarding blocks...Done. 2024-02-21T07:41:08.154 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi174.front.sepia.ceph.com -o noatime 2024-02-21T07:41:08.154 DEBUG:teuthology.orchestra.run.smithi174:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2024-02-21T07:41:08.269 DEBUG:teuthology.orchestra.run.smithi174:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2024-02-21T07:41:08.303 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:08.401 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:08.394+0000 7ff9b2266640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-21T07:41:08.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:08.394+0000 7ff9b2266640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-21T07:41:08.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:08.394+0000 7ff9b2266640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T07:41:08.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:08.394+0000 7ff9b2266640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T07:41:08.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:08.394+0000 7ff9b2266640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T07:41:08.402 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:08.395+0000 7ff9b2266640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-21T07:41:11.248 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-21T07:41:11.279 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:11.373 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:11.367+0000 7fe03b413640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-21T07:41:11.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:11.367+0000 7fe03b413640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-21T07:41:11.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:11.367+0000 7fe03b413640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T07:41:11.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:11.367+0000 7fe03b413640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T07:41:11.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:11.367+0000 7fe03b413640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T07:41:11.374 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:11.368+0000 7fe03b413640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-21T07:41:11.660 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:41:11.668 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:41:11.671 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:41:14.224 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-21T07:41:14.256 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:14.346 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:14.340+0000 7f3982a0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-21T07:41:14.346 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:14.340+0000 7f3982a0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-21T07:41:14.346 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:14.340+0000 7f3982a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T07:41:14.347 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:14.340+0000 7f3982a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T07:41:14.347 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:14.340+0000 7f3982a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T07:41:14.347 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:14.340+0000 7f3982a0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-21T07:41:17.194 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-21T07:41:17.221 DEBUG:teuthology.orchestra.run.smithi174:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:17.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:17.301+0000 7fc4bd8f7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2024-02-21T07:41:17.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:17.302+0000 7fc4bd8f7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2024-02-21T07:41:17.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:17.302+0000 7fc4bd8f7640 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-02-21T07:41:17.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:17.302+0000 7fc4bd8f7640 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-02-21T07:41:17.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:17.302+0000 7fc4bd8f7640 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-02-21T07:41:17.308 INFO:teuthology.orchestra.run.smithi174.stderr:2024-02-21T07:41:17.302+0000 7fc4bd8f7640 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2024-02-21T07:41:20.155 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-02-21T07:41:20.227 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-21T07:41:20.258 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T07:41:20.258 INFO:tasks.ceph:role: osd.2 2024-02-21T07:41:20.259 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:41:20.259 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T07:41:20.336 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:41:20.336 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:41:20.336 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:41:20.336 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:41:20.336 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:41:20.336 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:41:20.336 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:41:20.336 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:41:20.336 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:41:20.337 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:41:20.849 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-02-21T07:41:20.851 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-02-21T07:41:20.851 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-02-21T07:41:21.000 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-21T07:41:21.036 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-21T07:41:21.106 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T07:41:21.106 INFO:tasks.ceph:role: osd.5 2024-02-21T07:41:21.106 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:41:21.107 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T07:41:21.182 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:41:21.182 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:41:21.182 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:41:21.182 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:41:21.182 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:41:21.182 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:41:21.182 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:41:21.182 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:41:21.183 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:41:21.183 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:41:21.625 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-02-21T07:41:21.627 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-02-21T07:41:21.627 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-21T07:41:21.715 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-21T07:41:21.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2024-02-21T07:41:21.816 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T07:41:21.817 INFO:tasks.ceph:role: osd.8 2024-02-21T07:41:21.817 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:41:21.817 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T07:41:21.892 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:41:21.892 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:41:21.892 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:41:21.892 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:41:21.892 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:41:21.892 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:41:21.892 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:41:21.892 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:41:21.893 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:41:21.893 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:41:22.385 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-02-21T07:41:22.387 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-02-21T07:41:22.388 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2024-02-21T07:41:22.513 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2024-02-21T07:41:22.548 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2024-02-21T07:41:22.617 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T07:41:22.617 INFO:tasks.ceph:role: osd.11 2024-02-21T07:41:22.617 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:41:22.618 DEBUG:teuthology.orchestra.run.smithi184:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T07:41:22.694 INFO:teuthology.orchestra.run.smithi184.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T07:41:22.694 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T07:41:22.694 INFO:teuthology.orchestra.run.smithi184.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T07:41:22.694 INFO:teuthology.orchestra.run.smithi184.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T07:41:22.694 INFO:teuthology.orchestra.run.smithi184.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T07:41:22.695 INFO:teuthology.orchestra.run.smithi184.stdout: = sunit=0 swidth=0 blks 2024-02-21T07:41:22.695 INFO:teuthology.orchestra.run.smithi184.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T07:41:22.695 INFO:teuthology.orchestra.run.smithi184.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T07:41:22.695 INFO:teuthology.orchestra.run.smithi184.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T07:41:22.695 INFO:teuthology.orchestra.run.smithi184.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T07:41:23.203 INFO:teuthology.orchestra.run.smithi184.stdout:Discarding blocks...Done. 2024-02-21T07:41:23.208 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi184.front.sepia.ceph.com -o noatime 2024-02-21T07:41:23.208 DEBUG:teuthology.orchestra.run.smithi184:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2024-02-21T07:41:23.348 DEBUG:teuthology.orchestra.run.smithi184:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2024-02-21T07:41:23.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:23.482 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:23.475+0000 7fc75ba1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-21T07:41:23.482 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:23.476+0000 7fc75ba1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-21T07:41:23.482 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:23.476+0000 7fc75ba1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T07:41:23.482 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:23.476+0000 7fc75ba1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T07:41:23.482 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:23.476+0000 7fc75ba1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T07:41:23.483 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:23.477+0000 7fc75ba1b640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-21T07:41:26.335 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-21T07:41:26.366 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:26.458 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:26.452+0000 7f680d6f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-21T07:41:26.458 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:26.452+0000 7f680d6f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-21T07:41:26.458 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:26.452+0000 7f680d6f9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T07:41:26.458 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:26.452+0000 7f680d6f9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T07:41:26.459 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:26.452+0000 7f680d6f9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T07:41:26.459 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:26.453+0000 7f680d6f9640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-21T07:41:29.312 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-21T07:41:29.342 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:29.434 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:29.427+0000 7fb313468640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2024-02-21T07:41:29.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:29.428+0000 7fb313468640 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2024-02-21T07:41:29.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:29.428+0000 7fb313468640 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-02-21T07:41:29.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:29.428+0000 7fb313468640 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-02-21T07:41:29.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:29.428+0000 7fb313468640 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-02-21T07:41:29.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:29.428+0000 7fb313468640 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2024-02-21T07:41:32.289 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-02-21T07:41:32.321 DEBUG:teuthology.orchestra.run.smithi184:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:32.416 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:32.407+0000 7fae55ea0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2024-02-21T07:41:32.416 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:32.408+0000 7fae55ea0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2024-02-21T07:41:32.416 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:32.408+0000 7fae55ea0640 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-02-21T07:41:32.416 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:32.408+0000 7fae55ea0640 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-02-21T07:41:32.416 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:32.408+0000 7fae55ea0640 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-02-21T07:41:32.417 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:32.408+0000 7fae55ea0640 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2024-02-21T07:41:35.271 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2024-02-21T07:41:35.301 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-21T07:41:35.301 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:35.301 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-21T07:41:35.404 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:35.404 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-21T07:41:35.495 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:35.495 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-02-21T07:41:35.633 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:35.633 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-g/keyring of=/dev/stdout 2024-02-21T07:41:35.725 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:35.726 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-j/keyring of=/dev/stdout 2024-02-21T07:41:35.817 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:35.817 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-21T07:41:35.906 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:35.906 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-21T07:41:35.996 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:35.996 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-21T07:41:36.089 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:36.089 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2024-02-21T07:41:36.176 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:36.177 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-21T07:41:36.208 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:36.209 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-21T07:41:36.279 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:36.279 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-02-21T07:41:36.349 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:36.349 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-h/keyring of=/dev/stdout 2024-02-21T07:41:36.418 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:36.418 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/mds/ceph-k/keyring of=/dev/stdout 2024-02-21T07:41:36.488 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:36.488 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-21T07:41:36.556 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:36.556 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-21T07:41:36.624 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:36.624 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-21T07:41:36.691 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:36.691 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2024-02-21T07:41:36.759 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:36.759 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2024-02-21T07:41:36.790 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:36.790 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-21T07:41:36.860 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:36.860 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-02-21T07:41:36.928 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:36.929 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-i/keyring of=/dev/stdout 2024-02-21T07:41:36.996 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:36.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/mds/ceph-l/keyring of=/dev/stdout 2024-02-21T07:41:37.064 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:37.064 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-21T07:41:37.131 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:37.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-21T07:41:37.198 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:37.198 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2024-02-21T07:41:37.265 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:37.265 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2024-02-21T07:41:37.332 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:37.332 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-21T07:41:37.387 INFO:tasks.ceph:Adding keys to all mons... 2024-02-21T07:41:37.387 DEBUG:teuthology.orchestra.run.smithi069:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T07:41:37.391 DEBUG:teuthology.orchestra.run.smithi174:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T07:41:37.394 DEBUG:teuthology.orchestra.run.smithi184:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T07:41:37.419 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.x] 2024-02-21T07:41:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD+qNVlXmtdARAAg2xJpTt53lM4yJXSMwLYbA== 2024-02-21T07:41:37.419 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.a] 2024-02-21T07:41:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD+qNVl9mFHFhAAMsQ3K9mfh125qHtUIkKpHg== 2024-02-21T07:41:37.419 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.d] 2024-02-21T07:41:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD+qNVlRIpsJhAA/PmxbcTuE9UqezC/6z+PqA== 2024-02-21T07:41:37.419 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.g] 2024-02-21T07:41:37.419 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD+qNVllfZwNxAA7tG1A0bBlslO/zS7jen4Rw== 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.j] 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD/qNVl3HpKCxAA9e8Jk7BNvR2tEAMb7igZeg== 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.0] 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAEqdVl40GVDBAAml05pvGQDMTni9eIWFw3KQ== 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.3] 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAHqdVlJQ0TJBAAR2NLms/hJ+LdGL8AgnjW9g== 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.6] 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAKqdVle8YWLhAAe9rcppRHlPTM7ssrjVGfwQ== 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.9] 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQANqdVlHJP+NxAARB7z/J4P0ne5DDVz3mu2TA== 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.y] 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD+qNVlJD6IBxAAYfyvYhx6bs9fJoY3H37IXQ== 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.b] 2024-02-21T07:41:37.420 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD/qNVlL54sFRAA8iobI9G4bZjLdGvetp6sTg== 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.e] 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD/qNVlyyc/HRAACQpZ0ofagHfr36msyLmHBw== 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.h] 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD/qNVl/lm+JBAAxuzeAO2hDLSjXI6WORurTg== 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.k] 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD/qNVlM/MtLBAAHPG6KDUX2+/7K95OsZwyVw== 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.1] 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAUqdVl9yiZFxAAvEaiLyVV6OeF+Mvkm2nwJw== 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.4] 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAXqdVlD7L7FRAAJpVCOp8tcrd/h5WPVReiqA== 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.7] 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAaqdVl7NNaFBAAN0Q8lpdgkrIgWAKg8M3DbA== 2024-02-21T07:41:37.421 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.10] 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAdqdVl1pITEhAAcTdbu4cxE41T5U1Glmt1Ig== 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout:[mgr.z] 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD+qNVlt2wXDBAA2s21/AiUbTf8SpB1j0FeSw== 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.c] 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD/qNVlvr+ZMRAA/dR2aiORZ0noPqsdCUH9fg== 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.f] 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQD/qNVlE3UjORAAp8Bhn0e3z2pcDW+w9vI/mQ== 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.i] 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAAqdVlCVvcBBAAGd5KEKQf801TJ1iSYQj70A== 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout:[mds.l] 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAAqdVlMosqDBAAfdA6N8SKUCcUtacjikjbHg== 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.2] 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAjqdVlp0FrHBAA6jx0bxkrfihntEk5Fh/p+w== 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.5] 2024-02-21T07:41:37.422 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAmqdVlX0cIGxAAbuydGAK2MtQILy/0OqmiIg== 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.8] 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQApqdVltPyeGRAA0Q6fgzF5pWbfUl9Q+SqAZg== 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi174.stdout:[osd.11] 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAsqdVl0ORfGBAAL1xSZ2YcMQbafl650vAeGg== 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi174.stdout:[client.0] 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi174.stdout: key = AQAAqdVlI8m4FRAAqMHVNFBHGMRn2NCTMvGEqQ== 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.x] 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD+qNVlXmtdARAAg2xJpTt53lM4yJXSMwLYbA== 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.a] 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD+qNVl9mFHFhAAMsQ3K9mfh125qHtUIkKpHg== 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.d] 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD+qNVlRIpsJhAA/PmxbcTuE9UqezC/6z+PqA== 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.g] 2024-02-21T07:41:37.423 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD+qNVllfZwNxAA7tG1A0bBlslO/zS7jen4Rw== 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.j] 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD/qNVl3HpKCxAA9e8Jk7BNvR2tEAMb7igZeg== 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.0] 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAEqdVl40GVDBAAml05pvGQDMTni9eIWFw3KQ== 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.3] 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAHqdVlJQ0TJBAAR2NLms/hJ+LdGL8AgnjW9g== 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.6] 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAKqdVle8YWLhAAe9rcppRHlPTM7ssrjVGfwQ== 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.9] 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQANqdVlHJP+NxAARB7z/J4P0ne5DDVz3mu2TA== 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.y] 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD+qNVlJD6IBxAAYfyvYhx6bs9fJoY3H37IXQ== 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.b] 2024-02-21T07:41:37.424 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD/qNVlL54sFRAA8iobI9G4bZjLdGvetp6sTg== 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.e] 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD/qNVlyyc/HRAACQpZ0ofagHfr36msyLmHBw== 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.h] 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD/qNVl/lm+JBAAxuzeAO2hDLSjXI6WORurTg== 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.k] 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD/qNVlM/MtLBAAHPG6KDUX2+/7K95OsZwyVw== 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.1] 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAUqdVl9yiZFxAAvEaiLyVV6OeF+Mvkm2nwJw== 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.4] 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAXqdVlD7L7FRAAJpVCOp8tcrd/h5WPVReiqA== 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.7] 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAaqdVl7NNaFBAAN0Q8lpdgkrIgWAKg8M3DbA== 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.10] 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAdqdVl1pITEhAAcTdbu4cxE41T5U1Glmt1Ig== 2024-02-21T07:41:37.425 INFO:teuthology.orchestra.run.smithi184.stdout:[mgr.z] 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD+qNVlt2wXDBAA2s21/AiUbTf8SpB1j0FeSw== 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.c] 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD/qNVlvr+ZMRAA/dR2aiORZ0noPqsdCUH9fg== 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.f] 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQD/qNVlE3UjORAAp8Bhn0e3z2pcDW+w9vI/mQ== 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.i] 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAAqdVlCVvcBBAAGd5KEKQf801TJ1iSYQj70A== 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout:[mds.l] 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAAqdVlMosqDBAAfdA6N8SKUCcUtacjikjbHg== 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.2] 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAjqdVlp0FrHBAA6jx0bxkrfihntEk5Fh/p+w== 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.5] 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAmqdVlX0cIGxAAbuydGAK2MtQILy/0OqmiIg== 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.8] 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQApqdVltPyeGRAA0Q6fgzF5pWbfUl9Q+SqAZg== 2024-02-21T07:41:37.426 INFO:teuthology.orchestra.run.smithi184.stdout:[osd.11] 2024-02-21T07:41:37.427 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAsqdVl0ORfGBAAL1xSZ2YcMQbafl650vAeGg== 2024-02-21T07:41:37.427 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2024-02-21T07:41:37.427 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQAAqdVlI8m4FRAAqMHVNFBHGMRn2NCTMvGEqQ== 2024-02-21T07:41:37.469 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.x] 2024-02-21T07:41:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD+qNVlXmtdARAAg2xJpTt53lM4yJXSMwLYbA== 2024-02-21T07:41:37.469 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2024-02-21T07:41:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD+qNVl9mFHFhAAMsQ3K9mfh125qHtUIkKpHg== 2024-02-21T07:41:37.469 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d] 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD+qNVlRIpsJhAA/PmxbcTuE9UqezC/6z+PqA== 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.g] 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD+qNVllfZwNxAA7tG1A0bBlslO/zS7jen4Rw== 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.j] 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD/qNVl3HpKCxAA9e8Jk7BNvR2tEAMb7igZeg== 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.0] 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAEqdVl40GVDBAAml05pvGQDMTni9eIWFw3KQ== 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.3] 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAHqdVlJQ0TJBAAR2NLms/hJ+LdGL8AgnjW9g== 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.6] 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAKqdVle8YWLhAAe9rcppRHlPTM7ssrjVGfwQ== 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.9] 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQANqdVlHJP+NxAARB7z/J4P0ne5DDVz3mu2TA== 2024-02-21T07:41:37.470 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.y] 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD+qNVlJD6IBxAAYfyvYhx6bs9fJoY3H37IXQ== 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD/qNVlL54sFRAA8iobI9G4bZjLdGvetp6sTg== 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.e] 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD/qNVlyyc/HRAACQpZ0ofagHfr36msyLmHBw== 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.h] 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD/qNVl/lm+JBAAxuzeAO2hDLSjXI6WORurTg== 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.k] 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD/qNVlM/MtLBAAHPG6KDUX2+/7K95OsZwyVw== 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.1] 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAUqdVl9yiZFxAAvEaiLyVV6OeF+Mvkm2nwJw== 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.4] 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAXqdVlD7L7FRAAJpVCOp8tcrd/h5WPVReiqA== 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.7] 2024-02-21T07:41:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAaqdVl7NNaFBAAN0Q8lpdgkrIgWAKg8M3DbA== 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.10] 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAdqdVl1pITEhAAcTdbu4cxE41T5U1Glmt1Ig== 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.z] 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD+qNVlt2wXDBAA2s21/AiUbTf8SpB1j0FeSw== 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD/qNVlvr+ZMRAA/dR2aiORZ0noPqsdCUH9fg== 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.f] 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD/qNVlE3UjORAAp8Bhn0e3z2pcDW+w9vI/mQ== 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.i] 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAAqdVlCVvcBBAAGd5KEKQf801TJ1iSYQj70A== 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.l] 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAAqdVlMosqDBAAfdA6N8SKUCcUtacjikjbHg== 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.2] 2024-02-21T07:41:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAjqdVlp0FrHBAA6jx0bxkrfihntEk5Fh/p+w== 2024-02-21T07:41:37.473 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.5] 2024-02-21T07:41:37.473 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAmqdVlX0cIGxAAbuydGAK2MtQILy/0OqmiIg== 2024-02-21T07:41:37.473 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.8] 2024-02-21T07:41:37.473 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQApqdVltPyeGRAA0Q6fgzF5pWbfUl9Q+SqAZg== 2024-02-21T07:41:37.473 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.11] 2024-02-21T07:41:37.473 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAsqdVl0ORfGBAAL1xSZ2YcMQbafl650vAeGg== 2024-02-21T07:41:37.473 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2024-02-21T07:41:37.473 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAAqdVlI8m4FRAAqMHVNFBHGMRn2NCTMvGEqQ== 2024-02-21T07:41:37.474 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:41:37.481 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:41:37.484 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:41:37.613 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:37.620 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:37.622 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:37.754 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:37.761 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:37.764 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:37.896 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:37.901 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:37.903 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:38.030 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:38.035 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:38.037 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:38.173 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.178 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.181 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.309 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.313 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.316 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.445 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.450 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.452 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.583 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.588 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.590 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:38.720 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:41:38.726 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:41:38.729 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:41:38.864 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:38.869 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:38.871 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:39.003 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:39.009 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:39.011 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:39.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:39.142 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:39.144 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:39.269 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:39.276 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:39.279 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:39.414 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.419 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.421 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.549 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.553 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.556 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.689 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.693 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.696 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.828 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.834 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.836 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:39.969 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:41:39.974 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:41:39.976 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T07:41:40.098 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.105 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.107 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.241 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.246 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.382 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.387 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.389 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.523 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.528 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T07:41:40.668 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:40.672 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:40.675 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:40.809 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:40.815 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:40.817 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:40.946 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:40.951 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:40.953 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:41.082 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:41.086 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:41.088 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T07:41:41.219 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T07:41:41.226 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T07:41:41.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T07:41:41.368 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-21T07:41:41.368 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-21T07:41:41.464 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T07:41:41.617 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-21T07:41:41.709 DEBUG:teuthology.orchestra.run.smithi174:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-21T07:41:41.737 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T07:41:41.814 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:41:41.822 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:41:41.825 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:41:41.834 DEBUG:teuthology.orchestra.run.smithi174:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-21T07:41:41.900 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-21T07:41:41.928 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T07:41:42.024 DEBUG:teuthology.orchestra.run.smithi184:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-21T07:41:42.050 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:42.057 DEBUG:teuthology.orchestra.run.smithi174:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:42.059 DEBUG:teuthology.orchestra.run.smithi184:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T07:41:42.106 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-21T07:41:42.106 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-21T07:41:42.106 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-21T07:41:42.111 INFO:tasks.ceph.mon.a:Started 2024-02-21T07:41:42.111 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-21T07:41:42.111 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-21T07:41:42.114 INFO:tasks.ceph.mon.b:Started 2024-02-21T07:41:42.114 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-21T07:41:42.115 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-21T07:41:42.148 INFO:tasks.ceph.mon.c:Started 2024-02-21T07:41:42.148 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-21T07:41:42.148 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-21T07:41:42.148 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-21T07:41:42.153 INFO:tasks.ceph.mgr.x:Started 2024-02-21T07:41:42.153 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-21T07:41:42.153 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-21T07:41:42.155 INFO:tasks.ceph.mgr.y:Started 2024-02-21T07:41:42.156 INFO:tasks.ceph.mgr.z:Restarting daemon 2024-02-21T07:41:42.156 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2024-02-21T07:41:42.158 INFO:tasks.ceph.mgr.z:Started 2024-02-21T07:41:42.158 INFO:tasks.ceph:Setting crush tunables to default 2024-02-21T07:41:42.158 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd crush tunables default 2024-02-21T07:41:42.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.339+0000 7fa634a00640 1 Processor -- start 2024-02-21T07:41:42.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.339+0000 7fa634a00640 1 -- start start 2024-02-21T07:41:42.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.341+0000 7fa634a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa63017f550 0x7fa6300f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:42.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.341+0000 7fa634a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa6300fa7c0 0x7fa63018b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:42.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.341+0000 7fa634a00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63018bc10 con 0x7fa6300fa350 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.341+0000 7fa634a00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6300ff310 con 0x7fa63017f550 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.341+0000 7fa634a00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa630189f40 con 0x7fa6300fa7c0 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.341+0000 7fa62e800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa6300fa7c0 0x7fa63018b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.341+0000 7fa62e800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa6300fa7c0 0x7fa63018b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:60166/0 (socket says 172.21.15.69:60166) 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.341+0000 7fa62de00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa63017f550 0x7fa6300f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.341+0000 7fa62e800640 1 -- 172.21.15.69:0/2738845588 learned_addr learned my addr 172.21.15.69:0/2738845588 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.341+0000 7fa62d400640 1 --1- 172.21.15.69:0/2738845588 >> v1:172.21.15.184:6789/0 conn(0x7fa6300fa350 0x7fa63018afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:43874/0 (socket says 172.21.15.69:43874) 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.342+0000 7fa62e800640 1 -- 172.21.15.69:0/2738845588 >> v2:172.21.15.174:3300/0 conn(0x7fa6300fa7c0 msgr2=0x7fa63018b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.342+0000 7fa62e800640 1 -- 172.21.15.69:0/2738845588 >> v2:172.21.15.174:3300/0 conn(0x7fa6300fa7c0 msgr2=0x7fa63018b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.342+0000 7fa62e800640 1 --2- 172.21.15.69:0/2738845588 >> v2:172.21.15.174:3300/0 conn(0x7fa6300fa7c0 0x7fa63018b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.342+0000 7fa62e800640 1 --2- 172.21.15.69:0/2738845588 >> v2:172.21.15.174:3300/0 conn(0x7fa6300fa7c0 0x7fa63018b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.342+0000 7fa62de00640 1 -- 172.21.15.69:0/2738845588 >> v2:172.21.15.69:3300/0 conn(0x7fa63017f550 msgr2=0x7fa6300f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.342+0000 7fa62de00640 1 -- 172.21.15.69:0/2738845588 >> v2:172.21.15.69:3300/0 conn(0x7fa63017f550 msgr2=0x7fa6300f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T07:41:42.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.342+0000 7fa62de00640 1 --2- 172.21.15.69:0/2738845588 >> v2:172.21.15.69:3300/0 conn(0x7fa63017f550 0x7fa6300f9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T07:41:42.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.342+0000 7fa62de00640 1 --2- 172.21.15.69:0/2738845588 >> v2:172.21.15.69:3300/0 conn(0x7fa63017f550 0x7fa6300f9e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:41:42.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.349+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301647192 0 0) 0x7fa63018bc10 con 0x7fa6300fa350 2024-02-21T07:41:42.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.349+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa614003520 con 0x7fa6300fa350 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.349+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2207390473 0 0) 0x7fa614003520 con 0x7fa6300fa350 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.349+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 >> v2:172.21.15.174:3300/0 conn(0x7fa6300fa7c0 msgr2=0x7fa63018b6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.349+0000 7fa62ca00640 1 --2- 172.21.15.69:0/2738845588 >> v2:172.21.15.174:3300/0 conn(0x7fa6300fa7c0 0x7fa63018b6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.349+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 >> v2:172.21.15.69:3300/0 conn(0x7fa63017f550 msgr2=0x7fa6300f9e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.349+0000 7fa62ca00640 1 --2- 172.21.15.69:0/2738845588 >> v2:172.21.15.69:3300/0 conn(0x7fa63017f550 0x7fa6300f9e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.349+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63017f930 con 0x7fa6300fa350 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.349+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7fa61c001670 con 0x7fa6300fa350 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 >> v1:172.21.15.184:6789/0 conn(0x7fa6300fa350 legacy=0x7fa63018afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62ca00640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6140039c0 0x7fa614003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62ca00640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 0x7fa614004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62ca00640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6140051d0 0x7fa61400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6300ff310 con 0x7fa6140051d0 2024-02-21T07:41:42.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa630189f40 con 0x7fa6140039c0 2024-02-21T07:41:42.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61400c180 con 0x7fa6140047c0 2024-02-21T07:41:42.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62d400640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 0x7fa614004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:42.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62de00640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6140039c0 0x7fa614003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:42.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62d400640 1 -- 172.21.15.69:0/2738845588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6140039c0 msgr2=0x7fa614003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:42.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62d400640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6140039c0 0x7fa614003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62e800640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6140051d0 0x7fa61400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:42.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.350+0000 7fa62d400640 1 -- 172.21.15.69:0/2738845588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6140051d0 msgr2=0x7fa61400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:42.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.351+0000 7fa62d400640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6140051d0 0x7fa61400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.351+0000 7fa62d400640 1 -- 172.21.15.69:0/2738845588 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614003520 con 0x7fa6140047c0 2024-02-21T07:41:42.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.351+0000 7fa62e800640 1 -- 172.21.15.69:0/2738845588 reap_dead start 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.352+0000 7fa62d400640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 0x7fa614004c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c1e0 tx=0x7fa6140057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75826f6a36b97511 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.352+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c007270 con 0x7fa6140047c0 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.352+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c0073d0 con 0x7fa6140047c0 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.352+0000 7fa62ca00640 1 -- 172.21.15.69:0/2738845588 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c005810 con 0x7fa6140047c0 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.353+0000 7fa634a00640 1 -- 172.21.15.69:0/2738845588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 msgr2=0x7fa614004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.353+0000 7fa634a00640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 0x7fa614004c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c1e0 tx=0x7fa6140057f0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.353+0000 7fa634a00640 1 -- 172.21.15.69:0/2738845588 shutdown_connections 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.353+0000 7fa634a00640 1 --2- 172.21.15.69:0/2738845588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 0x7fa614004c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.353+0000 7fa634a00640 1 -- 172.21.15.69:0/2738845588 >> 172.21.15.69:0/2738845588 conn(0x7fa6300668e0 msgr2=0x7fa630066cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.353+0000 7fa634a00640 1 -- 172.21.15.69:0/2738845588 shutdown_connections 2024-02-21T07:41:42.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.353+0000 7fa634a00640 1 -- 172.21.15.69:0/2738845588 wait complete. 2024-02-21T07:41:42.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.356+0000 7fa634a00640 1 Processor -- start 2024-02-21T07:41:42.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.356+0000 7fa634a00640 1 -- start start 2024-02-21T07:41:42.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.358+0000 7fa634a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 0x7fa630167cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:42.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.358+0000 7fa634a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6301681f0 0x7fa63017e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:42.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.358+0000 7fa634a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa63017e8e0 0x7fa6300d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:42.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.358+0000 7fa634a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6300d2950 con 0x7fa6301681f0 2024-02-21T07:41:42.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.358+0000 7fa634a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63017ed60 con 0x7fa63017e8e0 2024-02-21T07:41:42.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.358+0000 7fa634a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6300d1af0 con 0x7fa6140047c0 2024-02-21T07:41:42.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.358+0000 7fa62e800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa63017e8e0 0x7fa6300d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:42.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.358+0000 7fa62d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6301681f0 0x7fa63017e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:42.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.358+0000 7fa62e800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa63017e8e0 0x7fa6300d0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:60194/0 (socket says 172.21.15.69:60194) 2024-02-21T07:41:42.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.358+0000 7fa62e800640 1 -- 172.21.15.69:0/3332322818 learned_addr learned my addr 172.21.15.69:0/3332322818 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:42.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.359+0000 7fa62de00640 1 --2- 172.21.15.69:0/3332322818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 0x7fa630167cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:42.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.359+0000 7fa62e800640 1 -- 172.21.15.69:0/3332322818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 msgr2=0x7fa630167cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:42.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.359+0000 7fa62e800640 1 --2- 172.21.15.69:0/3332322818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 0x7fa630167cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.359+0000 7fa62e800640 1 -- 172.21.15.69:0/3332322818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6301681f0 msgr2=0x7fa63017e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.359+0000 7fa62e800640 1 --2- 172.21.15.69:0/3332322818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6301681f0 0x7fa63017e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.359+0000 7fa62e800640 1 -- 172.21.15.69:0/3332322818 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300d1dd0 con 0x7fa63017e8e0 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.359+0000 7fa62d400640 1 --2- 172.21.15.69:0/3332322818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6301681f0 0x7fa63017e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.359+0000 7fa62de00640 1 --2- 172.21.15.69:0/3332322818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 0x7fa630167cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.359+0000 7fa62e800640 1 --2- 172.21.15.69:0/3332322818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa63017e8e0 0x7fa6300d0d40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa630067920 tx=0x7fa628007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.360+0000 7fa626000640 1 -- 172.21.15.69:0/3332322818 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628010070 con 0x7fa63017e8e0 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.360+0000 7fa626000640 1 -- 172.21.15.69:0/3332322818 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62800b070 con 0x7fa63017e8e0 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.360+0000 7fa626000640 1 -- 172.21.15.69:0/3332322818 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62800b400 con 0x7fa63017e8e0 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.360+0000 7fa634a00640 1 -- 172.21.15.69:0/3332322818 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6300d20b0 con 0x7fa63017e8e0 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.360+0000 7fa634a00640 1 -- 172.21.15.69:0/3332322818 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6300d2670 con 0x7fa63017e8e0 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.360+0000 7fa626000640 1 -- 172.21.15.69:0/3332322818 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa628003d20 con 0x7fa63017e8e0 2024-02-21T07:41:42.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.361+0000 7fa626000640 1 -- 172.21.15.69:0/3332322818 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa62800d810 con 0x7fa63017e8e0 2024-02-21T07:41:42.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.361+0000 7fa634a00640 1 -- 172.21.15.69:0/3332322818 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6301685d0 con 0x7fa63017e8e0 2024-02-21T07:41:42.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.364+0000 7fa626000640 1 -- 172.21.15.69:0/3332322818 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa6301685d0 con 0x7fa63017e8e0 2024-02-21T07:41:42.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.436+0000 7fa634a00640 1 -- 172.21.15.69:0/3332322818 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa630069d50 con 0x7fa63017e8e0 2024-02-21T07:41:42.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.446+0000 7fa626000640 1 -- 172.21.15.69:0/3332322818 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa628026090 con 0x7fa63017e8e0 2024-02-21T07:41:42.452 INFO:teuthology.orchestra.run.smithi069.stderr:adjusted tunables profile to default 2024-02-21T07:41:42.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.447+0000 7fa634a00640 1 -- 172.21.15.69:0/3332322818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa63017e8e0 msgr2=0x7fa6300d0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:42.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.447+0000 7fa634a00640 1 --2- 172.21.15.69:0/3332322818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa63017e8e0 0x7fa6300d0d40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa630067920 tx=0x7fa628007e20 comp rx=0 tx=0).stop 2024-02-21T07:41:42.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.447+0000 7fa634a00640 1 -- 172.21.15.69:0/3332322818 shutdown_connections 2024-02-21T07:41:42.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.447+0000 7fa634a00640 1 --2- 172.21.15.69:0/3332322818 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa63017e8e0 0x7fa6300d0d40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.447+0000 7fa634a00640 1 --2- 172.21.15.69:0/3332322818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6301681f0 0x7fa63017e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.447+0000 7fa634a00640 1 --2- 172.21.15.69:0/3332322818 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6140047c0 0x7fa630167cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:42.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.447+0000 7fa634a00640 1 -- 172.21.15.69:0/3332322818 >> 172.21.15.69:0/3332322818 conn(0x7fa6300668e0 msgr2=0x7fa6300fb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:42.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.448+0000 7fa634a00640 1 -- 172.21.15.69:0/3332322818 shutdown_connections 2024-02-21T07:41:42.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:42.448+0000 7fa634a00640 1 -- 172.21.15.69:0/3332322818 wait complete. 2024-02-21T07:41:42.470 INFO:tasks.ceph:check_enable_crimson: False 2024-02-21T07:41:42.471 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-21T07:41:42.471 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:42.471 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-21T07:41:42.547 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:42.547 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-21T07:41:42.668 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:42.668 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-21T07:41:42.802 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:41:42.802 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2024-02-21T07:41:42.816 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:42.810+0000 7f9988693040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T07:41:42.821 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:42.816+0000 7f19fcd51040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T07:41:42.869 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:42.864+0000 7f9988693040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T07:41:42.874 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:42.869+0000 7f19fcd51040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T07:41:42.892 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:42.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-21T07:41:42.919 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:42.920 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-21T07:41:42.957 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:42.952+0000 7fa829241040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T07:41:42.987 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:42.987 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-21T07:41:43.019 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:43.013+0000 7fa829241040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T07:41:43.057 DEBUG:teuthology.orchestra.run.smithi174:> set -ex 2024-02-21T07:41:43.057 DEBUG:teuthology.orchestra.run.smithi174:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2024-02-21T07:41:43.126 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:43.126 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-21T07:41:43.153 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:43.153 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-21T07:41:43.220 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:43.220 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2024-02-21T07:41:43.287 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-21T07:41:43.287 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2024-02-21T07:41:43.354 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e 0 2024-02-21T07:41:43.387 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:43.382+0000 7f9988693040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T07:41:43.406 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:43.401+0000 7f19fcd51040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T07:41:43.445 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:43.439+0000 7f9988693040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T07:41:43.459 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:43.454+0000 7f19fcd51040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T07:41:43.488 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.483+0000 7efc66a76640 1 Processor -- start 2024-02-21T07:41:43.488 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.483+0000 7efc66a76640 1 -- start start 2024-02-21T07:41:43.490 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc66a76640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efc60186a00 0x7efc6006d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.490 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc66a76640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc60071280 con 0x7efc6006d9a0 2024-02-21T07:41:43.490 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc66a76640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc600f9050 con 0x7efc60186210 2024-02-21T07:41:43.490 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc66a76640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc60189aa0 con 0x7efc60186a00 2024-02-21T07:41:43.490 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc64812640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7efc60186210 0x7efc600fa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:49864/0 (socket says 172.21.15.184:49864) 2024-02-21T07:41:43.490 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc64812640 1 -- 172.21.15.184:0/1119858346 learned_addr learned my addr 172.21.15.184:0/1119858346 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-21T07:41:43.491 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc5ffff640 1 --2- 172.21.15.184:0/1119858346 >> v2:172.21.15.174:3300/0 conn(0x7efc60186a00 0x7efc6006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.491 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc5f7fe640 1 -- 172.21.15.184:0/1119858346 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98827098 0 0) 0x7efc600f9050 con 0x7efc60186210 2024-02-21T07:41:43.491 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc5f7fe640 1 -- 172.21.15.184:0/1119858346 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc50003520 con 0x7efc60186210 2024-02-21T07:41:43.491 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc5ffff640 1 -- 172.21.15.184:0/1119858346 >> v1:172.21.15.184:6789/0 conn(0x7efc60186210 legacy=0x7efc600fa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.491 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc5ffff640 1 -- 172.21.15.184:0/1119858346 >> v1:172.21.15.69:6789/0 conn(0x7efc6006d9a0 legacy=0x7efc6006ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:43.491 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.484+0000 7efc5ffff640 1 -- 172.21.15.184:0/1119858346 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc600f9bd0 con 0x7efc60186a00 2024-02-21T07:41:43.492 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.485+0000 7efc5ffff640 1 --2- 172.21.15.184:0/1119858346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc60186a00 0x7efc6006d460 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0097a0 tx=0x7efc4c02b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6e78f90dd697bb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:43.492 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.485+0000 7efc5f7fe640 1 -- 172.21.15.184:0/1119858346 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c02f050 con 0x7efc60186a00 2024-02-21T07:41:43.492 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.485+0000 7efc5f7fe640 1 -- 172.21.15.184:0/1119858346 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c031700 con 0x7efc60186a00 2024-02-21T07:41:43.492 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.485+0000 7efc5f7fe640 1 -- 172.21.15.184:0/1119858346 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c031a90 con 0x7efc60186a00 2024-02-21T07:41:43.492 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.486+0000 7efc66a76640 1 -- 172.21.15.184:0/1119858346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc60186a00 msgr2=0x7efc6006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.493 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.486+0000 7efc66a76640 1 --2- 172.21.15.184:0/1119858346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc60186a00 0x7efc6006d460 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0097a0 tx=0x7efc4c02b7a0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.493 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.486+0000 7efc66a76640 1 -- 172.21.15.184:0/1119858346 shutdown_connections 2024-02-21T07:41:43.493 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.486+0000 7efc66a76640 1 --2- 172.21.15.184:0/1119858346 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc60186a00 0x7efc6006d460 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.493 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.486+0000 7efc66a76640 1 -- 172.21.15.184:0/1119858346 >> 172.21.15.184:0/1119858346 conn(0x7efc600f7250 msgr2=0x7efc600f7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:43.493 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.486+0000 7efc66a76640 1 -- 172.21.15.184:0/1119858346 shutdown_connections 2024-02-21T07:41:43.493 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.486+0000 7efc66a76640 1 -- 172.21.15.184:0/1119858346 wait complete. 2024-02-21T07:41:43.493 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:43.487+0000 7f9988693040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T07:41:43.493 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.487+0000 7efc66a76640 1 Processor -- start 2024-02-21T07:41:43.494 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.487+0000 7efc66a76640 1 -- start start 2024-02-21T07:41:43.496 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc66a76640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc6006d9a0 0x7efc60175930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.496 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc66a76640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc60186210 0x7efc600f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.496 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc66a76640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc60186a00 0x7efc60180590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.496 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc66a76640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6006c310 con 0x7efc60186210 2024-02-21T07:41:43.496 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc66a76640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600ce9b0 con 0x7efc6006d9a0 2024-02-21T07:41:43.496 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc66a76640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6006b6d0 con 0x7efc60186a00 2024-02-21T07:41:43.496 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc65013640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc60186a00 0x7efc60180590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.496 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc65013640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc60186a00 0x7efc60180590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:60998/0 (socket says 172.21.15.184:60998) 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc65013640 1 -- 172.21.15.184:0/2261063513 learned_addr learned my addr 172.21.15.184:0/2261063513 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc64812640 1 --2- 172.21.15.184:0/2261063513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc6006d9a0 0x7efc60175930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc5ffff640 1 --2- 172.21.15.184:0/2261063513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc60186210 0x7efc600f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc65013640 1 -- 172.21.15.184:0/2261063513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc6006d9a0 msgr2=0x7efc60175930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc65013640 1 --2- 172.21.15.184:0/2261063513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc6006d9a0 0x7efc60175930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc65013640 1 -- 172.21.15.184:0/2261063513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc60186210 msgr2=0x7efc600f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc65013640 1 --2- 172.21.15.184:0/2261063513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc60186210 0x7efc600f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc65013640 1 -- 172.21.15.184:0/2261063513 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c009400 con 0x7efc60186a00 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc64812640 1 --2- 172.21.15.184:0/2261063513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc6006d9a0 0x7efc60175930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc65013640 1 --2- 172.21.15.184:0/2261063513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc60186a00 0x7efc60180590 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efc5800b990 tx=0x7efc5800be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc5d7fa640 1 -- 172.21.15.184:0/2261063513 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800cba0 con 0x7efc60186a00 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc5d7fa640 1 -- 172.21.15.184:0/2261063513 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5800cd00 con 0x7efc60186a00 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc66a76640 1 -- 172.21.15.184:0/2261063513 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6006b970 con 0x7efc60186a00 2024-02-21T07:41:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc5d7fa640 1 -- 172.21.15.184:0/2261063513 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58014680 con 0x7efc60186a00 2024-02-21T07:41:43.498 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.489+0000 7efc66a76640 1 -- 172.21.15.184:0/2261063513 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6006bf30 con 0x7efc60186a00 2024-02-21T07:41:43.498 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.490+0000 7efc5d7fa640 1 -- 172.21.15.184:0/2261063513 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7efc580147e0 con 0x7efc60186a00 2024-02-21T07:41:43.498 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.490+0000 7efc5d7fa640 1 -- 172.21.15.184:0/2261063513 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7efc5801ec40 con 0x7efc60186a00 2024-02-21T07:41:43.498 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.490+0000 7efc66a76640 1 -- 172.21.15.184:0/2261063513 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6006c450 con 0x7efc60186a00 2024-02-21T07:41:43.498 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.493+0000 7efc5d7fa640 1 -- 172.21.15.184:0/2261063513 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efc6006c450 con 0x7efc60186a00 2024-02-21T07:41:43.505 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:43.500+0000 7f19fcd51040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T07:41:43.549 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:43.543+0000 7f9988693040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T07:41:43.558 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:43.553+0000 7f19fcd51040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T07:41:43.570 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.565+0000 7efc66a76640 1 -- 172.21.15.184:0/2261063513 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e", "id": 0} v 0) v1 -- 0x7efc60069d50 con 0x7efc60186a00 2024-02-21T07:41:43.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.574+0000 7efc5d7fa640 1 -- 172.21.15.184:0/2261063513 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7efc58019070 con 0x7efc60186a00 2024-02-21T07:41:43.580 INFO:teuthology.orchestra.run.smithi184.stdout:0 2024-02-21T07:41:43.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.575+0000 7efc66a76640 1 -- 172.21.15.184:0/2261063513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc60186a00 msgr2=0x7efc60180590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.575+0000 7efc66a76640 1 --2- 172.21.15.184:0/2261063513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc60186a00 0x7efc60180590 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7efc5800b990 tx=0x7efc5800be50 comp rx=0 tx=0).stop 2024-02-21T07:41:43.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.575+0000 7efc66a76640 1 -- 172.21.15.184:0/2261063513 shutdown_connections 2024-02-21T07:41:43.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.575+0000 7efc66a76640 1 --2- 172.21.15.184:0/2261063513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efc60186a00 0x7efc60180590 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.575+0000 7efc66a76640 1 --2- 172.21.15.184:0/2261063513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc60186210 0x7efc600f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.582 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.575+0000 7efc66a76640 1 --2- 172.21.15.184:0/2261063513 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efc6006d9a0 0x7efc60175930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.582 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.575+0000 7efc66a76640 1 -- 172.21.15.184:0/2261063513 >> 172.21.15.184:0/2261063513 conn(0x7efc600f7250 msgr2=0x7efc60181460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:43.582 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.575+0000 7efc66a76640 1 -- 172.21.15.184:0/2261063513 shutdown_connections 2024-02-21T07:41:43.582 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.575+0000 7efc66a76640 1 -- 172.21.15.184:0/2261063513 wait complete. 2024-02-21T07:41:43.591 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 042d13f7-fe8c-4305-bb57-ac48d115867d 1 2024-02-21T07:41:43.593 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:43.588+0000 7f9988693040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T07:41:43.601 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:43.596+0000 7f19fcd51040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T07:41:43.627 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:43.621+0000 7fa829241040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T07:41:43.689 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:43.683+0000 7fa829241040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T07:41:43.692 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.686+0000 7efdc388f640 1 Processor -- start 2024-02-21T07:41:43.692 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.686+0000 7efdc388f640 1 -- start start 2024-02-21T07:41:43.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.687+0000 7efdc388f640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efdbc186a00 0x7efdbc06d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.687+0000 7efdc388f640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efdbc06d9a0 0x7efdbc06ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.687+0000 7efdc388f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdbc071280 con 0x7efdbc186210 2024-02-21T07:41:43.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.687+0000 7efdc388f640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc189aa0 con 0x7efdbc186a00 2024-02-21T07:41:43.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.687+0000 7efdc388f640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdbc0f9050 con 0x7efdbc06d9a0 2024-02-21T07:41:43.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.688+0000 7efdc1e2c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efdbc06d9a0 0x7efdbc06ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.688+0000 7efdc1e2c640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efdbc06d9a0 0x7efdbc06ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32778/0 (socket says 172.21.15.184:32778) 2024-02-21T07:41:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.688+0000 7efdc162b640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7efdbc186210 0x7efdbc0fa060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:49866/0 (socket says 172.21.15.184:49866) 2024-02-21T07:41:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.688+0000 7efdc1e2c640 1 -- 172.21.15.184:0/3986919432 learned_addr learned my addr 172.21.15.184:0/3986919432 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.688+0000 7efdc0e2a640 1 --2- 172.21.15.184:0/3986919432 >> v2:172.21.15.174:3300/0 conn(0x7efdbc186a00 0x7efdbc06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.688+0000 7efdc1e2c640 1 -- 172.21.15.184:0/3986919432 >> v2:172.21.15.174:3300/0 conn(0x7efdbc186a00 msgr2=0x7efdbc06d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.688+0000 7efdc1e2c640 1 --2- 172.21.15.184:0/3986919432 >> v2:172.21.15.174:3300/0 conn(0x7efdbc186a00 0x7efdbc06d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.688+0000 7efdc1e2c640 1 -- 172.21.15.184:0/3986919432 >> v1:172.21.15.184:6789/0 conn(0x7efdbc186210 legacy=0x7efdbc0fa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.688+0000 7efdc1e2c640 1 -- 172.21.15.184:0/3986919432 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdbc0f9bd0 con 0x7efdbc06d9a0 2024-02-21T07:41:43.695 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.688+0000 7efdc0e2a640 1 --2- 172.21.15.184:0/3986919432 >> v2:172.21.15.174:3300/0 conn(0x7efdbc186a00 0x7efdbc06d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.689+0000 7efdc1e2c640 1 --2- 172.21.15.184:0/3986919432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc06d9a0 0x7efdbc06ea50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0ceb80 tx=0x7efdb402be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=392bbb1b6763e664 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.689+0000 7efdaffff640 1 -- 172.21.15.184:0/3986919432 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb402c9f0 con 0x7efdbc06d9a0 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.689+0000 7efdaffff640 1 -- 172.21.15.184:0/3986919432 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb402cb50 con 0x7efdbc06d9a0 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.689+0000 7efdaffff640 1 -- 172.21.15.184:0/3986919432 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb40343f0 con 0x7efdbc06d9a0 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.689+0000 7efdc388f640 1 -- 172.21.15.184:0/3986919432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc06d9a0 msgr2=0x7efdbc06ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.689+0000 7efdc388f640 1 --2- 172.21.15.184:0/3986919432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc06d9a0 0x7efdbc06ea50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0ceb80 tx=0x7efdb402be50 comp rx=0 tx=0).stop 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.689+0000 7efdc388f640 1 -- 172.21.15.184:0/3986919432 shutdown_connections 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.690+0000 7efdc388f640 1 --2- 172.21.15.184:0/3986919432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc06d9a0 0x7efdbc06ea50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.690+0000 7efdc388f640 1 --2- 172.21.15.184:0/3986919432 >> v2:172.21.15.174:3300/0 conn(0x7efdbc186a00 0x7efdbc06d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.690+0000 7efdc388f640 1 -- 172.21.15.184:0/3986919432 >> 172.21.15.184:0/3986919432 conn(0x7efdbc0f7250 msgr2=0x7efdbc0f7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:43.697 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.690+0000 7efdc388f640 1 -- 172.21.15.184:0/3986919432 shutdown_connections 2024-02-21T07:41:43.698 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.690+0000 7efdc388f640 1 -- 172.21.15.184:0/3986919432 wait complete. 2024-02-21T07:41:43.698 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.691+0000 7efdc388f640 1 Processor -- start 2024-02-21T07:41:43.698 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.691+0000 7efdc388f640 1 -- start start 2024-02-21T07:41:43.699 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc388f640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdbc06d9a0 0x7efdbc18a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc388f640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdbc186210 0x7efdbc1758c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc388f640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc186a00 0x7efdbc175e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc388f640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc18bca0 con 0x7efdbc06d9a0 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc388f640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc18ad40 con 0x7efdbc186210 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc388f640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdbc18b020 con 0x7efdbc186a00 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc1e2c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc186a00 0x7efdbc175e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc1e2c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc186a00 0x7efdbc175e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32780/0 (socket says 172.21.15.184:32780) 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc1e2c640 1 -- 172.21.15.184:0/3538879182 learned_addr learned my addr 172.21.15.184:0/3538879182 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc0e2a640 1 --2- 172.21.15.184:0/3538879182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdbc186210 0x7efdbc1758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc1e2c640 1 -- 172.21.15.184:0/3538879182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdbc186210 msgr2=0x7efdbc1758c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc1e2c640 1 --2- 172.21.15.184:0/3538879182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdbc186210 0x7efdbc1758c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc1e2c640 1 -- 172.21.15.184:0/3538879182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdbc06d9a0 msgr2=0x7efdbc18a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.700 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc1e2c640 1 --2- 172.21.15.184:0/3538879182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdbc06d9a0 0x7efdbc18a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc1e2c640 1 -- 172.21.15.184:0/3538879182 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4009b30 con 0x7efdbc186a00 2024-02-21T07:41:43.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.692+0000 7efdc1e2c640 1 --2- 172.21.15.184:0/3538879182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc186a00 0x7efdbc175e00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efdb4036040 tx=0x7efdb4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:43.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.693+0000 7efdadffb640 1 -- 172.21.15.184:0/3538879182 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb4009510 con 0x7efdbc186a00 2024-02-21T07:41:43.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.693+0000 7efdadffb640 1 -- 172.21.15.184:0/3538879182 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb403e450 con 0x7efdbc186a00 2024-02-21T07:41:43.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.693+0000 7efdc388f640 1 -- 172.21.15.184:0/3538879182 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdbc18b300 con 0x7efdbc186a00 2024-02-21T07:41:43.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.693+0000 7efdadffb640 1 -- 172.21.15.184:0/3538879182 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb403e800 con 0x7efdbc186a00 2024-02-21T07:41:43.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.693+0000 7efdc388f640 1 -- 172.21.15.184:0/3538879182 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdbc18b8c0 con 0x7efdbc186a00 2024-02-21T07:41:43.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.693+0000 7efdadffb640 1 -- 172.21.15.184:0/3538879182 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7efdb403e960 con 0x7efdbc186a00 2024-02-21T07:41:43.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.693+0000 7efdadffb640 1 -- 172.21.15.184:0/3538879182 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7efdb403f400 con 0x7efdbc186a00 2024-02-21T07:41:43.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.694+0000 7efdc388f640 1 -- 172.21.15.184:0/3538879182 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdbc069d50 con 0x7efdbc186a00 2024-02-21T07:41:43.702 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.696+0000 7efdadffb640 1 -- 172.21.15.184:0/3538879182 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efdb4066dd0 con 0x7efdbc186a00 2024-02-21T07:41:43.715 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:43.710+0000 7f9988693040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T07:41:43.717 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:43.712+0000 7f19fcd51040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T07:41:43.740 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:43.734+0000 7fa829241040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T07:41:43.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.768+0000 7efdc388f640 1 -- 172.21.15.184:0/3538879182 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "042d13f7-fe8c-4305-bb57-ac48d115867d", "id": 1} v 0) v1 -- 0x7efdbc06fa30 con 0x7efdbc186a00 2024-02-21T07:41:43.783 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.778+0000 7efdadffb640 1 -- 172.21.15.184:0/3538879182 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "042d13f7-fe8c-4305-bb57-ac48d115867d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7efdb4055030 con 0x7efdbc186a00 2024-02-21T07:41:43.783 INFO:teuthology.orchestra.run.smithi184.stdout:1 2024-02-21T07:41:43.784 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.779+0000 7efdc388f640 1 -- 172.21.15.184:0/3538879182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc186a00 msgr2=0x7efdbc175e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.785 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.779+0000 7efdc388f640 1 --2- 172.21.15.184:0/3538879182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc186a00 0x7efdbc175e00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efdb4036040 tx=0x7efdb4004a40 comp rx=0 tx=0).stop 2024-02-21T07:41:43.785 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.779+0000 7efdc388f640 1 -- 172.21.15.184:0/3538879182 shutdown_connections 2024-02-21T07:41:43.785 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.779+0000 7efdc388f640 1 --2- 172.21.15.184:0/3538879182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdbc186a00 0x7efdbc175e00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.785 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.779+0000 7efdc388f640 1 --2- 172.21.15.184:0/3538879182 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdbc186210 0x7efdbc1758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.785 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.779+0000 7efdc388f640 1 --2- 172.21.15.184:0/3538879182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdbc06d9a0 0x7efdbc18a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.785 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.779+0000 7efdc388f640 1 -- 172.21.15.184:0/3538879182 >> 172.21.15.184:0/3538879182 conn(0x7efdbc0f7250 msgr2=0x7efdbc0729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:43.785 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.779+0000 7efdc388f640 1 -- 172.21.15.184:0/3538879182 shutdown_connections 2024-02-21T07:41:43.785 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.779+0000 7efdc388f640 1 -- 172.21.15.184:0/3538879182 wait complete. 2024-02-21T07:41:43.786 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:43.782+0000 7f19fcd51040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T07:41:43.788 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:43.782+0000 7f9988693040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T07:41:43.795 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 8de34f92-bca8-48b6-88ca-d99a70ebbab3 2 2024-02-21T07:41:43.803 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:43.797+0000 7fa829241040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T07:41:43.833 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:43.828+0000 7f19fcd51040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T07:41:43.837 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:43.832+0000 7f9988693040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T07:41:43.852 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:43.846+0000 7fa829241040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T07:41:43.884 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:43.879+0000 7f19fcd51040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T07:41:43.892 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:43.886+0000 7f9988693040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T07:41:43.895 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.890+0000 7f66920f4640 1 Processor -- start 2024-02-21T07:41:43.895 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.890+0000 7f66920f4640 1 -- start start 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f66920f4640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f668c17f4e0 0x7f668c070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f66920f4640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f668c071750 0x7f668c1889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f66920f4640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668c17f8c0 con 0x7f668c0712d0 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f66920f4640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c06caa0 con 0x7f668c071750 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f66920f4640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c06f6e0 con 0x7f668c17f4e0 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f668b7fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f668c17f4e0 0x7f668c070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f668b7fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f668c17f4e0 0x7f668c070780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32790/0 (socket says 172.21.15.184:32790) 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f668b7fe640 1 -- 172.21.15.184:0/2181136805 learned_addr learned my addr 172.21.15.184:0/2181136805 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f668bfff640 1 --2- 172.21.15.184:0/2181136805 >> v2:172.21.15.174:3300/0 conn(0x7f668c071750 0x7f668c1889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f668b7fe640 1 -- 172.21.15.184:0/2181136805 >> v2:172.21.15.174:3300/0 conn(0x7f668c071750 msgr2=0x7f668c1889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:43.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f668b7fe640 1 --2- 172.21.15.184:0/2181136805 >> v2:172.21.15.174:3300/0 conn(0x7f668c071750 0x7f668c1889c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f668b7fe640 1 -- 172.21.15.184:0/2181136805 >> v1:172.21.15.69:6789/0 conn(0x7f668c0712d0 legacy=0x7f668c074280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:43.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.891+0000 7f668b7fe640 1 -- 172.21.15.184:0/2181136805 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c06f9c0 con 0x7f668c17f4e0 2024-02-21T07:41:43.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.892+0000 7f668b7fe640 1 --2- 172.21.15.184:0/2181136805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 0x7f668c070780 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f668c0f7a80 tx=0x7f668002b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4b12d4485647d8c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:43.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.892+0000 7f668a7fc640 1 -- 172.21.15.184:0/2181136805 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800317e0 con 0x7f668c17f4e0 2024-02-21T07:41:43.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.892+0000 7f668a7fc640 1 -- 172.21.15.184:0/2181136805 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6680031940 con 0x7f668c17f4e0 2024-02-21T07:41:43.899 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.892+0000 7f668a7fc640 1 -- 172.21.15.184:0/2181136805 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680031cd0 con 0x7f668c17f4e0 2024-02-21T07:41:43.900 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.893+0000 7f66920f4640 1 -- 172.21.15.184:0/2181136805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 msgr2=0x7f668c070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.900 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.893+0000 7f66920f4640 1 --2- 172.21.15.184:0/2181136805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 0x7f668c070780 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f668c0f7a80 tx=0x7f668002b880 comp rx=0 tx=0).stop 2024-02-21T07:41:43.900 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.893+0000 7f66920f4640 1 -- 172.21.15.184:0/2181136805 shutdown_connections 2024-02-21T07:41:43.900 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.893+0000 7f66920f4640 1 --2- 172.21.15.184:0/2181136805 >> v2:172.21.15.174:3300/0 conn(0x7f668c071750 0x7f668c1889c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.900 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.893+0000 7f66920f4640 1 --2- 172.21.15.184:0/2181136805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 0x7f668c070780 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.900 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.893+0000 7f66920f4640 1 -- 172.21.15.184:0/2181136805 >> 172.21.15.184:0/2181136805 conn(0x7f668c0cf570 msgr2=0x7f668c0cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:43.901 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.893+0000 7f66920f4640 1 -- 172.21.15.184:0/2181136805 shutdown_connections 2024-02-21T07:41:43.901 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.893+0000 7f66920f4640 1 -- 172.21.15.184:0/2181136805 wait complete. 2024-02-21T07:41:43.901 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.894+0000 7f66920f4640 1 Processor -- start 2024-02-21T07:41:43.901 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.894+0000 7f66920f4640 1 -- start start 2024-02-21T07:41:43.903 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.895+0000 7f66920f4640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f668c0712d0 0x7f668c168390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.903 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.895+0000 7f66920f4640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c071750 0x7f668c17fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.903 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.895+0000 7f66920f4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 0x7f668c21fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:43.903 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.895+0000 7f66920f4640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c1812e0 con 0x7f668c0712d0 2024-02-21T07:41:43.903 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.895+0000 7f66920f4640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c180380 con 0x7f668c071750 2024-02-21T07:41:43.903 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.895+0000 7f66920f4640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c180660 con 0x7f668c17f4e0 2024-02-21T07:41:43.903 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.895+0000 7f668bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 0x7f668c21fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.903 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f668bfff640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 0x7f668c21fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32798/0 (socket says 172.21.15.184:32798) 2024-02-21T07:41:43.903 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f668bfff640 1 -- 172.21.15.184:0/2108424822 learned_addr learned my addr 172.21.15.184:0/2108424822 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f668affd640 1 --2- 172.21.15.184:0/2108424822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c071750 0x7f668c17fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f668bfff640 1 -- 172.21.15.184:0/2108424822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c071750 msgr2=0x7f668c17fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f668bfff640 1 --2- 172.21.15.184:0/2108424822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c071750 0x7f668c17fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f668bfff640 1 -- 172.21.15.184:0/2108424822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f668c0712d0 msgr2=0x7f668c168390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f668bfff640 1 --2- 172.21.15.184:0/2108424822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f668c0712d0 0x7f668c168390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f668bfff640 1 -- 172.21.15.184:0/2108424822 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800094d0 con 0x7f668c17f4e0 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f668bfff640 1 --2- 172.21.15.184:0/2108424822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 0x7f668c21fc30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6684007e40 tx=0x7f668400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f6673fff640 1 -- 172.21.15.184:0/2108424822 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684014620 con 0x7f668c17f4e0 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f6673fff640 1 -- 172.21.15.184:0/2108424822 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668400ee90 con 0x7f668c17f4e0 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f66920f4640 1 -- 172.21.15.184:0/2108424822 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668c180940 con 0x7f668c17f4e0 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f6673fff640 1 -- 172.21.15.184:0/2108424822 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66840149e0 con 0x7f668c17f4e0 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f66920f4640 1 -- 172.21.15.184:0/2108424822 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668c180f00 con 0x7f668c17f4e0 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f6673fff640 1 -- 172.21.15.184:0/2108424822 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6684014b40 con 0x7f668c17f4e0 2024-02-21T07:41:43.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.896+0000 7f6673fff640 1 -- 172.21.15.184:0/2108424822 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f668401d7e0 con 0x7f668c17f4e0 2024-02-21T07:41:43.905 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.897+0000 7f66920f4640 1 -- 172.21.15.184:0/2108424822 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668c181090 con 0x7f668c17f4e0 2024-02-21T07:41:43.905 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.900+0000 7f6673fff640 1 -- 172.21.15.184:0/2108424822 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f668401d3c0 con 0x7f668c17f4e0 2024-02-21T07:41:43.932 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:43.927+0000 7f19fcd51040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T07:41:43.942 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:43.936+0000 7f9988693040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T07:41:43.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.971+0000 7f66920f4640 1 -- 172.21.15.184:0/2108424822 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8de34f92-bca8-48b6-88ca-d99a70ebbab3", "id": 2} v 0) v1 -- 0x7f668c069d50 con 0x7f668c17f4e0 2024-02-21T07:41:43.981 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:43.975+0000 7fa829241040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T07:41:43.986 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.980+0000 7f6673fff640 1 -- 172.21.15.184:0/2108424822 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8de34f92-bca8-48b6-88ca-d99a70ebbab3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f668401dac0 con 0x7f668c17f4e0 2024-02-21T07:41:43.986 INFO:teuthology.orchestra.run.smithi184.stdout:2 2024-02-21T07:41:43.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.981+0000 7f66920f4640 1 -- 172.21.15.184:0/2108424822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 msgr2=0x7f668c21fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:43.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.981+0000 7f66920f4640 1 --2- 172.21.15.184:0/2108424822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 0x7f668c21fc30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6684007e40 tx=0x7f668400e4b0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.981+0000 7f66920f4640 1 -- 172.21.15.184:0/2108424822 shutdown_connections 2024-02-21T07:41:43.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.981+0000 7f66920f4640 1 --2- 172.21.15.184:0/2108424822 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f668c17f4e0 0x7f668c21fc30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.981+0000 7f66920f4640 1 --2- 172.21.15.184:0/2108424822 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f668c071750 0x7f668c17fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.981+0000 7f66920f4640 1 --2- 172.21.15.184:0/2108424822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f668c0712d0 0x7f668c168390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:43.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.981+0000 7f66920f4640 1 -- 172.21.15.184:0/2108424822 >> 172.21.15.184:0/2108424822 conn(0x7f668c0cf570 msgr2=0x7f668c0d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:43.988 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.981+0000 7f66920f4640 1 -- 172.21.15.184:0/2108424822 shutdown_connections 2024-02-21T07:41:43.988 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:43.981+0000 7f66920f4640 1 -- 172.21.15.184:0/2108424822 wait complete. 2024-02-21T07:41:43.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new ca765220-c544-477d-b62e-e46cfc2507a3 3 2024-02-21T07:41:44.060 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:44.054+0000 7fa829241040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T07:41:44.113 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:44.107+0000 7fa829241040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T07:41:44.139 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.133+0000 7fa8ceefb640 1 Processor -- start 2024-02-21T07:41:44.139 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.133+0000 7fa8ceefb640 1 -- start start 2024-02-21T07:41:44.140 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.134+0000 7fa8ceefb640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa8c806dcd0 0x7fa8c81875e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.140 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.134+0000 7fa8ceefb640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa8c8185700 0x7fa8c8185bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.134+0000 7fa8ceefb640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c806f0f0 con 0x7fa8c8182e90 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.134+0000 7fa8ceefb640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c8187b20 con 0x7fa8c806dcd0 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.134+0000 7fa8ceefb640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c806e200 con 0x7fa8c8185700 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.134+0000 7fa8cd498640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa8c8185700 0x7fa8c8185bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.134+0000 7fa8cd498640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa8c8185700 0x7fa8c8185bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32800/0 (socket says 172.21.15.184:32800) 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.134+0000 7fa8cd498640 1 -- 172.21.15.184:0/1971534809 learned_addr learned my addr 172.21.15.184:0/1971534809 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.134+0000 7fa8c7fff640 1 --2- 172.21.15.184:0/1971534809 >> v2:172.21.15.174:3300/0 conn(0x7fa8c806dcd0 0x7fa8c81875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.135+0000 7fa8cd498640 1 -- 172.21.15.184:0/1971534809 >> v2:172.21.15.174:3300/0 conn(0x7fa8c806dcd0 msgr2=0x7fa8c81875e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.135+0000 7fa8cd498640 1 --2- 172.21.15.184:0/1971534809 >> v2:172.21.15.174:3300/0 conn(0x7fa8c806dcd0 0x7fa8c81875e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.135+0000 7fa8cd498640 1 -- 172.21.15.184:0/1971534809 >> v1:172.21.15.69:6789/0 conn(0x7fa8c8182e90 legacy=0x7fa8c8186ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:44.141 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.135+0000 7fa8cd498640 1 -- 172.21.15.184:0/1971534809 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c806e4e0 con 0x7fa8c8185700 2024-02-21T07:41:44.142 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.135+0000 7fa8cd498640 1 --2- 172.21.15.184:0/1971534809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c8185700 0x7fa8c8185bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80f5e20 tx=0x7fa8c002bdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d6050c0872ba1fe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:44.142 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.135+0000 7fa8c77fe640 1 -- 172.21.15.184:0/1971534809 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c002c960 con 0x7fa8c8185700 2024-02-21T07:41:44.143 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.135+0000 7fa8c77fe640 1 -- 172.21.15.184:0/1971534809 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c002cac0 con 0x7fa8c8185700 2024-02-21T07:41:44.143 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.135+0000 7fa8c77fe640 1 -- 172.21.15.184:0/1971534809 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c002ce50 con 0x7fa8c8185700 2024-02-21T07:41:44.143 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.136+0000 7fa8ceefb640 1 -- 172.21.15.184:0/1971534809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c8185700 msgr2=0x7fa8c8185bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.143 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.136+0000 7fa8ceefb640 1 --2- 172.21.15.184:0/1971534809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c8185700 0x7fa8c8185bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80f5e20 tx=0x7fa8c002bdc0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.143 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.136+0000 7fa8ceefb640 1 -- 172.21.15.184:0/1971534809 shutdown_connections 2024-02-21T07:41:44.143 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.136+0000 7fa8ceefb640 1 --2- 172.21.15.184:0/1971534809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c8185700 0x7fa8c8185bb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.143 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.136+0000 7fa8ceefb640 1 --2- 172.21.15.184:0/1971534809 >> v2:172.21.15.174:3300/0 conn(0x7fa8c806dcd0 0x7fa8c81875e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.143 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.136+0000 7fa8ceefb640 1 -- 172.21.15.184:0/1971534809 >> 172.21.15.184:0/1971534809 conn(0x7fa8c80cf570 msgr2=0x7fa8c80cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:44.143 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.136+0000 7fa8ceefb640 1 -- 172.21.15.184:0/1971534809 shutdown_connections 2024-02-21T07:41:44.143 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.136+0000 7fa8ceefb640 1 -- 172.21.15.184:0/1971534809 wait complete. 2024-02-21T07:41:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.138+0000 7fa8ceefb640 1 Processor -- start 2024-02-21T07:41:44.144 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.138+0000 7fa8ceefb640 1 -- start start 2024-02-21T07:41:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ceefb640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c806dcd0 0x7fa8c816f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ceefb640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8182e90 0x7fa8c8184740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ceefb640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8c8185700 0x7fa8c8184c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ceefb640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8221cd0 con 0x7fa8c8182e90 2024-02-21T07:41:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ceefb640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c81836a0 con 0x7fa8c8185700 2024-02-21T07:41:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ceefb640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8183980 con 0x7fa8c806dcd0 2024-02-21T07:41:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ccc97640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c806dcd0 0x7fa8c816f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.146 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ccc97640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c806dcd0 0x7fa8c816f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32806/0 (socket says 172.21.15.184:32806) 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ccc97640 1 -- 172.21.15.184:0/2660922210 learned_addr learned my addr 172.21.15.184:0/2660922210 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8cd498640 1 --2- 172.21.15.184:0/2660922210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8c8185700 0x7fa8c8184c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ccc97640 1 -- 172.21.15.184:0/2660922210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8c8185700 msgr2=0x7fa8c8184c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ccc97640 1 --2- 172.21.15.184:0/2660922210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8c8185700 0x7fa8c8184c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ccc97640 1 -- 172.21.15.184:0/2660922210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8182e90 msgr2=0x7fa8c8184740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ccc97640 1 --2- 172.21.15.184:0/2660922210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8182e90 0x7fa8c8184740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ccc97640 1 -- 172.21.15.184:0/2660922210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c0009b30 con 0x7fa8c806dcd0 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ccc97640 1 --2- 172.21.15.184:0/2660922210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c806dcd0 0x7fa8c816f120 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00b3e0 tx=0x7fa8bc00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8c57fa640 1 -- 172.21.15.184:0/2660922210 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011830 con 0x7fa8c806dcd0 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8c57fa640 1 -- 172.21.15.184:0/2660922210 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0119b0 con 0x7fa8c806dcd0 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ceefb640 1 -- 172.21.15.184:0/2660922210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c8183c60 con 0x7fa8c806dcd0 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8c57fa640 1 -- 172.21.15.184:0/2660922210 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc011d60 con 0x7fa8c806dcd0 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.139+0000 7fa8ceefb640 1 -- 172.21.15.184:0/2660922210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c8184220 con 0x7fa8c806dcd0 2024-02-21T07:41:44.147 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.140+0000 7fa8c57fa640 1 -- 172.21.15.184:0/2660922210 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa8bc01a790 con 0x7fa8c806dcd0 2024-02-21T07:41:44.148 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.140+0000 7fa8c57fa640 1 -- 172.21.15.184:0/2660922210 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa8bc010380 con 0x7fa8c806dcd0 2024-02-21T07:41:44.148 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.140+0000 7fa8ceefb640 1 -- 172.21.15.184:0/2660922210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c8069d50 con 0x7fa8c806dcd0 2024-02-21T07:41:44.148 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.142+0000 7fa8c57fa640 1 -- 172.21.15.184:0/2660922210 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa8bc039dd0 con 0x7fa8c806dcd0 2024-02-21T07:41:44.173 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:44.167+0000 7fa829241040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T07:41:44.220 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.214+0000 7fa8ceefb640 1 -- 172.21.15.184:0/2660922210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca765220-c544-477d-b62e-e46cfc2507a3", "id": 3} v 0) v1 -- 0x7fa8c8187520 con 0x7fa8c806dcd0 2024-02-21T07:41:44.227 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:44.221+0000 7fa829241040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T07:41:44.229 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.223+0000 7fa8c57fa640 1 -- 172.21.15.184:0/2660922210 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca765220-c544-477d-b62e-e46cfc2507a3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa8bc028030 con 0x7fa8c806dcd0 2024-02-21T07:41:44.229 INFO:teuthology.orchestra.run.smithi184.stdout:3 2024-02-21T07:41:44.231 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.224+0000 7fa8ceefb640 1 -- 172.21.15.184:0/2660922210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c806dcd0 msgr2=0x7fa8c816f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.231 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.224+0000 7fa8ceefb640 1 --2- 172.21.15.184:0/2660922210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c806dcd0 0x7fa8c816f120 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00b3e0 tx=0x7fa8bc00b8a0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.231 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.224+0000 7fa8ceefb640 1 -- 172.21.15.184:0/2660922210 shutdown_connections 2024-02-21T07:41:44.231 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.224+0000 7fa8ceefb640 1 --2- 172.21.15.184:0/2660922210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa8c8185700 0x7fa8c8184c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.224+0000 7fa8ceefb640 1 --2- 172.21.15.184:0/2660922210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8c8182e90 0x7fa8c8184740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.224+0000 7fa8ceefb640 1 --2- 172.21.15.184:0/2660922210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8c806dcd0 0x7fa8c816f120 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.224+0000 7fa8ceefb640 1 -- 172.21.15.184:0/2660922210 >> 172.21.15.184:0/2660922210 conn(0x7fa8c80cf570 msgr2=0x7fa8c806fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:44.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.225+0000 7fa8ceefb640 1 -- 172.21.15.184:0/2660922210 shutdown_connections 2024-02-21T07:41:44.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.225+0000 7fa8ceefb640 1 -- 172.21.15.184:0/2660922210 wait complete. 2024-02-21T07:41:44.241 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new ad332dc5-a949-4e4d-ba9b-22904c8a805b 4 2024-02-21T07:41:44.310 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:44.305+0000 7f19fcd51040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T07:41:44.337 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:44.331+0000 7f9988693040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T07:41:44.341 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.336+0000 7f5d749d7640 1 Processor -- start 2024-02-21T07:41:44.341 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.336+0000 7f5d749d7640 1 -- start start 2024-02-21T07:41:44.343 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d749d7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5d70189d80 0x7f5d701872d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.343 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d749d7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5d7006da30 0x7f5d7006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.343 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d749d7640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d70180c30 con 0x7f5d7018a160 2024-02-21T07:41:44.343 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d749d7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7006e420 con 0x7f5d70189d80 2024-02-21T07:41:44.343 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d749d7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7018acc0 con 0x7f5d7006da30 2024-02-21T07:41:44.343 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d6dd9b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5d7006da30 0x7f5d7006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.343 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d6dd9b640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5d7006da30 0x7f5d7006dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32812/0 (socket says 172.21.15.184:32812) 2024-02-21T07:41:44.343 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d6dd9b640 1 -- 172.21.15.184:0/756894633 learned_addr learned my addr 172.21.15.184:0/756894633 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:44.344 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d6e59c640 1 --2- 172.21.15.184:0/756894633 >> v2:172.21.15.174:3300/0 conn(0x7f5d70189d80 0x7f5d701872d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.344 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d6dd9b640 1 -- 172.21.15.184:0/756894633 >> v2:172.21.15.174:3300/0 conn(0x7f5d70189d80 msgr2=0x7f5d701872d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:44.344 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d6dd9b640 1 --2- 172.21.15.184:0/756894633 >> v2:172.21.15.174:3300/0 conn(0x7f5d70189d80 0x7f5d701872d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.344 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d6dd9b640 1 -- 172.21.15.184:0/756894633 >> v1:172.21.15.69:6789/0 conn(0x7f5d7018a160 legacy=0x7f5d7018a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:44.344 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.337+0000 7f5d6dd9b640 1 -- 172.21.15.184:0/756894633 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7008df50 con 0x7f5d7006da30 2024-02-21T07:41:44.345 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.338+0000 7f5d6dd9b640 1 --2- 172.21.15.184:0/756894633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d7006da30 0x7f5d7006dee0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5d700908a0 tx=0x7f5d6002b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94d71be21975198b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:44.345 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.338+0000 7f5d6d59a640 1 -- 172.21.15.184:0/756894633 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60031750 con 0x7f5d7006da30 2024-02-21T07:41:44.345 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.338+0000 7f5d6d59a640 1 -- 172.21.15.184:0/756894633 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d600318b0 con 0x7f5d7006da30 2024-02-21T07:41:44.345 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.338+0000 7f5d6d59a640 1 -- 172.21.15.184:0/756894633 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60031c40 con 0x7f5d7006da30 2024-02-21T07:41:44.345 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.339+0000 7f5d749d7640 1 -- 172.21.15.184:0/756894633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d7006da30 msgr2=0x7f5d7006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.345 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.339+0000 7f5d749d7640 1 --2- 172.21.15.184:0/756894633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d7006da30 0x7f5d7006dee0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5d700908a0 tx=0x7f5d6002b7f0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.345 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.339+0000 7f5d749d7640 1 -- 172.21.15.184:0/756894633 shutdown_connections 2024-02-21T07:41:44.345 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.339+0000 7f5d749d7640 1 --2- 172.21.15.184:0/756894633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d7006da30 0x7f5d7006dee0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.339+0000 7f5d749d7640 1 --2- 172.21.15.184:0/756894633 >> v2:172.21.15.174:3300/0 conn(0x7f5d70189d80 0x7f5d701872d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.339+0000 7f5d749d7640 1 -- 172.21.15.184:0/756894633 >> 172.21.15.184:0/756894633 conn(0x7f5d700f8ba0 msgr2=0x7f5d700f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:44.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.339+0000 7f5d749d7640 1 -- 172.21.15.184:0/756894633 shutdown_connections 2024-02-21T07:41:44.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.339+0000 7f5d749d7640 1 -- 172.21.15.184:0/756894633 wait complete. 2024-02-21T07:41:44.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.341+0000 7f5d749d7640 1 Processor -- start 2024-02-21T07:41:44.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.341+0000 7f5d749d7640 1 -- start start 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.341+0000 7f5d749d7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d7006da30 0x7f5d7017aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.341+0000 7f5d749d7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d70189d80 0x7f5d7017b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d749d7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d7018a160 0x7f5d701665c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d749d7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7017c940 con 0x7f5d7018a160 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d749d7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7017ba50 con 0x7f5d7006da30 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d749d7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7017bd30 con 0x7f5d70189d80 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d6dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d70189d80 0x7f5d7017b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d6dd9b640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d70189d80 0x7f5d7017b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32820/0 (socket says 172.21.15.184:32820) 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d6dd9b640 1 -- 172.21.15.184:0/3225573044 learned_addr learned my addr 172.21.15.184:0/3225573044 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d6e59c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d7006da30 0x7f5d7017aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d6dd9b640 1 -- 172.21.15.184:0/3225573044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d7006da30 msgr2=0x7f5d7017aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d6dd9b640 1 --2- 172.21.15.184:0/3225573044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d7006da30 0x7f5d7017aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d6dd9b640 1 -- 172.21.15.184:0/3225573044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d7018a160 msgr2=0x7f5d701665c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d6dd9b640 1 --2- 172.21.15.184:0/3225573044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d7018a160 0x7f5d701665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d6dd9b640 1 -- 172.21.15.184:0/3225573044 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d600094d0 con 0x7f5d70189d80 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d6dd9b640 1 --2- 172.21.15.184:0/3225573044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d70189d80 0x7f5d7017b410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5d60000c00 tx=0x7f5d600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d5effd640 1 -- 172.21.15.184:0/3225573044 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60033950 con 0x7f5d70189d80 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d5effd640 1 -- 172.21.15.184:0/3225573044 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d60033ad0 con 0x7f5d70189d80 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d749d7640 1 -- 172.21.15.184:0/3225573044 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7017c010 con 0x7f5d70189d80 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d5effd640 1 -- 172.21.15.184:0/3225573044 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60033e80 con 0x7f5d70189d80 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d749d7640 1 -- 172.21.15.184:0/3225573044 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7017c5d0 con 0x7f5d70189d80 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.342+0000 7f5d5effd640 1 -- 172.21.15.184:0/3225573044 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5d6003a040 con 0x7f5d70189d80 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.343+0000 7f5d5effd640 1 -- 172.21.15.184:0/3225573044 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f5d6003caf0 con 0x7f5d70189d80 2024-02-21T07:41:44.350 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.343+0000 7f5d749d7640 1 -- 172.21.15.184:0/3225573044 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7017caf0 con 0x7f5d70189d80 2024-02-21T07:41:44.351 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.345+0000 7f5d5effd640 1 -- 172.21.15.184:0/3225573044 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5d7017caf0 con 0x7f5d70189d80 2024-02-21T07:41:44.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.417+0000 7f5d749d7640 1 -- 172.21.15.184:0/3225573044 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ad332dc5-a949-4e4d-ba9b-22904c8a805b", "id": 4} v 0) v1 -- 0x7f5d7017c760 con 0x7f5d70189d80 2024-02-21T07:41:44.428 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.423+0000 7f5d5effd640 1 -- 172.21.15.184:0/3225573044 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad332dc5-a949-4e4d-ba9b-22904c8a805b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5d6004d060 con 0x7f5d70189d80 2024-02-21T07:41:44.429 INFO:teuthology.orchestra.run.smithi184.stdout:4 2024-02-21T07:41:44.430 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.424+0000 7f5d749d7640 1 -- 172.21.15.184:0/3225573044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d70189d80 msgr2=0x7f5d7017b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.430 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.424+0000 7f5d749d7640 1 --2- 172.21.15.184:0/3225573044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d70189d80 0x7f5d7017b410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5d60000c00 tx=0x7f5d600046c0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.430 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.424+0000 7f5d749d7640 1 -- 172.21.15.184:0/3225573044 shutdown_connections 2024-02-21T07:41:44.430 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.424+0000 7f5d749d7640 1 --2- 172.21.15.184:0/3225573044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d7018a160 0x7f5d701665c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.430 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.424+0000 7f5d749d7640 1 --2- 172.21.15.184:0/3225573044 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5d70189d80 0x7f5d7017b410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.430 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.424+0000 7f5d749d7640 1 --2- 172.21.15.184:0/3225573044 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5d7006da30 0x7f5d7017aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.430 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.424+0000 7f5d749d7640 1 -- 172.21.15.184:0/3225573044 >> 172.21.15.184:0/3225573044 conn(0x7f5d700f8ba0 msgr2=0x7f5d7018a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:44.430 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.424+0000 7f5d749d7640 1 -- 172.21.15.184:0/3225573044 shutdown_connections 2024-02-21T07:41:44.430 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.424+0000 7f5d749d7640 1 -- 172.21.15.184:0/3225573044 wait complete. 2024-02-21T07:41:44.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 2f062c18-b9e3-4229-8df3-88b1808c84a9 5 2024-02-21T07:41:44.444 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:44.439+0000 7f19fcd51040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T07:41:44.479 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:44.473+0000 7f9988693040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T07:41:44.541 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.535+0000 7f5dddc1c640 1 Processor -- start 2024-02-21T07:41:44.541 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.535+0000 7f5dddc1c640 1 -- start start 2024-02-21T07:41:44.543 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.536+0000 7f5dddc1c640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5dd817f4e0 0x7f5dd8070780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.543 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.536+0000 7f5dddc1c640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5dd8071750 0x7f5dd81889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.543 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.536+0000 7f5dddc1c640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd817f8c0 con 0x7f5dd80712d0 2024-02-21T07:41:44.543 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.536+0000 7f5dddc1c640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd806caa0 con 0x7f5dd817f4e0 2024-02-21T07:41:44.543 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.536+0000 7f5dddc1c640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd806f6e0 con 0x7f5dd8071750 2024-02-21T07:41:44.543 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.536+0000 7f5dd6ffd640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f5dd80712d0 0x7f5dd8074280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:49876/0 (socket says 172.21.15.184:49876) 2024-02-21T07:41:44.543 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.537+0000 7f5dd6ffd640 1 -- 172.21.15.184:0/1695975962 learned_addr learned my addr 172.21.15.184:0/1695975962 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-21T07:41:44.543 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.537+0000 7f5dd7fff640 1 --2- 172.21.15.184:0/1695975962 >> v2:172.21.15.174:3300/0 conn(0x7f5dd8071750 0x7f5dd81889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.543 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.537+0000 7f5dd67fc640 1 -- 172.21.15.184:0/1695975962 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594980380 0 0) 0x7f5dd817f8c0 con 0x7f5dd80712d0 2024-02-21T07:41:44.544 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.537+0000 7f5dd67fc640 1 -- 172.21.15.184:0/1695975962 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc0003520 con 0x7f5dd80712d0 2024-02-21T07:41:44.544 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.537+0000 7f5dd77fe640 1 --2- 172.21.15.184:0/1695975962 >> v2:172.21.15.69:3300/0 conn(0x7f5dd817f4e0 0x7f5dd8070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.544 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.537+0000 7f5dd7fff640 1 -- 172.21.15.184:0/1695975962 >> v2:172.21.15.69:3300/0 conn(0x7f5dd817f4e0 msgr2=0x7f5dd8070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:44.544 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.537+0000 7f5dd7fff640 1 --2- 172.21.15.184:0/1695975962 >> v2:172.21.15.69:3300/0 conn(0x7f5dd817f4e0 0x7f5dd8070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.544 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.537+0000 7f5dd7fff640 1 -- 172.21.15.184:0/1695975962 >> v1:172.21.15.184:6789/0 conn(0x7f5dd80712d0 legacy=0x7f5dd8074280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.544 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.537+0000 7f5dd67fc640 1 -- 172.21.15.184:0/1695975962 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2413871695 0 0) 0x7f5dc0003520 con 0x7f5dd80712d0 2024-02-21T07:41:44.544 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.537+0000 7f5dd7fff640 1 -- 172.21.15.184:0/1695975962 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd806f9c0 con 0x7f5dd8071750 2024-02-21T07:41:44.545 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.538+0000 7f5dd7fff640 1 --2- 172.21.15.184:0/1695975962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd8071750 0x7f5dd81889c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80d3bf0 tx=0x7f5dd002bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecbf19da397c0db server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:44.545 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.538+0000 7f5dd67fc640 1 -- 172.21.15.184:0/1695975962 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8001670 con 0x7f5dd8071750 2024-02-21T07:41:44.545 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.538+0000 7f5dd67fc640 1 -- 172.21.15.184:0/1695975962 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd002c830 con 0x7f5dd8071750 2024-02-21T07:41:44.545 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.538+0000 7f5dd67fc640 1 -- 172.21.15.184:0/1695975962 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd002cbc0 con 0x7f5dd8071750 2024-02-21T07:41:44.545 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.539+0000 7f5dddc1c640 1 -- 172.21.15.184:0/1695975962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd8071750 msgr2=0x7f5dd81889c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.546 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.539+0000 7f5dddc1c640 1 --2- 172.21.15.184:0/1695975962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd8071750 0x7f5dd81889c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80d3bf0 tx=0x7f5dd002bd00 comp rx=0 tx=0).stop 2024-02-21T07:41:44.546 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.539+0000 7f5dddc1c640 1 -- 172.21.15.184:0/1695975962 shutdown_connections 2024-02-21T07:41:44.546 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.539+0000 7f5dddc1c640 1 --2- 172.21.15.184:0/1695975962 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd8071750 0x7f5dd81889c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.546 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.539+0000 7f5dddc1c640 1 --2- 172.21.15.184:0/1695975962 >> v2:172.21.15.69:3300/0 conn(0x7f5dd817f4e0 0x7f5dd8070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.546 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.539+0000 7f5dddc1c640 1 -- 172.21.15.184:0/1695975962 >> 172.21.15.184:0/1695975962 conn(0x7f5dd80cf570 msgr2=0x7f5dd80cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:44.546 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.539+0000 7f5dddc1c640 1 -- 172.21.15.184:0/1695975962 shutdown_connections 2024-02-21T07:41:44.546 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.539+0000 7f5dddc1c640 1 -- 172.21.15.184:0/1695975962 wait complete. 2024-02-21T07:41:44.548 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.540+0000 7f5dddc1c640 1 Processor -- start 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.540+0000 7f5dddc1c640 1 -- start start 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.541+0000 7f5dddc1c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dd80712d0 0x7f5dd821bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.541+0000 7f5dddc1c640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd8071750 0x7f5dd80fa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.541+0000 7f5dddc1c640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dd817f4e0 0x7f5dd8164780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.541+0000 7f5dddc1c640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80ce140 con 0x7f5dd817f4e0 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.541+0000 7f5dddc1c640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80fadc0 con 0x7f5dd8071750 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.541+0000 7f5dddc1c640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd80cd1e0 con 0x7f5dd80712d0 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.541+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dd80712d0 0x7f5dd821bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.541+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dd80712d0 0x7f5dd821bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32822/0 (socket says 172.21.15.184:32822) 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.541+0000 7f5dd77fe640 1 -- 172.21.15.184:0/3631031471 learned_addr learned my addr 172.21.15.184:0/3631031471 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.541+0000 7f5dd6ffd640 1 --2- 172.21.15.184:0/3631031471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd8071750 0x7f5dd80fa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dd77fe640 1 -- 172.21.15.184:0/3631031471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd8071750 msgr2=0x7f5dd80fa880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dd77fe640 1 --2- 172.21.15.184:0/3631031471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd8071750 0x7f5dd80fa880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dd77fe640 1 -- 172.21.15.184:0/3631031471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dd817f4e0 msgr2=0x7f5dd8164780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dd77fe640 1 --2- 172.21.15.184:0/3631031471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dd817f4e0 0x7f5dd8164780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dd77fe640 1 -- 172.21.15.184:0/3631031471 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd0009a70 con 0x7f5dd80712d0 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dd77fe640 1 --2- 172.21.15.184:0/3631031471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dd80712d0 0x7f5dd821bf70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00d5f0 tx=0x7f5dcc00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dbffff640 1 -- 172.21.15.184:0/3631031471 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc0125f0 con 0x7f5dd80712d0 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dbffff640 1 -- 172.21.15.184:0/3631031471 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc012750 con 0x7f5dd80712d0 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dbffff640 1 -- 172.21.15.184:0/3631031471 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc012b00 con 0x7f5dd80712d0 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dddc1c640 1 -- 172.21.15.184:0/3631031471 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd80cd4c0 con 0x7f5dd80712d0 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dddc1c640 1 -- 172.21.15.184:0/3631031471 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd80cda80 con 0x7f5dd80712d0 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dbffff640 1 -- 172.21.15.184:0/3631031471 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5dcc012c60 con 0x7f5dd80712d0 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.542+0000 7f5dbffff640 1 -- 172.21.15.184:0/3631031471 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f5dcc014a50 con 0x7f5dd80712d0 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.543+0000 7f5dddc1c640 1 -- 172.21.15.184:0/3631031471 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd8069d50 con 0x7f5dd80712d0 2024-02-21T07:41:44.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.545+0000 7f5dbffff640 1 -- 172.21.15.184:0/3631031471 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5dcc014d50 con 0x7f5dd80712d0 2024-02-21T07:41:44.569 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:44.564+0000 7f19fcd51040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T07:41:44.598 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:44.592+0000 7f9988693040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T07:41:44.614 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:44.609+0000 7f19fcd51040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T07:41:44.622 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.616+0000 7f5dddc1c640 1 -- 172.21.15.184:0/3631031471 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2f062c18-b9e3-4229-8df3-88b1808c84a9", "id": 5} v 0) v1 -- 0x7f5dd806f090 con 0x7f5dd80712d0 2024-02-21T07:41:44.627 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.622+0000 7f5dbffff640 1 -- 172.21.15.184:0/3631031471 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f062c18-b9e3-4229-8df3-88b1808c84a9", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5dcc0144d0 con 0x7f5dd80712d0 2024-02-21T07:41:44.627 INFO:teuthology.orchestra.run.smithi184.stdout:5 2024-02-21T07:41:44.628 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.623+0000 7f5dddc1c640 1 -- 172.21.15.184:0/3631031471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dd80712d0 msgr2=0x7f5dd821bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.629 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.623+0000 7f5dddc1c640 1 --2- 172.21.15.184:0/3631031471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dd80712d0 0x7f5dd821bf70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00d5f0 tx=0x7f5dcc00dab0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.629 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.623+0000 7f5dddc1c640 1 -- 172.21.15.184:0/3631031471 shutdown_connections 2024-02-21T07:41:44.629 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.623+0000 7f5dddc1c640 1 --2- 172.21.15.184:0/3631031471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5dd817f4e0 0x7f5dd8164780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.629 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.623+0000 7f5dddc1c640 1 --2- 172.21.15.184:0/3631031471 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5dd8071750 0x7f5dd80fa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.629 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.623+0000 7f5dddc1c640 1 --2- 172.21.15.184:0/3631031471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5dd80712d0 0x7f5dd821bf70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.629 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.623+0000 7f5dddc1c640 1 -- 172.21.15.184:0/3631031471 >> 172.21.15.184:0/3631031471 conn(0x7f5dd80cf570 msgr2=0x7f5dd80f8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:44.629 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.623+0000 7f5dddc1c640 1 -- 172.21.15.184:0/3631031471 shutdown_connections 2024-02-21T07:41:44.629 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.623+0000 7f5dddc1c640 1 -- 172.21.15.184:0/3631031471 wait complete. 2024-02-21T07:41:44.638 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 721f268a-4c2f-419a-9569-de60c60a0164 6 2024-02-21T07:41:44.645 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:44.639+0000 7f9988693040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T07:41:44.676 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:44.670+0000 7fa829241040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T07:41:44.724 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:44.719+0000 7f19fcd51040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:41:44.745 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.739+0000 7fe110eec640 1 Processor -- start 2024-02-21T07:41:44.745 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.739+0000 7fe110eec640 1 -- start start 2024-02-21T07:41:44.746 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.740+0000 7fe110eec640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe10c06dcd0 0x7fe10c1875e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.746 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.740+0000 7fe110eec640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c06f0f0 con 0x7fe10c185700 2024-02-21T07:41:44.746 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.740+0000 7fe110eec640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c187b20 con 0x7fe10c182e90 2024-02-21T07:41:44.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.740+0000 7fe110eec640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c06e200 con 0x7fe10c06dcd0 2024-02-21T07:41:44.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.740+0000 7fe109d9b640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe10c06dcd0 0x7fe10c1875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.740+0000 7fe10a59c640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe10c182e90 0x7fe10c186ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.184:57096/0 (socket says 172.21.15.184:57096) 2024-02-21T07:41:44.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.740+0000 7fe10a59c640 1 -- 172.21.15.184:0/627956687 learned_addr learned my addr 172.21.15.184:0/627956687 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-21T07:41:44.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.741+0000 7fe109d9b640 1 -- 172.21.15.184:0/627956687 >> v1:172.21.15.174:6789/0 conn(0x7fe10c182e90 legacy=0x7fe10c186ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.741+0000 7fe109d9b640 1 -- 172.21.15.184:0/627956687 >> v1:172.21.15.69:6789/0 conn(0x7fe10c185700 legacy=0x7fe10c185bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:44.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.741+0000 7fe10959a640 1 -- 172.21.15.184:0/627956687 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262995374 0 0) 0x7fe10c187b20 con 0x7fe10c182e90 2024-02-21T07:41:44.747 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.741+0000 7fe109d9b640 1 -- 172.21.15.184:0/627956687 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c06e4e0 con 0x7fe10c06dcd0 2024-02-21T07:41:44.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe109d9b640 1 --2- 172.21.15.184:0/627956687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c06dcd0 0x7fe10c1875e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0097a0 tx=0x7fe0fc02b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bca5a8e74d56670 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:44.748 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe10959a640 1 -- 172.21.15.184:0/627956687 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc02f050 con 0x7fe10c06dcd0 2024-02-21T07:41:44.749 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe10959a640 1 -- 172.21.15.184:0/627956687 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc031700 con 0x7fe10c06dcd0 2024-02-21T07:41:44.749 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe10959a640 1 -- 172.21.15.184:0/627956687 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc031a90 con 0x7fe10c06dcd0 2024-02-21T07:41:44.749 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe110eec640 1 -- 172.21.15.184:0/627956687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c06dcd0 msgr2=0x7fe10c1875e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.749 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe110eec640 1 --2- 172.21.15.184:0/627956687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c06dcd0 0x7fe10c1875e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc0097a0 tx=0x7fe0fc02b7a0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.749 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe110eec640 1 -- 172.21.15.184:0/627956687 shutdown_connections 2024-02-21T07:41:44.749 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe110eec640 1 --2- 172.21.15.184:0/627956687 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c06dcd0 0x7fe10c1875e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.749 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe110eec640 1 -- 172.21.15.184:0/627956687 >> 172.21.15.184:0/627956687 conn(0x7fe10c0cf570 msgr2=0x7fe10c0cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:44.749 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe110eec640 1 -- 172.21.15.184:0/627956687 shutdown_connections 2024-02-21T07:41:44.749 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.742+0000 7fe110eec640 1 -- 172.21.15.184:0/627956687 wait complete. 2024-02-21T07:41:44.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.744+0000 7fe110eec640 1 Processor -- start 2024-02-21T07:41:44.750 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.744+0000 7fe110eec640 1 -- start start 2024-02-21T07:41:44.752 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe110eec640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe10c06dcd0 0x7fe10c164a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe110eec640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c182e90 0x7fe10c1809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe110eec640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe10c185700 0x7fe10c180f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe110eec640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c072230 con 0x7fe10c185700 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe110eec640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0712d0 con 0x7fe10c182e90 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe110eec640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c0715b0 con 0x7fe10c06dcd0 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe10a59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe10c06dcd0 0x7fe10c164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe109d9b640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c182e90 0x7fe10c1809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe10a59c640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe10c06dcd0 0x7fe10c164a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32834/0 (socket says 172.21.15.184:32834) 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe10a59c640 1 -- 172.21.15.184:0/534954106 learned_addr learned my addr 172.21.15.184:0/534954106 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe10a59c640 1 -- 172.21.15.184:0/534954106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c182e90 msgr2=0x7fe10c1809e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe10a59c640 1 --2- 172.21.15.184:0/534954106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c182e90 0x7fe10c1809e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe10a59c640 1 -- 172.21.15.184:0/534954106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe10c185700 msgr2=0x7fe10c180f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe10ad9d640 1 --2- 172.21.15.184:0/534954106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe10c185700 0x7fe10c180f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.745+0000 7fe10a59c640 1 --2- 172.21.15.184:0/534954106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe10c185700 0x7fe10c180f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.753 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.746+0000 7fe10a59c640 1 -- 172.21.15.184:0/534954106 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc009400 con 0x7fe10c06dcd0 2024-02-21T07:41:44.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.746+0000 7fe10a59c640 1 --2- 172.21.15.184:0/534954106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe10c06dcd0 0x7fe10c164a40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400e790 tx=0x7fe0f400ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:44.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.746+0000 7fe102ffd640 1 -- 172.21.15.184:0/534954106 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400eea0 con 0x7fe10c06dcd0 2024-02-21T07:41:44.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.746+0000 7fe102ffd640 1 -- 172.21.15.184:0/534954106 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f40072e0 con 0x7fe10c06dcd0 2024-02-21T07:41:44.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.746+0000 7fe110eec640 1 -- 172.21.15.184:0/534954106 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c071890 con 0x7fe10c06dcd0 2024-02-21T07:41:44.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.746+0000 7fe102ffd640 1 -- 172.21.15.184:0/534954106 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4007690 con 0x7fe10c06dcd0 2024-02-21T07:41:44.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.746+0000 7fe110eec640 1 -- 172.21.15.184:0/534954106 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c071e50 con 0x7fe10c06dcd0 2024-02-21T07:41:44.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.746+0000 7fe102ffd640 1 -- 172.21.15.184:0/534954106 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe0f40047e0 con 0x7fe10c06dcd0 2024-02-21T07:41:44.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.746+0000 7fe102ffd640 1 -- 172.21.15.184:0/534954106 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe0f4011a60 con 0x7fe10c06dcd0 2024-02-21T07:41:44.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.747+0000 7fe110eec640 1 -- 172.21.15.184:0/534954106 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10c072370 con 0x7fe10c06dcd0 2024-02-21T07:41:44.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.751+0000 7fe102ffd640 1 -- 172.21.15.184:0/534954106 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe0f4039dd0 con 0x7fe10c06dcd0 2024-02-21T07:41:44.765 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:44.760+0000 7f9988693040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:41:44.819 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:44.814+0000 7f19fcd51040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T07:41:44.829 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.823+0000 7fe110eec640 1 -- 172.21.15.184:0/534954106 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "721f268a-4c2f-419a-9569-de60c60a0164", "id": 6} v 0) v1 -- 0x7fe10c069d50 con 0x7fe10c06dcd0 2024-02-21T07:41:44.835 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.829+0000 7fe102ffd640 1 -- 172.21.15.184:0/534954106 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "721f268a-4c2f-419a-9569-de60c60a0164", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe0f4028030 con 0x7fe10c06dcd0 2024-02-21T07:41:44.835 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:44.829+0000 7fa829241040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T07:41:44.835 INFO:teuthology.orchestra.run.smithi184.stdout:6 2024-02-21T07:41:44.836 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.830+0000 7fe110eec640 1 -- 172.21.15.184:0/534954106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe10c06dcd0 msgr2=0x7fe10c164a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.836 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.830+0000 7fe110eec640 1 --2- 172.21.15.184:0/534954106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe10c06dcd0 0x7fe10c164a40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400e790 tx=0x7fe0f400ec50 comp rx=0 tx=0).stop 2024-02-21T07:41:44.836 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.830+0000 7fe110eec640 1 -- 172.21.15.184:0/534954106 shutdown_connections 2024-02-21T07:41:44.836 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.830+0000 7fe110eec640 1 --2- 172.21.15.184:0/534954106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe10c185700 0x7fe10c180f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.836 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.830+0000 7fe110eec640 1 --2- 172.21.15.184:0/534954106 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe10c182e90 0x7fe10c1809e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.836 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.830+0000 7fe110eec640 1 --2- 172.21.15.184:0/534954106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe10c06dcd0 0x7fe10c164a40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.836 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.830+0000 7fe110eec640 1 -- 172.21.15.184:0/534954106 >> 172.21.15.184:0/534954106 conn(0x7fe10c0cf570 msgr2=0x7fe10c070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:44.836 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.830+0000 7fe110eec640 1 -- 172.21.15.184:0/534954106 shutdown_connections 2024-02-21T07:41:44.837 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.830+0000 7fe110eec640 1 -- 172.21.15.184:0/534954106 wait complete. 2024-02-21T07:41:44.846 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 5d0fa9bc-caaf-41d4-953a-cf4004402619 7 2024-02-21T07:41:44.866 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:44.860+0000 7f9988693040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T07:41:44.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.941+0000 7f7af57a7640 1 Processor -- start 2024-02-21T07:41:44.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.941+0000 7f7af57a7640 1 -- start start 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.942+0000 7f7af57a7640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7af0066ca0 0x7f7af006f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.942+0000 7f7af57a7640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7af006fe20 0x7f7af00f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.942+0000 7f7af57a7640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af006f160 con 0x7f7af01842b0 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.942+0000 7f7af57a7640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af018adf0 con 0x7f7af0066ca0 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.942+0000 7f7af57a7640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af01869b0 con 0x7f7af006fe20 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.943+0000 7f7aef7fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7af006fe20 0x7f7af00f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.943+0000 7f7aef7fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7af006fe20 0x7f7af00f9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32848/0 (socket says 172.21.15.184:32848) 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.943+0000 7f7aef7fe640 1 -- 172.21.15.184:0/1638477182 learned_addr learned my addr 172.21.15.184:0/1638477182 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.943+0000 7f7ae7fff640 1 --2- 172.21.15.184:0/1638477182 >> v2:172.21.15.174:3300/0 conn(0x7f7af0066ca0 0x7f7af006f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.943+0000 7f7aef7fe640 1 -- 172.21.15.184:0/1638477182 >> v2:172.21.15.174:3300/0 conn(0x7f7af0066ca0 msgr2=0x7f7af006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.943+0000 7f7aef7fe640 1 --2- 172.21.15.184:0/1638477182 >> v2:172.21.15.174:3300/0 conn(0x7f7af0066ca0 0x7f7af006f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.943+0000 7f7aef7fe640 1 -- 172.21.15.184:0/1638477182 >> v1:172.21.15.174:6789/0 conn(0x7f7af01842b0 legacy=0x7f7af006ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.943+0000 7f7aef7fe640 1 -- 172.21.15.184:0/1638477182 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af0186c90 con 0x7f7af006fe20 2024-02-21T07:41:44.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.944+0000 7f7aef7fe640 1 --2- 172.21.15.184:0/1638477182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af006fe20 0x7f7af00f9810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7af006cbc0 tx=0x7f7ae802be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9ea2f7413fde604 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:44.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.944+0000 7f7aee7fc640 1 -- 172.21.15.184:0/1638477182 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae802c9f0 con 0x7f7af006fe20 2024-02-21T07:41:44.951 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.944+0000 7f7aee7fc640 1 -- 172.21.15.184:0/1638477182 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae802cb50 con 0x7f7af006fe20 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.944+0000 7f7aee7fc640 1 -- 172.21.15.184:0/1638477182 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae80343f0 con 0x7f7af006fe20 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.944+0000 7f7af57a7640 1 -- 172.21.15.184:0/1638477182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af006fe20 msgr2=0x7f7af00f9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.944+0000 7f7af57a7640 1 --2- 172.21.15.184:0/1638477182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af006fe20 0x7f7af00f9810 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7af006cbc0 tx=0x7f7ae802be50 comp rx=0 tx=0).stop 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.945+0000 7f7af57a7640 1 -- 172.21.15.184:0/1638477182 shutdown_connections 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.945+0000 7f7af57a7640 1 --2- 172.21.15.184:0/1638477182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af006fe20 0x7f7af00f9810 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.945+0000 7f7af57a7640 1 --2- 172.21.15.184:0/1638477182 >> v2:172.21.15.174:3300/0 conn(0x7f7af0066ca0 0x7f7af006f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.945+0000 7f7af57a7640 1 -- 172.21.15.184:0/1638477182 >> 172.21.15.184:0/1638477182 conn(0x7f7af00f7250 msgr2=0x7f7af00f7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.945+0000 7f7af57a7640 1 -- 172.21.15.184:0/1638477182 shutdown_connections 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.945+0000 7f7af57a7640 1 -- 172.21.15.184:0/1638477182 wait complete. 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.946+0000 7f7af57a7640 1 Processor -- start 2024-02-21T07:41:44.952 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.946+0000 7f7af57a7640 1 -- start start 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7af57a7640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af0066ca0 0x7f7af021a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7af57a7640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7af006fe20 0x7f7af0169690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7af57a7640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7af0176d60 0x7f7af021fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7af57a7640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af021acc0 con 0x7f7af0176d60 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7af57a7640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af0169bd0 con 0x7f7af006fe20 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7af57a7640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af021aec0 con 0x7f7af0066ca0 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7aeeffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af0066ca0 0x7f7af021a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7aeeffd640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af0066ca0 0x7f7af021a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32856/0 (socket says 172.21.15.184:32856) 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7aeeffd640 1 -- 172.21.15.184:0/3131604273 learned_addr learned my addr 172.21.15.184:0/3131604273 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7ae7fff640 1 --2- 172.21.15.184:0/3131604273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7af006fe20 0x7f7af0169690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7aeeffd640 1 -- 172.21.15.184:0/3131604273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7af006fe20 msgr2=0x7f7af0169690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7aeeffd640 1 --2- 172.21.15.184:0/3131604273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7af006fe20 0x7f7af0169690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7aeeffd640 1 -- 172.21.15.184:0/3131604273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7af0176d60 msgr2=0x7f7af021fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:44.955 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7aeeffd640 1 --2- 172.21.15.184:0/3131604273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7af0176d60 0x7f7af021fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:44.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7aeeffd640 1 -- 172.21.15.184:0/3131604273 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae8009b30 con 0x7f7af0066ca0 2024-02-21T07:41:44.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.947+0000 7f7aeeffd640 1 --2- 172.21.15.184:0/3131604273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af0066ca0 0x7f7af021a780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c3c0 tx=0x7f7ae000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:44.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.948+0000 7f7ae77fe640 1 -- 172.21.15.184:0/3131604273 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00052d0 con 0x7f7af0066ca0 2024-02-21T07:41:44.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.948+0000 7f7ae77fe640 1 -- 172.21.15.184:0/3131604273 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae0005450 con 0x7f7af0066ca0 2024-02-21T07:41:44.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.948+0000 7f7af57a7640 1 -- 172.21.15.184:0/3131604273 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af021b1a0 con 0x7f7af0066ca0 2024-02-21T07:41:44.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.948+0000 7f7ae77fe640 1 -- 172.21.15.184:0/3131604273 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae0007260 con 0x7f7af0066ca0 2024-02-21T07:41:44.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.948+0000 7f7af57a7640 1 -- 172.21.15.184:0/3131604273 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af021b760 con 0x7f7af0066ca0 2024-02-21T07:41:44.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.948+0000 7f7ae77fe640 1 -- 172.21.15.184:0/3131604273 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7ae00073c0 con 0x7f7af0066ca0 2024-02-21T07:41:44.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.948+0000 7f7ae77fe640 1 -- 172.21.15.184:0/3131604273 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f7ae0011590 con 0x7f7af0066ca0 2024-02-21T07:41:44.956 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.949+0000 7f7af57a7640 1 -- 172.21.15.184:0/3131604273 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af006d850 con 0x7f7af0066ca0 2024-02-21T07:41:44.957 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:44.951+0000 7f7ae77fe640 1 -- 172.21.15.184:0/3131604273 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7ae0020060 con 0x7f7af0066ca0 2024-02-21T07:41:44.969 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:44.963+0000 7fa829241040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T07:41:44.971 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:44.967+0000 7f19fcd51040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:41:45.014 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:45.009+0000 7f19fcd51040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T07:41:45.021 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:45.016+0000 7fa829241040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T07:41:45.027 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:45.022+0000 7f9988693040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:41:45.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.023+0000 7f7af57a7640 1 -- 172.21.15.184:0/3131604273 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5d0fa9bc-caaf-41d4-953a-cf4004402619", "id": 7} v 0) v1 -- 0x7f7af006e260 con 0x7f7af0066ca0 2024-02-21T07:41:45.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.028+0000 7f7ae77fe640 1 -- 172.21.15.184:0/3131604273 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5d0fa9bc-caaf-41d4-953a-cf4004402619", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7af006f160 con 0x7f7af0066ca0 2024-02-21T07:41:45.034 INFO:teuthology.orchestra.run.smithi184.stdout:7 2024-02-21T07:41:45.035 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.029+0000 7f7af57a7640 1 -- 172.21.15.184:0/3131604273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af0066ca0 msgr2=0x7f7af021a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.035 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.029+0000 7f7af57a7640 1 --2- 172.21.15.184:0/3131604273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af0066ca0 0x7f7af021a780 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000c3c0 tx=0x7f7ae000c880 comp rx=0 tx=0).stop 2024-02-21T07:41:45.035 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.029+0000 7f7af57a7640 1 -- 172.21.15.184:0/3131604273 shutdown_connections 2024-02-21T07:41:45.035 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.029+0000 7f7af57a7640 1 --2- 172.21.15.184:0/3131604273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7af0176d60 0x7f7af021fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.035 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.029+0000 7f7af57a7640 1 --2- 172.21.15.184:0/3131604273 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7af006fe20 0x7f7af0169690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.035 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.029+0000 7f7af57a7640 1 --2- 172.21.15.184:0/3131604273 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7af0066ca0 0x7f7af021a780 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.035 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.029+0000 7f7af57a7640 1 -- 172.21.15.184:0/3131604273 >> 172.21.15.184:0/3131604273 conn(0x7f7af00f7250 msgr2=0x7f7af006e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:45.035 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.029+0000 7f7af57a7640 1 -- 172.21.15.184:0/3131604273 shutdown_connections 2024-02-21T07:41:45.035 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.029+0000 7f7af57a7640 1 -- 172.21.15.184:0/3131604273 wait complete. 2024-02-21T07:41:45.045 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 02d11b92-1af3-4228-9877-2171f46bf252 8 2024-02-21T07:41:45.072 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:45.066+0000 7f9988693040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T07:41:45.148 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:45.142+0000 7fa829241040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:41:45.166 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:45.161+0000 7f19fcd51040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T07:41:45.174 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.168+0000 7fa65b088640 1 Processor -- start 2024-02-21T07:41:45.174 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.168+0000 7fa65b088640 1 -- start start 2024-02-21T07:41:45.177 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.169+0000 7fa65b088640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65406f0f0 con 0x7fa65406dcd0 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.169+0000 7fa65b088640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65406e200 con 0x7fa6540f65d0 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.169+0000 7fa65b088640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65406e4e0 con 0x7fa654182e90 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.169+0000 7fa658e24640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fa654182e90 0x7fa654186ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:49892/0 (socket says 172.21.15.184:49892) 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.169+0000 7fa658e24640 1 -- 172.21.15.184:0/792185804 learned_addr learned my addr 172.21.15.184:0/792185804 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.169+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137327875 0 0) 0x7fa65406e4e0 con 0x7fa654182e90 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa644003520 con 0x7fa654182e90 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209196035 0 0) 0x7fa65406e200 con 0x7fa6540f65d0 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa65406e4e0 con 0x7fa6540f65d0 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866684920 0 0) 0x7fa644003520 con 0x7fa654182e90 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 >> v1:172.21.15.174:6789/0 conn(0x7fa6540f65d0 legacy=0x7fa6540f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 >> v1:172.21.15.69:6789/0 conn(0x7fa65406dcd0 legacy=0x7fa6541875e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65406e7c0 con 0x7fa654182e90 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7fa648001670 con 0x7fa654182e90 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 >> v1:172.21.15.184:6789/0 conn(0x7fa654182e90 legacy=0x7fa654186ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 --2- 172.21.15.184:0/792185804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa644003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.178 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 --2- 172.21.15.184:0/792185804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6440047c0 0x7fa644004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 --2- 172.21.15.184:0/792185804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6440053b0 0x7fa64400ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64400c2d0 con 0x7fa6440053b0 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64400c440 con 0x7fa6440047c0 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64400c600 con 0x7fa644003b50 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa658e24640 1 --2- 172.21.15.184:0/792185804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa644003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa653fff640 1 --2- 172.21.15.184:0/792185804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6440047c0 0x7fa644004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa658e24640 1 -- 172.21.15.184:0/792185804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6440047c0 msgr2=0x7fa644004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa658e24640 1 --2- 172.21.15.184:0/792185804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa6440047c0 0x7fa644004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa658e24640 1 -- 172.21.15.184:0/792185804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6440053b0 msgr2=0x7fa64400ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa658e24640 1 --2- 172.21.15.184:0/792185804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6440053b0 0x7fa64400ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa658e24640 1 -- 172.21.15.184:0/792185804 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa644003520 con 0x7fa644003b50 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.170+0000 7fa659625640 1 -- 172.21.15.184:0/792185804 reap_dead start 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.171+0000 7fa658e24640 1 --2- 172.21.15.184:0/792185804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa644003f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa648007fd0 tx=0x7fa6440057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5de94c088759bae2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.171+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648005ad0 con 0x7fa644003b50 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.171+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa648005c50 con 0x7fa644003b50 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.171+0000 7fa6537fe640 1 -- 172.21.15.184:0/792185804 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64802c870 con 0x7fa644003b50 2024-02-21T07:41:45.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.172+0000 7fa65b088640 1 -- 172.21.15.184:0/792185804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 msgr2=0x7fa644003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.172+0000 7fa65b088640 1 --2- 172.21.15.184:0/792185804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa644003f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa648007fd0 tx=0x7fa6440057f0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.172+0000 7fa65b088640 1 -- 172.21.15.184:0/792185804 shutdown_connections 2024-02-21T07:41:45.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.172+0000 7fa65b088640 1 --2- 172.21.15.184:0/792185804 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa644003f30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.172+0000 7fa65b088640 1 -- 172.21.15.184:0/792185804 >> 172.21.15.184:0/792185804 conn(0x7fa6540cf570 msgr2=0x7fa6540cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:45.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.172+0000 7fa65b088640 1 -- 172.21.15.184:0/792185804 shutdown_connections 2024-02-21T07:41:45.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.172+0000 7fa65b088640 1 -- 172.21.15.184:0/792185804 wait complete. 2024-02-21T07:41:45.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.173+0000 7fa65b088640 1 Processor -- start 2024-02-21T07:41:45.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.173+0000 7fa65b088640 1 -- start start 2024-02-21T07:41:45.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.174+0000 7fa65b088640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa654169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.174+0000 7fa65b088640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa65421bdc0 0x7fa65421c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.174+0000 7fa65b088640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa65421c780 0x7fa654175a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.174+0000 7fa65b088640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654074b70 con 0x7fa65421bdc0 2024-02-21T07:41:45.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.174+0000 7fa65b088640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65421cc30 con 0x7fa65421c780 2024-02-21T07:41:45.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.174+0000 7fa65b088640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654073c10 con 0x7fa644003b50 2024-02-21T07:41:45.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.174+0000 7fa658e24640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa654169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.174+0000 7fa658e24640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa654169730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32872/0 (socket says 172.21.15.184:32872) 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.174+0000 7fa658e24640 1 -- 172.21.15.184:0/720849305 learned_addr learned my addr 172.21.15.184:0/720849305 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.174+0000 7fa659625640 1 --2- 172.21.15.184:0/720849305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa65421c780 0x7fa654175a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa658e24640 1 -- 172.21.15.184:0/720849305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa65421c780 msgr2=0x7fa654175a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa658e24640 1 --2- 172.21.15.184:0/720849305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa65421c780 0x7fa654175a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa658e24640 1 -- 172.21.15.184:0/720849305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa65421bdc0 msgr2=0x7fa65421c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa658e24640 1 --2- 172.21.15.184:0/720849305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa65421bdc0 0x7fa65421c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa658e24640 1 -- 172.21.15.184:0/720849305 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654073ef0 con 0x7fa644003b50 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa658e24640 1 --2- 172.21.15.184:0/720849305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa654169730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c250 tx=0x7fa6480019f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa6517fa640 1 -- 172.21.15.184:0/720849305 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64803c040 con 0x7fa644003b50 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa6517fa640 1 -- 172.21.15.184:0/720849305 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64802cc80 con 0x7fa644003b50 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa6517fa640 1 -- 172.21.15.184:0/720849305 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648001730 con 0x7fa644003b50 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa65b088640 1 -- 172.21.15.184:0/720849305 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6540741d0 con 0x7fa644003b50 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa65b088640 1 -- 172.21.15.184:0/720849305 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa654074790 con 0x7fa644003b50 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa6517fa640 1 -- 172.21.15.184:0/720849305 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa648032070 con 0x7fa644003b50 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.175+0000 7fa6517fa640 1 -- 172.21.15.184:0/720849305 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa648035470 con 0x7fa644003b50 2024-02-21T07:41:45.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.176+0000 7fa65b088640 1 -- 172.21.15.184:0/720849305 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6540f8f60 con 0x7fa644003b50 2024-02-21T07:41:45.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.178+0000 7fa6517fa640 1 -- 172.21.15.184:0/720849305 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa648046070 con 0x7fa644003b50 2024-02-21T07:41:45.235 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:45.229+0000 7f9988693040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T07:41:45.256 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.251+0000 7fa65b088640 1 -- 172.21.15.184:0/720849305 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "02d11b92-1af3-4228-9877-2171f46bf252", "id": 8} v 0) v1 -- 0x7fa654069d50 con 0x7fa644003b50 2024-02-21T07:41:45.258 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:45.252+0000 7fa829241040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T07:41:45.261 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.256+0000 7fa6517fa640 1 -- 172.21.15.184:0/720849305 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02d11b92-1af3-4228-9877-2171f46bf252", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa648007ca0 con 0x7fa644003b50 2024-02-21T07:41:45.261 INFO:teuthology.orchestra.run.smithi184.stdout:8 2024-02-21T07:41:45.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.257+0000 7fa65b088640 1 -- 172.21.15.184:0/720849305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 msgr2=0x7fa654169730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.257+0000 7fa65b088640 1 --2- 172.21.15.184:0/720849305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa654169730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c250 tx=0x7fa6480019f0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.257+0000 7fa65b088640 1 -- 172.21.15.184:0/720849305 shutdown_connections 2024-02-21T07:41:45.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.257+0000 7fa65b088640 1 --2- 172.21.15.184:0/720849305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa65421c780 0x7fa654175a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.257+0000 7fa65b088640 1 --2- 172.21.15.184:0/720849305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa65421bdc0 0x7fa65421c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.257+0000 7fa65b088640 1 --2- 172.21.15.184:0/720849305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa644003b50 0x7fa654169730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.257+0000 7fa65b088640 1 -- 172.21.15.184:0/720849305 >> 172.21.15.184:0/720849305 conn(0x7fa6540cf570 msgr2=0x7fa65408d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:45.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.257+0000 7fa65b088640 1 -- 172.21.15.184:0/720849305 shutdown_connections 2024-02-21T07:41:45.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.257+0000 7fa65b088640 1 -- 172.21.15.184:0/720849305 wait complete. 2024-02-21T07:41:45.272 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 293e6d5e-a5fa-46f6-988b-d36b61d156b6 9 2024-02-21T07:41:45.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.367+0000 7fe77d415640 1 Processor -- start 2024-02-21T07:41:45.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.367+0000 7fe77d415640 1 -- start start 2024-02-21T07:41:45.374 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.368+0000 7fe77d415640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe77806b6d0 0x7fe77806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.374 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.368+0000 7fe77d415640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7781899d0 con 0x7fe778070780 2024-02-21T07:41:45.374 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.368+0000 7fe77d415640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7780719e0 con 0x7fe77817f4e0 2024-02-21T07:41:45.375 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.368+0000 7fe77d415640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77806caa0 con 0x7fe77806b6d0 2024-02-21T07:41:45.375 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.369+0000 7fe7777fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe77806b6d0 0x7fe77806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.375 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.369+0000 7fe7777fe640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe77806b6d0 0x7fe77806bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32886/0 (socket says 172.21.15.184:32886) 2024-02-21T07:41:45.375 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.369+0000 7fe7777fe640 1 -- 172.21.15.184:0/355670011 learned_addr learned my addr 172.21.15.184:0/355670011 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:45.375 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.369+0000 7fe7777fe640 1 -- 172.21.15.184:0/355670011 >> v1:172.21.15.174:6789/0 conn(0x7fe77817f4e0 legacy=0x7fe7780712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.375 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.369+0000 7fe7777fe640 1 -- 172.21.15.184:0/355670011 >> v1:172.21.15.69:6789/0 conn(0x7fe778070780 legacy=0x7fe778074280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:45.375 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.369+0000 7fe7777fe640 1 -- 172.21.15.184:0/355670011 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77817f8c0 con 0x7fe77806b6d0 2024-02-21T07:41:45.376 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe7777fe640 1 --2- 172.21.15.184:0/355670011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77806b6d0 0x7fe77806bb00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe770009e50 tx=0x7fe77002bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a27845068218fb39 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:45.376 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe775ffb640 1 -- 172.21.15.184:0/355670011 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77002ca80 con 0x7fe77806b6d0 2024-02-21T07:41:45.376 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe775ffb640 1 -- 172.21.15.184:0/355670011 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77002cbe0 con 0x7fe77806b6d0 2024-02-21T07:41:45.376 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe775ffb640 1 -- 172.21.15.184:0/355670011 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7700343f0 con 0x7fe77806b6d0 2024-02-21T07:41:45.376 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe77d415640 1 -- 172.21.15.184:0/355670011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77806b6d0 msgr2=0x7fe77806bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.377 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe77d415640 1 --2- 172.21.15.184:0/355670011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77806b6d0 0x7fe77806bb00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe770009e50 tx=0x7fe77002bee0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.377 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe77d415640 1 -- 172.21.15.184:0/355670011 shutdown_connections 2024-02-21T07:41:45.377 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe77d415640 1 --2- 172.21.15.184:0/355670011 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77806b6d0 0x7fe77806bb00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.377 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe77d415640 1 -- 172.21.15.184:0/355670011 >> 172.21.15.184:0/355670011 conn(0x7fe7780cf570 msgr2=0x7fe7780cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:45.377 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe77d415640 1 -- 172.21.15.184:0/355670011 shutdown_connections 2024-02-21T07:41:45.377 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.370+0000 7fe77d415640 1 -- 172.21.15.184:0/355670011 wait complete. 2024-02-21T07:41:45.377 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.372+0000 7fe77d415640 1 Processor -- start 2024-02-21T07:41:45.377 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.372+0000 7fe77d415640 1 -- start start 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe77d415640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77806b6d0 0x7fe77821fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe77d415640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe778070780 0x7fe7781710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe77d415640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77817f4e0 0x7fe77821c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe77d415640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe778220450 con 0x7fe77806b6d0 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe77d415640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe778220730 con 0x7fe778070780 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe77d415640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe778220a10 con 0x7fe77817f4e0 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe7777fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77817f4e0 0x7fe77821c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe7777fe640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77817f4e0 0x7fe77821c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32890/0 (socket says 172.21.15.184:32890) 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe7777fe640 1 -- 172.21.15.184:0/269061156 learned_addr learned my addr 172.21.15.184:0/269061156 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe7767fc640 1 --2- 172.21.15.184:0/269061156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe778070780 0x7fe7781710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe7777fe640 1 -- 172.21.15.184:0/269061156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe778070780 msgr2=0x7fe7781710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe7777fe640 1 --2- 172.21.15.184:0/269061156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe778070780 0x7fe7781710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe7777fe640 1 -- 172.21.15.184:0/269061156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77806b6d0 msgr2=0x7fe77821fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.381 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe7777fe640 1 --2- 172.21.15.184:0/269061156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77806b6d0 0x7fe77821fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.381 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe7777fe640 1 -- 172.21.15.184:0/269061156 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe770009b30 con 0x7fe77817f4e0 2024-02-21T07:41:45.381 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe7777fe640 1 --2- 172.21.15.184:0/269061156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77817f4e0 0x7fe77821c6f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe770036040 tx=0x7fe770004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:45.381 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.373+0000 7fe75f7fe640 1 -- 172.21.15.184:0/269061156 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77003e450 con 0x7fe77817f4e0 2024-02-21T07:41:45.381 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.374+0000 7fe75f7fe640 1 -- 172.21.15.184:0/269061156 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77003e5d0 con 0x7fe77817f4e0 2024-02-21T07:41:45.381 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.374+0000 7fe77d415640 1 -- 172.21.15.184:0/269061156 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe778220cf0 con 0x7fe77817f4e0 2024-02-21T07:41:45.381 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.374+0000 7fe75f7fe640 1 -- 172.21.15.184:0/269061156 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77003e980 con 0x7fe77817f4e0 2024-02-21T07:41:45.381 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.374+0000 7fe77d415640 1 -- 172.21.15.184:0/269061156 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7782212b0 con 0x7fe77817f4e0 2024-02-21T07:41:45.382 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.375+0000 7fe75f7fe640 1 -- 172.21.15.184:0/269061156 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe77002cd50 con 0x7fe77817f4e0 2024-02-21T07:41:45.382 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.375+0000 7fe75f7fe640 1 -- 172.21.15.184:0/269061156 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1760+0+0 (secure 0 0 0) 0x7fe77003fb40 con 0x7fe77817f4e0 2024-02-21T07:41:45.382 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.375+0000 7fe77d415640 1 -- 172.21.15.184:0/269061156 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe778069d50 con 0x7fe77817f4e0 2024-02-21T07:41:45.382 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.377+0000 7fe75f7fe640 1 -- 172.21.15.184:0/269061156 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe770066dd0 con 0x7fe77817f4e0 2024-02-21T07:41:45.435 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:45.429+0000 7fa829241040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T07:41:45.455 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.449+0000 7fe77d415640 1 -- 172.21.15.184:0/269061156 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "293e6d5e-a5fa-46f6-988b-d36b61d156b6", "id": 9} v 0) v1 -- 0x7fe77806f090 con 0x7fe77817f4e0 2024-02-21T07:41:45.460 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.454+0000 7fe75f7fe640 1 -- 172.21.15.184:0/269061156 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "293e6d5e-a5fa-46f6-988b-d36b61d156b6", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe770055030 con 0x7fe77817f4e0 2024-02-21T07:41:45.460 INFO:teuthology.orchestra.run.smithi184.stdout:9 2024-02-21T07:41:45.461 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.455+0000 7fe77d415640 1 -- 172.21.15.184:0/269061156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77817f4e0 msgr2=0x7fe77821c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.461 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.455+0000 7fe77d415640 1 --2- 172.21.15.184:0/269061156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77817f4e0 0x7fe77821c6f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe770036040 tx=0x7fe770004a40 comp rx=0 tx=0).stop 2024-02-21T07:41:45.461 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.455+0000 7fe77d415640 1 -- 172.21.15.184:0/269061156 shutdown_connections 2024-02-21T07:41:45.461 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.455+0000 7fe77d415640 1 --2- 172.21.15.184:0/269061156 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77817f4e0 0x7fe77821c6f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.461 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.455+0000 7fe77d415640 1 --2- 172.21.15.184:0/269061156 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe778070780 0x7fe7781710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.462 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.455+0000 7fe77d415640 1 --2- 172.21.15.184:0/269061156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77806b6d0 0x7fe77821fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.462 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.455+0000 7fe77d415640 1 -- 172.21.15.184:0/269061156 >> 172.21.15.184:0/269061156 conn(0x7fe7780cf570 msgr2=0x7fe7780712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:45.462 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.456+0000 7fe77d415640 1 -- 172.21.15.184:0/269061156 shutdown_connections 2024-02-21T07:41:45.462 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.456+0000 7fe77d415640 1 -- 172.21.15.184:0/269061156 wait complete. 2024-02-21T07:41:45.471 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 3cb5657f-5d84-4cf8-a50a-28ee1a03a271 10 2024-02-21T07:41:45.485 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:45.479+0000 7fa829241040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T07:41:45.570 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.565+0000 7fed93302640 1 Processor -- start 2024-02-21T07:41:45.571 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.565+0000 7fed93302640 1 -- start start 2024-02-21T07:41:45.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.566+0000 7fed93302640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fed8c182e90 0x7fed8c186ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.566+0000 7fed93302640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c06f0f0 con 0x7fed8c06dcd0 2024-02-21T07:41:45.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.566+0000 7fed93302640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c187b20 con 0x7fed8c185700 2024-02-21T07:41:45.572 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.566+0000 7fed93302640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c06e200 con 0x7fed8c182e90 2024-02-21T07:41:45.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.566+0000 7fed9109e640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fed8c182e90 0x7fed8c186ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.566+0000 7fed9189f640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fed8c185700 0x7fed8c185bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:49906/0 (socket says 172.21.15.184:49906) 2024-02-21T07:41:45.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.566+0000 7fed9189f640 1 -- 172.21.15.184:0/2711645144 learned_addr learned my addr 172.21.15.184:0/2711645144 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-21T07:41:45.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.566+0000 7fed9109e640 1 -- 172.21.15.184:0/2711645144 >> v1:172.21.15.184:6789/0 conn(0x7fed8c185700 legacy=0x7fed8c185bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.566+0000 7fed9109e640 1 -- 172.21.15.184:0/2711645144 >> v1:172.21.15.69:6789/0 conn(0x7fed8c06dcd0 legacy=0x7fed8c187410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:45.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.566+0000 7fed9109e640 1 -- 172.21.15.184:0/2711645144 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c06e4e0 con 0x7fed8c182e90 2024-02-21T07:41:45.574 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.567+0000 7fed9109e640 1 --2- 172.21.15.184:0/2711645144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 0x7fed8c186ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fed880097a0 tx=0x7fed8802b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f315a87c59824f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:45.574 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.567+0000 7fed83fff640 1 -- 172.21.15.184:0/2711645144 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8802f050 con 0x7fed8c182e90 2024-02-21T07:41:45.574 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.567+0000 7fed83fff640 1 -- 172.21.15.184:0/2711645144 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88031700 con 0x7fed8c182e90 2024-02-21T07:41:45.574 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.567+0000 7fed83fff640 1 -- 172.21.15.184:0/2711645144 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88031a90 con 0x7fed8c182e90 2024-02-21T07:41:45.574 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.568+0000 7fed93302640 1 -- 172.21.15.184:0/2711645144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 msgr2=0x7fed8c186ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.574 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.568+0000 7fed93302640 1 --2- 172.21.15.184:0/2711645144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 0x7fed8c186ed0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fed880097a0 tx=0x7fed8802b7a0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.574 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.568+0000 7fed93302640 1 -- 172.21.15.184:0/2711645144 shutdown_connections 2024-02-21T07:41:45.574 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.568+0000 7fed93302640 1 --2- 172.21.15.184:0/2711645144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 0x7fed8c186ed0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.574 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.568+0000 7fed93302640 1 -- 172.21.15.184:0/2711645144 >> 172.21.15.184:0/2711645144 conn(0x7fed8c0cf570 msgr2=0x7fed8c0cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:45.575 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.568+0000 7fed93302640 1 -- 172.21.15.184:0/2711645144 shutdown_connections 2024-02-21T07:41:45.575 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.568+0000 7fed93302640 1 -- 172.21.15.184:0/2711645144 wait complete. 2024-02-21T07:41:45.575 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.569+0000 7fed93302640 1 Processor -- start 2024-02-21T07:41:45.575 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.569+0000 7fed93302640 1 -- start start 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.570+0000 7fed93302640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed8c06dcd0 0x7fed8c0f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.570+0000 7fed93302640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 0x7fed8c1606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.570+0000 7fed93302640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed8c185700 0x7fed8c21a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.570+0000 7fed93302640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0f78b0 con 0x7fed8c185700 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.570+0000 7fed93302640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0f69c0 con 0x7fed8c06dcd0 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.570+0000 7fed93302640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0f6ca0 con 0x7fed8c182e90 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.570+0000 7fed9089d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 0x7fed8c1606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed9089d640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 0x7fed8c1606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32906/0 (socket says 172.21.15.184:32906) 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed9089d640 1 -- 172.21.15.184:0/2575920881 learned_addr learned my addr 172.21.15.184:0/2575920881 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed9109e640 1 --2- 172.21.15.184:0/2575920881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed8c06dcd0 0x7fed8c0f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed9089d640 1 -- 172.21.15.184:0/2575920881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed8c06dcd0 msgr2=0x7fed8c0f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed9089d640 1 --2- 172.21.15.184:0/2575920881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed8c06dcd0 0x7fed8c0f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed9089d640 1 -- 172.21.15.184:0/2575920881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed8c185700 msgr2=0x7fed8c21a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed9089d640 1 --2- 172.21.15.184:0/2575920881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed8c185700 0x7fed8c21a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed9089d640 1 -- 172.21.15.184:0/2575920881 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed88009400 con 0x7fed8c182e90 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed9089d640 1 --2- 172.21.15.184:0/2575920881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 0x7fed8c1606c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00b3c0 tx=0x7fed7c00b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed81ffb640 1 -- 172.21.15.184:0/2575920881 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c011830 con 0x7fed8c182e90 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed81ffb640 1 -- 172.21.15.184:0/2575920881 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c011990 con 0x7fed8c182e90 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed93302640 1 -- 172.21.15.184:0/2575920881 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c0f6f80 con 0x7fed8c182e90 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed81ffb640 1 -- 172.21.15.184:0/2575920881 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c011d60 con 0x7fed8c182e90 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed93302640 1 -- 172.21.15.184:0/2575920881 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c0f7540 con 0x7fed8c182e90 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed81ffb640 1 -- 172.21.15.184:0/2575920881 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fed7c01b460 con 0x7fed8c182e90 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.571+0000 7fed81ffb640 1 -- 172.21.15.184:0/2575920881 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1875+0+0 (secure 0 0 0) 0x7fed7c010380 con 0x7fed8c182e90 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.572+0000 7fed93302640 1 -- 172.21.15.184:0/2575920881 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c21a4b0 con 0x7fed8c182e90 2024-02-21T07:41:45.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.574+0000 7fed81ffb640 1 -- 172.21.15.184:0/2575920881 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fed8c21a4b0 con 0x7fed8c182e90 2024-02-21T07:41:45.651 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.645+0000 7fed93302640 1 -- 172.21.15.184:0/2575920881 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3cb5657f-5d84-4cf8-a50a-28ee1a03a271", "id": 10} v 0) v1 -- 0x7fed8c069d50 con 0x7fed8c182e90 2024-02-21T07:41:45.656 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.650+0000 7fed81ffb640 1 -- 172.21.15.184:0/2575920881 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3cb5657f-5d84-4cf8-a50a-28ee1a03a271", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7fed7c02a0b0 con 0x7fed8c182e90 2024-02-21T07:41:45.656 INFO:teuthology.orchestra.run.smithi184.stdout:10 2024-02-21T07:41:45.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.651+0000 7fed93302640 1 -- 172.21.15.184:0/2575920881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 msgr2=0x7fed8c1606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.651+0000 7fed93302640 1 --2- 172.21.15.184:0/2575920881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 0x7fed8c1606c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00b3c0 tx=0x7fed7c00b880 comp rx=0 tx=0).stop 2024-02-21T07:41:45.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.651+0000 7fed93302640 1 -- 172.21.15.184:0/2575920881 shutdown_connections 2024-02-21T07:41:45.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.651+0000 7fed93302640 1 --2- 172.21.15.184:0/2575920881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed8c185700 0x7fed8c21a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.651+0000 7fed93302640 1 --2- 172.21.15.184:0/2575920881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fed8c182e90 0x7fed8c1606c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.651+0000 7fed93302640 1 --2- 172.21.15.184:0/2575920881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fed8c06dcd0 0x7fed8c0f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.658 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.651+0000 7fed93302640 1 -- 172.21.15.184:0/2575920881 >> 172.21.15.184:0/2575920881 conn(0x7fed8c0cf570 msgr2=0x7fed8c187d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:45.658 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.651+0000 7fed93302640 1 -- 172.21.15.184:0/2575920881 shutdown_connections 2024-02-21T07:41:45.658 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.652+0000 7fed93302640 1 -- 172.21.15.184:0/2575920881 wait complete. 2024-02-21T07:41:45.659 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:45.653+0000 7fa829241040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T07:41:45.667 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --cluster ceph osd new 7af2eeca-42fb-4513-a506-c63df777cd1d 11 2024-02-21T07:41:45.767 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.762+0000 7f5f5b617640 1 Processor -- start 2024-02-21T07:41:45.767 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.762+0000 7f5f5b617640 1 -- start start 2024-02-21T07:41:45.771 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f5b617640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5f5406e140 0x7f5f541872d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.771 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f5b617640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5f5418a160 0x7f5f5418a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.771 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f5b617640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f54180c30 con 0x7f5f54189d80 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f5b617640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5408df50 con 0x7f5f5418a160 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f5b617640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5408e230 con 0x7f5f5406e140 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f593b3640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f5f54189d80 0x7f5f5406da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:49918/0 (socket says 172.21.15.184:49918) 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f593b3640 1 -- 172.21.15.184:0/660599402 learned_addr learned my addr 172.21.15.184:0/660599402 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f58bb2640 1 --2- 172.21.15.184:0/660599402 >> v2:172.21.15.174:3300/0 conn(0x7f5f5406e140 0x7f5f541872d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478511203 0 0) 0x7f5f54180c30 con 0x7f5f54189d80 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f3c003520 con 0x7f5f54189d80 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 527919588 0 0) 0x7f5f3c003520 con 0x7f5f54189d80 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 >> v2:172.21.15.174:3300/0 conn(0x7f5f5406e140 msgr2=0x7f5f541872d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f53fff640 1 --2- 172.21.15.184:0/660599402 >> v2:172.21.15.174:3300/0 conn(0x7f5f5406e140 0x7f5f541872d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 >> v2:172.21.15.69:3300/0 conn(0x7f5f5418a160 msgr2=0x7f5f5418a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f59bb4640 1 --2- 172.21.15.184:0/660599402 >> v2:172.21.15.69:3300/0 conn(0x7f5f5418a160 0x7f5f5418a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.772 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f53fff640 1 --2- 172.21.15.184:0/660599402 >> v2:172.21.15.69:3300/0 conn(0x7f5f5418a160 0x7f5f5418a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5408e510 con 0x7f5f54189d80 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.763+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f5f4c001670 con 0x7f5f54189d80 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 >> v1:172.21.15.184:6789/0 conn(0x7f5f54189d80 legacy=0x7f5f5406da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f53fff640 1 --2- 172.21.15.184:0/660599402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3c0039c0 0x7f5f3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f53fff640 1 --2- 172.21.15.184:0/660599402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f3c0047c0 0x7f5f3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f53fff640 1 --2- 172.21.15.184:0/660599402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f3c0052a0 0x7f5f3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5408df50 con 0x7f5f3c0052a0 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5408e230 con 0x7f5f3c0047c0 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c00c220 con 0x7f5f3c0039c0 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f593b3640 1 --2- 172.21.15.184:0/660599402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3c0039c0 0x7f5f3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f58bb2640 1 --2- 172.21.15.184:0/660599402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f3c0047c0 0x7f5f3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f593b3640 1 -- 172.21.15.184:0/660599402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f3c0047c0 msgr2=0x7f5f3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f593b3640 1 --2- 172.21.15.184:0/660599402 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f3c0047c0 0x7f5f3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f593b3640 1 -- 172.21.15.184:0/660599402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f3c0052a0 msgr2=0x7f5f3c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:45.773 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f593b3640 1 --2- 172.21.15.184:0/660599402 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f3c0052a0 0x7f5f3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f59bb4640 1 -- 172.21.15.184:0/660599402 reap_dead start 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.764+0000 7f5f593b3640 1 -- 172.21.15.184:0/660599402 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c003520 con 0x7f5f3c0039c0 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f593b3640 1 --2- 172.21.15.184:0/660599402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3c0039c0 0x7f5f3c003de0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00c290 tx=0x7f5f3c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69b5f884acc7587a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c005ad0 con 0x7f5f3c0039c0 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c005c30 con 0x7f5f3c0039c0 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f53fff640 1 -- 172.21.15.184:0/660599402 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c02c8d0 con 0x7f5f3c0039c0 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f5b617640 1 -- 172.21.15.184:0/660599402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3c0039c0 msgr2=0x7f5f3c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f5b617640 1 --2- 172.21.15.184:0/660599402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3c0039c0 0x7f5f3c003de0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c00c290 tx=0x7f5f3c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f5b617640 1 -- 172.21.15.184:0/660599402 shutdown_connections 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f5b617640 1 --2- 172.21.15.184:0/660599402 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f3c0039c0 0x7f5f3c003de0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f5b617640 1 -- 172.21.15.184:0/660599402 >> 172.21.15.184:0/660599402 conn(0x7f5f540f8ba0 msgr2=0x7f5f540f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f5b617640 1 -- 172.21.15.184:0/660599402 shutdown_connections 2024-02-21T07:41:45.774 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.765+0000 7f5f5b617640 1 -- 172.21.15.184:0/660599402 wait complete. 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.767+0000 7f5f5b617640 1 Processor -- start 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.767+0000 7f5f5b617640 1 -- start start 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f5b617640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f3c0039c0 0x7f5f541684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f5b617640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f5416cf00 0x7f5f5417da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f5b617640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5417df60 0x7f5f5421f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f5b617640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5416b8a0 con 0x7f5f5416cf00 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f5b617640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5416bb80 con 0x7f5f3c0039c0 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f5b617640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5416be60 con 0x7f5f5417df60 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f59bb4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5417df60 0x7f5f5421f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f59bb4640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5417df60 0x7f5f5421f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:32934/0 (socket says 172.21.15.184:32934) 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f59bb4640 1 -- 172.21.15.184:0/2669467337 learned_addr learned my addr 172.21.15.184:0/2669467337 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-21T07:41:45.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f593b3640 1 --2- 172.21.15.184:0/2669467337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f3c0039c0 0x7f5f541684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f59bb4640 1 -- 172.21.15.184:0/2669467337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f3c0039c0 msgr2=0x7f5f541684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f59bb4640 1 --2- 172.21.15.184:0/2669467337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f3c0039c0 0x7f5f541684e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f59bb4640 1 -- 172.21.15.184:0/2669467337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f5416cf00 msgr2=0x7f5f5417da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f59bb4640 1 --2- 172.21.15.184:0/2669467337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f5416cf00 0x7f5f5417da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f59bb4640 1 -- 172.21.15.184:0/2669467337 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5416c140 con 0x7f5f5417df60 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f59bb4640 1 --2- 172.21.15.184:0/2669467337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5417df60 0x7f5f5421f8c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5f54090320 tx=0x7f5f4400a7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f51ffb640 1 -- 172.21.15.184:0/2669467337 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44004230 con 0x7f5f5417df60 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f51ffb640 1 -- 172.21.15.184:0/2669467337 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4400c050 con 0x7f5f5417df60 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f5b617640 1 -- 172.21.15.184:0/2669467337 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5416c420 con 0x7f5f5417df60 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.768+0000 7f5f51ffb640 1 -- 172.21.15.184:0/2669467337 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44011620 con 0x7f5f5417df60 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.769+0000 7f5f5b617640 1 -- 172.21.15.184:0/2669467337 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5416c9e0 con 0x7f5f5417df60 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.769+0000 7f5f51ffb640 1 -- 172.21.15.184:0/2669467337 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5f44011780 con 0x7f5f5417df60 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.769+0000 7f5f51ffb640 1 -- 172.21.15.184:0/2669467337 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 1990+0+0 (secure 0 0 0) 0x7f5f4401cbe0 con 0x7f5f5417df60 2024-02-21T07:41:45.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.769+0000 7f5f5b617640 1 -- 172.21.15.184:0/2669467337 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f54069d50 con 0x7f5f5417df60 2024-02-21T07:41:45.779 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.771+0000 7f5f51ffb640 1 -- 172.21.15.184:0/2669467337 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5f44022060 con 0x7f5f5417df60 2024-02-21T07:41:45.850 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.845+0000 7f5f5b617640 1 -- 172.21.15.184:0/2669467337 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7af2eeca-42fb-4513-a506-c63df777cd1d", "id": 11} v 0) v1 -- 0x7f5f540d4aa0 con 0x7f5f5417df60 2024-02-21T07:41:45.855 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.850+0000 7f5f51ffb640 1 -- 172.21.15.184:0/2669467337 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7af2eeca-42fb-4513-a506-c63df777cd1d", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7f5f44018070 con 0x7f5f5417df60 2024-02-21T07:41:45.855 INFO:teuthology.orchestra.run.smithi184.stdout:11 2024-02-21T07:41:45.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.851+0000 7f5f5b617640 1 -- 172.21.15.184:0/2669467337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5417df60 msgr2=0x7f5f5421f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:45.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.851+0000 7f5f5b617640 1 --2- 172.21.15.184:0/2669467337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5417df60 0x7f5f5421f8c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5f54090320 tx=0x7f5f4400a7f0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.851+0000 7f5f5b617640 1 -- 172.21.15.184:0/2669467337 shutdown_connections 2024-02-21T07:41:45.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.851+0000 7f5f5b617640 1 --2- 172.21.15.184:0/2669467337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f5417df60 0x7f5f5421f8c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.851+0000 7f5f5b617640 1 --2- 172.21.15.184:0/2669467337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f5416cf00 0x7f5f5417da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.851+0000 7f5f5b617640 1 --2- 172.21.15.184:0/2669467337 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5f3c0039c0 0x7f5f541684e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:45.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.851+0000 7f5f5b617640 1 -- 172.21.15.184:0/2669467337 >> 172.21.15.184:0/2669467337 conn(0x7f5f540f8ba0 msgr2=0x7f5f54170260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:45.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.851+0000 7f5f5b617640 1 -- 172.21.15.184:0/2669467337 shutdown_connections 2024-02-21T07:41:45.857 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-21T07:41:45.851+0000 7f5f5b617640 1 -- 172.21.15.184:0/2669467337 wait complete. 2024-02-21T07:41:45.867 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-21T07:41:45.867 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-21T07:41:45.874 INFO:tasks.ceph.osd.0:Started 2024-02-21T07:41:45.874 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-21T07:41:45.874 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-21T07:41:45.881 INFO:tasks.ceph.osd.3:Started 2024-02-21T07:41:45.881 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-21T07:41:45.881 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-21T07:41:45.887 INFO:tasks.ceph.osd.6:Started 2024-02-21T07:41:45.887 INFO:tasks.ceph.osd.9:Restarting daemon 2024-02-21T07:41:45.887 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-02-21T07:41:45.891 INFO:tasks.ceph.osd.9:Started 2024-02-21T07:41:45.891 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-21T07:41:45.892 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-21T07:41:45.894 INFO:tasks.ceph.osd.1:Started 2024-02-21T07:41:45.894 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-21T07:41:45.894 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-21T07:41:45.896 INFO:tasks.ceph.osd.4:Started 2024-02-21T07:41:45.896 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-21T07:41:45.896 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-21T07:41:45.898 INFO:tasks.ceph.osd.7:Started 2024-02-21T07:41:45.898 INFO:tasks.ceph.osd.10:Restarting daemon 2024-02-21T07:41:45.898 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2024-02-21T07:41:45.900 INFO:tasks.ceph.osd.10:Started 2024-02-21T07:41:45.900 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-21T07:41:45.900 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-21T07:41:45.902 INFO:tasks.ceph.osd.2:Started 2024-02-21T07:41:45.903 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-21T07:41:45.903 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-21T07:41:45.904 INFO:tasks.ceph.osd.5:Started 2024-02-21T07:41:45.905 INFO:tasks.ceph.osd.8:Restarting daemon 2024-02-21T07:41:45.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2024-02-21T07:41:45.907 INFO:tasks.ceph.osd.8:Started 2024-02-21T07:41:45.907 INFO:tasks.ceph.osd.11:Restarting daemon 2024-02-21T07:41:45.907 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2024-02-21T07:41:45.909 INFO:tasks.ceph.osd.11:Started 2024-02-21T07:41:45.909 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:41:45.962 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:45.957+0000 7f19fcd51040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T07:41:46.093 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:46.087+0000 7f9988693040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T07:41:46.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.140+0000 7f9245800640 1 Processor -- start 2024-02-21T07:41:46.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.140+0000 7f9245800640 1 -- start start 2024-02-21T07:41:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.142+0000 7f9245800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9240185da0 0x7f92400cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.142+0000 7f9245800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f924018c600 0x7f924018ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.142+0000 7f9245800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92400f9bd0 con 0x7f92400cf1f0 2024-02-21T07:41:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.142+0000 7f9245800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9240187620 con 0x7f924018c600 2024-02-21T07:41:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.142+0000 7f9245800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92400f9e90 con 0x7f9240185da0 2024-02-21T07:41:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.142+0000 7f923f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f924018c600 0x7f924018ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.142+0000 7f923f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f924018c600 0x7f924018ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53462/0 (socket says 172.21.15.69:53462) 2024-02-21T07:41:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.142+0000 7f923ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9240185da0 0x7f92400cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:46.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.142+0000 7f923f400640 1 -- 172.21.15.69:0/651233707 learned_addr learned my addr 172.21.15.69:0/651233707 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:46.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.142+0000 7f923d600640 1 -- 172.21.15.69:0/651233707 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567971369 0 0) 0x7f92400f9bd0 con 0x7f92400cf1f0 2024-02-21T07:41:46.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.143+0000 7f923d600640 1 -- 172.21.15.69:0/651233707 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9224003520 con 0x7f92400cf1f0 2024-02-21T07:41:46.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.143+0000 7f923f400640 1 -- 172.21.15.69:0/651233707 >> v2:172.21.15.184:3300/0 conn(0x7f9240185da0 msgr2=0x7f92400cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:46.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.143+0000 7f923f400640 1 --2- 172.21.15.69:0/651233707 >> v2:172.21.15.184:3300/0 conn(0x7f9240185da0 0x7f92400cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:46.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.143+0000 7f923f400640 1 -- 172.21.15.69:0/651233707 >> v1:172.21.15.184:6789/0 conn(0x7f92400cf1f0 legacy=0x7f924018bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:46.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.143+0000 7f923f400640 1 -- 172.21.15.69:0/651233707 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92401869a0 con 0x7f924018c600 2024-02-21T07:41:46.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.143+0000 7f923ea00640 1 --2- 172.21.15.69:0/651233707 >> v2:172.21.15.184:3300/0 conn(0x7f9240185da0 0x7f92400cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:41:46.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.144+0000 7f923f400640 1 --2- 172.21.15.69:0/651233707 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f924018c600 0x7f924018ca00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f92400724a0 tx=0x7f923802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b664309a7dd7e470 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:46.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.144+0000 7f923d600640 1 -- 172.21.15.69:0/651233707 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923802c9f0 con 0x7f924018c600 2024-02-21T07:41:46.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.144+0000 7f923d600640 1 -- 172.21.15.69:0/651233707 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923802cb50 con 0x7f924018c600 2024-02-21T07:41:46.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.144+0000 7f923d600640 1 -- 172.21.15.69:0/651233707 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92380343f0 con 0x7f924018c600 2024-02-21T07:41:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.145+0000 7f9245800640 1 -- 172.21.15.69:0/651233707 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f924018c600 msgr2=0x7f924018ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.145+0000 7f9245800640 1 --2- 172.21.15.69:0/651233707 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f924018c600 0x7f924018ca00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f92400724a0 tx=0x7f923802be50 comp rx=0 tx=0).stop 2024-02-21T07:41:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.145+0000 7f9245800640 1 -- 172.21.15.69:0/651233707 shutdown_connections 2024-02-21T07:41:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.145+0000 7f9245800640 1 --2- 172.21.15.69:0/651233707 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f924018c600 0x7f924018ca00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.145+0000 7f9245800640 1 --2- 172.21.15.69:0/651233707 >> v2:172.21.15.184:3300/0 conn(0x7f9240185da0 0x7f92400cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.145+0000 7f9245800640 1 -- 172.21.15.69:0/651233707 >> 172.21.15.69:0/651233707 conn(0x7f9240071b80 msgr2=0x7f92400668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.145+0000 7f9245800640 1 -- 172.21.15.69:0/651233707 shutdown_connections 2024-02-21T07:41:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.145+0000 7f9245800640 1 -- 172.21.15.69:0/651233707 wait complete. 2024-02-21T07:41:46.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.147+0000 7f9245800640 1 Processor -- start 2024-02-21T07:41:46.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.147+0000 7f9245800640 1 -- start start 2024-02-21T07:41:46.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f9245800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92400cf1f0 0x7f924016bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:46.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f9245800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9240185da0 0x7f924021e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:46.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f9245800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f924018c600 0x7f924021eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:46.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f9245800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924021f3e0 con 0x7f92400cf1f0 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f9245800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400fd270 con 0x7f9240185da0 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f9245800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92400fd550 con 0x7f924018c600 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f923ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92400cf1f0 0x7f924016bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f923ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92400cf1f0 0x7f924016bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53468/0 (socket says 172.21.15.69:53468) 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f923ea00640 1 -- 172.21.15.69:0/957665286 learned_addr learned my addr 172.21.15.69:0/957665286 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f923f400640 1 --2- 172.21.15.69:0/957665286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f924018c600 0x7f924021eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.148+0000 7f923e000640 1 --2- 172.21.15.69:0/957665286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9240185da0 0x7f924021e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f923f400640 1 -- 172.21.15.69:0/957665286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9240185da0 msgr2=0x7f924021e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f923f400640 1 --2- 172.21.15.69:0/957665286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9240185da0 0x7f924021e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f923f400640 1 -- 172.21.15.69:0/957665286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92400cf1f0 msgr2=0x7f924016bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f923f400640 1 --2- 172.21.15.69:0/957665286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92400cf1f0 0x7f924016bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f923f400640 1 -- 172.21.15.69:0/957665286 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9230009400 con 0x7f924018c600 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f923ea00640 1 --2- 172.21.15.69:0/957665286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92400cf1f0 0x7f924016bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:41:46.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f923f400640 1 --2- 172.21.15.69:0/957665286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f924018c600 0x7f924021eab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9238032000 tx=0x7f9238004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:46.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f9236a00640 1 -- 172.21.15.69:0/957665286 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9238007000 con 0x7f924018c600 2024-02-21T07:41:46.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f9236a00640 1 -- 172.21.15.69:0/957665286 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923803e450 con 0x7f924018c600 2024-02-21T07:41:46.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f9236a00640 1 -- 172.21.15.69:0/957665286 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923803e800 con 0x7f924018c600 2024-02-21T07:41:46.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f9245800640 1 -- 172.21.15.69:0/957665286 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9238009b30 con 0x7f924018c600 2024-02-21T07:41:46.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.149+0000 7f9245800640 1 -- 172.21.15.69:0/957665286 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92400fdb10 con 0x7f924018c600 2024-02-21T07:41:46.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.150+0000 7f9236a00640 1 -- 172.21.15.69:0/957665286 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f923803e960 con 0x7f924018c600 2024-02-21T07:41:46.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.150+0000 7f9236a00640 1 -- 172.21.15.69:0/957665286 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2105+0+0 (secure 0 0 0) 0x7f923803fca0 con 0x7f924018c600 2024-02-21T07:41:46.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.151+0000 7f9245800640 1 -- 172.21.15.69:0/957665286 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9240069d50 con 0x7f924018c600 2024-02-21T07:41:46.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.153+0000 7f9236a00640 1 -- 172.21.15.69:0/957665286 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9238043020 con 0x7f924018c600 2024-02-21T07:41:46.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.236+0000 7f9245800640 1 -- 172.21.15.69:0/957665286 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9240067d00 con 0x7f924018c600 2024-02-21T07:41:46.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.237+0000 7f9236a00640 1 -- 172.21.15.69:0/957665286 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9967 (secure 0 0 0) 0x7f923803eda0 con 0x7f924018c600 2024-02-21T07:41:46.243 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:41:46.243 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":14,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:41:45.847042+0000","last_up_change":"0.000000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:41:46.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.238+0000 7f9245800640 1 -- 172.21.15.69:0/957665286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f924018c600 msgr2=0x7f924021eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:46.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.238+0000 7f9245800640 1 --2- 172.21.15.69:0/957665286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f924018c600 0x7f924021eab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9238032000 tx=0x7f9238004a40 comp rx=0 tx=0).stop 2024-02-21T07:41:46.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.238+0000 7f9245800640 1 -- 172.21.15.69:0/957665286 shutdown_connections 2024-02-21T07:41:46.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.238+0000 7f9245800640 1 --2- 172.21.15.69:0/957665286 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f924018c600 0x7f924021eab0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:46.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.238+0000 7f9245800640 1 --2- 172.21.15.69:0/957665286 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9240185da0 0x7f924021e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:46.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.238+0000 7f9245800640 1 --2- 172.21.15.69:0/957665286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92400cf1f0 0x7f924016bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:46.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.238+0000 7f9245800640 1 -- 172.21.15.69:0/957665286 >> 172.21.15.69:0/957665286 conn(0x7f9240071b80 msgr2=0x7f92400d1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:46.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.238+0000 7f9245800640 1 -- 172.21.15.69:0/957665286 shutdown_connections 2024-02-21T07:41:46.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:46.238+0000 7f9245800640 1 -- 172.21.15.69:0/957665286 wait complete. 2024-02-21T07:41:46.253 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:46.248+0000 7f19fcd51040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T07:41:46.259 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-21T07:41:46.259 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-21T07:41:46.306 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:46.301+0000 7f19fcd51040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T07:41:46.368 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:46.363+0000 7f9988693040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T07:41:46.419 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:46.413+0000 7f9988693040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T07:41:46.421 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:46.416+0000 7f19fcd51040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T07:41:46.492 INFO:tasks.ceph.osd.10.smithi174.stderr:2024-02-21T07:41:46.487+0000 7f5f55e1d640 -1 Falling back to public interface 2024-02-21T07:41:46.493 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-02-21T07:41:46.488+0000 7f2a20ca6640 -1 Falling back to public interface 2024-02-21T07:41:46.505 INFO:tasks.ceph.osd.8.smithi184.stderr:2024-02-21T07:41:46.499+0000 7ff692738640 -1 Falling back to public interface 2024-02-21T07:41:46.509 INFO:tasks.ceph.osd.11.smithi184.stderr:2024-02-21T07:41:46.503+0000 7fe344837640 -1 Falling back to public interface 2024-02-21T07:41:46.514 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-02-21T07:41:46.509+0000 7fa0c600d640 -1 Falling back to public interface 2024-02-21T07:41:46.517 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-02-21T07:41:46.511+0000 7fd7b099a640 -1 Falling back to public interface 2024-02-21T07:41:46.520 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-02-21T07:41:46.515+0000 7f459bad9640 -1 Falling back to public interface 2024-02-21T07:41:46.522 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-02-21T07:41:46.516+0000 7fda83011640 -1 Falling back to public interface 2024-02-21T07:41:46.539 INFO:tasks.ceph.mgr.z.smithi184.stderr:2024-02-21T07:41:46.532+0000 7f9988693040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T07:41:46.595 INFO:tasks.ceph.osd.6.smithi069.stderr:2024-02-21T07:41:46.589+0000 7efd07b2a640 -1 Falling back to public interface 2024-02-21T07:41:46.597 INFO:tasks.ceph.osd.0.smithi069.stderr:2024-02-21T07:41:46.592+0000 7ff97b016640 -1 Falling back to public interface 2024-02-21T07:41:46.603 INFO:tasks.ceph.osd.9.smithi069.stderr:2024-02-21T07:41:46.597+0000 7fdcdc620640 -1 Falling back to public interface 2024-02-21T07:41:46.611 INFO:tasks.ceph.osd.3.smithi069.stderr:2024-02-21T07:41:46.606+0000 7fe1afc0d640 -1 Falling back to public interface 2024-02-21T07:41:46.805 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:46.799+0000 7fa829241040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T07:41:47.113 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:47.107+0000 7fa829241040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T07:41:47.174 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:47.168+0000 7fa829241040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T07:41:47.305 INFO:tasks.ceph.mgr.x.smithi069.stderr:2024-02-21T07:41:47.299+0000 7fa829241040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T07:41:47.460 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:47.455+0000 7f199e1bd640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-21T07:41:47.460 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:41:47.456+0000 7f199e1bd640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-21T07:41:47.469 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-21T07:41:47.627 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.621+0000 7f7097800640 1 Processor -- start 2024-02-21T07:41:47.627 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.621+0000 7f7097800640 1 -- start start 2024-02-21T07:41:47.629 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.623+0000 7f7097800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f709017f9b0 0x7f709006e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:47.629 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.623+0000 7f7097800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7090188120 0x7f709006ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:47.629 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.623+0000 7f7097800640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7090186c90 con 0x7f709006e890 2024-02-21T07:41:47.629 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.623+0000 7f7097800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70901875f0 con 0x7f709017f9b0 2024-02-21T07:41:47.630 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.623+0000 7f7097800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709006bd70 con 0x7f7090188120 2024-02-21T07:41:47.630 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.623+0000 7f7094e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f709017f9b0 0x7f709006e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:47.630 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.623+0000 7f7094e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f709017f9b0 0x7f709006e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53472/0 (socket says 172.21.15.69:53472) 2024-02-21T07:41:47.630 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.623+0000 7f7094e00640 1 -- 172.21.15.69:0/4174216814 learned_addr learned my addr 172.21.15.69:0/4174216814 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:47.630 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.623+0000 7f7095800640 1 --2- 172.21.15.69:0/4174216814 >> v2:172.21.15.184:3300/0 conn(0x7f7090188120 0x7f709006ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:47.630 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.624+0000 7f7094e00640 1 -- 172.21.15.69:0/4174216814 >> v2:172.21.15.184:3300/0 conn(0x7f7090188120 msgr2=0x7f709006ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:47.630 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.624+0000 7f7094e00640 1 --2- 172.21.15.69:0/4174216814 >> v2:172.21.15.184:3300/0 conn(0x7f7090188120 0x7f709006ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:47.630 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.624+0000 7f7094e00640 1 -- 172.21.15.69:0/4174216814 >> v1:172.21.15.174:6789/0 conn(0x7f709006e890 legacy=0x7f7090187a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:47.630 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.624+0000 7f708f400640 1 -- 172.21.15.69:0/4174216814 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437164296 0 0) 0x7f7090186c90 con 0x7f709006e890 2024-02-21T07:41:47.630 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.624+0000 7f7094e00640 1 -- 172.21.15.69:0/4174216814 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090186f30 con 0x7f709017f9b0 2024-02-21T07:41:47.631 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.625+0000 7f7094e00640 1 --2- 172.21.15.69:0/4174216814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f709017f9b0 0x7f709006e350 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f709008e5f0 tx=0x7f707802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0d3f7e3753df9c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:47.631 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.625+0000 7f708f400640 1 -- 172.21.15.69:0/4174216814 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780317e0 con 0x7f709017f9b0 2024-02-21T07:41:47.631 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.625+0000 7f708f400640 1 -- 172.21.15.69:0/4174216814 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7078031940 con 0x7f709017f9b0 2024-02-21T07:41:47.632 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.625+0000 7f708f400640 1 -- 172.21.15.69:0/4174216814 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078031cd0 con 0x7f709017f9b0 2024-02-21T07:41:47.632 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.626+0000 7f7097800640 1 -- 172.21.15.69:0/4174216814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f709017f9b0 msgr2=0x7f709006e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:47.632 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.626+0000 7f7097800640 1 --2- 172.21.15.69:0/4174216814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f709017f9b0 0x7f709006e350 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f709008e5f0 tx=0x7f707802b880 comp rx=0 tx=0).stop 2024-02-21T07:41:47.632 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.626+0000 7f7097800640 1 -- 172.21.15.69:0/4174216814 shutdown_connections 2024-02-21T07:41:47.632 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.626+0000 7f7097800640 1 --2- 172.21.15.69:0/4174216814 >> v2:172.21.15.184:3300/0 conn(0x7f7090188120 0x7f709006ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:47.632 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.626+0000 7f7097800640 1 --2- 172.21.15.69:0/4174216814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f709017f9b0 0x7f709006e350 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:47.632 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.626+0000 7f7097800640 1 -- 172.21.15.69:0/4174216814 >> 172.21.15.69:0/4174216814 conn(0x7f70900ce430 msgr2=0x7f70900ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:47.632 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.626+0000 7f7097800640 1 -- 172.21.15.69:0/4174216814 shutdown_connections 2024-02-21T07:41:47.632 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.626+0000 7f7097800640 1 -- 172.21.15.69:0/4174216814 wait complete. 2024-02-21T07:41:47.633 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.628+0000 7f7097800640 1 Processor -- start 2024-02-21T07:41:47.633 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.628+0000 7f7097800640 1 -- start start 2024-02-21T07:41:47.635 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.629+0000 7f7097800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f709006e890 0x7f70901742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.629+0000 7f7097800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7090188120 0x7f709021fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.629+0000 7f7097800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7090220260 0x7f7090178960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.629+0000 7f7097800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090220760 con 0x7f7090188120 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.629+0000 7f7097800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090220a40 con 0x7f7090220260 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.629+0000 7f7097800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7090220d20 con 0x7f709006e890 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.629+0000 7f708fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7090188120 0x7f709021fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.629+0000 7f708fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7090188120 0x7f709021fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53476/0 (socket says 172.21.15.69:53476) 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.629+0000 7f708fe00640 1 -- 172.21.15.69:0/1922997058 learned_addr learned my addr 172.21.15.69:0/1922997058 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f7094e00640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f709006e890 0x7f70901742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f7095800640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7090220260 0x7f7090178960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f708fe00640 1 -- 172.21.15.69:0/1922997058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f709006e890 msgr2=0x7f70901742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f708fe00640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f709006e890 0x7f70901742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:47.636 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f708fe00640 1 -- 172.21.15.69:0/1922997058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7090220260 msgr2=0x7f7090178960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:47.637 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f708fe00640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7090220260 0x7f7090178960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:47.637 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f708fe00640 1 -- 172.21.15.69:0/1922997058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70780094d0 con 0x7f7090188120 2024-02-21T07:41:47.637 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f708fe00640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7090188120 0x7f709021fd20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f708000c390 tx=0x7f708000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:47.637 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f708cc00640 1 -- 172.21.15.69:0/1922997058 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800035f0 con 0x7f7090188120 2024-02-21T07:41:47.637 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f708cc00640 1 -- 172.21.15.69:0/1922997058 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7080003750 con 0x7f7090188120 2024-02-21T07:41:47.638 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f708cc00640 1 -- 172.21.15.69:0/1922997058 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080003b00 con 0x7f7090188120 2024-02-21T07:41:47.638 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.630+0000 7f7097800640 1 -- 172.21.15.69:0/1922997058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7090221000 con 0x7f7090188120 2024-02-21T07:41:47.638 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.631+0000 7f7097800640 1 -- 172.21.15.69:0/1922997058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70902215c0 con 0x7f7090188120 2024-02-21T07:41:47.638 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.632+0000 7f7097800640 1 -- 172.21.15.69:0/1922997058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70900f0cc0 con 0x7f7090188120 2024-02-21T07:41:47.639 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.633+0000 7f708cc00640 1 -- 172.21.15.69:0/1922997058 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 3) v1 ==== 134206+0+0 (secure 0 0 0) 0x7f7080003c60 con 0x7f7090188120 2024-02-21T07:41:47.640 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.635+0000 7f708cc00640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f706c09eef0 0x7f706c0a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:47.640 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.635+0000 7f708cc00640 1 -- 172.21.15.69:0/1922997058 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2105+0+0 (secure 0 0 0) 0x7f70800c7410 con 0x7f7090188120 2024-02-21T07:41:47.640 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.635+0000 7f7094e00640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f706c09eef0 0x7f706c0a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:47.641 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.635+0000 7f7094e00640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f706c09eef0 0x7f706c0a13b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7078036000 tx=0x7f707803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:47.644 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.639+0000 7f708cc00640 1 -- 172.21.15.69:0/1922997058 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7080092e50 con 0x7f7090188120 2024-02-21T07:41:47.840 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.834+0000 7f7097800640 1 -- 172.21.15.69:0/1922997058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7090069c20 con 0x7f7090188120 2024-02-21T07:41:47.840 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.835+0000 7f708cc00640 1 -- 172.21.15.69:0/1922997058 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9967 (secure 0 0 0) 0x7f7080017090 con 0x7f7090188120 2024-02-21T07:41:47.841 INFO:teuthology.misc.health.smithi069.stdout: 2024-02-21T07:41:47.841 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":14,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:41:45.847042+0000","last_up_change":"0.000000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:41:47.843 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 -- 172.21.15.69:0/1922997058 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f706c09eef0 msgr2=0x7f706c0a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:47.843 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f706c09eef0 0x7f706c0a13b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7078036000 tx=0x7f707803d040 comp rx=0 tx=0).stop 2024-02-21T07:41:47.843 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 -- 172.21.15.69:0/1922997058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7090188120 msgr2=0x7f709021fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:47.843 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7090188120 0x7f709021fd20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f708000c390 tx=0x7f708000c850 comp rx=0 tx=0).stop 2024-02-21T07:41:47.843 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 -- 172.21.15.69:0/1922997058 shutdown_connections 2024-02-21T07:41:47.843 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f706c09eef0 0x7f706c0a13b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:47.843 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7090220260 0x7f7090178960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:47.844 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7090188120 0x7f709021fd20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:47.844 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 --2- 172.21.15.69:0/1922997058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f709006e890 0x7f70901742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:47.844 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 -- 172.21.15.69:0/1922997058 >> 172.21.15.69:0/1922997058 conn(0x7f70900ce430 msgr2=0x7f7090187a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:47.844 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 -- 172.21.15.69:0/1922997058 shutdown_connections 2024-02-21T07:41:47.844 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:47.837+0000 7f7097800640 1 -- 172.21.15.69:0/1922997058 wait complete. 2024-02-21T07:41:47.856 DEBUG:teuthology.misc:0 of 12 OSDs are up 2024-02-21T07:41:49.928 INFO:tasks.ceph.osd.8.smithi184.stderr:2024-02-21T07:41:49.922+0000 7ff692738640 -1 osd.8 0 log_to_monitors true 2024-02-21T07:41:49.981 INFO:tasks.ceph.osd.10.smithi174.stderr:2024-02-21T07:41:49.976+0000 7f5f55e1d640 -1 osd.10 0 log_to_monitors true 2024-02-21T07:41:49.986 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-02-21T07:41:49.981+0000 7f2a20ca6640 -1 osd.1 0 log_to_monitors true 2024-02-21T07:41:49.990 INFO:tasks.ceph.osd.11.smithi184.stderr:2024-02-21T07:41:49.985+0000 7fe344837640 -1 osd.11 0 log_to_monitors true 2024-02-21T07:41:50.011 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-02-21T07:41:50.006+0000 7fd7b099a640 -1 osd.5 0 log_to_monitors true 2024-02-21T07:41:50.022 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-02-21T07:41:50.017+0000 7fa0c600d640 -1 osd.7 0 log_to_monitors true 2024-02-21T07:41:50.023 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-02-21T07:41:50.019+0000 7f459bad9640 -1 osd.4 0 log_to_monitors true 2024-02-21T07:41:50.039 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-02-21T07:41:50.033+0000 7fda83011640 -1 osd.2 0 log_to_monitors true 2024-02-21T07:41:50.129 INFO:tasks.ceph.osd.6.smithi069.stderr:2024-02-21T07:41:50.123+0000 7efd07b2a640 -1 osd.6 0 log_to_monitors true 2024-02-21T07:41:50.185 INFO:tasks.ceph.osd.0.smithi069.stderr:2024-02-21T07:41:50.179+0000 7ff97b016640 -1 osd.0 0 log_to_monitors true 2024-02-21T07:41:50.216 INFO:tasks.ceph.osd.3.smithi069.stderr:2024-02-21T07:41:50.211+0000 7fe1afc0d640 -1 osd.3 0 log_to_monitors true 2024-02-21T07:41:50.445 INFO:tasks.ceph.osd.9.smithi069.stderr:2024-02-21T07:41:50.439+0000 7fdcdc620640 -1 osd.9 0 log_to_monitors true 2024-02-21T07:41:53.597 INFO:tasks.ceph.osd.10.smithi174.stderr:2024-02-21T07:41:53.589+0000 7f5f516ed640 -1 osd.10 0 waiting for initial osdmap 2024-02-21T07:41:53.599 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-02-21T07:41:53.593+0000 7fa0c19af640 -1 osd.7 0 waiting for initial osdmap 2024-02-21T07:41:53.602 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-02-21T07:41:53.596+0000 7f4598283640 -1 osd.4 0 waiting for initial osdmap 2024-02-21T07:41:53.609 INFO:tasks.ceph.osd.10.smithi174.stderr:2024-02-21T07:41:53.604+0000 7f5f4951e640 -1 osd.10 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.612 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-02-21T07:41:53.607+0000 7f458f88f640 -1 osd.4 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.612 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-02-21T07:41:53.607+0000 7fa0b97cf640 -1 osd.7 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.631 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-02-21T07:41:53.626+0000 7f2a1cc3c640 -1 osd.1 0 waiting for initial osdmap 2024-02-21T07:41:53.641 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-02-21T07:41:53.636+0000 7fd7ad144640 -1 osd.5 0 waiting for initial osdmap 2024-02-21T07:41:53.642 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-02-21T07:41:53.637+0000 7f2a14a5c640 -1 osd.1 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.643 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-02-21T07:41:53.636+0000 7fda7e90f640 -1 osd.2 0 waiting for initial osdmap 2024-02-21T07:41:53.646 INFO:tasks.ceph.osd.11.smithi184.stderr:2024-02-21T07:41:53.641+0000 7fe3407cd640 -1 osd.11 0 waiting for initial osdmap 2024-02-21T07:41:53.654 INFO:tasks.ceph.osd.8.smithi184.stderr:2024-02-21T07:41:53.648+0000 7ff68eee2640 -1 osd.8 0 waiting for initial osdmap 2024-02-21T07:41:53.655 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-02-21T07:41:53.650+0000 7fd7a4750640 -1 osd.5 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.656 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-02-21T07:41:53.651+0000 7fda7672f640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.660 INFO:tasks.ceph.osd.11.smithi184.stderr:2024-02-21T07:41:53.655+0000 7fe3385ed640 -1 osd.11 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.663 INFO:tasks.ceph.osd.8.smithi184.stderr:2024-02-21T07:41:53.658+0000 7ff6864ee640 -1 osd.8 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.846 INFO:tasks.ceph.osd.0.smithi069.stderr:2024-02-21T07:41:53.840+0000 7ff975a00640 -1 osd.0 0 waiting for initial osdmap 2024-02-21T07:41:53.857 INFO:tasks.ceph.osd.0.smithi069.stderr:2024-02-21T07:41:53.851+0000 7ff96ba00640 -1 osd.0 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.863 INFO:tasks.ceph.osd.9.smithi069.stderr:2024-02-21T07:41:53.857+0000 7fdcd6e00640 -1 osd.9 0 waiting for initial osdmap 2024-02-21T07:41:53.867 INFO:tasks.ceph.osd.9.smithi069.stderr:2024-02-21T07:41:53.861+0000 7fdccce00640 -1 osd.9 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.923 INFO:tasks.ceph.osd.3.smithi069.stderr:2024-02-21T07:41:53.918+0000 7fe1aa400640 -1 osd.3 0 waiting for initial osdmap 2024-02-21T07:41:53.933 INFO:tasks.ceph.osd.3.smithi069.stderr:2024-02-21T07:41:53.927+0000 7fe1a0400640 -1 osd.3 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:53.940 INFO:tasks.ceph.osd.6.smithi069.stderr:2024-02-21T07:41:53.934+0000 7efd02a00640 -1 osd.6 0 waiting for initial osdmap 2024-02-21T07:41:53.960 INFO:tasks.ceph.osd.6.smithi069.stderr:2024-02-21T07:41:53.954+0000 7efcf8a00640 -1 osd.6 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T07:41:55.069 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-21T07:41:55.251 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.245+0000 7f3dba200640 1 Processor -- start 2024-02-21T07:41:55.251 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.245+0000 7f3dba200640 1 -- start start 2024-02-21T07:41:55.254 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.247+0000 7f3dba200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f3db4187410 0x7f3db418a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.254 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.247+0000 7f3dba200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f3db418a6f0 0x7f3db4187cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.254 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.247+0000 7f3dba200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db4189aa0 con 0x7f3db4189dd0 2024-02-21T07:41:55.254 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.247+0000 7f3dba200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db4188bb0 con 0x7f3db4187410 2024-02-21T07:41:55.254 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.247+0000 7f3dba200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db4188e90 con 0x7f3db418a6f0 2024-02-21T07:41:55.254 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.248+0000 7f3db3400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f3db4189dd0 0x7f3db4186d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46436/0 (socket says 172.21.15.69:46436) 2024-02-21T07:41:55.255 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.248+0000 7f3db3400640 1 -- 172.21.15.69:0/2201174401 learned_addr learned my addr 172.21.15.69:0/2201174401 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:41:55.255 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.248+0000 7f3daaa00640 1 --2- 172.21.15.69:0/2201174401 >> v2:172.21.15.174:3300/0 conn(0x7f3db4187410 0x7f3db418a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.255 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.248+0000 7f3db3e00640 1 --2- 172.21.15.69:0/2201174401 >> v2:172.21.15.184:3300/0 conn(0x7f3db418a6f0 0x7f3db4187cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.255 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.248+0000 7f3db2a00640 1 -- 172.21.15.69:0/2201174401 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286549908 0 0) 0x7f3db4189aa0 con 0x7f3db4189dd0 2024-02-21T07:41:55.255 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.248+0000 7f3db2a00640 1 -- 172.21.15.69:0/2201174401 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d98003520 con 0x7f3db4189dd0 2024-02-21T07:41:55.255 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.248+0000 7f3daaa00640 1 -- 172.21.15.69:0/2201174401 >> v2:172.21.15.184:3300/0 conn(0x7f3db418a6f0 msgr2=0x7f3db4187cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:55.255 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.248+0000 7f3daaa00640 1 --2- 172.21.15.69:0/2201174401 >> v2:172.21.15.184:3300/0 conn(0x7f3db418a6f0 0x7f3db4187cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.255 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.248+0000 7f3daaa00640 1 -- 172.21.15.69:0/2201174401 >> v1:172.21.15.69:6789/0 conn(0x7f3db4189dd0 legacy=0x7f3db4186d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.255 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.248+0000 7f3daaa00640 1 -- 172.21.15.69:0/2201174401 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db4189170 con 0x7f3db4187410 2024-02-21T07:41:55.256 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.249+0000 7f3daaa00640 1 --2- 172.21.15.69:0/2201174401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3db4187410 0x7f3db418a1b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3db4074070 tx=0x7f3d9c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd1278181acf164f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3db2a00640 1 -- 172.21.15.69:0/2201174401 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c02e070 con 0x7f3db4187410 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3db2a00640 1 -- 172.21.15.69:0/2201174401 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0315a0 con 0x7f3db4187410 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3db2a00640 1 -- 172.21.15.69:0/2201174401 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c031930 con 0x7f3db4187410 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3dba200640 1 -- 172.21.15.69:0/2201174401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3db4187410 msgr2=0x7f3db418a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3dba200640 1 --2- 172.21.15.69:0/2201174401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3db4187410 0x7f3db418a1b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3db4074070 tx=0x7f3d9c02b840 comp rx=0 tx=0).stop 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3dba200640 1 -- 172.21.15.69:0/2201174401 shutdown_connections 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3dba200640 1 --2- 172.21.15.69:0/2201174401 >> v2:172.21.15.184:3300/0 conn(0x7f3db418a6f0 0x7f3db4187cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3dba200640 1 --2- 172.21.15.69:0/2201174401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3db4187410 0x7f3db418a1b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3dba200640 1 -- 172.21.15.69:0/2201174401 >> 172.21.15.69:0/2201174401 conn(0x7f3db40ce430 msgr2=0x7f3db40ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3dba200640 1 -- 172.21.15.69:0/2201174401 shutdown_connections 2024-02-21T07:41:55.257 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.250+0000 7f3dba200640 1 -- 172.21.15.69:0/2201174401 wait complete. 2024-02-21T07:41:55.258 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.252+0000 7f3dba200640 1 Processor -- start 2024-02-21T07:41:55.258 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.252+0000 7f3dba200640 1 -- start start 2024-02-21T07:41:55.261 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.253+0000 7f3dba200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3db4187410 0x7f3db416ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.261 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.253+0000 7f3dba200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4189dd0 0x7f3db416f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.261 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.253+0000 7f3dba200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3db418a6f0 0x7f3db417ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.261 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.253+0000 7f3dba200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db4177ee0 con 0x7f3db4189dd0 2024-02-21T07:41:55.261 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.253+0000 7f3dba200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db421a250 con 0x7f3db4187410 2024-02-21T07:41:55.261 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.253+0000 7f3dba200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db421a530 con 0x7f3db418a6f0 2024-02-21T07:41:55.261 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3daaa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4189dd0 0x7f3db416f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.261 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3daaa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4189dd0 0x7f3db416f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40512/0 (socket says 172.21.15.69:40512) 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3daaa00640 1 -- 172.21.15.69:0/1973561198 learned_addr learned my addr 172.21.15.69:0/1973561198 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3db3e00640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3db418a6f0 0x7f3db417ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3db3400640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3db4187410 0x7f3db416ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3daaa00640 1 -- 172.21.15.69:0/1973561198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3db418a6f0 msgr2=0x7f3db417ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3daaa00640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3db418a6f0 0x7f3db417ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3daaa00640 1 -- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3db4187410 msgr2=0x7f3db416ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3daaa00640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3db4187410 0x7f3db416ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3daaa00640 1 -- 172.21.15.69:0/1973561198 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c009400 con 0x7f3db4189dd0 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.254+0000 7f3db3400640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3db4187410 0x7f3db416ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.255+0000 7f3daaa00640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4189dd0 0x7f3db416f210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c034040 tx=0x7f3d9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.255+0000 7f3dabe00640 1 -- 172.21.15.69:0/1973561198 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c032840 con 0x7f3db4189dd0 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.255+0000 7f3dabe00640 1 -- 172.21.15.69:0/1973561198 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c031f00 con 0x7f3db4189dd0 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.255+0000 7f3dabe00640 1 -- 172.21.15.69:0/1973561198 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c032be0 con 0x7f3db4189dd0 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.255+0000 7f3dba200640 1 -- 172.21.15.69:0/1973561198 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db421a810 con 0x7f3db4189dd0 2024-02-21T07:41:55.262 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.255+0000 7f3dba200640 1 -- 172.21.15.69:0/1973561198 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db417b380 con 0x7f3db4189dd0 2024-02-21T07:41:55.263 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.256+0000 7f3dba200640 1 -- 172.21.15.69:0/1973561198 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db421ad30 con 0x7f3db4189dd0 2024-02-21T07:41:55.263 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.258+0000 7f3dabe00640 1 -- 172.21.15.69:0/1973561198 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) v1 ==== 134312+0+0 (secure 0 0 0) 0x7f3d9c032d40 con 0x7f3db4189dd0 2024-02-21T07:41:55.265 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.259+0000 7f3dabe00640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f3d9009f010 0x7f3d900a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.265 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.259+0000 7f3dabe00640 1 -- 172.21.15.69:0/1973561198 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f3d9c0eafb0 con 0x7f3db4189dd0 2024-02-21T07:41:55.265 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.259+0000 7f3db3400640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f3d9009f010 0x7f3d900a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.265 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.260+0000 7f3db3400640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f3d9009f010 0x7f3d900a14d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3da4005c00 tx=0x7f3da4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:55.269 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.263+0000 7f3dabe00640 1 -- 172.21.15.69:0/1973561198 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3db421ad30 con 0x7f3db4189dd0 2024-02-21T07:41:55.465 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.459+0000 7f3dba200640 1 -- 172.21.15.69:0/1973561198 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3db421ad30 con 0x7f3db4189dd0 2024-02-21T07:41:55.467 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.461+0000 7f3dabe00640 1 -- 172.21.15.69:0/1973561198 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+15738 (secure 0 0 0) 0x7f3db421ad30 con 0x7f3db4189dd0 2024-02-21T07:41:55.467 INFO:teuthology.misc.health.smithi069.stdout: 2024-02-21T07:41:55.467 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":17,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:41:54.610033+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:41:55.470 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 -- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f3d9009f010 msgr2=0x7f3d900a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.470 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f3d9009f010 0x7f3d900a14d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3da4005c00 tx=0x7f3da4009040 comp rx=0 tx=0).stop 2024-02-21T07:41:55.470 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 -- 172.21.15.69:0/1973561198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4189dd0 msgr2=0x7f3db416f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.470 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4189dd0 0x7f3db416f210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c034040 tx=0x7f3d9c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.470 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 -- 172.21.15.69:0/1973561198 shutdown_connections 2024-02-21T07:41:55.470 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f3d9009f010 0x7f3d900a14d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.470 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3db418a6f0 0x7f3db417ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.471 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3db4189dd0 0x7f3db416f210 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.471 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 --2- 172.21.15.69:0/1973561198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3db4187410 0x7f3db416ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.471 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 -- 172.21.15.69:0/1973561198 >> 172.21.15.69:0/1973561198 conn(0x7f3db40ce430 msgr2=0x7f3db40cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:55.471 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 -- 172.21.15.69:0/1973561198 shutdown_connections 2024-02-21T07:41:55.471 INFO:teuthology.misc.health.smithi069.stderr:2024-02-21T07:41:55.464+0000 7f3dba200640 1 -- 172.21.15.69:0/1973561198 wait complete. 2024-02-21T07:41:55.483 DEBUG:teuthology.misc:12 of 12 OSDs are up 2024-02-21T07:41:55.483 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-21T07:41:55.484 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-21T07:41:55.484 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-21T07:41:55.490 INFO:tasks.ceph.mds.a:Started 2024-02-21T07:41:55.490 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-21T07:41:55.490 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-21T07:41:55.497 INFO:tasks.ceph.mds.d:Started 2024-02-21T07:41:55.497 INFO:tasks.ceph.mds.g:Restarting daemon 2024-02-21T07:41:55.497 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i g 2024-02-21T07:41:55.502 INFO:tasks.ceph.mds.g:Started 2024-02-21T07:41:55.502 INFO:tasks.ceph.mds.j:Restarting daemon 2024-02-21T07:41:55.502 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i j 2024-02-21T07:41:55.506 INFO:tasks.ceph.mds.j:Started 2024-02-21T07:41:55.506 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-21T07:41:55.506 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-21T07:41:55.509 INFO:tasks.ceph.mds.b:Started 2024-02-21T07:41:55.509 INFO:tasks.ceph.mds.e:Restarting daemon 2024-02-21T07:41:55.509 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-02-21T07:41:55.511 INFO:tasks.ceph.mds.e:Started 2024-02-21T07:41:55.511 INFO:tasks.ceph.mds.h:Restarting daemon 2024-02-21T07:41:55.511 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i h 2024-02-21T07:41:55.513 INFO:tasks.ceph.mds.h:Started 2024-02-21T07:41:55.513 INFO:tasks.ceph.mds.k:Restarting daemon 2024-02-21T07:41:55.513 DEBUG:teuthology.orchestra.run.smithi174:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i k 2024-02-21T07:41:55.516 INFO:tasks.ceph.mds.k:Started 2024-02-21T07:41:55.516 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-21T07:41:55.516 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-21T07:41:55.519 INFO:tasks.ceph.mds.c:Started 2024-02-21T07:41:55.519 INFO:tasks.ceph.mds.f:Restarting daemon 2024-02-21T07:41:55.519 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-02-21T07:41:55.522 INFO:tasks.ceph.mds.f:Started 2024-02-21T07:41:55.522 INFO:tasks.ceph.mds.i:Restarting daemon 2024-02-21T07:41:55.522 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i i 2024-02-21T07:41:55.524 INFO:tasks.ceph.mds.i:Started 2024-02-21T07:41:55.524 INFO:tasks.ceph.mds.l:Restarting daemon 2024-02-21T07:41:55.524 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i l 2024-02-21T07:41:55.526 INFO:tasks.ceph.mds.l:Started 2024-02-21T07:41:55.527 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-21T07:41:55.527 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:41:55.598 INFO:tasks.ceph.mds.k.smithi174.stdout:starting mds.k at 2024-02-21T07:41:55.598 INFO:tasks.ceph.mds.e.smithi174.stdout:starting mds.e at 2024-02-21T07:41:55.599 INFO:tasks.ceph.mds.h.smithi174.stdout:starting mds.h at 2024-02-21T07:41:55.599 INFO:tasks.ceph.mds.b.smithi174.stdout:starting mds.b at 2024-02-21T07:41:55.607 INFO:tasks.ceph.mds.c.smithi184.stdout:starting mds.c at 2024-02-21T07:41:55.610 INFO:tasks.ceph.mds.i.smithi184.stdout:starting mds.i at 2024-02-21T07:41:55.612 INFO:tasks.ceph.mds.f.smithi184.stdout:starting mds.f at 2024-02-21T07:41:55.613 INFO:tasks.ceph.mds.l.smithi184.stdout:starting mds.l at 2024-02-21T07:41:55.656 INFO:tasks.ceph.mds.d.smithi069.stdout:starting mds.d at 2024-02-21T07:41:55.666 INFO:tasks.ceph.mds.g.smithi069.stdout:starting mds.g at 2024-02-21T07:41:55.685 INFO:tasks.ceph.mds.j.smithi069.stdout:starting mds.j at 2024-02-21T07:41:55.695 INFO:tasks.ceph.mds.a.smithi069.stdout:starting mds.a at 2024-02-21T07:41:55.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.730+0000 7efdabe00640 1 Processor -- start 2024-02-21T07:41:55.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.730+0000 7efdabe00640 1 -- start start 2024-02-21T07:41:55.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.731+0000 7efdabe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efda4185da0 0x7efda40cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.731+0000 7efdabe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efda418c600 0x7efda418ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.731+0000 7efdabe00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40f9bd0 con 0x7efda40cf1f0 2024-02-21T07:41:55.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.731+0000 7efdabe00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda4187620 con 0x7efda4185da0 2024-02-21T07:41:55.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.731+0000 7efdabe00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda40f9e90 con 0x7efda418c600 2024-02-21T07:41:55.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda9400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efda4185da0 0x7efda40cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda8a00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7efda40cf1f0 0x7efda418bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:53968/0 (socket says 172.21.15.69:53968) 2024-02-21T07:41:55.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda8a00640 1 -- 172.21.15.69:0/3012156461 learned_addr learned my addr 172.21.15.69:0/3012156461 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:41:55.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda9400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efda4185da0 0x7efda40cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40596/0 (socket says 172.21.15.69:40596) 2024-02-21T07:41:55.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda9e00640 1 --2- 172.21.15.69:0/3012156461 >> v2:172.21.15.174:3300/0 conn(0x7efda418c600 0x7efda418ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda3e00640 1 -- 172.21.15.69:0/3012156461 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011632663 0 0) 0x7efda40f9bd0 con 0x7efda40cf1f0 2024-02-21T07:41:55.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda3e00640 1 -- 172.21.15.69:0/3012156461 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd8c003520 con 0x7efda40cf1f0 2024-02-21T07:41:55.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda9400640 1 -- 172.21.15.69:0/3012156461 >> v2:172.21.15.174:3300/0 conn(0x7efda418c600 msgr2=0x7efda418ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:55.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda9400640 1 --2- 172.21.15.69:0/3012156461 >> v2:172.21.15.174:3300/0 conn(0x7efda418c600 0x7efda418ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda9400640 1 -- 172.21.15.69:0/3012156461 >> v1:172.21.15.184:6789/0 conn(0x7efda40cf1f0 legacy=0x7efda418bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.732+0000 7efda9400640 1 -- 172.21.15.69:0/3012156461 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda41869a0 con 0x7efda4185da0 2024-02-21T07:41:55.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.733+0000 7efda9400640 1 --2- 172.21.15.69:0/3012156461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 0x7efda40cecb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efda40678f0 tx=0x7efd9802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb296c5b6c6f85d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:55.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efda3e00640 1 -- 172.21.15.69:0/3012156461 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98031520 con 0x7efda4185da0 2024-02-21T07:41:55.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efda3e00640 1 -- 172.21.15.69:0/3012156461 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd98031680 con 0x7efda4185da0 2024-02-21T07:41:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efda3e00640 1 -- 172.21.15.69:0/3012156461 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd980319f0 con 0x7efda4185da0 2024-02-21T07:41:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efdabe00640 1 -- 172.21.15.69:0/3012156461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 msgr2=0x7efda40cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efdabe00640 1 --2- 172.21.15.69:0/3012156461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 0x7efda40cecb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efda40678f0 tx=0x7efd9802b7c0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efdabe00640 1 -- 172.21.15.69:0/3012156461 shutdown_connections 2024-02-21T07:41:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efdabe00640 1 --2- 172.21.15.69:0/3012156461 >> v2:172.21.15.174:3300/0 conn(0x7efda418c600 0x7efda418ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efdabe00640 1 --2- 172.21.15.69:0/3012156461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 0x7efda40cecb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efdabe00640 1 -- 172.21.15.69:0/3012156461 >> 172.21.15.69:0/3012156461 conn(0x7efda4071b80 msgr2=0x7efda40668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efdabe00640 1 -- 172.21.15.69:0/3012156461 shutdown_connections 2024-02-21T07:41:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.734+0000 7efdabe00640 1 -- 172.21.15.69:0/3012156461 wait complete. 2024-02-21T07:41:55.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.736+0000 7efdabe00640 1 Processor -- start 2024-02-21T07:41:55.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.737+0000 7efdabe00640 1 -- start start 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efdabe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efda40cf1f0 0x7efda4172440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efdabe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 0x7efda4172980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efdabe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efda418c600 0x7efda4214370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efdabe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda417cea0 con 0x7efda4185da0 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efdabe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda4215170 con 0x7efda40cf1f0 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efdabe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda4215450 con 0x7efda418c600 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda8a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 0x7efda4172980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda8a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 0x7efda4172980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40608/0 (socket says 172.21.15.69:40608) 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda8a00640 1 -- 172.21.15.69:0/3660483360 learned_addr learned my addr 172.21.15.69:0/3660483360 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda9400640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efda40cf1f0 0x7efda4172440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda9e00640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efda418c600 0x7efda4214370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda8a00640 1 -- 172.21.15.69:0/3660483360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efda418c600 msgr2=0x7efda4214370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda8a00640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efda418c600 0x7efda4214370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda8a00640 1 -- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efda40cf1f0 msgr2=0x7efda4172440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda8a00640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efda40cf1f0 0x7efda4172440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda8a00640 1 -- 172.21.15.69:0/3660483360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98009400 con 0x7efda4185da0 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.738+0000 7efda9400640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efda40cf1f0 0x7efda4172440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.739+0000 7efda8a00640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 0x7efda4172980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efd9000c410 tx=0x7efd9000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.739+0000 7efda1600640 1 -- 172.21.15.69:0/3660483360 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90005ce0 con 0x7efda4185da0 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.739+0000 7efda1600640 1 -- 172.21.15.69:0/3660483360 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd90005e40 con 0x7efda4185da0 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.739+0000 7efda1600640 1 -- 172.21.15.69:0/3660483360 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd900072f0 con 0x7efda4185da0 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.739+0000 7efdabe00640 1 -- 172.21.15.69:0/3660483360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda4215730 con 0x7efda4185da0 2024-02-21T07:41:55.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.739+0000 7efdabe00640 1 -- 172.21.15.69:0/3660483360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda4212b80 con 0x7efda4185da0 2024-02-21T07:41:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.740+0000 7efdabe00640 1 -- 172.21.15.69:0/3660483360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda4069d50 con 0x7efda4185da0 2024-02-21T07:41:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.742+0000 7efda1600640 1 -- 172.21.15.69:0/3660483360 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) v1 ==== 134312+0+0 (secure 0 0 0) 0x7efd90007510 con 0x7efda4185da0 2024-02-21T07:41:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.743+0000 7efda1600640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efd8409f010 0x7efd840a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.743+0000 7efda1600640 1 -- 172.21.15.69:0/3660483360 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 6311+0+0 (secure 0 0 0) 0x7efd900c8780 con 0x7efda4185da0 2024-02-21T07:41:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.743+0000 7efda9400640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efd8409f010 0x7efd840a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.744+0000 7efda9400640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efd8409f010 0x7efd840a14d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efd98035000 tx=0x7efd98030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:55.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.747+0000 7efda1600640 1 -- 172.21.15.69:0/3660483360 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efd90092f20 con 0x7efda4185da0 2024-02-21T07:41:55.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.946+0000 7efdabe00640 1 -- 172.21.15.69:0/3660483360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efda40fd050 con 0x7efda4185da0 2024-02-21T07:41:55.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.948+0000 7efda1600640 1 -- 172.21.15.69:0/3660483360 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+16014 (secure 0 0 0) 0x7efd900965e0 con 0x7efda4185da0 2024-02-21T07:41:55.954 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:41:55.955 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":18,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:41:55.852067+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 -- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efd8409f010 msgr2=0x7efd840a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efd8409f010 0x7efd840a14d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efd98035000 tx=0x7efd98030000 comp rx=0 tx=0).stop 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 -- 172.21.15.69:0/3660483360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 msgr2=0x7efda4172980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 0x7efda4172980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efd9000c410 tx=0x7efd9000c8d0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 -- 172.21.15.69:0/3660483360 shutdown_connections 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efd8409f010 0x7efd840a14d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efda418c600 0x7efda4214370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efda4185da0 0x7efda4172980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 --2- 172.21.15.69:0/3660483360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efda40cf1f0 0x7efda4172440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 -- 172.21.15.69:0/3660483360 >> 172.21.15.69:0/3660483360 conn(0x7efda4071b80 msgr2=0x7efda40d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:55.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 -- 172.21.15.69:0/3660483360 shutdown_connections 2024-02-21T07:41:55.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:55.951+0000 7efdabe00640 1 -- 172.21.15.69:0/3660483360 wait complete. 2024-02-21T07:41:55.974 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-02-21T07:41:55.974 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:41:56.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.168+0000 7f0be9c00640 1 Processor -- start 2024-02-21T07:41:56.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.168+0000 7f0be9c00640 1 -- start start 2024-02-21T07:41:56.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.170+0000 7f0be9c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0be40f4e60 0x7f0be40f8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:56.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.170+0000 7f0be9c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0be4185b00 0x7f0be4182dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:56.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.170+0000 7f0be9c00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be40f5350 con 0x7f0be40f7e40 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.170+0000 7f0be9c00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be4189460 con 0x7f0be4185b00 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.170+0000 7f0be9c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be40f5630 con 0x7f0be40f4e60 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.170+0000 7f0be2a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f0be40f7e40 0x7f0be40f8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46470/0 (socket says 172.21.15.69:46470) 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.170+0000 7f0be2a00640 1 -- 172.21.15.69:0/3035809395 learned_addr learned my addr 172.21.15.69:0/3035809395 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.170+0000 7f0bda000640 1 --2- 172.21.15.69:0/3035809395 >> v2:172.21.15.174:3300/0 conn(0x7f0be40f4e60 0x7f0be40f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.170+0000 7f0be3400640 1 --2- 172.21.15.69:0/3035809395 >> v2:172.21.15.69:3300/0 conn(0x7f0be4185b00 0x7f0be4182dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.171+0000 7f0bda000640 1 -- 172.21.15.69:0/3035809395 >> v2:172.21.15.69:3300/0 conn(0x7f0be4185b00 msgr2=0x7f0be4182dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.171+0000 7f0bda000640 1 --2- 172.21.15.69:0/3035809395 >> v2:172.21.15.69:3300/0 conn(0x7f0be4185b00 0x7f0be4182dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.171+0000 7f0bda000640 1 -- 172.21.15.69:0/3035809395 >> v1:172.21.15.69:6789/0 conn(0x7f0be40f7e40 legacy=0x7f0be40f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.171+0000 7f0bda000640 1 -- 172.21.15.69:0/3035809395 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40f5910 con 0x7f0be40f4e60 2024-02-21T07:41:56.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.171+0000 7f0be2000640 1 -- 172.21.15.69:0/3035809395 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286154303 0 0) 0x7f0be40f5350 con 0x7f0be40f7e40 2024-02-21T07:41:56.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.172+0000 7f0bda000640 1 --2- 172.21.15.69:0/3035809395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0be40f4e60 0x7f0be40f8930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0be40eda40 tx=0x7f0bcc02c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a547e0b28ec501d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.172+0000 7f0be2000640 1 -- 172.21.15.69:0/3035809395 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc030800 con 0x7f0be40f4e60 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.172+0000 7f0be2000640 1 -- 172.21.15.69:0/3035809395 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc030960 con 0x7f0be40f4e60 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.172+0000 7f0be2000640 1 -- 172.21.15.69:0/3035809395 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc030cf0 con 0x7f0be40f4e60 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.172+0000 7f0be9c00640 1 -- 172.21.15.69:0/3035809395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0be40f4e60 msgr2=0x7f0be40f8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.172+0000 7f0be9c00640 1 --2- 172.21.15.69:0/3035809395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0be40f4e60 0x7f0be40f8930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0be40eda40 tx=0x7f0bcc02c9e0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.173+0000 7f0be9c00640 1 -- 172.21.15.69:0/3035809395 shutdown_connections 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.173+0000 7f0be9c00640 1 --2- 172.21.15.69:0/3035809395 >> v2:172.21.15.69:3300/0 conn(0x7f0be4185b00 0x7f0be4182dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.173+0000 7f0be9c00640 1 --2- 172.21.15.69:0/3035809395 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0be40f4e60 0x7f0be40f8930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.173+0000 7f0be9c00640 1 -- 172.21.15.69:0/3035809395 >> 172.21.15.69:0/3035809395 conn(0x7f0be40f69c0 msgr2=0x7f0be40f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.173+0000 7f0be9c00640 1 -- 172.21.15.69:0/3035809395 shutdown_connections 2024-02-21T07:41:56.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.173+0000 7f0be9c00640 1 -- 172.21.15.69:0/3035809395 wait complete. 2024-02-21T07:41:56.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.175+0000 7f0be9c00640 1 Processor -- start 2024-02-21T07:41:56.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.175+0000 7f0be9c00640 1 -- start start 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0be9c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0be40f4e60 0x7f0be4168b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0be9c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0be40f7e40 0x7f0be41869c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0be9c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4185b00 0x7f0be4186f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0be9c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be4210740 con 0x7f0be40f7e40 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0be9c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be4210a20 con 0x7f0be40f4e60 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0be9c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be4210d00 con 0x7f0be4185b00 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0bda000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0be40f7e40 0x7f0be41869c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0be2a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0be40f4e60 0x7f0be4168b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0bda000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0be40f7e40 0x7f0be41869c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40626/0 (socket says 172.21.15.69:40626) 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0bda000640 1 -- 172.21.15.69:0/3168892740 learned_addr learned my addr 172.21.15.69:0/3168892740 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:56.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0be3400640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4185b00 0x7f0be4186f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0bda000640 1 -- 172.21.15.69:0/3168892740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4185b00 msgr2=0x7f0be4186f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0bda000640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4185b00 0x7f0be4186f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0bda000640 1 -- 172.21.15.69:0/3168892740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0be40f4e60 msgr2=0x7f0be4168b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0bda000640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0be40f4e60 0x7f0be4168b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0bda000640 1 -- 172.21.15.69:0/3168892740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009400 con 0x7f0be40f7e40 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0be2a00640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0be40f4e60 0x7f0be4168b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.176+0000 7f0be3400640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4185b00 0x7f0be4186f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.177+0000 7f0bda000640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0be40f7e40 0x7f0be41869c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009890 tx=0x7f0bcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.177+0000 7f0bdb400640 1 -- 172.21.15.69:0/3168892740 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc03d070 con 0x7f0be40f7e40 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.177+0000 7f0bdb400640 1 -- 172.21.15.69:0/3168892740 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc0389c0 con 0x7f0be40f7e40 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.177+0000 7f0be9c00640 1 -- 172.21.15.69:0/3168892740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be4210fe0 con 0x7f0be40f7e40 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.177+0000 7f0bdb400640 1 -- 172.21.15.69:0/3168892740 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc038d50 con 0x7f0be40f7e40 2024-02-21T07:41:56.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.177+0000 7f0be9c00640 1 -- 172.21.15.69:0/3168892740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be41864a0 con 0x7f0be40f7e40 2024-02-21T07:41:56.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.178+0000 7f0be9c00640 1 -- 172.21.15.69:0/3168892740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be4186690 con 0x7f0be40f7e40 2024-02-21T07:41:56.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.180+0000 7f0bdb400640 1 -- 172.21.15.69:0/3168892740 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) v1 ==== 134312+0+0 (secure 0 0 0) 0x7f0bcc04a400 con 0x7f0be40f7e40 2024-02-21T07:41:56.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.181+0000 7f0bdb400640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bc009f040 0x7f0bc00a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:56.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.181+0000 7f0bdb400640 1 -- 172.21.15.69:0/3168892740 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f0bcc0eb250 con 0x7f0be40f7e40 2024-02-21T07:41:56.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.181+0000 7f0be2a00640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bc009f040 0x7f0bc00a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:56.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.182+0000 7f0be2a00640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bc009f040 0x7f0bc00a1500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4000f60 tx=0x7f0bd4007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:56.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.185+0000 7f0bdb400640 1 -- 172.21.15.69:0/3168892740 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0bcc0b58b0 con 0x7f0be40f7e40 2024-02-21T07:41:56.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.416+0000 7f0be9c00640 1 -- 172.21.15.69:0/3168892740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0be4069d50 con 0x7f0be40f7e40 2024-02-21T07:41:56.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.417+0000 7f0bdb400640 1 -- 172.21.15.69:0/3168892740 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f0bcc0b77e0 con 0x7f0be40f7e40 2024-02-21T07:41:56.423 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:41:56.423 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4318,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-02-21T07:41:56.423 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 2 2024-02-21T07:41:56.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 -- 172.21.15.69:0/3168892740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bc009f040 msgr2=0x7f0bc00a1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:56.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bc009f040 0x7f0bc00a1500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4000f60 tx=0x7f0bd4007e40 comp rx=0 tx=0).stop 2024-02-21T07:41:56.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 -- 172.21.15.69:0/3168892740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0be40f7e40 msgr2=0x7f0be41869c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:56.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0be40f7e40 0x7f0be41869c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009890 tx=0x7f0bcc0046c0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 -- 172.21.15.69:0/3168892740 shutdown_connections 2024-02-21T07:41:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bc009f040 0x7f0bc00a1500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0be4185b00 0x7f0be4186f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0be40f7e40 0x7f0be41869c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 --2- 172.21.15.69:0/3168892740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0be40f4e60 0x7f0be4168b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 -- 172.21.15.69:0/3168892740 >> 172.21.15.69:0/3168892740 conn(0x7f0be40f69c0 msgr2=0x7f0be40f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.420+0000 7f0be9c00640 1 -- 172.21.15.69:0/3168892740 shutdown_connections 2024-02-21T07:41:56.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:56.421+0000 7f0be9c00640 1 -- 172.21.15.69:0/3168892740 wait complete. 2024-02-21T07:41:58.445 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:41:58.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.662+0000 7fca95400640 1 Processor -- start 2024-02-21T07:41:58.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.662+0000 7fca95400640 1 -- start start 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.664+0000 7fca95400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fca901827d0 0x7fca90182bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.664+0000 7fca95400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fca9018b510 0x7fca9018b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.664+0000 7fca95400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca90189f40 con 0x7fca90160690 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.664+0000 7fca95400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9018b080 con 0x7fca901827d0 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.664+0000 7fca95400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9018a190 con 0x7fca9018b510 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.665+0000 7fca8e800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fca901827d0 0x7fca90182bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.665+0000 7fca8e800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fca901827d0 0x7fca90182bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40634/0 (socket says 172.21.15.69:40634) 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.665+0000 7fca8e800640 1 -- 172.21.15.69:0/1308795073 learned_addr learned my addr 172.21.15.69:0/1308795073 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.665+0000 7fca87e00640 1 --2- 172.21.15.69:0/1308795073 >> v2:172.21.15.184:3300/0 conn(0x7fca9018b510 0x7fca9018b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.665+0000 7fca8e800640 1 -- 172.21.15.69:0/1308795073 >> v2:172.21.15.184:3300/0 conn(0x7fca9018b510 msgr2=0x7fca9018b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.665+0000 7fca8e800640 1 --2- 172.21.15.69:0/1308795073 >> v2:172.21.15.184:3300/0 conn(0x7fca9018b510 0x7fca9018b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:58.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.665+0000 7fca8e800640 1 -- 172.21.15.69:0/1308795073 >> v1:172.21.15.184:6789/0 conn(0x7fca90160690 legacy=0x7fca90160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:58.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.665+0000 7fca8e800640 1 -- 172.21.15.69:0/1308795073 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9018a470 con 0x7fca901827d0 2024-02-21T07:41:58.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.665+0000 7fca8de00640 1 -- 172.21.15.69:0/1308795073 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955537391 0 0) 0x7fca90189f40 con 0x7fca90160690 2024-02-21T07:41:58.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.666+0000 7fca8e800640 1 --2- 172.21.15.69:0/1308795073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca901827d0 0x7fca90182bb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fca900f8890 tx=0x7fca8002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ffa1c18dad8b3b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:58.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.666+0000 7fca8de00640 1 -- 172.21.15.69:0/1308795073 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80031870 con 0x7fca901827d0 2024-02-21T07:41:58.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.666+0000 7fca8de00640 1 -- 172.21.15.69:0/1308795073 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca800319d0 con 0x7fca901827d0 2024-02-21T07:41:58.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.666+0000 7fca8de00640 1 -- 172.21.15.69:0/1308795073 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80031d60 con 0x7fca901827d0 2024-02-21T07:41:58.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.667+0000 7fca95400640 1 -- 172.21.15.69:0/1308795073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca901827d0 msgr2=0x7fca90182bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:58.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.667+0000 7fca95400640 1 --2- 172.21.15.69:0/1308795073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca901827d0 0x7fca90182bb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fca900f8890 tx=0x7fca8002b910 comp rx=0 tx=0).stop 2024-02-21T07:41:58.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.667+0000 7fca95400640 1 -- 172.21.15.69:0/1308795073 shutdown_connections 2024-02-21T07:41:58.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.667+0000 7fca95400640 1 --2- 172.21.15.69:0/1308795073 >> v2:172.21.15.184:3300/0 conn(0x7fca9018b510 0x7fca9018b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.667+0000 7fca95400640 1 --2- 172.21.15.69:0/1308795073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca901827d0 0x7fca90182bb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.667+0000 7fca95400640 1 -- 172.21.15.69:0/1308795073 >> 172.21.15.69:0/1308795073 conn(0x7fca900d28c0 msgr2=0x7fca900d2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.667+0000 7fca95400640 1 -- 172.21.15.69:0/1308795073 shutdown_connections 2024-02-21T07:41:58.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.667+0000 7fca95400640 1 -- 172.21.15.69:0/1308795073 wait complete. 2024-02-21T07:41:58.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.670+0000 7fca95400640 1 Processor -- start 2024-02-21T07:41:58.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.670+0000 7fca95400640 1 -- start start 2024-02-21T07:41:58.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.671+0000 7fca95400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca90160690 0x7fca9021ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:58.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.671+0000 7fca95400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca901827d0 0x7fca9015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.671+0000 7fca95400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca9018b510 0x7fca9021f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.671+0000 7fca95400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9017b930 con 0x7fca901827d0 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.671+0000 7fca95400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9017bdc0 con 0x7fca9018b510 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.671+0000 7fca95400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9017aa40 con 0x7fca90160690 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca8e800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca90160690 0x7fca9021ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca87e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca901827d0 0x7fca9015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca8e800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca90160690 0x7fca9021ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34518/0 (socket says 172.21.15.69:34518) 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca8e800640 1 -- 172.21.15.69:0/395705919 learned_addr learned my addr 172.21.15.69:0/395705919 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca8f200640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca9018b510 0x7fca9021f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca8e800640 1 -- 172.21.15.69:0/395705919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca9018b510 msgr2=0x7fca9021f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca8e800640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca9018b510 0x7fca9021f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca8e800640 1 -- 172.21.15.69:0/395705919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca901827d0 msgr2=0x7fca9015d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca8e800640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca901827d0 0x7fca9015d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:58.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca8e800640 1 -- 172.21.15.69:0/395705919 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800094d0 con 0x7fca90160690 2024-02-21T07:41:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.672+0000 7fca8e800640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca90160690 0x7fca9021ee10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca8002b950 tx=0x7fca800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.673+0000 7fca86a00640 1 -- 172.21.15.69:0/395705919 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8003abe0 con 0x7fca90160690 2024-02-21T07:41:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.673+0000 7fca86a00640 1 -- 172.21.15.69:0/395705919 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8003ad60 con 0x7fca90160690 2024-02-21T07:41:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.673+0000 7fca86a00640 1 -- 172.21.15.69:0/395705919 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80044630 con 0x7fca90160690 2024-02-21T07:41:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.673+0000 7fca95400640 1 -- 172.21.15.69:0/395705919 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9017ad20 con 0x7fca90160690 2024-02-21T07:41:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.673+0000 7fca95400640 1 -- 172.21.15.69:0/395705919 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9017b2e0 con 0x7fca90160690 2024-02-21T07:41:58.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.674+0000 7fca95400640 1 -- 172.21.15.69:0/395705919 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca900ff160 con 0x7fca90160690 2024-02-21T07:41:58.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.675+0000 7fca86a00640 1 -- 172.21.15.69:0/395705919 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 4) v1 ==== 134312+0+0 (secure 0 0 0) 0x7fca8004d450 con 0x7fca90160690 2024-02-21T07:41:58.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.677+0000 7fca86a00640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fca6c09f010 0x7fca6c0a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:58.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.677+0000 7fca86a00640 1 -- 172.21.15.69:0/395705919 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6697+0+0 (secure 0 0 0) 0x7fca8002d040 con 0x7fca90160690 2024-02-21T07:41:58.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.677+0000 7fca87e00640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fca6c09f010 0x7fca6c0a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:58.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.678+0000 7fca87e00640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fca6c09f010 0x7fca6c0a14d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca900fbd60 tx=0x7fca78009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:58.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.681+0000 7fca86a00640 1 -- 172.21.15.69:0/395705919 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fca800b5de0 con 0x7fca90160690 2024-02-21T07:41:58.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.921+0000 7fca95400640 1 -- 172.21.15.69:0/395705919 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca90069d50 con 0x7fca90160690 2024-02-21T07:41:58.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.923+0000 7fca86a00640 1 -- 172.21.15.69:0/395705919 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+10029 (secure 0 0 0) 0x7fca80035090 con 0x7fca90160690 2024-02-21T07:41:58.928 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:41:58.929 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4318,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4334,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4345,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4363,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4375,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4378,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-02-21T07:41:58.929 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 3 2024-02-21T07:41:58.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 -- 172.21.15.69:0/395705919 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fca6c09f010 msgr2=0x7fca6c0a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:58.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fca6c09f010 0x7fca6c0a14d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fca900fbd60 tx=0x7fca78009190 comp rx=0 tx=0).stop 2024-02-21T07:41:58.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 -- 172.21.15.69:0/395705919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca90160690 msgr2=0x7fca9021ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:58.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca90160690 0x7fca9021ee10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fca8002b950 tx=0x7fca800046c0 comp rx=0 tx=0).stop 2024-02-21T07:41:58.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 -- 172.21.15.69:0/395705919 shutdown_connections 2024-02-21T07:41:58.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fca6c09f010 0x7fca6c0a14d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:58.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fca9018b510 0x7fca9021f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:58.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca901827d0 0x7fca9015d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:58.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 --2- 172.21.15.69:0/395705919 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca90160690 0x7fca9021ee10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:58.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 -- 172.21.15.69:0/395705919 >> 172.21.15.69:0/395705919 conn(0x7fca900d28c0 msgr2=0x7fca90180550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:58.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 -- 172.21.15.69:0/395705919 shutdown_connections 2024-02-21T07:41:58.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:58.925+0000 7fca95400640 1 -- 172.21.15.69:0/395705919 wait complete. 2024-02-21T07:41:58.950 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:41:59.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.141+0000 7f1560200640 1 Processor -- start 2024-02-21T07:41:59.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.141+0000 7f1560200640 1 -- start start 2024-02-21T07:41:59.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.143+0000 7f1560200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f15581827d0 0x7f1558182bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.143+0000 7f1560200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f155818b510 0x7f155818b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.143+0000 7f1560200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1558189f40 con 0x7f1558160690 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.143+0000 7f1560200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155818b080 con 0x7f15581827d0 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.143+0000 7f1560200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155818a190 con 0x7f155818b510 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.143+0000 7f155d800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f15581827d0 0x7f1558182bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.143+0000 7f155d800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f15581827d0 0x7f1558182bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51516/0 (socket says 172.21.15.69:51516) 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.144+0000 7f155d800640 1 -- 172.21.15.69:0/1945338014 learned_addr learned my addr 172.21.15.69:0/1945338014 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.143+0000 7f155ce00640 1 --2- 172.21.15.69:0/1945338014 >> v2:172.21.15.184:3300/0 conn(0x7f155818b510 0x7f155818b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.144+0000 7f155d800640 1 -- 172.21.15.69:0/1945338014 >> v2:172.21.15.184:3300/0 conn(0x7f155818b510 msgr2=0x7f155818b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.144+0000 7f155d800640 1 --2- 172.21.15.69:0/1945338014 >> v2:172.21.15.184:3300/0 conn(0x7f155818b510 0x7f155818b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.144+0000 7f155d800640 1 -- 172.21.15.69:0/1945338014 >> v1:172.21.15.174:6789/0 conn(0x7f1558160690 legacy=0x7f1558160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.144+0000 7f1557e00640 1 -- 172.21.15.69:0/1945338014 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865242273 0 0) 0x7f1558189f40 con 0x7f1558160690 2024-02-21T07:41:59.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.144+0000 7f155d800640 1 -- 172.21.15.69:0/1945338014 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155818a470 con 0x7f15581827d0 2024-02-21T07:41:59.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.145+0000 7f155d800640 1 --2- 172.21.15.69:0/1945338014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15581827d0 0x7f1558182bb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f15580f8890 tx=0x7f154c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bca0707aa3ffe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:59.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.145+0000 7f1557e00640 1 -- 172.21.15.69:0/1945338014 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c031870 con 0x7f15581827d0 2024-02-21T07:41:59.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.145+0000 7f1557e00640 1 -- 172.21.15.69:0/1945338014 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c0319d0 con 0x7f15581827d0 2024-02-21T07:41:59.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.145+0000 7f1557e00640 1 -- 172.21.15.69:0/1945338014 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c031d60 con 0x7f15581827d0 2024-02-21T07:41:59.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.146+0000 7f1560200640 1 -- 172.21.15.69:0/1945338014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15581827d0 msgr2=0x7f1558182bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.146+0000 7f1560200640 1 --2- 172.21.15.69:0/1945338014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15581827d0 0x7f1558182bb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f15580f8890 tx=0x7f154c02b910 comp rx=0 tx=0).stop 2024-02-21T07:41:59.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.146+0000 7f1560200640 1 -- 172.21.15.69:0/1945338014 shutdown_connections 2024-02-21T07:41:59.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.146+0000 7f1560200640 1 --2- 172.21.15.69:0/1945338014 >> v2:172.21.15.184:3300/0 conn(0x7f155818b510 0x7f155818b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.146+0000 7f1560200640 1 --2- 172.21.15.69:0/1945338014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15581827d0 0x7f1558182bb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.146+0000 7f1560200640 1 -- 172.21.15.69:0/1945338014 >> 172.21.15.69:0/1945338014 conn(0x7f15580d28c0 msgr2=0x7f15580d2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:59.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.146+0000 7f1560200640 1 -- 172.21.15.69:0/1945338014 shutdown_connections 2024-02-21T07:41:59.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.146+0000 7f1560200640 1 -- 172.21.15.69:0/1945338014 wait complete. 2024-02-21T07:41:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.148+0000 7f1560200640 1 Processor -- start 2024-02-21T07:41:59.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.148+0000 7f1560200640 1 -- start start 2024-02-21T07:41:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.149+0000 7f1560200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1558160690 0x7f15581686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f1560200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15581827d0 0x7f155808ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f1560200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f155818b510 0x7f155815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f1560200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1558168260 con 0x7f155818b510 2024-02-21T07:41:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f1560200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155808f990 con 0x7f15581827d0 2024-02-21T07:41:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f1560200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155808f3d0 con 0x7f1558160690 2024-02-21T07:41:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155e200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f155818b510 0x7f155815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155e200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f155818b510 0x7f155815e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51528/0 (socket says 172.21.15.69:51528) 2024-02-21T07:41:59.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155e200640 1 -- 172.21.15.69:0/720492405 learned_addr learned my addr 172.21.15.69:0/720492405 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:59.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155d800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1558160690 0x7f15581686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155ce00640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15581827d0 0x7f155808ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155e200640 1 -- 172.21.15.69:0/720492405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1558160690 msgr2=0x7f15581686f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155e200640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1558160690 0x7f15581686f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155e200640 1 -- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15581827d0 msgr2=0x7f155808ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155e200640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15581827d0 0x7f155808ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155e200640 1 -- 172.21.15.69:0/720492405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0094d0 con 0x7f155818b510 2024-02-21T07:41:59.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.150+0000 7f155ce00640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15581827d0 0x7f155808ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:41:59.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.151+0000 7f155e200640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f155818b510 0x7f155815e2b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f155000c780 tx=0x7f155000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:59.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.151+0000 7f1555600640 1 -- 172.21.15.69:0/720492405 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550003b70 con 0x7f155818b510 2024-02-21T07:41:59.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.151+0000 7f1555600640 1 -- 172.21.15.69:0/720492405 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1550003cd0 con 0x7f155818b510 2024-02-21T07:41:59.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.151+0000 7f1560200640 1 -- 172.21.15.69:0/720492405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155808f6b0 con 0x7f155818b510 2024-02-21T07:41:59.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.151+0000 7f1555600640 1 -- 172.21.15.69:0/720492405 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550005270 con 0x7f155818b510 2024-02-21T07:41:59.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.151+0000 7f1560200640 1 -- 172.21.15.69:0/720492405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1558167ef0 con 0x7f155818b510 2024-02-21T07:41:59.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.152+0000 7f1560200640 1 -- 172.21.15.69:0/720492405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1558168410 con 0x7f155818b510 2024-02-21T07:41:59.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.154+0000 7f1555600640 1 -- 172.21.15.69:0/720492405 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) v1 ==== 134312+0+0 (secure 0 0 0) 0x7f15500053d0 con 0x7f155818b510 2024-02-21T07:41:59.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.156+0000 7f1555600640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f153809f010 0x7f15380a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.157+0000 7f1555600640 1 -- 172.21.15.69:0/720492405 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6697+0+0 (secure 0 0 0) 0x7f15500c99d0 con 0x7f155818b510 2024-02-21T07:41:59.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.157+0000 7f155d800640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f153809f010 0x7f15380a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.158+0000 7f155d800640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f153809f010 0x7f15380a14d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f154c036000 tx=0x7f154c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:59.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.160+0000 7f1555600640 1 -- 172.21.15.69:0/720492405 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1550093eb0 con 0x7f155818b510 2024-02-21T07:41:59.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.363+0000 7f1560200640 1 -- 172.21.15.69:0/720492405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1558072690 con 0x7f155818b510 2024-02-21T07:41:59.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.366+0000 7f1555600640 1 -- 172.21.15.69:0/720492405 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+17872 (secure 0 0 0) 0x7f1550095de0 con 0x7f155818b510 2024-02-21T07:41:59.372 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:41:59.372 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":21,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:41:58.882961+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 -- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f153809f010 msgr2=0x7f15380a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f153809f010 0x7f15380a14d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f154c036000 tx=0x7f154c03c040 comp rx=0 tx=0).stop 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 -- 172.21.15.69:0/720492405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f155818b510 msgr2=0x7f155815e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f155818b510 0x7f155815e2b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f155000c780 tx=0x7f155000cb80 comp rx=0 tx=0).stop 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 -- 172.21.15.69:0/720492405 shutdown_connections 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f153809f010 0x7f15380a14d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f155818b510 0x7f155815e2b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f15581827d0 0x7f155808ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 --2- 172.21.15.69:0/720492405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1558160690 0x7f15581686f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 -- 172.21.15.69:0/720492405 >> 172.21.15.69:0/720492405 conn(0x7f15580d28c0 msgr2=0x7f1558189490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:59.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 -- 172.21.15.69:0/720492405 shutdown_connections 2024-02-21T07:41:59.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.369+0000 7f1560200640 1 -- 172.21.15.69:0/720492405 wait complete. 2024-02-21T07:41:59.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:41:56.520105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T07:41:59.393 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:41:59.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.593+0000 7f4c54c00640 1 Processor -- start 2024-02-21T07:41:59.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.593+0000 7f4c54c00640 1 -- start start 2024-02-21T07:41:59.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.595+0000 7f4c54c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4c5017f4f0 0x7f4c500d45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.595+0000 7f4c54c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4c500d6020 0x7f4c501888a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.595+0000 7f4c54c00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5018a4a0 con 0x7f4c5017f110 2024-02-21T07:41:59.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.595+0000 7f4c54c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500d4ca0 con 0x7f4c500d6020 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.595+0000 7f4c54c00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500d4f80 con 0x7f4c5017f4f0 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.595+0000 7f4c4fe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4c500d6020 0x7f4c501888a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.595+0000 7f4c4f400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f4c5017f110 0x7f4c50189d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:53726/0 (socket says 172.21.15.69:53726) 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.595+0000 7f4c4f400640 1 -- 172.21.15.69:0/911485987 learned_addr learned my addr 172.21.15.69:0/911485987 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.595+0000 7f4c47e00640 1 --2- 172.21.15.69:0/911485987 >> v2:172.21.15.184:3300/0 conn(0x7f4c5017f4f0 0x7f4c500d45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.596+0000 7f4c4ea00640 1 -- 172.21.15.69:0/911485987 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555131346 0 0) 0x7f4c5018a4a0 con 0x7f4c5017f110 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.596+0000 7f4c4ea00640 1 -- 172.21.15.69:0/911485987 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c30003520 con 0x7f4c5017f110 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.596+0000 7f4c4fe00640 1 -- 172.21.15.69:0/911485987 >> v2:172.21.15.184:3300/0 conn(0x7f4c5017f4f0 msgr2=0x7f4c500d45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.596+0000 7f4c4fe00640 1 --2- 172.21.15.69:0/911485987 >> v2:172.21.15.184:3300/0 conn(0x7f4c5017f4f0 0x7f4c500d45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.596+0000 7f4c4fe00640 1 -- 172.21.15.69:0/911485987 >> v1:172.21.15.174:6789/0 conn(0x7f4c5017f110 legacy=0x7f4c50189d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.596+0000 7f4c4fe00640 1 -- 172.21.15.69:0/911485987 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500d5260 con 0x7f4c500d6020 2024-02-21T07:41:59.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.597+0000 7f4c4fe00640 1 --2- 172.21.15.69:0/911485987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c500d6020 0x7f4c501888a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c500f97a0 tx=0x7f4c4802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61e21e7000f1c906 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:59.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.598+0000 7f4c4ea00640 1 -- 172.21.15.69:0/911485987 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4802cc80 con 0x7f4c500d6020 2024-02-21T07:41:59.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.598+0000 7f4c4ea00640 1 -- 172.21.15.69:0/911485987 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4802cde0 con 0x7f4c500d6020 2024-02-21T07:41:59.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.598+0000 7f4c4ea00640 1 -- 172.21.15.69:0/911485987 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48034640 con 0x7f4c500d6020 2024-02-21T07:41:59.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.598+0000 7f4c54c00640 1 -- 172.21.15.69:0/911485987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c500d6020 msgr2=0x7f4c501888a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.598+0000 7f4c54c00640 1 --2- 172.21.15.69:0/911485987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c500d6020 0x7f4c501888a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4c500f97a0 tx=0x7f4c4802bed0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.598+0000 7f4c54c00640 1 -- 172.21.15.69:0/911485987 shutdown_connections 2024-02-21T07:41:59.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.598+0000 7f4c54c00640 1 --2- 172.21.15.69:0/911485987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c500d6020 0x7f4c501888a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.598+0000 7f4c54c00640 1 --2- 172.21.15.69:0/911485987 >> v2:172.21.15.184:3300/0 conn(0x7f4c5017f4f0 0x7f4c500d45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.598+0000 7f4c54c00640 1 -- 172.21.15.69:0/911485987 >> 172.21.15.69:0/911485987 conn(0x7f4c500d2c10 msgr2=0x7f4c500d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:59.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.599+0000 7f4c54c00640 1 -- 172.21.15.69:0/911485987 shutdown_connections 2024-02-21T07:41:59.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.599+0000 7f4c54c00640 1 -- 172.21.15.69:0/911485987 wait complete. 2024-02-21T07:41:59.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.601+0000 7f4c54c00640 1 Processor -- start 2024-02-21T07:41:59.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.601+0000 7f4c54c00640 1 -- start start 2024-02-21T07:41:59.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c54c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c500d6020 0x7f4c50171d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c54c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c5017f110 0x7f4c50220de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c54c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c5017f4f0 0x7f4c50221320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c54c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5021c4c0 con 0x7f4c500d6020 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c54c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50220950 con 0x7f4c5017f4f0 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c54c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50221860 con 0x7f4c5017f110 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c4f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c500d6020 0x7f4c50171d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c4f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c500d6020 0x7f4c50171d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51544/0 (socket says 172.21.15.69:51544) 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c47e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c5017f110 0x7f4c50220de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c4f400640 1 -- 172.21.15.69:0/1227790117 learned_addr learned my addr 172.21.15.69:0/1227790117 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.602+0000 7f4c4fe00640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c5017f4f0 0x7f4c50221320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.603+0000 7f4c47e00640 1 -- 172.21.15.69:0/1227790117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c5017f4f0 msgr2=0x7f4c50221320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.603+0000 7f4c47e00640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c5017f4f0 0x7f4c50221320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.603+0000 7f4c47e00640 1 -- 172.21.15.69:0/1227790117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c500d6020 msgr2=0x7f4c50171d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.603+0000 7f4c47e00640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c500d6020 0x7f4c50171d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.603+0000 7f4c47e00640 1 -- 172.21.15.69:0/1227790117 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48009a70 con 0x7f4c5017f110 2024-02-21T07:41:59.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.603+0000 7f4c47e00640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c5017f110 0x7f4c50220de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800e870 tx=0x7f4c3800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:59.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.603+0000 7f4c47400640 1 -- 172.21.15.69:0/1227790117 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800ee60 con 0x7f4c5017f110 2024-02-21T07:41:59.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.603+0000 7f4c54c00640 1 -- 172.21.15.69:0/1227790117 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5021fa60 con 0x7f4c5017f110 2024-02-21T07:41:59.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.603+0000 7f4c47400640 1 -- 172.21.15.69:0/1227790117 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3800c940 con 0x7f4c5017f110 2024-02-21T07:41:59.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.603+0000 7f4c47400640 1 -- 172.21.15.69:0/1227790117 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800ccd0 con 0x7f4c5017f110 2024-02-21T07:41:59.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.604+0000 7f4c54c00640 1 -- 172.21.15.69:0/1227790117 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c50220020 con 0x7f4c5017f110 2024-02-21T07:41:59.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.605+0000 7f4c54c00640 1 -- 172.21.15.69:0/1227790117 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c50220b00 con 0x7f4c5017f110 2024-02-21T07:41:59.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.608+0000 7f4c47400640 1 -- 172.21.15.69:0/1227790117 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4c38013470 con 0x7f4c5017f110 2024-02-21T07:41:59.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.609+0000 7f4c47400640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4c2c09f0a0 0x7f4c2c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:41:59.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.609+0000 7f4c47400640 1 -- 172.21.15.69:0/1227790117 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6697+0+0 (secure 0 0 0) 0x7f4c380c92c0 con 0x7f4c5017f110 2024-02-21T07:41:59.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.610+0000 7f4c4f400640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4c2c09f0a0 0x7f4c2c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:41:59.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.610+0000 7f4c4f400640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4c2c09f0a0 0x7f4c2c0a1560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4c40005880 tx=0x7f4c40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:41:59.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.613+0000 7f4c47400640 1 -- 172.21.15.69:0/1227790117 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4c50220b00 con 0x7f4c5017f110 2024-02-21T07:41:59.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.810+0000 7f4c54c00640 1 -- 172.21.15.69:0/1227790117 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c50220ac0 con 0x7f4c5017f110 2024-02-21T07:41:59.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.811+0000 7f4c47400640 1 -- 172.21.15.69:0/1227790117 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c380973d0 con 0x7f4c5017f110 2024-02-21T07:41:59.817 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 -- 172.21.15.69:0/1227790117 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4c2c09f0a0 msgr2=0x7f4c2c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4c2c09f0a0 0x7f4c2c0a1560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4c40005880 tx=0x7f4c40009040 comp rx=0 tx=0).stop 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 -- 172.21.15.69:0/1227790117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c5017f110 msgr2=0x7f4c50220de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c5017f110 0x7f4c50220de0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800e870 tx=0x7f4c3800ed30 comp rx=0 tx=0).stop 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 -- 172.21.15.69:0/1227790117 shutdown_connections 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4c2c09f0a0 0x7f4c2c0a1560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4c5017f4f0 0x7f4c50221320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c5017f110 0x7f4c50220de0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 --2- 172.21.15.69:0/1227790117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c500d6020 0x7f4c50171d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 -- 172.21.15.69:0/1227790117 >> 172.21.15.69:0/1227790117 conn(0x7f4c500d2c10 msgr2=0x7f4c500d6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:41:59.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 -- 172.21.15.69:0/1227790117 shutdown_connections 2024-02-21T07:41:59.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:41:59.814+0000 7f4c54c00640 1 -- 172.21.15.69:0/1227790117 wait complete. 2024-02-21T07:41:59.839 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-21T07:42:00.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.032+0000 7fb1c4c00640 1 Processor -- start 2024-02-21T07:42:00.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.032+0000 7fb1c4c00640 1 -- start start 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.033+0000 7fb1c4c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1c017f670 0x7fb1c006dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.033+0000 7fb1c4c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1c006e3e0 0x7fb1c0184580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.033+0000 7fb1c4c00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c017fa50 con 0x7fb1c0184ac0 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.033+0000 7fb1c4c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c0186580 con 0x7fb1c017f670 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.033+0000 7fb1c4c00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c00f8e90 con 0x7fb1c006e3e0 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.034+0000 7fb1b5400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1c006e3e0 0x7fb1c0184580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.034+0000 7fb1b5400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1c006e3e0 0x7fb1c0184580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40060/0 (socket says 172.21.15.69:40060) 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.034+0000 7fb1b5400640 1 -- 172.21.15.69:0/1992763034 learned_addr learned my addr 172.21.15.69:0/1992763034 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.034+0000 7fb1bde00640 1 --2- 172.21.15.69:0/1992763034 >> v2:172.21.15.174:3300/0 conn(0x7fb1c017f670 0x7fb1c006dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.034+0000 7fb1b5400640 1 -- 172.21.15.69:0/1992763034 >> v2:172.21.15.174:3300/0 conn(0x7fb1c017f670 msgr2=0x7fb1c006dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:00.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.034+0000 7fb1b5400640 1 --2- 172.21.15.69:0/1992763034 >> v2:172.21.15.174:3300/0 conn(0x7fb1c017f670 0x7fb1c006dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.034+0000 7fb1b5400640 1 -- 172.21.15.69:0/1992763034 >> v1:172.21.15.69:6789/0 conn(0x7fb1c0184ac0 legacy=0x7fb1c00f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:00.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.034+0000 7fb1b5400640 1 -- 172.21.15.69:0/1992763034 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c01834e0 con 0x7fb1c006e3e0 2024-02-21T07:42:00.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.035+0000 7fb1b5400640 1 --2- 172.21.15.69:0/1992763034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c006e3e0 0x7fb1c0184580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00f5cf0 tx=0x7fb1a802b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e8e0dcbc6212b07 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:00.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1bd400640 1 -- 172.21.15.69:0/1992763034 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8031750 con 0x7fb1c006e3e0 2024-02-21T07:42:00.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1bd400640 1 -- 172.21.15.69:0/1992763034 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a80318b0 con 0x7fb1c006e3e0 2024-02-21T07:42:00.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1bd400640 1 -- 172.21.15.69:0/1992763034 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8031c40 con 0x7fb1c006e3e0 2024-02-21T07:42:00.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1c4c00640 1 -- 172.21.15.69:0/1992763034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c006e3e0 msgr2=0x7fb1c0184580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1c4c00640 1 --2- 172.21.15.69:0/1992763034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c006e3e0 0x7fb1c0184580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00f5cf0 tx=0x7fb1a802b7f0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1c4c00640 1 -- 172.21.15.69:0/1992763034 shutdown_connections 2024-02-21T07:42:00.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1c4c00640 1 --2- 172.21.15.69:0/1992763034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c006e3e0 0x7fb1c0184580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1c4c00640 1 --2- 172.21.15.69:0/1992763034 >> v2:172.21.15.174:3300/0 conn(0x7fb1c017f670 0x7fb1c006dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1c4c00640 1 -- 172.21.15.69:0/1992763034 >> 172.21.15.69:0/1992763034 conn(0x7fb1c00ce380 msgr2=0x7fb1c00ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:00.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1c4c00640 1 -- 172.21.15.69:0/1992763034 shutdown_connections 2024-02-21T07:42:00.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.036+0000 7fb1c4c00640 1 -- 172.21.15.69:0/1992763034 wait complete. 2024-02-21T07:42:00.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.038+0000 7fb1c4c00640 1 Processor -- start 2024-02-21T07:42:00.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.038+0000 7fb1c4c00640 1 -- start start 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1c4c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1c006e3e0 0x7fb1c0155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1c4c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1c017f670 0x7fb1c015e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1c4c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c0184ac0 0x7fb1c00f7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1c4c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00f86a0 con 0x7fb1c006e3e0 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1c4c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c015d8a0 con 0x7fb1c017f670 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1c4c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c015db80 con 0x7fb1c0184ac0 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1b5400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1c017f670 0x7fb1c015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1bde00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1c006e3e0 0x7fb1c0155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1b5400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1c017f670 0x7fb1c015e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:32818/0 (socket says 172.21.15.69:32818) 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1b5400640 1 -- 172.21.15.69:0/3834219198 learned_addr learned my addr 172.21.15.69:0/3834219198 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:00.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1be800640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c0184ac0 0x7fb1c00f7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1b5400640 1 -- 172.21.15.69:0/3834219198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c0184ac0 msgr2=0x7fb1c00f7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1b5400640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c0184ac0 0x7fb1c00f7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1b5400640 1 -- 172.21.15.69:0/3834219198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1c006e3e0 msgr2=0x7fb1c0155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1b5400640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1c006e3e0 0x7fb1c0155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.040+0000 7fb1b5400640 1 -- 172.21.15.69:0/3834219198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a80094d0 con 0x7fb1c017f670 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.041+0000 7fb1b5400640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1c017f670 0x7fb1c015e660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8000c00 tx=0x7fb1a80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.041+0000 7fb1b6a00640 1 -- 172.21.15.69:0/3834219198 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8033950 con 0x7fb1c017f670 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.041+0000 7fb1b6a00640 1 -- 172.21.15.69:0/3834219198 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a8033ab0 con 0x7fb1c017f670 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.041+0000 7fb1b6a00640 1 -- 172.21.15.69:0/3834219198 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8033e40 con 0x7fb1c017f670 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.041+0000 7fb1c4c00640 1 -- 172.21.15.69:0/3834219198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c015de60 con 0x7fb1c017f670 2024-02-21T07:42:00.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.041+0000 7fb1c4c00640 1 -- 172.21.15.69:0/3834219198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c0156110 con 0x7fb1c017f670 2024-02-21T07:42:00.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.042+0000 7fb1c4c00640 1 -- 172.21.15.69:0/3834219198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c021f460 con 0x7fb1c017f670 2024-02-21T07:42:00.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.044+0000 7fb1b6a00640 1 -- 172.21.15.69:0/3834219198 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb1a803a040 con 0x7fb1c017f670 2024-02-21T07:42:00.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.045+0000 7fb1b6a00640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb19c09f0a0 0x7fb19c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.045+0000 7fb1b6a00640 1 -- 172.21.15.69:0/3834219198 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6697+0+0 (secure 0 0 0) 0x7fb1a80eaf30 con 0x7fb1c017f670 2024-02-21T07:42:00.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.045+0000 7fb1bde00640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb19c09f0a0 0x7fb19c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.046+0000 7fb1bde00640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb19c09f0a0 0x7fb19c0a1560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb1c01729f0 tx=0x7fb1b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:00.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.049+0000 7fb1b6a00640 1 -- 172.21.15.69:0/3834219198 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb1a80b5450 con 0x7fb1c017f670 2024-02-21T07:42:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.251+0000 7fb1c4c00640 1 -- 172.21.15.69:0/3834219198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb1c015e380 con 0x7fb1c017f670 2024-02-21T07:42:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.252+0000 7fb1b6a00640 1 -- 172.21.15.69:0/3834219198 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb1c015e380 con 0x7fb1c017f670 2024-02-21T07:42:00.258 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:00.258 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2024-02-21T07:42:00.258 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:42:00.258 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 1, 2024-02-21T07:42:00.258 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": ".mgr" 2024-02-21T07:42:00.258 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:42:00.258 INFO:teuthology.orchestra.run.smithi069.stdout:] 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 -- 172.21.15.69:0/3834219198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb19c09f0a0 msgr2=0x7fb19c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb19c09f0a0 0x7fb19c0a1560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb1c01729f0 tx=0x7fb1b0008040 comp rx=0 tx=0).stop 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 -- 172.21.15.69:0/3834219198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1c017f670 msgr2=0x7fb1c015e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1c017f670 0x7fb1c015e660 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8000c00 tx=0x7fb1a80046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 -- 172.21.15.69:0/3834219198 shutdown_connections 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb19c09f0a0 0x7fb19c0a1560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1c0184ac0 0x7fb1c00f7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1c017f670 0x7fb1c015e660 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 --2- 172.21.15.69:0/3834219198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1c006e3e0 0x7fb1c0155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 -- 172.21.15.69:0/3834219198 >> 172.21.15.69:0/3834219198 conn(0x7fb1c00ce380 msgr2=0x7fb1c017ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 -- 172.21.15.69:0/3834219198 shutdown_connections 2024-02-21T07:42:00.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.255+0000 7fb1c4c00640 1 -- 172.21.15.69:0/3834219198 wait complete. 2024-02-21T07:42:00.280 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-21T07:42:00.280 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-21T07:42:00.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.491+0000 7fa87d400640 1 Processor -- start 2024-02-21T07:42:00.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.491+0000 7fa87d400640 1 -- start start 2024-02-21T07:42:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.493+0000 7fa87d400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa878183f80 0x7fa87806d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.493+0000 7fa87d400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8780f6710 con 0x7fa8780f48c0 2024-02-21T07:42:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.493+0000 7fa87d400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8780f5b90 con 0x7fa878188300 2024-02-21T07:42:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.493+0000 7fa87d400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8780f5e70 con 0x7fa878183f80 2024-02-21T07:42:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.493+0000 7fa876800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa878183f80 0x7fa87806d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.493+0000 7fa877200640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa8780f48c0 0x7fa8780f4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:53730/0 (socket says 172.21.15.69:53730) 2024-02-21T07:42:00.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.493+0000 7fa877200640 1 -- 172.21.15.69:0/1919690975 learned_addr learned my addr 172.21.15.69:0/1919690975 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.494+0000 7fa876800640 1 -- 172.21.15.69:0/1919690975 >> v1:172.21.15.184:6789/0 conn(0x7fa878188300 legacy=0x7fa878188760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.494+0000 7fa875e00640 1 -- 172.21.15.69:0/1919690975 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646925004 0 0) 0x7fa8780f6710 con 0x7fa8780f48c0 2024-02-21T07:42:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.494+0000 7fa876800640 1 -- 172.21.15.69:0/1919690975 >> v1:172.21.15.174:6789/0 conn(0x7fa8780f48c0 legacy=0x7fa8780f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.494+0000 7fa876800640 1 -- 172.21.15.69:0/1919690975 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780f6150 con 0x7fa878183f80 2024-02-21T07:42:00.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.495+0000 7fa876800640 1 --2- 172.21.15.69:0/1919690975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 0x7fa87806d6c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa868009720 tx=0x7fa86802b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36d2008d4efd4cef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.495+0000 7fa875e00640 1 -- 172.21.15.69:0/1919690975 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86802bea0 con 0x7fa878183f80 2024-02-21T07:42:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.495+0000 7fa875e00640 1 -- 172.21.15.69:0/1919690975 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86802e050 con 0x7fa878183f80 2024-02-21T07:42:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.495+0000 7fa875e00640 1 -- 172.21.15.69:0/1919690975 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868030930 con 0x7fa878183f80 2024-02-21T07:42:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.495+0000 7fa87d400640 1 -- 172.21.15.69:0/1919690975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 msgr2=0x7fa87806d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.495+0000 7fa87d400640 1 --2- 172.21.15.69:0/1919690975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 0x7fa87806d6c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa868009720 tx=0x7fa86802b620 comp rx=0 tx=0).stop 2024-02-21T07:42:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.496+0000 7fa87d400640 1 -- 172.21.15.69:0/1919690975 shutdown_connections 2024-02-21T07:42:00.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.496+0000 7fa87d400640 1 --2- 172.21.15.69:0/1919690975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 0x7fa87806d6c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.496+0000 7fa87d400640 1 -- 172.21.15.69:0/1919690975 >> 172.21.15.69:0/1919690975 conn(0x7fa8780f6ba0 msgr2=0x7fa8780f6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:00.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.496+0000 7fa87d400640 1 -- 172.21.15.69:0/1919690975 shutdown_connections 2024-02-21T07:42:00.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.496+0000 7fa87d400640 1 -- 172.21.15.69:0/1919690975 wait complete. 2024-02-21T07:42:00.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.498+0000 7fa87d400640 1 Processor -- start 2024-02-21T07:42:00.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.498+0000 7fa87d400640 1 -- start start 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.499+0000 7fa87d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8780f48c0 0x7fa87821fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.499+0000 7fa87d400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 0x7fa8782216b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.499+0000 7fa87d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878188300 0x7fa87821c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.499+0000 7fa87d400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa878220330 con 0x7fa878188300 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.499+0000 7fa87d400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa878220610 con 0x7fa878183f80 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.499+0000 7fa87d400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8782208f0 con 0x7fa8780f48c0 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.499+0000 7fa86de00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 0x7fa8782216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.499+0000 7fa876800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8780f48c0 0x7fa87821fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.499+0000 7fa877200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878188300 0x7fa87821c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa86de00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 0x7fa8782216b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:32838/0 (socket says 172.21.15.69:32838) 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa86de00640 1 -- 172.21.15.69:0/2379736661 learned_addr learned my addr 172.21.15.69:0/2379736661 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:00.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa876800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8780f48c0 0x7fa87821fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40086/0 (socket says 172.21.15.69:40086) 2024-02-21T07:42:00.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa876800640 1 -- 172.21.15.69:0/2379736661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 msgr2=0x7fa8782216b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa876800640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 0x7fa8782216b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa876800640 1 -- 172.21.15.69:0/2379736661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878188300 msgr2=0x7fa87821c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa876800640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878188300 0x7fa87821c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa876800640 1 -- 172.21.15.69:0/2379736661 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa868009400 con 0x7fa8780f48c0 2024-02-21T07:42:00.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa86de00640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 0x7fa8782216b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:00.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa876800640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8780f48c0 0x7fa87821fcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa868032000 tx=0x7fa8680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:00.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.500+0000 7fa86f400640 1 -- 172.21.15.69:0/2379736661 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86803c880 con 0x7fa8780f48c0 2024-02-21T07:42:00.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.501+0000 7fa86f400640 1 -- 172.21.15.69:0/2379736661 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86803c9e0 con 0x7fa8780f48c0 2024-02-21T07:42:00.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.501+0000 7fa86f400640 1 -- 172.21.15.69:0/2379736661 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86803cd90 con 0x7fa8780f48c0 2024-02-21T07:42:00.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.501+0000 7fa87d400640 1 -- 172.21.15.69:0/2379736661 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa878220bd0 con 0x7fa8780f48c0 2024-02-21T07:42:00.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.501+0000 7fa87d400640 1 -- 172.21.15.69:0/2379736661 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa878221190 con 0x7fa8780f48c0 2024-02-21T07:42:00.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.502+0000 7fa87d400640 1 -- 172.21.15.69:0/2379736661 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa878069d50 con 0x7fa8780f48c0 2024-02-21T07:42:00.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.504+0000 7fa86f400640 1 -- 172.21.15.69:0/2379736661 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa868039040 con 0x7fa8780f48c0 2024-02-21T07:42:00.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.505+0000 7fa86f400640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa85409f0a0 0x7fa8540a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:00.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.505+0000 7fa86f400640 1 -- 172.21.15.69:0/2379736661 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6697+0+0 (secure 0 0 0) 0x7fa8680eaf10 con 0x7fa8780f48c0 2024-02-21T07:42:00.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.505+0000 7fa86de00640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa85409f0a0 0x7fa8540a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:00.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.506+0000 7fa86de00640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa85409f0a0 0x7fa8540a1560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa8780d1880 tx=0x7fa860009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:00.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.510+0000 7fa86f400640 1 -- 172.21.15.69:0/2379736661 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa8680b54f0 con 0x7fa8780f48c0 2024-02-21T07:42:00.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.705+0000 7fa87d400640 1 -- 172.21.15.69:0/2379736661 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa8780f5770 con 0x7fa8780f48c0 2024-02-21T07:42:00.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.911+0000 7fa86f400640 1 -- 172.21.15.69:0/2379736661 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa8680370b0 con 0x7fa8780f48c0 2024-02-21T07:42:00.917 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' created 2024-02-21T07:42:00.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 -- 172.21.15.69:0/2379736661 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa85409f0a0 msgr2=0x7fa8540a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa85409f0a0 0x7fa8540a1560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa8780d1880 tx=0x7fa860009040 comp rx=0 tx=0).stop 2024-02-21T07:42:00.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 -- 172.21.15.69:0/2379736661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8780f48c0 msgr2=0x7fa87821fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:00.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8780f48c0 0x7fa87821fcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa868032000 tx=0x7fa8680046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 -- 172.21.15.69:0/2379736661 shutdown_connections 2024-02-21T07:42:00.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa85409f0a0 0x7fa8540a1560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa878188300 0x7fa87821c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa878183f80 0x7fa8782216b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 --2- 172.21.15.69:0/2379736661 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa8780f48c0 0x7fa87821fcd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:00.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 -- 172.21.15.69:0/2379736661 >> 172.21.15.69:0/2379736661 conn(0x7fa8780f6ba0 msgr2=0x7fa878188760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:00.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 -- 172.21.15.69:0/2379736661 shutdown_connections 2024-02-21T07:42:00.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:00.916+0000 7fa87d400640 1 -- 172.21.15.69:0/2379736661 wait complete. 2024-02-21T07:42:00.945 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-02-21T07:42:01.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.142+0000 7f10f4000640 1 Processor -- start 2024-02-21T07:42:01.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.142+0000 7f10f4000640 1 -- start start 2024-02-21T07:42:01.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.144+0000 7f10f4000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f10ec186210 0x7f10ec186a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:01.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.144+0000 7f10f4000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f10ec0fa060 0x7f10ec06d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:01.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.144+0000 7f10f4000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec186f40 con 0x7f10ec06d9a0 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.144+0000 7f10f4000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec189aa0 con 0x7f10ec0fa060 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.144+0000 7f10f4000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec071280 con 0x7f10ec186210 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.144+0000 7f10f0c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f10ec0fa060 0x7f10ec06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.144+0000 7f10f0c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f10ec0fa060 0x7f10ec06d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51570/0 (socket says 172.21.15.69:51570) 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.144+0000 7f10f0c00640 1 -- 172.21.15.69:0/3779979236 learned_addr learned my addr 172.21.15.69:0/3779979236 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.144+0000 7f10f1600640 1 --2- 172.21.15.69:0/3779979236 >> v2:172.21.15.174:3300/0 conn(0x7f10ec186210 0x7f10ec186a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.144+0000 7f10f2000640 1 --1- 172.21.15.69:0/3779979236 >> v1:172.21.15.184:6789/0 conn(0x7f10ec06d9a0 0x7f10ec06ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:33140/0 (socket says 172.21.15.69:33140) 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.145+0000 7f10f1600640 1 -- 172.21.15.69:0/3779979236 >> v2:172.21.15.69:3300/0 conn(0x7f10ec0fa060 msgr2=0x7f10ec06d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.145+0000 7f10f1600640 1 --2- 172.21.15.69:0/3779979236 >> v2:172.21.15.69:3300/0 conn(0x7f10ec0fa060 0x7f10ec06d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.145+0000 7f10ebe00640 1 -- 172.21.15.69:0/3779979236 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730310893 0 0) 0x7f10ec186f40 con 0x7f10ec06d9a0 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.145+0000 7f10f1600640 1 -- 172.21.15.69:0/3779979236 >> v1:172.21.15.184:6789/0 conn(0x7f10ec06d9a0 legacy=0x7f10ec06ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.145+0000 7f10f1600640 1 -- 172.21.15.69:0/3779979236 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec0f9050 con 0x7f10ec186210 2024-02-21T07:42:01.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.145+0000 7f10f0c00640 1 --2- 172.21.15.69:0/3779979236 >> v2:172.21.15.69:3300/0 conn(0x7f10ec0fa060 0x7f10ec06d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.146+0000 7f10f1600640 1 --2- 172.21.15.69:0/3779979236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10ec186210 0x7f10ec186a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10ec067140 tx=0x7f10dc02bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff51703a7a11c2f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.146+0000 7f10ebe00640 1 -- 172.21.15.69:0/3779979236 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc02cb50 con 0x7f10ec186210 2024-02-21T07:42:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.146+0000 7f10ebe00640 1 -- 172.21.15.69:0/3779979236 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc02ccb0 con 0x7f10ec186210 2024-02-21T07:42:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.146+0000 7f10ebe00640 1 -- 172.21.15.69:0/3779979236 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc034660 con 0x7f10ec186210 2024-02-21T07:42:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.147+0000 7f10f4000640 1 -- 172.21.15.69:0/3779979236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10ec186210 msgr2=0x7f10ec186a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.147+0000 7f10f4000640 1 --2- 172.21.15.69:0/3779979236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10ec186210 0x7f10ec186a00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f10ec067140 tx=0x7f10dc02bda0 comp rx=0 tx=0).stop 2024-02-21T07:42:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.147+0000 7f10f4000640 1 -- 172.21.15.69:0/3779979236 shutdown_connections 2024-02-21T07:42:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.147+0000 7f10f4000640 1 --2- 172.21.15.69:0/3779979236 >> v2:172.21.15.69:3300/0 conn(0x7f10ec0fa060 0x7f10ec06d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.147+0000 7f10f4000640 1 --2- 172.21.15.69:0/3779979236 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10ec186210 0x7f10ec186a00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.147+0000 7f10f4000640 1 -- 172.21.15.69:0/3779979236 >> 172.21.15.69:0/3779979236 conn(0x7f10ec0f7250 msgr2=0x7f10ec0f7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.147+0000 7f10f4000640 1 -- 172.21.15.69:0/3779979236 shutdown_connections 2024-02-21T07:42:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.147+0000 7f10f4000640 1 -- 172.21.15.69:0/3779979236 wait complete. 2024-02-21T07:42:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.149+0000 7f10f4000640 1 Processor -- start 2024-02-21T07:42:01.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.149+0000 7f10f4000640 1 -- start start 2024-02-21T07:42:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.150+0000 7f10f4000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10ec06d9a0 0x7f10ec16ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.150+0000 7f10f4000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10ec0fa060 0x7f10ec2213b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.150+0000 7f10f4000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ec186210 0x7f10ec2218f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.150+0000 7f10f4000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec2200c0 con 0x7f10ec186210 2024-02-21T07:42:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.150+0000 7f10f4000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec220f20 con 0x7f10ec0fa060 2024-02-21T07:42:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.150+0000 7f10f4000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec220310 con 0x7f10ec06d9a0 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f1600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10ec06d9a0 0x7f10ec16ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f2000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ec186210 0x7f10ec2218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f1600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10ec06d9a0 0x7f10ec16ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40092/0 (socket says 172.21.15.69:40092) 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f1600640 1 -- 172.21.15.69:0/3759550745 learned_addr learned my addr 172.21.15.69:0/3759550745 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f0c00640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10ec0fa060 0x7f10ec2213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f1600640 1 -- 172.21.15.69:0/3759550745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10ec0fa060 msgr2=0x7f10ec2213b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f1600640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10ec0fa060 0x7f10ec2213b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f1600640 1 -- 172.21.15.69:0/3759550745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ec186210 msgr2=0x7f10ec2218f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f1600640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ec186210 0x7f10ec2218f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f1600640 1 -- 172.21.15.69:0/3759550745 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d80094d0 con 0x7f10ec06d9a0 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f2000640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ec186210 0x7f10ec2218f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.151+0000 7f10f1600640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10ec06d9a0 0x7f10ec16ea30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10dc037040 tx=0x7f10dc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.152+0000 7f10e9600640 1 -- 172.21.15.69:0/3759550745 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc040650 con 0x7f10ec06d9a0 2024-02-21T07:42:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.152+0000 7f10e9600640 1 -- 172.21.15.69:0/3759550745 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc0407b0 con 0x7f10ec06d9a0 2024-02-21T07:42:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.152+0000 7f10f4000640 1 -- 172.21.15.69:0/3759550745 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc009a70 con 0x7f10ec06d9a0 2024-02-21T07:42:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.152+0000 7f10e9600640 1 -- 172.21.15.69:0/3759550745 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc040b60 con 0x7f10ec06d9a0 2024-02-21T07:42:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.152+0000 7f10f4000640 1 -- 172.21.15.69:0/3759550745 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec2208d0 con 0x7f10ec06d9a0 2024-02-21T07:42:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.153+0000 7f10f4000640 1 -- 172.21.15.69:0/3759550745 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec069d50 con 0x7f10ec06d9a0 2024-02-21T07:42:01.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.155+0000 7f10e9600640 1 -- 172.21.15.69:0/3759550745 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f10dc040cc0 con 0x7f10ec06d9a0 2024-02-21T07:42:01.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.156+0000 7f10e9600640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f10cc09f0a0 0x7f10cc0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:01.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.156+0000 7f10e9600640 1 -- 172.21.15.69:0/3759550745 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7067+0+0 (secure 0 0 0) 0x7f10dc0ec2b0 con 0x7f10ec06d9a0 2024-02-21T07:42:01.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.156+0000 7f10f0c00640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f10cc09f0a0 0x7f10cc0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:01.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.157+0000 7f10f0c00640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f10cc09f0a0 0x7f10cc0a1560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0d30f0 tx=0x7f10d8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:01.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.160+0000 7f10e9600640 1 -- 172.21.15.69:0/3759550745 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10dc0b6660 con 0x7f10ec06d9a0 2024-02-21T07:42:01.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.357+0000 7f10f4000640 1 -- 172.21.15.69:0/3759550745 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f10ec06df50 con 0x7f10ec06d9a0 2024-02-21T07:42:01.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.918+0000 7f10e9600640 1 -- 172.21.15.69:0/3759550745 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v23) v1 ==== 171+0+0 (secure 0 0 0) 0x7f10dc0b9d20 con 0x7f10ec06d9a0 2024-02-21T07:42:01.924 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' created 2024-02-21T07:42:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.925+0000 7f10f4000640 1 -- 172.21.15.69:0/3759550745 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f10cc09f0a0 msgr2=0x7f10cc0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.925+0000 7f10f4000640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f10cc09f0a0 0x7f10cc0a1560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0d30f0 tx=0x7f10d8009240 comp rx=0 tx=0).stop 2024-02-21T07:42:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.925+0000 7f10f4000640 1 -- 172.21.15.69:0/3759550745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10ec06d9a0 msgr2=0x7f10ec16ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.925+0000 7f10f4000640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10ec06d9a0 0x7f10ec16ea30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10dc037040 tx=0x7f10dc004a40 comp rx=0 tx=0).stop 2024-02-21T07:42:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.927+0000 7f10f4000640 1 -- 172.21.15.69:0/3759550745 shutdown_connections 2024-02-21T07:42:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.927+0000 7f10f4000640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f10cc09f0a0 0x7f10cc0a1560 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.927+0000 7f10f4000640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ec186210 0x7f10ec2218f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.927+0000 7f10f4000640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f10ec0fa060 0x7f10ec2213b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.927+0000 7f10f4000640 1 --2- 172.21.15.69:0/3759550745 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10ec06d9a0 0x7f10ec16ea30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.927+0000 7f10f4000640 1 -- 172.21.15.69:0/3759550745 >> 172.21.15.69:0/3759550745 conn(0x7f10ec0f7250 msgr2=0x7f10ec070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.927+0000 7f10f4000640 1 -- 172.21.15.69:0/3759550745 shutdown_connections 2024-02-21T07:42:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:01.928+0000 7f10f4000640 1 -- 172.21.15.69:0/3759550745 wait complete. 2024-02-21T07:42:01.967 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-21T07:42:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.146+0000 7f1aa5a00640 1 Processor -- start 2024-02-21T07:42:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.146+0000 7f1aa5a00640 1 -- start start 2024-02-21T07:42:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.148+0000 7f1aa5a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1aa017f700 0x7f1aa0183670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.148+0000 7f1aa5a00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa0184c50 con 0x7f1aa0185cc0 2024-02-21T07:42:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.148+0000 7f1aa5a00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa0185560 con 0x7f1aa01850e0 2024-02-21T07:42:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.148+0000 7f1aa5a00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa0183d60 con 0x7f1aa017f700 2024-02-21T07:42:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.148+0000 7f1a9ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1aa017f700 0x7f1aa0183670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.148+0000 7f1a9f400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1aa0185cc0 0x7f1aa0186130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:54272/0 (socket says 172.21.15.69:54272) 2024-02-21T07:42:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.148+0000 7f1a9f400640 1 -- 172.21.15.69:0/3909617526 learned_addr learned my addr 172.21.15.69:0/3909617526 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.149+0000 7f1a9ea00640 1 -- 172.21.15.69:0/3909617526 >> v1:172.21.15.174:6789/0 conn(0x7f1aa01850e0 legacy=0x7f1aa00cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.149+0000 7f1a9ea00640 1 -- 172.21.15.69:0/3909617526 >> v1:172.21.15.69:6789/0 conn(0x7f1aa0185cc0 legacy=0x7f1aa0186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:02.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.149+0000 7f1a9ea00640 1 -- 172.21.15.69:0/3909617526 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa0184040 con 0x7f1aa017f700 2024-02-21T07:42:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.149+0000 7f1a9d600640 1 -- 172.21.15.69:0/3909617526 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014762105 0 0) 0x7f1aa0185560 con 0x7f1aa01850e0 2024-02-21T07:42:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.150+0000 7f1a9ea00640 1 --2- 172.21.15.69:0/3909617526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa017f700 0x7f1aa0183670 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a900097a0 tx=0x7f1a9002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cdabbd825863ed server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.150+0000 7f1a9d600640 1 -- 172.21.15.69:0/3909617526 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9002e070 con 0x7f1aa017f700 2024-02-21T07:42:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.150+0000 7f1a9d600640 1 -- 172.21.15.69:0/3909617526 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a900315a0 con 0x7f1aa017f700 2024-02-21T07:42:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.150+0000 7f1a9d600640 1 -- 172.21.15.69:0/3909617526 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90031930 con 0x7f1aa017f700 2024-02-21T07:42:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.151+0000 7f1aa5a00640 1 -- 172.21.15.69:0/3909617526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa017f700 msgr2=0x7f1aa0183670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.151+0000 7f1aa5a00640 1 --2- 172.21.15.69:0/3909617526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa017f700 0x7f1aa0183670 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a900097a0 tx=0x7f1a9002b840 comp rx=0 tx=0).stop 2024-02-21T07:42:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.151+0000 7f1aa5a00640 1 -- 172.21.15.69:0/3909617526 shutdown_connections 2024-02-21T07:42:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.151+0000 7f1aa5a00640 1 --2- 172.21.15.69:0/3909617526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa017f700 0x7f1aa0183670 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.151+0000 7f1aa5a00640 1 -- 172.21.15.69:0/3909617526 >> 172.21.15.69:0/3909617526 conn(0x7f1aa00ce3d0 msgr2=0x7f1aa00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.151+0000 7f1aa5a00640 1 -- 172.21.15.69:0/3909617526 shutdown_connections 2024-02-21T07:42:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.151+0000 7f1aa5a00640 1 -- 172.21.15.69:0/3909617526 wait complete. 2024-02-21T07:42:02.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.153+0000 7f1aa5a00640 1 Processor -- start 2024-02-21T07:42:02.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.153+0000 7f1aa5a00640 1 -- start start 2024-02-21T07:42:02.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.154+0000 7f1aa5a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1aa017f700 0x7f1aa016ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:02.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.154+0000 7f1aa5a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa01850e0 0x7f1aa021f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:02.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.154+0000 7f1aa5a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0185cc0 0x7f1aa016e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:02.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.154+0000 7f1aa5a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa016f230 con 0x7f1aa01850e0 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.154+0000 7f1aa5a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa016f4c0 con 0x7f1aa0185cc0 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.154+0000 7f1aa5a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa016f7a0 con 0x7f1aa017f700 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa01850e0 0x7f1aa021f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa01850e0 0x7f1aa021f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51602/0 (socket says 172.21.15.69:51602) 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9e000640 1 -- 172.21.15.69:0/794906987 learned_addr learned my addr 172.21.15.69:0/794906987 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9ea00640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1aa017f700 0x7f1aa016ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9f400640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0185cc0 0x7f1aa016e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9e000640 1 -- 172.21.15.69:0/794906987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1aa017f700 msgr2=0x7f1aa016ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9e000640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1aa017f700 0x7f1aa016ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9e000640 1 -- 172.21.15.69:0/794906987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0185cc0 msgr2=0x7f1aa016e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9e000640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0185cc0 0x7f1aa016e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9e000640 1 -- 172.21.15.69:0/794906987 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90009400 con 0x7f1aa01850e0 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.155+0000 7f1a9e000640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa01850e0 0x7f1aa021f520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c410 tx=0x7f1a8c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:02.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.156+0000 7f1a96a00640 1 -- 172.21.15.69:0/794906987 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0035f0 con 0x7f1aa01850e0 2024-02-21T07:42:02.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.156+0000 7f1a96a00640 1 -- 172.21.15.69:0/794906987 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c003770 con 0x7f1aa01850e0 2024-02-21T07:42:02.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.156+0000 7f1aa5a00640 1 -- 172.21.15.69:0/794906987 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa016fa80 con 0x7f1aa01850e0 2024-02-21T07:42:02.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.156+0000 7f1a96a00640 1 -- 172.21.15.69:0/794906987 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c003b20 con 0x7f1aa01850e0 2024-02-21T07:42:02.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.156+0000 7f1aa5a00640 1 -- 172.21.15.69:0/794906987 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa0170040 con 0x7f1aa01850e0 2024-02-21T07:42:02.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.157+0000 7f1aa5a00640 1 -- 172.21.15.69:0/794906987 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa0069d50 con 0x7f1aa01850e0 2024-02-21T07:42:02.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.159+0000 7f1a96a00640 1 -- 172.21.15.69:0/794906987 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f1a8c003c80 con 0x7f1aa01850e0 2024-02-21T07:42:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.160+0000 7f1a96a00640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1a8009f0a0 0x7f1a800a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.160+0000 7f1a96a00640 1 -- 172.21.15.69:0/794906987 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7449+0+0 (secure 0 0 0) 0x7f1a8c0c9150 con 0x7f1aa01850e0 2024-02-21T07:42:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.161+0000 7f1a9ea00640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1a8009f0a0 0x7f1a800a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:02.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.161+0000 7f1a9ea00640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1a8009f0a0 0x7f1a800a1560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1a90036000 tx=0x7f1a9003e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:02.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.163+0000 7f1a96a00640 1 -- 172.21.15.69:0/794906987 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1a8c093310 con 0x7f1aa01850e0 2024-02-21T07:42:02.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.395+0000 7f1aa5a00640 1 -- 172.21.15.69:0/794906987 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1aa00f9440 con 0x7f1aa01850e0 2024-02-21T07:42:02.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.959+0000 7f1a96a00640 1 -- 172.21.15.69:0/794906987 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1a8c017020 con 0x7f1aa01850e0 2024-02-21T07:42:02.965 INFO:teuthology.orchestra.run.smithi069.stderr:new fs with metadata pool 2 and data pool 3 2024-02-21T07:42:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.969+0000 7f1aa5a00640 1 -- 172.21.15.69:0/794906987 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1a8009f0a0 msgr2=0x7f1a800a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.969+0000 7f1aa5a00640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1a8009f0a0 0x7f1a800a1560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1a90036000 tx=0x7f1a9003e040 comp rx=0 tx=0).stop 2024-02-21T07:42:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.969+0000 7f1aa5a00640 1 -- 172.21.15.69:0/794906987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa01850e0 msgr2=0x7f1aa021f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.969+0000 7f1aa5a00640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa01850e0 0x7f1aa021f520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00c410 tx=0x7f1a8c00c8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.971+0000 7f1aa5a00640 1 -- 172.21.15.69:0/794906987 shutdown_connections 2024-02-21T07:42:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.971+0000 7f1aa5a00640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1a8009f0a0 0x7f1a800a1560 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.971+0000 7f1aa5a00640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1aa0185cc0 0x7f1aa016e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.971+0000 7f1aa5a00640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1aa01850e0 0x7f1aa021f520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.971+0000 7f1aa5a00640 1 --2- 172.21.15.69:0/794906987 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1aa017f700 0x7f1aa016ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.971+0000 7f1aa5a00640 1 -- 172.21.15.69:0/794906987 >> 172.21.15.69:0/794906987 conn(0x7f1aa00ce3d0 msgr2=0x7f1aa0186110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.971+0000 7f1aa5a00640 1 -- 172.21.15.69:0/794906987 shutdown_connections 2024-02-21T07:42:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:02.971+0000 7f1aa5a00640 1 -- 172.21.15.69:0/794906987 wait complete. 2024-02-21T07:42:03.004 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-02-21T07:42:03.004 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-02-21T07:42:03.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.176+0000 7fce02e00640 1 Processor -- start 2024-02-21T07:42:03.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.176+0000 7fce02e00640 1 -- start start 2024-02-21T07:42:03.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.178+0000 7fce02e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcdfc182900 0x7fcdfc08d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:03.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.178+0000 7fce02e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc0d0a20 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.178+0000 7fce02e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc187f30 con 0x7fcdfc182ce0 2024-02-21T07:42:03.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.178+0000 7fce02e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc188210 con 0x7fcdfc182900 2024-02-21T07:42:03.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.179+0000 7fcdfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcdfc182900 0x7fcdfc08d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:03.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.179+0000 7fcdfb400640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fcdfc182ce0 0x7fcdfc0d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:33148/0 (socket says 172.21.15.69:33148) 2024-02-21T07:42:03.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.179+0000 7fcdfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcdfc182900 0x7fcdfc08d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40110/0 (socket says 172.21.15.69:40110) 2024-02-21T07:42:03.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.179+0000 7fcdfb400640 1 -- 172.21.15.69:0/684345361 learned_addr learned my addr 172.21.15.69:0/684345361 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:03.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.179+0000 7fcdfbe00640 1 -- 172.21.15.69:0/684345361 >> v1:172.21.15.184:6789/0 conn(0x7fcdfc182ce0 legacy=0x7fcdfc0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:03.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.179+0000 7fcdfbe00640 1 -- 172.21.15.69:0/684345361 >> v1:172.21.15.174:6789/0 conn(0x7fcdfc0d18f0 legacy=0x7fcdfc1887d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:03.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.179+0000 7fcdfbe00640 1 -- 172.21.15.69:0/684345361 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc1884f0 con 0x7fcdfc182900 2024-02-21T07:42:03.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.180+0000 7fcdfbe00640 1 --2- 172.21.15.69:0/684345361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdfc182900 0x7fcdfc08d4e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009d90 tx=0x7fcdec02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=117212ad6a888233 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.180+0000 7fcdfaa00640 1 -- 172.21.15.69:0/684345361 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec02cbd0 con 0x7fcdfc182900 2024-02-21T07:42:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.180+0000 7fcdfaa00640 1 -- 172.21.15.69:0/684345361 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec02cd30 con 0x7fcdfc182900 2024-02-21T07:42:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.180+0000 7fcdfaa00640 1 -- 172.21.15.69:0/684345361 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec02cea0 con 0x7fcdfc182900 2024-02-21T07:42:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.181+0000 7fce02e00640 1 -- 172.21.15.69:0/684345361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdfc182900 msgr2=0x7fcdfc08d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.181+0000 7fce02e00640 1 --2- 172.21.15.69:0/684345361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdfc182900 0x7fcdfc08d4e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcdec009d90 tx=0x7fcdec02be20 comp rx=0 tx=0).stop 2024-02-21T07:42:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.181+0000 7fce02e00640 1 -- 172.21.15.69:0/684345361 shutdown_connections 2024-02-21T07:42:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.181+0000 7fce02e00640 1 --2- 172.21.15.69:0/684345361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdfc182900 0x7fcdfc08d4e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.181+0000 7fce02e00640 1 -- 172.21.15.69:0/684345361 >> 172.21.15.69:0/684345361 conn(0x7fcdfc0d6580 msgr2=0x7fcdfc0d6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.181+0000 7fce02e00640 1 -- 172.21.15.69:0/684345361 shutdown_connections 2024-02-21T07:42:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.181+0000 7fce02e00640 1 -- 172.21.15.69:0/684345361 wait complete. 2024-02-21T07:42:03.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.183+0000 7fce02e00640 1 Processor -- start 2024-02-21T07:42:03.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.183+0000 7fce02e00640 1 -- start start 2024-02-21T07:42:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fce02e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdfc0d18f0 0x7fcdfc183180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fce02e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdfc182900 0x7fcdfc1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fce02e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdfc182ce0 0x7fcdfc17a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fce02e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc213fd0 con 0x7fcdfc182900 2024-02-21T07:42:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fce02e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc179180 con 0x7fcdfc182ce0 2024-02-21T07:42:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fce02e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc179460 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fcdfb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdfc182900 0x7fcdfc1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fcdfb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdfc182900 0x7fcdfc1599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51618/0 (socket says 172.21.15.69:51618) 2024-02-21T07:42:03.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fcdfb400640 1 -- 172.21.15.69:0/1410899964 learned_addr learned my addr 172.21.15.69:0/1410899964 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:03.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fce00e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdfc182ce0 0x7fcdfc17a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:03.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.184+0000 7fcdfbe00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdfc0d18f0 0x7fcdfc183180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:03.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.185+0000 7fcdfbe00640 1 -- 172.21.15.69:0/1410899964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdfc182ce0 msgr2=0x7fcdfc17a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:03.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.185+0000 7fcdfbe00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdfc182ce0 0x7fcdfc17a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:03.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.185+0000 7fcdfbe00640 1 -- 172.21.15.69:0/1410899964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdfc182900 msgr2=0x7fcdfc1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:03.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.185+0000 7fcdfbe00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdfc182900 0x7fcdfc1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:03.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.185+0000 7fcdfbe00640 1 -- 172.21.15.69:0/1410899964 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec009a70 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.185+0000 7fcdfbe00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdfc0d18f0 0x7fcdfc183180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcdec033000 tx=0x7fcdec004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:03.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.185+0000 7fcdf3e00640 1 -- 172.21.15.69:0/1410899964 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec02cea0 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.185+0000 7fcdf3e00640 1 -- 172.21.15.69:0/1410899964 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec040670 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.185+0000 7fce02e00640 1 -- 172.21.15.69:0/1410899964 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc179740 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.185+0000 7fcdf3e00640 1 -- 172.21.15.69:0/1410899964 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec040a20 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.186+0000 7fce02e00640 1 -- 172.21.15.69:0/1410899964 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc179d00 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.186+0000 7fce02e00640 1 -- 172.21.15.69:0/1410899964 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc069d50 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.189+0000 7fcdf3e00640 1 -- 172.21.15.69:0/1410899964 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fcdec040b80 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.190+0000 7fcdf3e00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcddc09f0a0 0x7fcddc0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:03.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.190+0000 7fcdf3e00640 1 -- 172.21.15.69:0/1410899964 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7549+0+0 (secure 0 0 0) 0x7fcdec0ec880 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.190+0000 7fcdfb400640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcddc09f0a0 0x7fcddc0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:03.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.191+0000 7fcdfb400640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcddc09f0a0 0x7fcddc0a1560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc214e60 tx=0x7fcde8007f10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:03.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.192+0000 7fcdf3e00640 1 -- 172.21.15.69:0/1410899964 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcdec0b69c0 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.395+0000 7fce02e00640 1 -- 172.21.15.69:0/1410899964 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fcdfc1795a0 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.949+0000 7fcdf3e00640 1 -- 172.21.15.69:0/1410899964 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 157+0+0 (secure 0 0 0) 0x7fcdfc1795a0 con 0x7fcdfc0d18f0 2024-02-21T07:42:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 -- 172.21.15.69:0/1410899964 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcddc09f0a0 msgr2=0x7fcddc0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcddc09f0a0 0x7fcddc0a1560 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc214e60 tx=0x7fcde8007f10 comp rx=0 tx=0).stop 2024-02-21T07:42:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 -- 172.21.15.69:0/1410899964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdfc0d18f0 msgr2=0x7fcdfc183180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdfc0d18f0 0x7fcdfc183180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcdec033000 tx=0x7fcdec004a40 comp rx=0 tx=0).stop 2024-02-21T07:42:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 -- 172.21.15.69:0/1410899964 shutdown_connections 2024-02-21T07:42:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcddc09f0a0 0x7fcddc0a1560 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcdfc182ce0 0x7fcdfc17a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdfc182900 0x7fcdfc1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 --2- 172.21.15.69:0/1410899964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcdfc0d18f0 0x7fcdfc183180 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 -- 172.21.15.69:0/1410899964 >> 172.21.15.69:0/1410899964 conn(0x7fcdfc0d6580 msgr2=0x7fcdfc0d4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:03.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 -- 172.21.15.69:0/1410899964 shutdown_connections 2024-02-21T07:42:03.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:03.953+0000 7fce02e00640 1 -- 172.21.15.69:0/1410899964 wait complete. 2024-02-21T07:42:03.982 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-02-21T07:42:04.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.181+0000 7f4587e00640 1 Processor -- start 2024-02-21T07:42:04.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.181+0000 7f4587e00640 1 -- start start 2024-02-21T07:42:04.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f4587e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4588161230 0x7f458818c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:04.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f4587e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f458818c590 0x7f45881875e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:04.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f4587e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45880f58a0 con 0x7f4588187b20 2024-02-21T07:42:04.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f4587e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4588189780 con 0x7f458818c590 2024-02-21T07:42:04.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f4587e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45880f55c0 con 0x7f4588161230 2024-02-21T07:42:04.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f457e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f458818c590 0x7f45881875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:04.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f457e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f458818c590 0x7f45881875e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51632/0 (socket says 172.21.15.69:51632) 2024-02-21T07:42:04.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f4586a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4588161230 0x7f458818c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:04.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f457e000640 1 -- 172.21.15.69:0/3835213647 learned_addr learned my addr 172.21.15.69:0/3835213647 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:04.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f4586a00640 1 -- 172.21.15.69:0/3835213647 >> v2:172.21.15.69:3300/0 conn(0x7f458818c590 msgr2=0x7f45881875e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:04.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f4586a00640 1 --2- 172.21.15.69:0/3835213647 >> v2:172.21.15.69:3300/0 conn(0x7f458818c590 0x7f45881875e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:04.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.183+0000 7f4586a00640 1 -- 172.21.15.69:0/3835213647 >> v1:172.21.15.174:6789/0 conn(0x7f4588187b20 legacy=0x7f45880f4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:04.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.184+0000 7f4586a00640 1 -- 172.21.15.69:0/3835213647 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4588186820 con 0x7f4588161230 2024-02-21T07:42:04.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.184+0000 7f457e000640 1 --2- 172.21.15.69:0/3835213647 >> v2:172.21.15.69:3300/0 conn(0x7f458818c590 0x7f45881875e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:04.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.185+0000 7f4586a00640 1 --2- 172.21.15.69:0/3835213647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588161230 0x7f458818c050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f458808d4d0 tx=0x7f457802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bede4ebdee90cde5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:04.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.185+0000 7f4586000640 1 -- 172.21.15.69:0/3835213647 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457802e070 con 0x7f4588161230 2024-02-21T07:42:04.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.185+0000 7f4586000640 1 -- 172.21.15.69:0/3835213647 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45780315a0 con 0x7f4588161230 2024-02-21T07:42:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.185+0000 7f4586000640 1 -- 172.21.15.69:0/3835213647 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578031930 con 0x7f4588161230 2024-02-21T07:42:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.185+0000 7f4587e00640 1 -- 172.21.15.69:0/3835213647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588161230 msgr2=0x7f458818c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.185+0000 7f4587e00640 1 --2- 172.21.15.69:0/3835213647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588161230 0x7f458818c050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f458808d4d0 tx=0x7f457802b840 comp rx=0 tx=0).stop 2024-02-21T07:42:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.186+0000 7f4587e00640 1 -- 172.21.15.69:0/3835213647 shutdown_connections 2024-02-21T07:42:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.186+0000 7f4587e00640 1 --2- 172.21.15.69:0/3835213647 >> v2:172.21.15.69:3300/0 conn(0x7f458818c590 0x7f45881875e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.186+0000 7f4587e00640 1 --2- 172.21.15.69:0/3835213647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588161230 0x7f458818c050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.186+0000 7f4587e00640 1 -- 172.21.15.69:0/3835213647 >> 172.21.15.69:0/3835213647 conn(0x7f45880ce150 msgr2=0x7f45880ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.186+0000 7f4587e00640 1 -- 172.21.15.69:0/3835213647 shutdown_connections 2024-02-21T07:42:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.186+0000 7f4587e00640 1 -- 172.21.15.69:0/3835213647 wait complete. 2024-02-21T07:42:04.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.188+0000 7f4587e00640 1 Processor -- start 2024-02-21T07:42:04.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.188+0000 7f4587e00640 1 -- start start 2024-02-21T07:42:04.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f4587e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4588161230 0x7f45880cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:04.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f4587e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588187b20 0x7f4588189970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:04.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f4587e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f458818c590 0x7f4588157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f4587e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4588222cf0 con 0x7f458818c590 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f4587e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458818a060 con 0x7f4588161230 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f4587e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458818a340 con 0x7f4588187b20 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f457e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588187b20 0x7f4588189970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f457e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588187b20 0x7f4588189970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40132/0 (socket says 172.21.15.69:40132) 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f457e000640 1 -- 172.21.15.69:0/202171841 learned_addr learned my addr 172.21.15.69:0/202171841 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f4586a00640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4588161230 0x7f45880cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f4587400640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f458818c590 0x7f4588157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f457e000640 1 -- 172.21.15.69:0/202171841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4588161230 msgr2=0x7f45880cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f457e000640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4588161230 0x7f45880cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f457e000640 1 -- 172.21.15.69:0/202171841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f458818c590 msgr2=0x7f4588157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f457e000640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f458818c590 0x7f4588157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f457e000640 1 -- 172.21.15.69:0/202171841 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700094d0 con 0x7f4588187b20 2024-02-21T07:42:04.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.190+0000 7f4587400640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f458818c590 0x7f4588157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:04.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.191+0000 7f457e000640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588187b20 0x7f4588189970 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f457000e9e0 tx=0x7f457000eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:04.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.191+0000 7f457f400640 1 -- 172.21.15.69:0/202171841 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000c9d0 con 0x7f4588187b20 2024-02-21T07:42:04.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.191+0000 7f457f400640 1 -- 172.21.15.69:0/202171841 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457000cb30 con 0x7f4588187b20 2024-02-21T07:42:04.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.191+0000 7f457f400640 1 -- 172.21.15.69:0/202171841 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000cea0 con 0x7f4588187b20 2024-02-21T07:42:04.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.191+0000 7f4587e00640 1 -- 172.21.15.69:0/202171841 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4578009400 con 0x7f4588187b20 2024-02-21T07:42:04.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.191+0000 7f4587e00640 1 -- 172.21.15.69:0/202171841 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458818a900 con 0x7f4588187b20 2024-02-21T07:42:04.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.192+0000 7f4587e00640 1 -- 172.21.15.69:0/202171841 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458808ddb0 con 0x7f4588187b20 2024-02-21T07:42:04.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.194+0000 7f457f400640 1 -- 172.21.15.69:0/202171841 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4570005990 con 0x7f4588187b20 2024-02-21T07:42:04.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.195+0000 7f457f400640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f456409f0a0 0x7f45640a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:04.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.195+0000 7f457f400640 1 -- 172.21.15.69:0/202171841 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 7847+0+0 (secure 0 0 0) 0x7f45700c9cd0 con 0x7f4588187b20 2024-02-21T07:42:04.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.196+0000 7f4586a00640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f456409f0a0 0x7f45640a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:04.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.196+0000 7f4586a00640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f456409f0a0 0x7f45640a1560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4578036000 tx=0x7f457803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:04.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.197+0000 7f457f400640 1 -- 172.21.15.69:0/202171841 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4570093ce0 con 0x7f4588187b20 2024-02-21T07:42:04.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:04.378+0000 7f4587e00640 1 -- 172.21.15.69:0/202171841 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4588069c10 con 0x7f4588187b20 2024-02-21T07:42:05.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.983+0000 7f457f400640 1 -- 172.21.15.69:0/202171841 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7f4570021020 con 0x7f4588187b20 2024-02-21T07:42:05.995 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data_ec' created 2024-02-21T07:42:05.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.990+0000 7f4587e00640 1 -- 172.21.15.69:0/202171841 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f456409f0a0 msgr2=0x7f45640a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:05.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.990+0000 7f4587e00640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f456409f0a0 0x7f45640a1560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4578036000 tx=0x7f457803d040 comp rx=0 tx=0).stop 2024-02-21T07:42:05.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.991+0000 7f4587e00640 1 -- 172.21.15.69:0/202171841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588187b20 msgr2=0x7f4588189970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:05.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.991+0000 7f4587e00640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588187b20 0x7f4588189970 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f457000e9e0 tx=0x7f457000eea0 comp rx=0 tx=0).stop 2024-02-21T07:42:05.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.992+0000 7f4587e00640 1 -- 172.21.15.69:0/202171841 shutdown_connections 2024-02-21T07:42:05.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.992+0000 7f4587e00640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f456409f0a0 0x7f45640a1560 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:05.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.992+0000 7f4587e00640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f458818c590 0x7f4588157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:05.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.992+0000 7f4587e00640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4588187b20 0x7f4588189970 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:05.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.992+0000 7f4587e00640 1 --2- 172.21.15.69:0/202171841 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4588161230 0x7f45880cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:05.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.992+0000 7f4587e00640 1 -- 172.21.15.69:0/202171841 >> 172.21.15.69:0/202171841 conn(0x7f45880ce150 msgr2=0x7f4588068a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:05.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.992+0000 7f4587e00640 1 -- 172.21.15.69:0/202171841 shutdown_connections 2024-02-21T07:42:05.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:05.993+0000 7f4587e00640 1 -- 172.21.15.69:0/202171841 wait complete. 2024-02-21T07:42:06.020 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-02-21T07:42:06.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.206+0000 7fb669600640 1 Processor -- start 2024-02-21T07:42:06.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.206+0000 7fb669600640 1 -- start start 2024-02-21T07:42:06.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.208+0000 7fb669600640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb664182e00 0x7fb6640f5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:06.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.208+0000 7fb669600640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb6641874c0 0x7fb664187920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.208+0000 7fb669600640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb664187030 con 0x7fb664187e60 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.208+0000 7fb669600640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6640f5fd0 con 0x7fb6641874c0 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.208+0000 7fb669600640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6640f62b0 con 0x7fb664182e00 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.208+0000 7fb662a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb664182e00 0x7fb6640f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.209+0000 7fb662a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb664182e00 0x7fb6640f5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40140/0 (socket says 172.21.15.69:40140) 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.209+0000 7fb662a00640 1 -- 172.21.15.69:0/128187018 learned_addr learned my addr 172.21.15.69:0/128187018 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.209+0000 7fb662000640 1 --2- 172.21.15.69:0/128187018 >> v2:172.21.15.174:3300/0 conn(0x7fb6641874c0 0x7fb664187920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.209+0000 7fb662a00640 1 -- 172.21.15.69:0/128187018 >> v2:172.21.15.174:3300/0 conn(0x7fb6641874c0 msgr2=0x7fb664187920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.209+0000 7fb662a00640 1 --2- 172.21.15.69:0/128187018 >> v2:172.21.15.174:3300/0 conn(0x7fb6641874c0 0x7fb664187920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.209+0000 7fb662a00640 1 -- 172.21.15.69:0/128187018 >> v1:172.21.15.174:6789/0 conn(0x7fb664187e60 legacy=0x7fb664188c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.209+0000 7fb662a00640 1 -- 172.21.15.69:0/128187018 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6640f6590 con 0x7fb664182e00 2024-02-21T07:42:06.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.210+0000 7fb662a00640 1 --2- 172.21.15.69:0/128187018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb664182e00 0x7fb6640f5690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb6640cf4a0 tx=0x7fb65402dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95ada4591f4d71cd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:06.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.210+0000 7fb661600640 1 -- 172.21.15.69:0/128187018 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65402f870 con 0x7fb664182e00 2024-02-21T07:42:06.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.210+0000 7fb661600640 1 -- 172.21.15.69:0/128187018 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65402f9d0 con 0x7fb664182e00 2024-02-21T07:42:06.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.210+0000 7fb661600640 1 -- 172.21.15.69:0/128187018 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65402fd60 con 0x7fb664182e00 2024-02-21T07:42:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.211+0000 7fb669600640 1 -- 172.21.15.69:0/128187018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb664182e00 msgr2=0x7fb6640f5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.211+0000 7fb669600640 1 --2- 172.21.15.69:0/128187018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb664182e00 0x7fb6640f5690 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb6640cf4a0 tx=0x7fb65402dab0 comp rx=0 tx=0).stop 2024-02-21T07:42:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.211+0000 7fb669600640 1 -- 172.21.15.69:0/128187018 shutdown_connections 2024-02-21T07:42:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.211+0000 7fb669600640 1 --2- 172.21.15.69:0/128187018 >> v2:172.21.15.174:3300/0 conn(0x7fb6641874c0 0x7fb664187920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.211+0000 7fb669600640 1 --2- 172.21.15.69:0/128187018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb664182e00 0x7fb6640f5690 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.211+0000 7fb669600640 1 -- 172.21.15.69:0/128187018 >> 172.21.15.69:0/128187018 conn(0x7fb6640f6ba0 msgr2=0x7fb6640f6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.211+0000 7fb669600640 1 -- 172.21.15.69:0/128187018 shutdown_connections 2024-02-21T07:42:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.211+0000 7fb669600640 1 -- 172.21.15.69:0/128187018 wait complete. 2024-02-21T07:42:06.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.213+0000 7fb669600640 1 Processor -- start 2024-02-21T07:42:06.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.213+0000 7fb669600640 1 -- start start 2024-02-21T07:42:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.214+0000 7fb669600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb664182e00 0x7fb66415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.214+0000 7fb669600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6641874c0 0x7fb664218ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.214+0000 7fb669600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb664187e60 0x7fb664219420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.214+0000 7fb669600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66421d0a0 con 0x7fb664182e00 2024-02-21T07:42:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb669600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66421d380 con 0x7fb664187e60 2024-02-21T07:42:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb669600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb664218120 con 0x7fb6641874c0 2024-02-21T07:42:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb663400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb664187e60 0x7fb664219420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb662000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6641874c0 0x7fb664218ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:06.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb662a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb664182e00 0x7fb66415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:06.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb662000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6641874c0 0x7fb664218ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40154/0 (socket says 172.21.15.69:40154) 2024-02-21T07:42:06.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb662000640 1 -- 172.21.15.69:0/3228695702 learned_addr learned my addr 172.21.15.69:0/3228695702 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:06.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb662000640 1 -- 172.21.15.69:0/3228695702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb664187e60 msgr2=0x7fb664219420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:06.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb662000640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb664187e60 0x7fb664219420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:06.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb662000640 1 -- 172.21.15.69:0/3228695702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb664182e00 msgr2=0x7fb66415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:06.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb662000640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb664182e00 0x7fb66415d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:06.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.215+0000 7fb662000640 1 -- 172.21.15.69:0/3228695702 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540094d0 con 0x7fb6641874c0 2024-02-21T07:42:06.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.216+0000 7fb662000640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6641874c0 0x7fb664218ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb65000e870 tx=0x7fb65000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:06.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.216+0000 7fb65aa00640 1 -- 172.21.15.69:0/3228695702 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6500094f0 con 0x7fb6641874c0 2024-02-21T07:42:06.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.216+0000 7fb65aa00640 1 -- 172.21.15.69:0/3228695702 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65000c940 con 0x7fb6641874c0 2024-02-21T07:42:06.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.216+0000 7fb65aa00640 1 -- 172.21.15.69:0/3228695702 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000ccf0 con 0x7fb6641874c0 2024-02-21T07:42:06.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.216+0000 7fb669600640 1 -- 172.21.15.69:0/3228695702 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb664218400 con 0x7fb6641874c0 2024-02-21T07:42:06.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.216+0000 7fb669600640 1 -- 172.21.15.69:0/3228695702 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6642189c0 con 0x7fb6641874c0 2024-02-21T07:42:06.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.217+0000 7fb669600640 1 -- 172.21.15.69:0/3228695702 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb664069d50 con 0x7fb6641874c0 2024-02-21T07:42:06.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.219+0000 7fb65aa00640 1 -- 172.21.15.69:0/3228695702 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb650013470 con 0x7fb6641874c0 2024-02-21T07:42:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.220+0000 7fb65aa00640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb64409f0a0 0x7fb6440a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.221+0000 7fb65aa00640 1 -- 172.21.15.69:0/3228695702 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 8340+0+0 (secure 0 0 0) 0x7fb6500ca2e0 con 0x7fb6641874c0 2024-02-21T07:42:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.221+0000 7fb662a00640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb64409f0a0 0x7fb6440a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:06.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.221+0000 7fb662a00640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb64409f0a0 0x7fb6440a1560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb654038000 tx=0x7fb654008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.223+0000 7fb65aa00640 1 -- 172.21.15.69:0/3228695702 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb6500941a0 con 0x7fb6641874c0 2024-02-21T07:42:06.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.415+0000 7fb669600640 1 -- 172.21.15.69:0/3228695702 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fb6640cc0b0 con 0x7fb6641874c0 2024-02-21T07:42:06.638 INFO:tasks.ceph.mds.a.smithi069.stderr:2024-02-21T07:42:06.632+0000 7f62a1600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-21T07:42:06.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.988+0000 7fb65aa00640 1 -- 172.21.15.69:0/3228695702 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb6500210c0 con 0x7fb6641874c0 2024-02-21T07:42:06.994 INFO:teuthology.orchestra.run.smithi069.stderr:set pool 4 allow_ec_overwrites to true 2024-02-21T07:42:06.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.993+0000 7fb669600640 1 -- 172.21.15.69:0/3228695702 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb64409f0a0 msgr2=0x7fb6440a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.993+0000 7fb669600640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb64409f0a0 0x7fb6440a1560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb654038000 tx=0x7fb654008030 comp rx=0 tx=0).stop 2024-02-21T07:42:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.993+0000 7fb669600640 1 -- 172.21.15.69:0/3228695702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6641874c0 msgr2=0x7fb664218ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.993+0000 7fb669600640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6641874c0 0x7fb664218ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb65000e870 tx=0x7fb65000ed30 comp rx=0 tx=0).stop 2024-02-21T07:42:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.993+0000 7fb669600640 1 -- 172.21.15.69:0/3228695702 shutdown_connections 2024-02-21T07:42:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.993+0000 7fb669600640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb64409f0a0 0x7fb6440a1560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.993+0000 7fb669600640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb664187e60 0x7fb664219420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.993+0000 7fb669600640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb6641874c0 0x7fb664218ee0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.994+0000 7fb669600640 1 --2- 172.21.15.69:0/3228695702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb664182e00 0x7fb66415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.994+0000 7fb669600640 1 -- 172.21.15.69:0/3228695702 >> 172.21.15.69:0/3228695702 conn(0x7fb6640f6ba0 msgr2=0x7fb6640f6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.994+0000 7fb669600640 1 -- 172.21.15.69:0/3228695702 shutdown_connections 2024-02-21T07:42:07.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:06.994+0000 7fb669600640 1 -- 172.21.15.69:0/3228695702 wait complete. 2024-02-21T07:42:07.039 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-02-21T07:42:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.214+0000 7f0b97c00640 1 Processor -- start 2024-02-21T07:42:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.214+0000 7f0b97c00640 1 -- start start 2024-02-21T07:42:07.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b97c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f0b900ee640 0x7f0b900eead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b97c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0b90186bc0 0x7f0b90187010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b97c00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b900ef010 con 0x7f0b90183ea0 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b97c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b90186010 con 0x7f0b90186bc0 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b97c00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b90184df0 con 0x7f0b900ee640 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b95200640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0b90183ea0 0x7f0b901846e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:53788/0 (socket says 172.21.15.69:53788) 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b95200640 1 -- 172.21.15.69:0/4180011773 learned_addr learned my addr 172.21.15.69:0/4180011773 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b87e00640 1 --2- 172.21.15.69:0/4180011773 >> v2:172.21.15.184:3300/0 conn(0x7f0b900ee640 0x7f0b900eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b95c00640 1 --2- 172.21.15.69:0/4180011773 >> v2:172.21.15.174:3300/0 conn(0x7f0b90186bc0 0x7f0b90187010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b8fe00640 1 -- 172.21.15.69:0/4180011773 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623681435 0 0) 0x7f0b900ef010 con 0x7f0b90183ea0 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b87e00640 1 -- 172.21.15.69:0/4180011773 >> v2:172.21.15.174:3300/0 conn(0x7f0b90186bc0 msgr2=0x7f0b90187010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b87e00640 1 --2- 172.21.15.69:0/4180011773 >> v2:172.21.15.174:3300/0 conn(0x7f0b90186bc0 0x7f0b90187010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.216+0000 7f0b87e00640 1 -- 172.21.15.69:0/4180011773 >> v1:172.21.15.174:6789/0 conn(0x7f0b90183ea0 legacy=0x7f0b901846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.217+0000 7f0b87e00640 1 -- 172.21.15.69:0/4180011773 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b901850b0 con 0x7f0b900ee640 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.218+0000 7f0b87e00640 1 --2- 172.21.15.69:0/4180011773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b900ee640 0x7f0b900eead0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0b900faf60 tx=0x7f0b7802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3f8b0caa85e7603 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.218+0000 7f0b8fe00640 1 -- 172.21.15.69:0/4180011773 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7802e070 con 0x7f0b900ee640 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.218+0000 7f0b8fe00640 1 -- 172.21.15.69:0/4180011773 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b780315a0 con 0x7f0b900ee640 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.218+0000 7f0b8fe00640 1 -- 172.21.15.69:0/4180011773 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78031930 con 0x7f0b900ee640 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.218+0000 7f0b97c00640 1 -- 172.21.15.69:0/4180011773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b900ee640 msgr2=0x7f0b900eead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.218+0000 7f0b97c00640 1 --2- 172.21.15.69:0/4180011773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b900ee640 0x7f0b900eead0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0b900faf60 tx=0x7f0b7802b840 comp rx=0 tx=0).stop 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.219+0000 7f0b97c00640 1 -- 172.21.15.69:0/4180011773 shutdown_connections 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.219+0000 7f0b97c00640 1 --2- 172.21.15.69:0/4180011773 >> v2:172.21.15.174:3300/0 conn(0x7f0b90186bc0 0x7f0b90187010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.219+0000 7f0b97c00640 1 --2- 172.21.15.69:0/4180011773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b900ee640 0x7f0b900eead0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.219+0000 7f0b97c00640 1 -- 172.21.15.69:0/4180011773 >> 172.21.15.69:0/4180011773 conn(0x7f0b900ce3d0 msgr2=0x7f0b900ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.219+0000 7f0b97c00640 1 -- 172.21.15.69:0/4180011773 shutdown_connections 2024-02-21T07:42:07.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.219+0000 7f0b97c00640 1 -- 172.21.15.69:0/4180011773 wait complete. 2024-02-21T07:42:07.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.221+0000 7f0b97c00640 1 Processor -- start 2024-02-21T07:42:07.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.221+0000 7f0b97c00640 1 -- start start 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b97c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b900ee640 0x7f0b90160d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b97c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b90183ea0 0x7f0b90187ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b97c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b90186bc0 0x7f0b90187ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b97c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9021e470 con 0x7f0b900ee640 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b97c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9021d580 con 0x7f0b90186bc0 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b97c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9021d860 con 0x7f0b90183ea0 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b95200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b900ee640 0x7f0b90160d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b95200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b900ee640 0x7f0b90160d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51660/0 (socket says 172.21.15.69:51660) 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b95200640 1 -- 172.21.15.69:0/488466288 learned_addr learned my addr 172.21.15.69:0/488466288 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b87e00640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b90183ea0 0x7f0b90187ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.222+0000 7f0b95c00640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b90186bc0 0x7f0b90187ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:07.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b95200640 1 -- 172.21.15.69:0/488466288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b90183ea0 msgr2=0x7f0b90187ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b95200640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b90183ea0 0x7f0b90187ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b95200640 1 -- 172.21.15.69:0/488466288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b90186bc0 msgr2=0x7f0b90187ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b95200640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b90186bc0 0x7f0b90187ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b95200640 1 -- 172.21.15.69:0/488466288 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b78009400 con 0x7f0b900ee640 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b95200640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b900ee640 0x7f0b90160d20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c3f0 tx=0x7f0b8000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b8d600640 1 -- 172.21.15.69:0/488466288 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b800074e0 con 0x7f0b900ee640 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b8d600640 1 -- 172.21.15.69:0/488466288 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b80007640 con 0x7f0b900ee640 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b8d600640 1 -- 172.21.15.69:0/488466288 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b80004a00 con 0x7f0b900ee640 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b97c00640 1 -- 172.21.15.69:0/488466288 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9021db40 con 0x7f0b900ee640 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.223+0000 7f0b97c00640 1 -- 172.21.15.69:0/488466288 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9021e100 con 0x7f0b900ee640 2024-02-21T07:42:07.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.224+0000 7f0b97c00640 1 -- 172.21.15.69:0/488466288 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b90069d50 con 0x7f0b900ee640 2024-02-21T07:42:07.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.228+0000 7f0b8d600640 1 -- 172.21.15.69:0/488466288 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f0b80004b60 con 0x7f0b900ee640 2024-02-21T07:42:07.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.229+0000 7f0b8d600640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0b6c09f0d0 0x7f0b6c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:07.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.229+0000 7f0b8d600640 1 -- 172.21.15.69:0/488466288 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8340+0+0 (secure 0 0 0) 0x7f0b800c9ea0 con 0x7f0b900ee640 2024-02-21T07:42:07.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.229+0000 7f0b87e00640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0b6c09f0d0 0x7f0b6c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:07.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.230+0000 7f0b87e00640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0b6c09f0d0 0x7f0b6c0a1590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0b78036000 tx=0x7f0b7803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.232+0000 7f0b8d600640 1 -- 172.21.15.69:0/488466288 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0b80093c20 con 0x7f0b900ee640 2024-02-21T07:42:07.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.470+0000 7f0b97c00640 1 -- 172.21.15.69:0/488466288 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f0b900f6000 con 0x7f0b900ee640 2024-02-21T07:42:08.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:07.997+0000 7f0b8d600640 1 -- 172.21.15.69:0/488466288 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0b80095b50 con 0x7f0b900ee640 2024-02-21T07:42:08.003 INFO:teuthology.orchestra.run.smithi069.stderr:added data pool 4 to fsmap 2024-02-21T07:42:08.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.000+0000 7f0b97c00640 1 -- 172.21.15.69:0/488466288 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0b6c09f0d0 msgr2=0x7f0b6c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.000+0000 7f0b97c00640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0b6c09f0d0 0x7f0b6c0a1590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0b78036000 tx=0x7f0b7803d040 comp rx=0 tx=0).stop 2024-02-21T07:42:08.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.000+0000 7f0b97c00640 1 -- 172.21.15.69:0/488466288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b900ee640 msgr2=0x7f0b90160d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.000+0000 7f0b97c00640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b900ee640 0x7f0b90160d20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0b8000c3f0 tx=0x7f0b8000c8b0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.001+0000 7f0b97c00640 1 -- 172.21.15.69:0/488466288 shutdown_connections 2024-02-21T07:42:08.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.001+0000 7f0b97c00640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0b6c09f0d0 0x7f0b6c0a1590 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.001+0000 7f0b97c00640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0b90186bc0 0x7f0b90187ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.001+0000 7f0b97c00640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0b90183ea0 0x7f0b90187ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.001+0000 7f0b97c00640 1 --2- 172.21.15.69:0/488466288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b900ee640 0x7f0b90160d20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.001+0000 7f0b97c00640 1 -- 172.21.15.69:0/488466288 >> 172.21.15.69:0/488466288 conn(0x7f0b900ce3d0 msgr2=0x7f0b900f06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:08.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.001+0000 7f0b97c00640 1 -- 172.21.15.69:0/488466288 shutdown_connections 2024-02-21T07:42:08.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.001+0000 7f0b97c00640 1 -- 172.21.15.69:0/488466288 wait complete. 2024-02-21T07:42:08.026 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:42:08.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.230+0000 7fa70ca00640 1 Processor -- start 2024-02-21T07:42:08.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.231+0000 7fa70ca00640 1 -- start start 2024-02-21T07:42:08.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.232+0000 7fa70ca00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa708182a50 0x7fa708188300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.232+0000 7fa70ca00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa70818c3f0 0x7fa70818c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.232+0000 7fa70ca00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7080f5f70 con 0x7fa708186820 2024-02-21T07:42:08.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.232+0000 7fa70ca00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa708182e30 con 0x7fa708182a50 2024-02-21T07:42:08.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.232+0000 7fa70ca00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa708186f80 con 0x7fa70818c3f0 2024-02-21T07:42:08.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.233+0000 7fa705400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa708186820 0x7fa7080f5860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:54288/0 (socket says 172.21.15.69:54288) 2024-02-21T07:42:08.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.233+0000 7fa705400640 1 -- 172.21.15.69:0/1555936844 learned_addr learned my addr 172.21.15.69:0/1555936844 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:08.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.233+0000 7fa705e00640 1 --2- 172.21.15.69:0/1555936844 >> v2:172.21.15.69:3300/0 conn(0x7fa708182a50 0x7fa708188300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.233+0000 7fa706800640 1 --2- 172.21.15.69:0/1555936844 >> v2:172.21.15.184:3300/0 conn(0x7fa70818c3f0 0x7fa70818c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.233+0000 7fa705e00640 1 -- 172.21.15.69:0/1555936844 >> v2:172.21.15.184:3300/0 conn(0x7fa70818c3f0 msgr2=0x7fa70818c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:08.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.233+0000 7fa705e00640 1 --2- 172.21.15.69:0/1555936844 >> v2:172.21.15.184:3300/0 conn(0x7fa70818c3f0 0x7fa70818c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.233+0000 7fa705e00640 1 -- 172.21.15.69:0/1555936844 >> v1:172.21.15.69:6789/0 conn(0x7fa708186820 legacy=0x7fa7080f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.233+0000 7fa705e00640 1 -- 172.21.15.69:0/1555936844 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa708187260 con 0x7fa708182a50 2024-02-21T07:42:08.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.233+0000 7fa704a00640 1 -- 172.21.15.69:0/1555936844 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269267015 0 0) 0x7fa6f4001110 con 0x7fa708186820 2024-02-21T07:42:08.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.234+0000 7fa705e00640 1 --2- 172.21.15.69:0/1555936844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa708182a50 0x7fa708188300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa708074fc0 tx=0x7fa6f802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959b0d8b96c2b1d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:08.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.234+0000 7fa704a00640 1 -- 172.21.15.69:0/1555936844 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8031710 con 0x7fa708182a50 2024-02-21T07:42:08.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.235+0000 7fa704a00640 1 -- 172.21.15.69:0/1555936844 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f802f050 con 0x7fa708182a50 2024-02-21T07:42:08.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.235+0000 7fa704a00640 1 -- 172.21.15.69:0/1555936844 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8031a90 con 0x7fa708182a50 2024-02-21T07:42:08.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.235+0000 7fa70ca00640 1 -- 172.21.15.69:0/1555936844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa708182a50 msgr2=0x7fa708188300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.235+0000 7fa70ca00640 1 --2- 172.21.15.69:0/1555936844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa708182a50 0x7fa708188300 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa708074fc0 tx=0x7fa6f802b7b0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.235+0000 7fa70ca00640 1 -- 172.21.15.69:0/1555936844 shutdown_connections 2024-02-21T07:42:08.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.235+0000 7fa70ca00640 1 --2- 172.21.15.69:0/1555936844 >> v2:172.21.15.184:3300/0 conn(0x7fa70818c3f0 0x7fa70818c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.235+0000 7fa70ca00640 1 --2- 172.21.15.69:0/1555936844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa708182a50 0x7fa708188300 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.235+0000 7fa70ca00640 1 -- 172.21.15.69:0/1555936844 >> 172.21.15.69:0/1555936844 conn(0x7fa7080cf3b0 msgr2=0x7fa7080cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:08.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.235+0000 7fa70ca00640 1 -- 172.21.15.69:0/1555936844 shutdown_connections 2024-02-21T07:42:08.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.235+0000 7fa70ca00640 1 -- 172.21.15.69:0/1555936844 wait complete. 2024-02-21T07:42:08.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.237+0000 7fa70ca00640 1 Processor -- start 2024-02-21T07:42:08.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.237+0000 7fa70ca00640 1 -- start start 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa70ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa708182a50 0x7fa7080f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa70ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa708186820 0x7fa708168680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa70ca00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa70818c3f0 0x7fa708168bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa70ca00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080f3870 con 0x7fa708186820 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa70ca00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080f2980 con 0x7fa70818c3f0 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa70ca00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080f2c60 con 0x7fa708182a50 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa705400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa708186820 0x7fa708168680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa705e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa708182a50 0x7fa7080f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa705e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa708182a50 0x7fa7080f1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40190/0 (socket says 172.21.15.69:40190) 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa705e00640 1 -- 172.21.15.69:0/2225879477 learned_addr learned my addr 172.21.15.69:0/2225879477 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:08.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa706800640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa70818c3f0 0x7fa708168bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa705e00640 1 -- 172.21.15.69:0/2225879477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa70818c3f0 msgr2=0x7fa708168bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa705e00640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa70818c3f0 0x7fa708168bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa705e00640 1 -- 172.21.15.69:0/2225879477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa708186820 msgr2=0x7fa708168680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa705e00640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa708186820 0x7fa708168680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa705e00640 1 -- 172.21.15.69:0/2225879477 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8009400 con 0x7fa708182a50 2024-02-21T07:42:08.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.239+0000 7fa705400640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa708186820 0x7fa708168680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:08.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.240+0000 7fa705e00640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa708182a50 0x7fa7080f1fb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8000c00 tx=0x7fa6f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:08.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.240+0000 7fa6fe000640 1 -- 172.21.15.69:0/2225879477 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f803c8d0 con 0x7fa708182a50 2024-02-21T07:42:08.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.240+0000 7fa6fe000640 1 -- 172.21.15.69:0/2225879477 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f803ca30 con 0x7fa708182a50 2024-02-21T07:42:08.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.240+0000 7fa6fe000640 1 -- 172.21.15.69:0/2225879477 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f803cde0 con 0x7fa708182a50 2024-02-21T07:42:08.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.240+0000 7fa70ca00640 1 -- 172.21.15.69:0/2225879477 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7080f2f40 con 0x7fa708182a50 2024-02-21T07:42:08.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.240+0000 7fa70ca00640 1 -- 172.21.15.69:0/2225879477 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7080f3500 con 0x7fa708182a50 2024-02-21T07:42:08.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.241+0000 7fa70ca00640 1 -- 172.21.15.69:0/2225879477 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7080cbf80 con 0x7fa708182a50 2024-02-21T07:42:08.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.243+0000 7fa6fe000640 1 -- 172.21.15.69:0/2225879477 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa6f803a040 con 0x7fa708182a50 2024-02-21T07:42:08.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.244+0000 7fa6fe000640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa6e809f0a0 0x7fa6e80a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.245+0000 7fa6fe000640 1 -- 172.21.15.69:0/2225879477 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa6f80eb2b0 con 0x7fa708182a50 2024-02-21T07:42:08.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.245+0000 7fa705400640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa6e809f0a0 0x7fa6e80a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.245+0000 7fa705400640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa6e809f0a0 0x7fa6e80a1560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa7080cba70 tx=0x7fa6f4007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:08.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.247+0000 7fa6fe000640 1 -- 172.21.15.69:0/2225879477 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa6f80b5150 con 0x7fa708182a50 2024-02-21T07:42:08.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.481+0000 7fa70ca00640 1 -- 172.21.15.69:0/2225879477 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7080f3690 con 0x7fa708182a50 2024-02-21T07:42:08.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.483+0000 7fa6fe000640 1 -- 172.21.15.69:0/2225879477 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+11269 (secure 0 0 0) 0x7fa6f80b8810 con 0x7fa708182a50 2024-02-21T07:42:08.489 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:08.489 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4318,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4334,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4345,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4363,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4375,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:07.472679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-21T07:42:08.489 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 7 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 -- 172.21.15.69:0/2225879477 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa6e809f0a0 msgr2=0x7fa6e80a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa6e809f0a0 0x7fa6e80a1560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa7080cba70 tx=0x7fa6f4007e40 comp rx=0 tx=0).stop 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 -- 172.21.15.69:0/2225879477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa708182a50 msgr2=0x7fa7080f1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa708182a50 0x7fa7080f1fb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8000c00 tx=0x7fa6f80046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 -- 172.21.15.69:0/2225879477 shutdown_connections 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa6e809f0a0 0x7fa6e80a1560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa70818c3f0 0x7fa708168bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa708186820 0x7fa708168680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 --2- 172.21.15.69:0/2225879477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa708182a50 0x7fa7080f1fb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 -- 172.21.15.69:0/2225879477 >> 172.21.15.69:0/2225879477 conn(0x7fa7080cf3b0 msgr2=0x7fa708189ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 -- 172.21.15.69:0/2225879477 shutdown_connections 2024-02-21T07:42:08.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.486+0000 7fa70ca00640 1 -- 172.21.15.69:0/2225879477 wait complete. 2024-02-21T07:42:08.508 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.702+0000 7f89cbe00640 1 Processor -- start 2024-02-21T07:42:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.702+0000 7f89cbe00640 1 -- start start 2024-02-21T07:42:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.704+0000 7f89cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f89cc185cd0 0x7f89cc188e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.704+0000 7f89cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f89cc18a2e0 0x7f89cc0f5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.704+0000 7f89cbe00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc18b770 con 0x7f89cc1860b0 2024-02-21T07:42:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.704+0000 7f89cbe00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc18a880 con 0x7f89cc185cd0 2024-02-21T07:42:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.704+0000 7f89cbe00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc18ab60 con 0x7f89cc18a2e0 2024-02-21T07:42:08.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.704+0000 7f89caa00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f89cc185cd0 0x7f89cc188e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.704+0000 7f89cb400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f89cc18a2e0 0x7f89cc0f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.704+0000 7f89caa00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f89cc185cd0 0x7f89cc188e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:32932/0 (socket says 172.21.15.69:32932) 2024-02-21T07:42:08.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.704+0000 7f89caa00640 1 -- 172.21.15.69:0/1296317206 learned_addr learned my addr 172.21.15.69:0/1296317206 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:08.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.705+0000 7f89caa00640 1 -- 172.21.15.69:0/1296317206 >> v2:172.21.15.184:3300/0 conn(0x7f89cc18a2e0 msgr2=0x7f89cc0f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:08.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.705+0000 7f89caa00640 1 --2- 172.21.15.69:0/1296317206 >> v2:172.21.15.184:3300/0 conn(0x7f89cc18a2e0 0x7f89cc0f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.705+0000 7f89caa00640 1 -- 172.21.15.69:0/1296317206 >> v1:172.21.15.184:6789/0 conn(0x7f89cc1860b0 legacy=0x7f89cc189bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.705+0000 7f89caa00640 1 -- 172.21.15.69:0/1296317206 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc18ae40 con 0x7f89cc185cd0 2024-02-21T07:42:08.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.706+0000 7f89caa00640 1 --2- 172.21.15.69:0/1296317206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89cc185cd0 0x7f89cc188e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0d39e0 tx=0x7f89bc02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5407c31e4354a28 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:08.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.706+0000 7f89c9600640 1 -- 172.21.15.69:0/1296317206 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0317e0 con 0x7f89cc185cd0 2024-02-21T07:42:08.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.706+0000 7f89c9600640 1 -- 172.21.15.69:0/1296317206 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc031940 con 0x7f89cc185cd0 2024-02-21T07:42:08.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.706+0000 7f89c9600640 1 -- 172.21.15.69:0/1296317206 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc031cd0 con 0x7f89cc185cd0 2024-02-21T07:42:08.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.707+0000 7f89cbe00640 1 -- 172.21.15.69:0/1296317206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89cc185cd0 msgr2=0x7f89cc188e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.707+0000 7f89cbe00640 1 --2- 172.21.15.69:0/1296317206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89cc185cd0 0x7f89cc188e00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0d39e0 tx=0x7f89bc02b880 comp rx=0 tx=0).stop 2024-02-21T07:42:08.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.707+0000 7f89cbe00640 1 -- 172.21.15.69:0/1296317206 shutdown_connections 2024-02-21T07:42:08.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.707+0000 7f89cbe00640 1 --2- 172.21.15.69:0/1296317206 >> v2:172.21.15.184:3300/0 conn(0x7f89cc18a2e0 0x7f89cc0f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.707+0000 7f89cbe00640 1 --2- 172.21.15.69:0/1296317206 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89cc185cd0 0x7f89cc188e00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.707+0000 7f89cbe00640 1 -- 172.21.15.69:0/1296317206 >> 172.21.15.69:0/1296317206 conn(0x7f89cc0cf360 msgr2=0x7f89cc0cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:08.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.707+0000 7f89cbe00640 1 -- 172.21.15.69:0/1296317206 shutdown_connections 2024-02-21T07:42:08.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.707+0000 7f89cbe00640 1 -- 172.21.15.69:0/1296317206 wait complete. 2024-02-21T07:42:08.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.709+0000 7f89cbe00640 1 Processor -- start 2024-02-21T07:42:08.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.709+0000 7f89cbe00640 1 -- start start 2024-02-21T07:42:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.710+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc185cd0 0x7f89cc2224a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.710+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89cc1860b0 0x7f89cc2229e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.710+0000 7f89cbe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89cc18a2e0 0x7f89cc172dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.710+0000 7f89cbe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc221c20 con 0x7f89cc185cd0 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.710+0000 7f89cbe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc21ca00 con 0x7f89cc1860b0 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.710+0000 7f89cbe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc2210a0 con 0x7f89cc18a2e0 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.710+0000 7f89caa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc185cd0 0x7f89cc2224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.710+0000 7f89caa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc185cd0 0x7f89cc2224a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51682/0 (socket says 172.21.15.69:51682) 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.710+0000 7f89caa00640 1 -- 172.21.15.69:0/252790269 learned_addr learned my addr 172.21.15.69:0/252790269 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.710+0000 7f89ca000640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89cc1860b0 0x7f89cc2229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89cb400640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89cc18a2e0 0x7f89cc172dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89caa00640 1 -- 172.21.15.69:0/252790269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89cc18a2e0 msgr2=0x7f89cc172dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89caa00640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89cc18a2e0 0x7f89cc172dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89caa00640 1 -- 172.21.15.69:0/252790269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89cc1860b0 msgr2=0x7f89cc2229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89caa00640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89cc1860b0 0x7f89cc2229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89caa00640 1 -- 172.21.15.69:0/252790269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc0094d0 con 0x7f89cc185cd0 2024-02-21T07:42:08.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89caa00640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc185cd0 0x7f89cc2224a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89bc02b8c0 tx=0x7f89bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:08.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89c2a00640 1 -- 172.21.15.69:0/252790269 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc032880 con 0x7f89cc185cd0 2024-02-21T07:42:08.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89c2a00640 1 -- 172.21.15.69:0/252790269 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc032a20 con 0x7f89cc185cd0 2024-02-21T07:42:08.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89cbe00640 1 -- 172.21.15.69:0/252790269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc221380 con 0x7f89cc185cd0 2024-02-21T07:42:08.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89c2a00640 1 -- 172.21.15.69:0/252790269 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc032dd0 con 0x7f89cc185cd0 2024-02-21T07:42:08.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.711+0000 7f89cbe00640 1 -- 172.21.15.69:0/252790269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc221940 con 0x7f89cc185cd0 2024-02-21T07:42:08.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.713+0000 7f89cbe00640 1 -- 172.21.15.69:0/252790269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc069c10 con 0x7f89cc185cd0 2024-02-21T07:42:08.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.714+0000 7f89c2a00640 1 -- 172.21.15.69:0/252790269 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f89bc0453f0 con 0x7f89cc185cd0 2024-02-21T07:42:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.716+0000 7f89c2a00640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f89ac09f0a0 0x7f89ac0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.717+0000 7f89c2a00640 1 -- 172.21.15.69:0/252790269 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f89bc0eba40 con 0x7f89cc185cd0 2024-02-21T07:42:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.717+0000 7f89ca000640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f89ac09f0a0 0x7f89ac0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:08.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.717+0000 7f89ca000640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f89ac09f0a0 0x7f89ac0a1560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f89cc17dcd0 tx=0x7f89b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:08.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.721+0000 7f89c2a00640 1 -- 172.21.15.69:0/252790269 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f89bc07f8c0 con 0x7f89cc185cd0 2024-02-21T07:42:08.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.900+0000 7f89cbe00640 1 -- 172.21.15.69:0/252790269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89cc0f9860 con 0x7f89cc185cd0 2024-02-21T07:42:08.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.902+0000 7f89c2a00640 1 -- 172.21.15.69:0/252790269 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7f89bc0b5970 con 0x7f89cc185cd0 2024-02-21T07:42:08.908 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:08.908 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:08.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.904+0000 7f89cbe00640 1 -- 172.21.15.69:0/252790269 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f89ac09f0a0 msgr2=0x7f89ac0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.904+0000 7f89cbe00640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f89ac09f0a0 0x7f89ac0a1560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f89cc17dcd0 tx=0x7f89b8009040 comp rx=0 tx=0).stop 2024-02-21T07:42:08.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.904+0000 7f89cbe00640 1 -- 172.21.15.69:0/252790269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc185cd0 msgr2=0x7f89cc2224a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:08.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.904+0000 7f89cbe00640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc185cd0 0x7f89cc2224a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f89bc02b8c0 tx=0x7f89bc0046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.904+0000 7f89cbe00640 1 -- 172.21.15.69:0/252790269 shutdown_connections 2024-02-21T07:42:08.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.904+0000 7f89cbe00640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f89ac09f0a0 0x7f89ac0a1560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.904+0000 7f89cbe00640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89cc18a2e0 0x7f89cc172dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.904+0000 7f89cbe00640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f89cc1860b0 0x7f89cc2229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.904+0000 7f89cbe00640 1 --2- 172.21.15.69:0/252790269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f89cc185cd0 0x7f89cc2224a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:08.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.904+0000 7f89cbe00640 1 -- 172.21.15.69:0/252790269 >> 172.21.15.69:0/252790269 conn(0x7f89cc0cf360 msgr2=0x7f89cc06e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:08.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.905+0000 7f89cbe00640 1 -- 172.21.15.69:0/252790269 shutdown_connections 2024-02-21T07:42:08.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:08.905+0000 7f89cbe00640 1 -- 172.21.15.69:0/252790269 wait complete. 2024-02-21T07:42:08.929 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:09.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.129+0000 7f3640a00640 1 Processor -- start 2024-02-21T07:42:09.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.129+0000 7f3640a00640 1 -- start start 2024-02-21T07:42:09.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.131+0000 7f3640a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f363c183fa0 0x7f363c0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.131+0000 7f3640a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f363c188980 0x7f363c186730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.131+0000 7f3640a00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363c0ce230 con 0x7f363c0f6310 2024-02-21T07:42:09.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.131+0000 7f3640a00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c06dcd0 con 0x7f363c183fa0 2024-02-21T07:42:09.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.131+0000 7f3640a00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c184380 con 0x7f363c188980 2024-02-21T07:42:09.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.131+0000 7f3639e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f363c183fa0 0x7f363c0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.131+0000 7f3639e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f363c183fa0 0x7f363c0cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40332/0 (socket says 172.21.15.69:40332) 2024-02-21T07:42:09.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.131+0000 7f3639e00640 1 -- 172.21.15.69:0/2295680572 learned_addr learned my addr 172.21.15.69:0/2295680572 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:09.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.131+0000 7f3631400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f363c0f6310 0x7f363c188270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45538/0 (socket says 172.21.15.69:45538) 2024-02-21T07:42:09.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.131+0000 7f363a800640 1 --2- 172.21.15.69:0/2295680572 >> v2:172.21.15.184:3300/0 conn(0x7f363c188980 0x7f363c186730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.132+0000 7f3639e00640 1 -- 172.21.15.69:0/2295680572 >> v2:172.21.15.184:3300/0 conn(0x7f363c188980 msgr2=0x7f363c186730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:09.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.132+0000 7f3639e00640 1 --2- 172.21.15.69:0/2295680572 >> v2:172.21.15.184:3300/0 conn(0x7f363c188980 0x7f363c186730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.132+0000 7f3639e00640 1 -- 172.21.15.69:0/2295680572 >> v1:172.21.15.69:6789/0 conn(0x7f363c0f6310 legacy=0x7f363c188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.132+0000 7f3639e00640 1 -- 172.21.15.69:0/2295680572 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c0cd6b0 con 0x7f363c183fa0 2024-02-21T07:42:09.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.133+0000 7f3639e00640 1 --2- 172.21.15.69:0/2295680572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c183fa0 0x7f363c0cd090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f363c0f4520 tx=0x7f362c02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b9f67e04e3ca8da server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:09.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.133+0000 7f3639400640 1 -- 172.21.15.69:0/2295680572 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c0317e0 con 0x7f363c183fa0 2024-02-21T07:42:09.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.133+0000 7f3639400640 1 -- 172.21.15.69:0/2295680572 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362c031940 con 0x7f363c183fa0 2024-02-21T07:42:09.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.133+0000 7f3639400640 1 -- 172.21.15.69:0/2295680572 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362c031cd0 con 0x7f363c183fa0 2024-02-21T07:42:09.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.134+0000 7f3640a00640 1 -- 172.21.15.69:0/2295680572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c183fa0 msgr2=0x7f363c0cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.134+0000 7f3640a00640 1 --2- 172.21.15.69:0/2295680572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c183fa0 0x7f363c0cd090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f363c0f4520 tx=0x7f362c02b880 comp rx=0 tx=0).stop 2024-02-21T07:42:09.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.134+0000 7f3640a00640 1 -- 172.21.15.69:0/2295680572 shutdown_connections 2024-02-21T07:42:09.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.134+0000 7f3640a00640 1 --2- 172.21.15.69:0/2295680572 >> v2:172.21.15.184:3300/0 conn(0x7f363c188980 0x7f363c186730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.134+0000 7f3640a00640 1 --2- 172.21.15.69:0/2295680572 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c183fa0 0x7f363c0cd090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.134+0000 7f3640a00640 1 -- 172.21.15.69:0/2295680572 >> 172.21.15.69:0/2295680572 conn(0x7f363c0f69c0 msgr2=0x7f363c0f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:09.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.134+0000 7f3640a00640 1 -- 172.21.15.69:0/2295680572 shutdown_connections 2024-02-21T07:42:09.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.134+0000 7f3640a00640 1 -- 172.21.15.69:0/2295680572 wait complete. 2024-02-21T07:42:09.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.136+0000 7f3640a00640 1 Processor -- start 2024-02-21T07:42:09.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.136+0000 7f3640a00640 1 -- start start 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.137+0000 7f3640a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c0f6310 0x7f363c220900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.137+0000 7f3640a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f363c183fa0 0x7f363c179f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.137+0000 7f3640a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c188980 0x7f363c21a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.137+0000 7f3640a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c15cd30 con 0x7f363c183fa0 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.137+0000 7f3640a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c15d010 con 0x7f363c188980 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.137+0000 7f3640a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c15d2f0 con 0x7f363c0f6310 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.137+0000 7f3631400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f363c183fa0 0x7f363c179f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.138+0000 7f3631400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f363c183fa0 0x7f363c179f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42808/0 (socket says 172.21.15.69:42808) 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.138+0000 7f3631400640 1 -- 172.21.15.69:0/1279594832 learned_addr learned my addr 172.21.15.69:0/1279594832 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.138+0000 7f3639e00640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c0f6310 0x7f363c220900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.138+0000 7f363a800640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c188980 0x7f363c21a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.138+0000 7f3631400640 1 -- 172.21.15.69:0/1279594832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c0f6310 msgr2=0x7f363c220900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.138+0000 7f3631400640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c0f6310 0x7f363c220900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.138+0000 7f3631400640 1 -- 172.21.15.69:0/1279594832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c188980 msgr2=0x7f363c21a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.138+0000 7f3631400640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c188980 0x7f363c21a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.138+0000 7f3631400640 1 -- 172.21.15.69:0/1279594832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c0094d0 con 0x7f363c183fa0 2024-02-21T07:42:09.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.138+0000 7f3631400640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f363c183fa0 0x7f363c179f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f362400c730 tx=0x7f362400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:09.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.139+0000 7f3632a00640 1 -- 172.21.15.69:0/1279594832 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400ce40 con 0x7f363c183fa0 2024-02-21T07:42:09.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.139+0000 7f3632a00640 1 -- 172.21.15.69:0/1279594832 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362400a640 con 0x7f363c183fa0 2024-02-21T07:42:09.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.139+0000 7f3640a00640 1 -- 172.21.15.69:0/1279594832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c15d5d0 con 0x7f363c183fa0 2024-02-21T07:42:09.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.139+0000 7f3632a00640 1 -- 172.21.15.69:0/1279594832 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400a9d0 con 0x7f363c183fa0 2024-02-21T07:42:09.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.139+0000 7f3640a00640 1 -- 172.21.15.69:0/1279594832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c15db90 con 0x7f363c183fa0 2024-02-21T07:42:09.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.140+0000 7f3640a00640 1 -- 172.21.15.69:0/1279594832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c069d50 con 0x7f363c183fa0 2024-02-21T07:42:09.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.142+0000 7f3632a00640 1 -- 172.21.15.69:0/1279594832 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f362400ab30 con 0x7f363c183fa0 2024-02-21T07:42:09.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.143+0000 7f3632a00640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f361809f0a0 0x7f36180a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.143+0000 7f3632a00640 1 -- 172.21.15.69:0/1279594832 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f36240c9230 con 0x7f363c183fa0 2024-02-21T07:42:09.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.143+0000 7f3639e00640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f361809f0a0 0x7f36180a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.144+0000 7f3639e00640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f361809f0a0 0x7f36180a1560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f362c036000 tx=0x7f362c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:09.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.147+0000 7f3632a00640 1 -- 172.21.15.69:0/1279594832 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3624096c00 con 0x7f363c183fa0 2024-02-21T07:42:09.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.345+0000 7f3640a00640 1 -- 172.21.15.69:0/1279594832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f363c0d27e0 con 0x7f363c183fa0 2024-02-21T07:42:09.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.347+0000 7f3632a00640 1 -- 172.21.15.69:0/1279594832 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7f3624017090 con 0x7f363c183fa0 2024-02-21T07:42:09.353 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:09.353 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:09.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 -- 172.21.15.69:0/1279594832 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f361809f0a0 msgr2=0x7f36180a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f361809f0a0 0x7f36180a1560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f362c036000 tx=0x7f362c03d040 comp rx=0 tx=0).stop 2024-02-21T07:42:09.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 -- 172.21.15.69:0/1279594832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f363c183fa0 msgr2=0x7f363c179f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f363c183fa0 0x7f363c179f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f362400c730 tx=0x7f362400cbf0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 -- 172.21.15.69:0/1279594832 shutdown_connections 2024-02-21T07:42:09.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f361809f0a0 0x7f36180a1560 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f363c188980 0x7f363c21a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f363c183fa0 0x7f363c179f40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 --2- 172.21.15.69:0/1279594832 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f363c0f6310 0x7f363c220900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 -- 172.21.15.69:0/1279594832 >> 172.21.15.69:0/1279594832 conn(0x7f363c0f69c0 msgr2=0x7f363c0f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 -- 172.21.15.69:0/1279594832 shutdown_connections 2024-02-21T07:42:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.350+0000 7f3640a00640 1 -- 172.21.15.69:0/1279594832 wait complete. 2024-02-21T07:42:09.389 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:42:09.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.599+0000 7fde9c800640 1 Processor -- start 2024-02-21T07:42:09.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.599+0000 7fde9c800640 1 -- start start 2024-02-21T07:42:09.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.601+0000 7fde9c800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fde94183fa0 0x7fde940cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.601+0000 7fde9c800640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940ce230 con 0x7fde940f6310 2024-02-21T07:42:09.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.601+0000 7fde9c800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9406dcd0 con 0x7fde94188980 2024-02-21T07:42:09.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.601+0000 7fde9c800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde94184380 con 0x7fde94183fa0 2024-02-21T07:42:09.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.601+0000 7fde99400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fde940f6310 0x7fde94188270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45546/0 (socket says 172.21.15.69:45546) 2024-02-21T07:42:09.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.601+0000 7fde99400640 1 -- 172.21.15.69:0/2867279010 learned_addr learned my addr 172.21.15.69:0/2867279010 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:09.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.602+0000 7fde99e00640 1 --2- 172.21.15.69:0/2867279010 >> v2:172.21.15.184:3300/0 conn(0x7fde94183fa0 0x7fde940cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.602+0000 7fde98a00640 1 -- 172.21.15.69:0/2867279010 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337304819 0 0) 0x7fde940ce230 con 0x7fde940f6310 2024-02-21T07:42:09.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.602+0000 7fde98a00640 1 -- 172.21.15.69:0/2867279010 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde7c003520 con 0x7fde940f6310 2024-02-21T07:42:09.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.602+0000 7fde99e00640 1 -- 172.21.15.69:0/2867279010 >> v1:172.21.15.184:6789/0 conn(0x7fde94188980 legacy=0x7fde94186730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.602+0000 7fde98a00640 1 -- 172.21.15.69:0/2867279010 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679991647 0 0) 0x7fde9406dcd0 con 0x7fde94188980 2024-02-21T07:42:09.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.602+0000 7fde99e00640 1 -- 172.21.15.69:0/2867279010 >> v1:172.21.15.69:6789/0 conn(0x7fde940f6310 legacy=0x7fde94188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.602+0000 7fde99e00640 1 -- 172.21.15.69:0/2867279010 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940cd6b0 con 0x7fde94183fa0 2024-02-21T07:42:09.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.603+0000 7fde99e00640 1 --2- 172.21.15.69:0/2867279010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde94183fa0 0x7fde940cd090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fde880097a0 tx=0x7fde8802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f892e31104c79e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:09.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.603+0000 7fde98a00640 1 -- 172.21.15.69:0/2867279010 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8802e070 con 0x7fde94183fa0 2024-02-21T07:42:09.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.603+0000 7fde98a00640 1 -- 172.21.15.69:0/2867279010 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde880315a0 con 0x7fde94183fa0 2024-02-21T07:42:09.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.603+0000 7fde98a00640 1 -- 172.21.15.69:0/2867279010 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88031930 con 0x7fde94183fa0 2024-02-21T07:42:09.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.604+0000 7fde9c800640 1 -- 172.21.15.69:0/2867279010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde94183fa0 msgr2=0x7fde940cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.604+0000 7fde9c800640 1 --2- 172.21.15.69:0/2867279010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde94183fa0 0x7fde940cd090 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fde880097a0 tx=0x7fde8802b840 comp rx=0 tx=0).stop 2024-02-21T07:42:09.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.604+0000 7fde9c800640 1 -- 172.21.15.69:0/2867279010 shutdown_connections 2024-02-21T07:42:09.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.604+0000 7fde9c800640 1 --2- 172.21.15.69:0/2867279010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde94183fa0 0x7fde940cd090 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.604+0000 7fde9c800640 1 -- 172.21.15.69:0/2867279010 >> 172.21.15.69:0/2867279010 conn(0x7fde940f69c0 msgr2=0x7fde940f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:09.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.604+0000 7fde9c800640 1 -- 172.21.15.69:0/2867279010 shutdown_connections 2024-02-21T07:42:09.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.604+0000 7fde9c800640 1 -- 172.21.15.69:0/2867279010 wait complete. 2024-02-21T07:42:09.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.607+0000 7fde9c800640 1 Processor -- start 2024-02-21T07:42:09.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.607+0000 7fde9c800640 1 -- start start 2024-02-21T07:42:09.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde9c800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde940f6310 0x7fde9415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde9c800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde94183fa0 0x7fde9415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde9c800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde94188980 0x7fde9415f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde9c800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9415c680 con 0x7fde94183fa0 2024-02-21T07:42:09.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde9c800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde941860e0 con 0x7fde940f6310 2024-02-21T07:42:09.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde9c800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde94185e00 con 0x7fde94188980 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde99400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde94183fa0 0x7fde9415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde99400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde94183fa0 0x7fde9415eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42812/0 (socket says 172.21.15.69:42812) 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde99400640 1 -- 172.21.15.69:0/1423556719 learned_addr learned my addr 172.21.15.69:0/1423556719 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde9a800640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde94188980 0x7fde9415f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde99e00640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde940f6310 0x7fde9415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde99e00640 1 -- 172.21.15.69:0/1423556719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde94188980 msgr2=0x7fde9415f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde99e00640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde94188980 0x7fde9415f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde99e00640 1 -- 172.21.15.69:0/1423556719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde94183fa0 msgr2=0x7fde9415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde99e00640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde94183fa0 0x7fde9415eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde99e00640 1 -- 172.21.15.69:0/1423556719 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde88009400 con 0x7fde940f6310 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde9a800640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde94188980 0x7fde9415f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:09.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.609+0000 7fde99400640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde94183fa0 0x7fde9415eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:09.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.610+0000 7fde99e00640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde940f6310 0x7fde9415c140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fde88033000 tx=0x7fde880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:09.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.610+0000 7fde8e000640 1 -- 172.21.15.69:0/1423556719 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88004220 con 0x7fde940f6310 2024-02-21T07:42:09.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.610+0000 7fde8e000640 1 -- 172.21.15.69:0/1423556719 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde88031f00 con 0x7fde940f6310 2024-02-21T07:42:09.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.610+0000 7fde8e000640 1 -- 172.21.15.69:0/1423556719 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde88003610 con 0x7fde940f6310 2024-02-21T07:42:09.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.610+0000 7fde9c800640 1 -- 172.21.15.69:0/1423556719 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9415e230 con 0x7fde940f6310 2024-02-21T07:42:09.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.610+0000 7fde9c800640 1 -- 172.21.15.69:0/1423556719 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9415e7f0 con 0x7fde940f6310 2024-02-21T07:42:09.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.611+0000 7fde9c800640 1 -- 172.21.15.69:0/1423556719 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde94069d50 con 0x7fde940f6310 2024-02-21T07:42:09.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.614+0000 7fde8e000640 1 -- 172.21.15.69:0/1423556719 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fde88043070 con 0x7fde940f6310 2024-02-21T07:42:09.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.615+0000 7fde8e000640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7809f0d0 0x7fde780a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:09.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.616+0000 7fde8e000640 1 -- 172.21.15.69:0/1423556719 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fde880eb700 con 0x7fde940f6310 2024-02-21T07:42:09.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.616+0000 7fde99400640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7809f0d0 0x7fde780a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:09.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.616+0000 7fde99400640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7809f0d0 0x7fde780a1590 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde9421c030 tx=0x7fde84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:09.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.617+0000 7fde8e000640 1 -- 172.21.15.69:0/1423556719 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde880b54f0 con 0x7fde940f6310 2024-02-21T07:42:09.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.831+0000 7fde9c800640 1 -- 172.21.15.69:0/1423556719 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde940cce70 con 0x7fde940f6310 2024-02-21T07:42:09.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.832+0000 7fde8e000640 1 -- 172.21.15.69:0/1423556719 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+11269 (secure 0 0 0) 0x7fde880b8bb0 con 0x7fde940f6310 2024-02-21T07:42:09.838 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:09.838 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4318,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4321,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4334,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4345,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4360,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4363,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4375,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:07.472679+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4378},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-21T07:42:09.838 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 7 2024-02-21T07:42:09.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.834+0000 7fde9c800640 1 -- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7809f0d0 msgr2=0x7fde780a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.834+0000 7fde9c800640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7809f0d0 0x7fde780a1590 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde9421c030 tx=0x7fde84009040 comp rx=0 tx=0).stop 2024-02-21T07:42:09.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.834+0000 7fde9c800640 1 -- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde940f6310 msgr2=0x7fde9415c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:09.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.834+0000 7fde9c800640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde940f6310 0x7fde9415c140 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fde88033000 tx=0x7fde880046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.834+0000 7fde9c800640 1 -- 172.21.15.69:0/1423556719 shutdown_connections 2024-02-21T07:42:09.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.834+0000 7fde9c800640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7809f0d0 0x7fde780a1590 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.834+0000 7fde9c800640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde94188980 0x7fde9415f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.834+0000 7fde9c800640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde94183fa0 0x7fde9415eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.834+0000 7fde9c800640 1 --2- 172.21.15.69:0/1423556719 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde940f6310 0x7fde9415c140 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:09.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.834+0000 7fde9c800640 1 -- 172.21.15.69:0/1423556719 >> 172.21.15.69:0/1423556719 conn(0x7fde940f69c0 msgr2=0x7fde940f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:09.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.835+0000 7fde9c800640 1 -- 172.21.15.69:0/1423556719 shutdown_connections 2024-02-21T07:42:09.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:09.835+0000 7fde9c800640 1 -- 172.21.15.69:0/1423556719 wait complete. 2024-02-21T07:42:09.859 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:10.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.061+0000 7fda57600640 1 Processor -- start 2024-02-21T07:42:10.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.061+0000 7fda57600640 1 -- start start 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.063+0000 7fda57600640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fda5018aff0 0x7fda5006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.063+0000 7fda57600640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fda5006ef00 0x7fda5018b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.063+0000 7fda57600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fda5018b910 0x7fda5006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.063+0000 7fda57600640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5006f6c0 con 0x7fda5018b910 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.063+0000 7fda57600640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5006d5d0 con 0x7fda5006ef00 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.063+0000 7fda57600640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5006d8b0 con 0x7fda5018aff0 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.063+0000 7fda55600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fda5018b910 0x7fda5006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.063+0000 7fda55600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fda5018b910 0x7fda5006fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42816/0 (socket says 172.21.15.69:42816) 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.063+0000 7fda55600640 1 -- 172.21.15.69:0/3441900428 learned_addr learned my addr 172.21.15.69:0/3441900428 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.064+0000 7fda54c00640 1 --2- 172.21.15.69:0/3441900428 >> v2:172.21.15.184:3300/0 conn(0x7fda5018aff0 0x7fda5006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.064+0000 7fda4fe00640 1 --2- 172.21.15.69:0/3441900428 >> v2:172.21.15.174:3300/0 conn(0x7fda5006ef00 0x7fda5018b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.064+0000 7fda55600640 1 -- 172.21.15.69:0/3441900428 >> v2:172.21.15.184:3300/0 conn(0x7fda5018aff0 msgr2=0x7fda5006e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.064+0000 7fda55600640 1 --2- 172.21.15.69:0/3441900428 >> v2:172.21.15.184:3300/0 conn(0x7fda5018aff0 0x7fda5006e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.064+0000 7fda55600640 1 -- 172.21.15.69:0/3441900428 >> v2:172.21.15.174:3300/0 conn(0x7fda5006ef00 msgr2=0x7fda5018b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:10.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.064+0000 7fda55600640 1 --2- 172.21.15.69:0/3441900428 >> v2:172.21.15.174:3300/0 conn(0x7fda5006ef00 0x7fda5018b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.064+0000 7fda55600640 1 -- 172.21.15.69:0/3441900428 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5006db90 con 0x7fda5018b910 2024-02-21T07:42:10.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.065+0000 7fda55600640 1 --2- 172.21.15.69:0/3441900428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018b910 0x7fda5006fb10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda5008df30 tx=0x7fda4802be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1f1f18ebe929cd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:10.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.065+0000 7fda4f400640 1 -- 172.21.15.69:0/3441900428 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4802ca10 con 0x7fda5018b910 2024-02-21T07:42:10.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.065+0000 7fda4f400640 1 -- 172.21.15.69:0/3441900428 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4802cb70 con 0x7fda5018b910 2024-02-21T07:42:10.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.065+0000 7fda4f400640 1 -- 172.21.15.69:0/3441900428 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda480343f0 con 0x7fda5018b910 2024-02-21T07:42:10.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.066+0000 7fda57600640 1 -- 172.21.15.69:0/3441900428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018b910 msgr2=0x7fda5006fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:10.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.066+0000 7fda57600640 1 --2- 172.21.15.69:0/3441900428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018b910 0x7fda5006fb10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fda5008df30 tx=0x7fda4802be70 comp rx=0 tx=0).stop 2024-02-21T07:42:10.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.066+0000 7fda57600640 1 -- 172.21.15.69:0/3441900428 shutdown_connections 2024-02-21T07:42:10.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.066+0000 7fda57600640 1 --2- 172.21.15.69:0/3441900428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018b910 0x7fda5006fb10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.066+0000 7fda57600640 1 --2- 172.21.15.69:0/3441900428 >> v2:172.21.15.174:3300/0 conn(0x7fda5006ef00 0x7fda5018b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.066+0000 7fda57600640 1 --2- 172.21.15.69:0/3441900428 >> v2:172.21.15.184:3300/0 conn(0x7fda5018aff0 0x7fda5006e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.066+0000 7fda57600640 1 -- 172.21.15.69:0/3441900428 >> 172.21.15.69:0/3441900428 conn(0x7fda500f7200 msgr2=0x7fda500f7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:10.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.066+0000 7fda57600640 1 -- 172.21.15.69:0/3441900428 shutdown_connections 2024-02-21T07:42:10.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.066+0000 7fda57600640 1 -- 172.21.15.69:0/3441900428 wait complete. 2024-02-21T07:42:10.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.068+0000 7fda57600640 1 Processor -- start 2024-02-21T07:42:10.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.068+0000 7fda57600640 1 -- start start 2024-02-21T07:42:10.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda57600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5006ef00 0x7fda5016d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:10.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda57600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018aff0 0x7fda5016df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:10.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda57600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda5018b910 0x7fda5006ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:10.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda57600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5006c9e0 con 0x7fda5018aff0 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda57600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5006b740 con 0x7fda5006ef00 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda57600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5006ba20 con 0x7fda5018b910 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda4fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018aff0 0x7fda5016df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda4fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018aff0 0x7fda5016df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42818/0 (socket says 172.21.15.69:42818) 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda4fe00640 1 -- 172.21.15.69:0/1230348171 learned_addr learned my addr 172.21.15.69:0/1230348171 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda54c00640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5006ef00 0x7fda5016d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda55600640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda5018b910 0x7fda5006ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda54c00640 1 -- 172.21.15.69:0/1230348171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda5018b910 msgr2=0x7fda5006ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda54c00640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda5018b910 0x7fda5006ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda54c00640 1 -- 172.21.15.69:0/1230348171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018aff0 msgr2=0x7fda5016df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda54c00640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018aff0 0x7fda5016df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda54c00640 1 -- 172.21.15.69:0/1230348171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48009b30 con 0x7fda5006ef00 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.070+0000 7fda4fe00640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018aff0 0x7fda5016df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:10.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.071+0000 7fda54c00640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5006ef00 0x7fda5016d9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fda4400e870 tx=0x7fda4400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:10.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.071+0000 7fda4cc00640 1 -- 172.21.15.69:0/1230348171 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4400ee60 con 0x7fda5006ef00 2024-02-21T07:42:10.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.071+0000 7fda4cc00640 1 -- 172.21.15.69:0/1230348171 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4400c940 con 0x7fda5006ef00 2024-02-21T07:42:10.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.071+0000 7fda4cc00640 1 -- 172.21.15.69:0/1230348171 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4400ccd0 con 0x7fda5006ef00 2024-02-21T07:42:10.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.071+0000 7fda57600640 1 -- 172.21.15.69:0/1230348171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5021fdc0 con 0x7fda5006ef00 2024-02-21T07:42:10.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.071+0000 7fda57600640 1 -- 172.21.15.69:0/1230348171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda50220380 con 0x7fda5006ef00 2024-02-21T07:42:10.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.072+0000 7fda57600640 1 -- 172.21.15.69:0/1230348171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda50069d50 con 0x7fda5006ef00 2024-02-21T07:42:10.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.074+0000 7fda4cc00640 1 -- 172.21.15.69:0/1230348171 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fda44005990 con 0x7fda5006ef00 2024-02-21T07:42:10.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.075+0000 7fda4cc00640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fda3009f0a0 0x7fda300a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:10.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.076+0000 7fda4cc00640 1 -- 172.21.15.69:0/1230348171 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fda440c9c90 con 0x7fda5006ef00 2024-02-21T07:42:10.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.076+0000 7fda4fe00640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fda3009f0a0 0x7fda300a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:10.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.076+0000 7fda4fe00640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fda3009f0a0 0x7fda300a1560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fda500cead0 tx=0x7fda3c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:10.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.077+0000 7fda4cc00640 1 -- 172.21.15.69:0/1230348171 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fda44093aa0 con 0x7fda5006ef00 2024-02-21T07:42:10.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.258+0000 7fda57600640 1 -- 172.21.15.69:0/1230348171 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda5006f370 con 0x7fda5006ef00 2024-02-21T07:42:10.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.260+0000 7fda4cc00640 1 -- 172.21.15.69:0/1230348171 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7fda4404dc10 con 0x7fda5006ef00 2024-02-21T07:42:10.266 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:10.266 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:10.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.262+0000 7fda57600640 1 -- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fda3009f0a0 msgr2=0x7fda300a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:10.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.262+0000 7fda57600640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fda3009f0a0 0x7fda300a1560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fda500cead0 tx=0x7fda3c009190 comp rx=0 tx=0).stop 2024-02-21T07:42:10.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.262+0000 7fda57600640 1 -- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5006ef00 msgr2=0x7fda5016d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:10.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.262+0000 7fda57600640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5006ef00 0x7fda5016d9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fda4400e870 tx=0x7fda4400ed30 comp rx=0 tx=0).stop 2024-02-21T07:42:10.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.262+0000 7fda57600640 1 -- 172.21.15.69:0/1230348171 shutdown_connections 2024-02-21T07:42:10.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.262+0000 7fda57600640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fda3009f0a0 0x7fda300a1560 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.262+0000 7fda57600640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda5018b910 0x7fda5006ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.262+0000 7fda57600640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda5018aff0 0x7fda5016df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.262+0000 7fda57600640 1 --2- 172.21.15.69:0/1230348171 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fda5006ef00 0x7fda5016d9d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:10.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.262+0000 7fda57600640 1 -- 172.21.15.69:0/1230348171 >> 172.21.15.69:0/1230348171 conn(0x7fda500f7200 msgr2=0x7fda50189460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:10.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.263+0000 7fda57600640 1 -- 172.21.15.69:0/1230348171 shutdown_connections 2024-02-21T07:42:10.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:10.263+0000 7fda57600640 1 -- 172.21.15.69:0/1230348171 wait complete. 2024-02-21T07:42:11.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-21T07:42:02.396796+0000', 'modified': '2024-02-21T07:42:07.472679+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4378}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4378': {'gid': 4378, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.69:6839/3963425058', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6838', 'nonce': 3963425058}, {'type': 'v1', 'addr': '172.21.15.69:6839', 'nonce': 3963425058}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-02-21T07:42:11.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-21T07:42:11.495 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-02-21T07:42:11.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.709+0000 7f61c4a00640 1 Processor -- start 2024-02-21T07:42:11.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.709+0000 7f61c4a00640 1 -- start start 2024-02-21T07:42:11.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61c4a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f61c0183fa0 0x7f61c00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61c4a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f61c00f6310 0x7f61c0188270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61c4a00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c0187740 con 0x7f61c01887b0 2024-02-21T07:42:11.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61c4a00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c00ce230 con 0x7f61c0183fa0 2024-02-21T07:42:11.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61c4a00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c006dcd0 con 0x7f61c00f6310 2024-02-21T07:42:11.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61bde00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f61c0183fa0 0x7f61c00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61bde00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f61c0183fa0 0x7f61c00cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42832/0 (socket says 172.21.15.69:42832) 2024-02-21T07:42:11.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61bde00640 1 -- 172.21.15.69:0/893143730 learned_addr learned my addr 172.21.15.69:0/893143730 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:11.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61b7e00640 1 --2- 172.21.15.69:0/893143730 >> v2:172.21.15.174:3300/0 conn(0x7f61c00f6310 0x7f61c0188270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61bde00640 1 -- 172.21.15.69:0/893143730 >> v2:172.21.15.174:3300/0 conn(0x7f61c00f6310 msgr2=0x7f61c0188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:11.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61bde00640 1 --2- 172.21.15.69:0/893143730 >> v2:172.21.15.174:3300/0 conn(0x7f61c00f6310 0x7f61c0188270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.711+0000 7f61bde00640 1 -- 172.21.15.69:0/893143730 >> v1:172.21.15.174:6789/0 conn(0x7f61c01887b0 legacy=0x7f61c0189d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.712+0000 7f61bde00640 1 -- 172.21.15.69:0/893143730 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c0184380 con 0x7f61c0183fa0 2024-02-21T07:42:11.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.712+0000 7f61b7e00640 1 --2- 172.21.15.69:0/893143730 >> v2:172.21.15.174:3300/0 conn(0x7f61c00f6310 0x7f61c0188270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:11.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.713+0000 7f61bde00640 1 --2- 172.21.15.69:0/893143730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61c0183fa0 0x7f61c00cd090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f61c0162ab0 tx=0x7f61b002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a99e203cf5cdd5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:11.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.713+0000 7f61bd400640 1 -- 172.21.15.69:0/893143730 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b00317e0 con 0x7f61c0183fa0 2024-02-21T07:42:11.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.713+0000 7f61bd400640 1 -- 172.21.15.69:0/893143730 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b0031940 con 0x7f61c0183fa0 2024-02-21T07:42:11.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.713+0000 7f61bd400640 1 -- 172.21.15.69:0/893143730 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0031cd0 con 0x7f61c0183fa0 2024-02-21T07:42:11.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.713+0000 7f61c4a00640 1 -- 172.21.15.69:0/893143730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61c0183fa0 msgr2=0x7f61c00cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.713+0000 7f61c4a00640 1 --2- 172.21.15.69:0/893143730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61c0183fa0 0x7f61c00cd090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f61c0162ab0 tx=0x7f61b002b880 comp rx=0 tx=0).stop 2024-02-21T07:42:11.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.714+0000 7f61c4a00640 1 -- 172.21.15.69:0/893143730 shutdown_connections 2024-02-21T07:42:11.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.714+0000 7f61c4a00640 1 --2- 172.21.15.69:0/893143730 >> v2:172.21.15.174:3300/0 conn(0x7f61c00f6310 0x7f61c0188270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.714+0000 7f61c4a00640 1 --2- 172.21.15.69:0/893143730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61c0183fa0 0x7f61c00cd090 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.714+0000 7f61c4a00640 1 -- 172.21.15.69:0/893143730 >> 172.21.15.69:0/893143730 conn(0x7f61c00f69c0 msgr2=0x7f61c00f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:11.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.714+0000 7f61c4a00640 1 -- 172.21.15.69:0/893143730 shutdown_connections 2024-02-21T07:42:11.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.714+0000 7f61c4a00640 1 -- 172.21.15.69:0/893143730 wait complete. 2024-02-21T07:42:11.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.716+0000 7f61c4a00640 1 Processor -- start 2024-02-21T07:42:11.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.716+0000 7f61c4a00640 1 -- start start 2024-02-21T07:42:11.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61c4a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61c00f6310 0x7f61c0179540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61c4a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c0183fa0 0x7f61c00cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61c4a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61c01887b0 0x7f61c016ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61c4a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0220010 con 0x7f61c01887b0 2024-02-21T07:42:11.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61c4a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0179a80 con 0x7f61c0183fa0 2024-02-21T07:42:11.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61c4a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00ce4b0 con 0x7f61c00f6310 2024-02-21T07:42:11.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61b7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c0183fa0 0x7f61c00cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61be800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61c01887b0 0x7f61c016ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61b7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c0183fa0 0x7f61c00cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40390/0 (socket says 172.21.15.69:40390) 2024-02-21T07:42:11.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61b7e00640 1 -- 172.21.15.69:0/1542164453 learned_addr learned my addr 172.21.15.69:0/1542164453 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:11.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.717+0000 7f61bde00640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61c00f6310 0x7f61c0179540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61be800640 1 -- 172.21.15.69:0/1542164453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61c00f6310 msgr2=0x7f61c0179540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61be800640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61c00f6310 0x7f61c0179540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61be800640 1 -- 172.21.15.69:0/1542164453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c0183fa0 msgr2=0x7f61c00cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61be800640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c0183fa0 0x7f61c00cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61be800640 1 -- 172.21.15.69:0/1542164453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b00094d0 con 0x7f61c01887b0 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61b7e00640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c0183fa0 0x7f61c00cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61be800640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61c01887b0 0x7f61c016ceb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c730 tx=0x7f61b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61b6000640 1 -- 172.21.15.69:0/1542164453 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8003b70 con 0x7f61c01887b0 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61b6000640 1 -- 172.21.15.69:0/1542164453 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8003cd0 con 0x7f61c01887b0 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61c4a00640 1 -- 172.21.15.69:0/1542164453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c00ce720 con 0x7f61c01887b0 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61b6000640 1 -- 172.21.15.69:0/1542164453 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8005310 con 0x7f61c01887b0 2024-02-21T07:42:11.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.718+0000 7f61c4a00640 1 -- 172.21.15.69:0/1542164453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c00cece0 con 0x7f61c01887b0 2024-02-21T07:42:11.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.721+0000 7f61b6000640 1 -- 172.21.15.69:0/1542164453 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f61b8005680 con 0x7f61c01887b0 2024-02-21T07:42:11.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.722+0000 7f61c77bb740 1 Processor -- start 2024-02-21T07:42:11.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.723+0000 7f61c77bb740 1 -- start start 2024-02-21T07:42:11.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.723+0000 7f61b6000640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f619c09f0a0 0x7f619c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.723+0000 7f61b6000640 1 -- 172.21.15.69:0/1542164453 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f61b80c9a00 con 0x7f61c01887b0 2024-02-21T07:42:11.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.723+0000 7f61b7e00640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f619c09f0a0 0x7f619c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61b7e00640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f619c09f0a0 0x7f619c0a1560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f61c006bca0 tx=0x7f61a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4e7e0 0x5650efc4ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc4f100 0x5650efc89970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc89eb0 0x5650efc8ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61c77bb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efb81b30 con 0x5650efc4f100 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61c77bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efb7f060 con 0x5650efc4e7e0 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61c77bb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efb7a840 con 0x5650efc89eb0 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61b7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc4f100 0x5650efc89970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61b7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc4f100 0x5650efc89970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42856/0 (socket says 172.21.15.69:42856) 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61b7e00640 1 -- 172.21.15.69:0/59454907 learned_addr learned my addr 172.21.15.69:0/59454907 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.724+0000 7f61bde00640 1 --2- 172.21.15.69:0/59454907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4e7e0 0x5650efc4ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.725+0000 7f61be800640 1 --2- 172.21.15.69:0/59454907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc89eb0 0x5650efc8ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.725+0000 7f61b7e00640 1 -- 172.21.15.69:0/59454907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc89eb0 msgr2=0x5650efc8ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.725+0000 7f61b7e00640 1 --2- 172.21.15.69:0/59454907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc89eb0 0x5650efc8ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.725+0000 7f61b7e00640 1 -- 172.21.15.69:0/59454907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4e7e0 msgr2=0x5650efc4ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:11.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.725+0000 7f61b7e00640 1 --2- 172.21.15.69:0/59454907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4e7e0 0x5650efc4ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.725+0000 7f61b7e00640 1 -- 172.21.15.69:0/59454907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650efb424c0 con 0x5650efc4f100 2024-02-21T07:42:11.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.725+0000 7f61bde00640 1 --2- 172.21.15.69:0/59454907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4e7e0 0x5650efc4ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:11.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.725+0000 7f61b7e00640 1 --2- 172.21.15.69:0/59454907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc4f100 0x5650efc89970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f61a8011010 tx=0x7f61a8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b1b5eb4d78dc09 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:11.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.725+0000 7f61ae600640 1 -- 172.21.15.69:0/59454907 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a8014640 con 0x5650efc4f100 2024-02-21T07:42:11.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61ae600640 1 -- 172.21.15.69:0/59454907 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a801a070 con 0x5650efc4f100 2024-02-21T07:42:11.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61ae600640 1 -- 172.21.15.69:0/59454907 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80149a0 con 0x5650efc4f100 2024-02-21T07:42:11.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61c77bb740 1 -- 172.21.15.69:0/59454907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc4f100 msgr2=0x5650efc89970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61c77bb740 1 --2- 172.21.15.69:0/59454907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc4f100 0x5650efc89970 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f61a8011010 tx=0x7f61a8013000 comp rx=0 tx=0).stop 2024-02-21T07:42:11.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61c77bb740 1 -- 172.21.15.69:0/59454907 shutdown_connections 2024-02-21T07:42:11.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61c77bb740 1 --2- 172.21.15.69:0/59454907 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc89eb0 0x5650efc8ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61c77bb740 1 --2- 172.21.15.69:0/59454907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc4f100 0x5650efc89970 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61c77bb740 1 --2- 172.21.15.69:0/59454907 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4e7e0 0x5650efc4ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61c77bb740 1 -- 172.21.15.69:0/59454907 >> 172.21.15.69:0/59454907 conn(0x5650efc10db0 msgr2=0x5650efc11e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:11.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61c77bb740 1 -- 172.21.15.69:0/59454907 shutdown_connections 2024-02-21T07:42:11.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.726+0000 7f61c77bb740 1 -- 172.21.15.69:0/59454907 wait complete. 2024-02-21T07:42:11.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.727+0000 7f61c77bb740 1 -- start start 2024-02-21T07:42:11.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.727+0000 7f61c77bb740 1 Processor -- start 2024-02-21T07:42:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4f100 0x5650efc446c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc89eb0 0x5650efc87c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc41390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61c77bb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efb1fea0 con 0x5650efc42b60 2024-02-21T07:42:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61c77bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efb1fb40 con 0x5650efc4f100 2024-02-21T07:42:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61c77bb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650ef8c2f20 con 0x5650efc89eb0 2024-02-21T07:42:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61c77bb740 10 client.0 _ll_register_callbacks cb 0x5650efb33950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61be800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc41390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61be800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc41390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42858/0 (socket says 172.21.15.69:42858) 2024-02-21T07:42:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61be800640 1 -- 172.21.15.69:0/771725828 learned_addr learned my addr 172.21.15.69:0/771725828 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61b7e00640 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc89eb0 0x5650efc87c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61bde00640 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4f100 0x5650efc446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61be800640 1 -- 172.21.15.69:0/771725828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc89eb0 msgr2=0x5650efc87c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61be800640 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc89eb0 0x5650efc87c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61be800640 1 -- 172.21.15.69:0/771725828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4f100 msgr2=0x5650efc446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61be800640 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4f100 0x5650efc446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.729+0000 7f61be800640 1 -- 172.21.15.69:0/771725828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a800e040 con 0x5650efc42b60 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.730+0000 7f61be800640 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc41390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61b80974e0 tx=0x7f61b8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d45e235b906d57 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.730+0000 7f61a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.730+0000 7f61a2a00640 1 -- 172.21.15.69:0/771725828 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b80af170 con 0x5650efc42b60 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.730+0000 7f61a2a00640 1 -- 172.21.15.69:0/771725828 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f61b8003e40 con 0x5650efc42b60 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.730+0000 7f61c77bb740 1 -- 172.21.15.69:0/771725828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650efb9ec40 con 0x5650efc42b60 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.730+0000 7f61a2a00640 1 -- 172.21.15.69:0/771725828 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61b809b6a0 con 0x5650efc42b60 2024-02-21T07:42:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.730+0000 7f61c77bb740 10 client.4335 fetch_fsmap learned FSMap version 7 2024-02-21T07:42:11.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.730+0000 7f61c77bb740 1 -- 172.21.15.69:0/771725828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5650efb78ec0 con 0x5650efc42b60 2024-02-21T07:42:11.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.730+0000 7f61a2a00640 1 -- 172.21.15.69:0/771725828 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5650efb9ec40 con 0x5650efc42b60 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.731+0000 7f61a2a00640 1 -- 172.21.15.69:0/771725828 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 7) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f61b8019020 con 0x5650efc42b60 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.731+0000 7f61c77bb740 10 client.4335 fetch_fsmap finished waiting for FSMap version 7 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.731+0000 7f61c77bb740 10 client.4335 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.731+0000 7f61c77bb740 20 client.4335 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.731+0000 7f61c77bb740 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5650efc0cfe0 0x5650efc458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.731+0000 7f61c77bb740 4 client.4335 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.731+0000 7f61c77bb740 1 -- 172.21.15.69:0/771725828 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650ef87a6c0 con 0x5650efc0cfe0 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.731+0000 7f61bde00640 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5650efc0cfe0 0x5650efc458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.731+0000 7f61bde00640 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5650efc0cfe0 0x5650efc458b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b8d645a713a01a2 server_cookie=9a110c2f422c3dcf in_seq=0 out_seq=0 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.731+0000 7f61a2a00640 10 client.4335 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.732+0000 7f61a2a00640 1 -- 172.21.15.69:0/771725828 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5650ef87a6c0 con 0x5650efc0cfe0 2024-02-21T07:42:11.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.732+0000 7f61a2a00640 10 client.4335 handle_command_reply: tid=0 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.732+0000 7f61c77bb740 1 client.4335 shutdown 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.732+0000 7f61c77bb740 1 -- 172.21.15.69:0/771725828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 msgr2=0x5650efc41390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.732+0000 7f61c77bb740 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc41390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f61b80974e0 tx=0x7f61b8001250 comp rx=0 tx=0).stop 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.733+0000 7f61c77bb740 1 -- 172.21.15.69:0/771725828 shutdown_connections 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.733+0000 7f61c77bb740 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5650efc0cfe0 0x5650efc458b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.733+0000 7f61c77bb740 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc41390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.733+0000 7f61c77bb740 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc89eb0 0x5650efc87c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.733+0000 7f61a2a00640 0 client.4335 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.733+0000 7f61c77bb740 1 --2- 172.21.15.69:0/771725828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc4f100 0x5650efc446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.733+0000 7f61c77bb740 1 -- 172.21.15.69:0/771725828 >> 172.21.15.69:0/771725828 conn(0x5650efc4e7e0 msgr2=0x5650efc12820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.733+0000 7f61c77bb740 1 -- 172.21.15.69:0/771725828 shutdown_connections 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.733+0000 7f61c77bb740 1 -- 172.21.15.69:0/771725828 wait complete. 2024-02-21T07:42:11.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.733+0000 7f61c77bb740 20 client.4335 trim_cache size 0 max 16384 2024-02-21T07:42:11.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.750+0000 7f61c77bb740 1 Processor -- start 2024-02-21T07:42:11.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.750+0000 7f61c77bb740 1 -- start start 2024-02-21T07:42:11.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.751+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc42b60 0x5650efc4ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.751+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 0x5650efc46a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.751+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc89eb0 0x5650efc88b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.751+0000 7f61c77bb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efc44de0 con 0x5650efc89eb0 2024-02-21T07:42:11.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.751+0000 7f61c77bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efc186d0 con 0x5650efc42b60 2024-02-21T07:42:11.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.751+0000 7f61c77bb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efc122c0 con 0x5650efc4f100 2024-02-21T07:42:11.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.751+0000 7f61be800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc89eb0 0x5650efc88b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.751+0000 7f61be800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc89eb0 0x5650efc88b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42866/0 (socket says 172.21.15.69:42866) 2024-02-21T07:42:11.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61be800640 1 -- 172.21.15.69:0/2339253093 learned_addr learned my addr 172.21.15.69:0/2339253093 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:11.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61bde00640 1 --2- 172.21.15.69:0/2339253093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc42b60 0x5650efc4ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61b7e00640 1 --2- 172.21.15.69:0/2339253093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 0x5650efc46a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61be800640 1 -- 172.21.15.69:0/2339253093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 msgr2=0x5650efc46a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61be800640 1 --2- 172.21.15.69:0/2339253093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 0x5650efc46a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61be800640 1 -- 172.21.15.69:0/2339253093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc42b60 msgr2=0x5650efc4ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61be800640 1 --2- 172.21.15.69:0/2339253093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc42b60 0x5650efc4ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61be800640 1 -- 172.21.15.69:0/2339253093 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650efb158b0 con 0x5650efc89eb0 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61b7e00640 1 --2- 172.21.15.69:0/2339253093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 0x5650efc46a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61be800640 1 --2- 172.21.15.69:0/2339253093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc89eb0 0x5650efc88b40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f61b80b6010 tx=0x7f61b801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363d40ce05dee07b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61adc00640 1 -- 172.21.15.69:0/2339253093 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8097090 con 0x5650efc89eb0 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61adc00640 1 -- 172.21.15.69:0/2339253093 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8093760 con 0x5650efc89eb0 2024-02-21T07:42:11.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.752+0000 7f61adc00640 1 -- 172.21.15.69:0/2339253093 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b80af170 con 0x5650efc89eb0 2024-02-21T07:42:11.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.753+0000 7f61c77bb740 1 -- 172.21.15.69:0/2339253093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc89eb0 msgr2=0x5650efc88b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.753+0000 7f61c77bb740 1 --2- 172.21.15.69:0/2339253093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc89eb0 0x5650efc88b40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f61b80b6010 tx=0x7f61b801c000 comp rx=0 tx=0).stop 2024-02-21T07:42:11.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.753+0000 7f61c77bb740 1 -- 172.21.15.69:0/2339253093 shutdown_connections 2024-02-21T07:42:11.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.753+0000 7f61c77bb740 1 --2- 172.21.15.69:0/2339253093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc89eb0 0x5650efc88b40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.753+0000 7f61c77bb740 1 --2- 172.21.15.69:0/2339253093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 0x5650efc46a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.753+0000 7f61c77bb740 1 --2- 172.21.15.69:0/2339253093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc42b60 0x5650efc4ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.753+0000 7f61c77bb740 1 -- 172.21.15.69:0/2339253093 >> 172.21.15.69:0/2339253093 conn(0x5650efc4e7e0 msgr2=0x5650efc12820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:11.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.753+0000 7f61c77bb740 1 -- 172.21.15.69:0/2339253093 shutdown_connections 2024-02-21T07:42:11.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.753+0000 7f61c77bb740 1 -- 172.21.15.69:0/2339253093 wait complete. 2024-02-21T07:42:11.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.754+0000 7f61c77bb740 1 -- start start 2024-02-21T07:42:11.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.754+0000 7f61c77bb740 1 Processor -- start 2024-02-21T07:42:11.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.755+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc35fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.755+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 0x5650efc85180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.755+0000 7f61c77bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc89eb0 0x5650efc3f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.755+0000 7f61c77bb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efc40f50 con 0x5650efc42b60 2024-02-21T07:42:11.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.755+0000 7f61c77bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efc85a10 con 0x5650efc89eb0 2024-02-21T07:42:11.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.755+0000 7f61c77bb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650efc52800 con 0x5650efc4f100 2024-02-21T07:42:11.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.755+0000 7f61c77bb740 10 client.0 _ll_register_callbacks cb 0x7f61b800c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61bde00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc35fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61bde00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc35fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42868/0 (socket says 172.21.15.69:42868) 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61bde00640 1 -- 172.21.15.69:0/1118371663 learned_addr learned my addr 172.21.15.69:0/1118371663 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61be800640 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc89eb0 0x5650efc3f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61b7e00640 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 0x5650efc85180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61bde00640 1 -- 172.21.15.69:0/1118371663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 msgr2=0x5650efc85180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61bde00640 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 0x5650efc85180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61bde00640 1 -- 172.21.15.69:0/1118371663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc89eb0 msgr2=0x5650efc3f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61bde00640 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc89eb0 0x5650efc3f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61bde00640 1 -- 172.21.15.69:0/1118371663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650efb78ec0 con 0x5650efc42b60 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61be800640 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc89eb0 0x5650efc3f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61bde00640 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc35fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f61b0034040 tx=0x7f61b002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78de4e5db25e8566 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61a2a00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:42:11.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61a2a00640 1 -- 172.21.15.69:0/1118371663 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b0004450 con 0x5650efc42b60 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61a2a00640 1 -- 172.21.15.69:0/1118371663 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f61b0040040 con 0x5650efc42b60 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.756+0000 7f61c77bb740 1 -- 172.21.15.69:0/1118371663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61a801a070 con 0x5650efc42b60 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61a2a00640 1 -- 172.21.15.69:0/1118371663 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61b0003610 con 0x5650efc42b60 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61c77bb740 10 client.4341 fetch_fsmap learned FSMap version 7 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61c77bb740 1 -- 172.21.15.69:0/1118371663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5650efb3b510 con 0x5650efc42b60 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61a2a00640 1 -- 172.21.15.69:0/1118371663 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a801a070 con 0x5650efc42b60 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61a2a00640 1 -- 172.21.15.69:0/1118371663 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 7) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f61b0003770 con 0x5650efc42b60 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61c77bb740 10 client.4341 fetch_fsmap finished waiting for FSMap version 7 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61c77bb740 10 client.4341 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61c77bb740 20 client.4341 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61c77bb740 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5650efc38e90 0x5650efc7e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61c77bb740 4 client.4341 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.757+0000 7f61c77bb740 1 -- 172.21.15.69:0/1118371663 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5650ef8cb270 con 0x5650efc38e90 2024-02-21T07:42:11.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.758+0000 7f61b7e00640 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5650efc38e90 0x5650efc7e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.758+0000 7f61b7e00640 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5650efc38e90 0x5650efc7e6e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c4a03b34d4c792 server_cookie=998478c8aa1c2e1e in_seq=0 out_seq=0 2024-02-21T07:42:11.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.758+0000 7f61a2a00640 10 client.4341 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:42:11.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.758+0000 7f61a2a00640 1 -- 172.21.15.69:0/1118371663 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5650ef8cb270 con 0x5650efc38e90 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.758+0000 7f61a2a00640 10 client.4341 handle_command_reply: tid=0 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.758+0000 7f61c77bb740 1 client.4341 shutdown 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.758+0000 7f61c77bb740 1 -- 172.21.15.69:0/1118371663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 msgr2=0x5650efc35fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.758+0000 7f61c77bb740 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc35fe0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f61b0034040 tx=0x7f61b002e000 comp rx=0 tx=0).stop 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.759+0000 7f61c77bb740 1 -- 172.21.15.69:0/1118371663 shutdown_connections 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.759+0000 7f61c77bb740 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5650efc38e90 0x5650efc7e6e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.759+0000 7f61c77bb740 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5650efc89eb0 0x5650efc3f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.759+0000 7f61c77bb740 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5650efc4f100 0x5650efc85180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.759+0000 7f61c77bb740 1 --2- 172.21.15.69:0/1118371663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5650efc42b60 0x5650efc35fe0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.759+0000 7f61c77bb740 1 -- 172.21.15.69:0/1118371663 >> 172.21.15.69:0/1118371663 conn(0x5650efc4e7e0 msgr2=0x5650efc0f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.759+0000 7f61a2a00640 0 client.4341 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.759+0000 7f61c77bb740 1 -- 172.21.15.69:0/1118371663 shutdown_connections 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.759+0000 7f61c77bb740 1 -- 172.21.15.69:0/1118371663 wait complete. 2024-02-21T07:42:11.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.759+0000 7f61c77bb740 20 client.4341 trim_cache size 0 max 16384 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "c8bdd735-83bd-400f-baca-e501b49b60ea", 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4378, 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 8.8020166520000007, 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 7, 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 29, 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 29, 2024-02-21T07:42:11.768 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 16.064754385000001 2024-02-21T07:42:11.769 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:42:11.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 -- 172.21.15.69:0/1542164453 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f619c09f0a0 msgr2=0x7f619c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f619c09f0a0 0x7f619c0a1560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f61c006bca0 tx=0x7f61a8008040 comp rx=0 tx=0).stop 2024-02-21T07:42:11.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 -- 172.21.15.69:0/1542164453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61c01887b0 msgr2=0x7f61c016ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61c01887b0 0x7f61c016ceb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c730 tx=0x7f61b800cbf0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 -- 172.21.15.69:0/1542164453 shutdown_connections 2024-02-21T07:42:11.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f619c09f0a0 0x7f619c0a1560 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61c01887b0 0x7f61c016ceb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61c0183fa0 0x7f61c00cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 --2- 172.21.15.69:0/1542164453 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61c00f6310 0x7f61c0179540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 -- 172.21.15.69:0/1542164453 >> 172.21.15.69:0/1542164453 conn(0x7f61c00f69c0 msgr2=0x7f61c00d1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:11.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 -- 172.21.15.69:0/1542164453 shutdown_connections 2024-02-21T07:42:11.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.760+0000 7f61c4a00640 1 -- 172.21.15.69:0/1542164453 wait complete. 2024-02-21T07:42:11.784 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-21T07:42:11.784 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:42:11.784 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T07:42:11.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.976+0000 7f5826400640 1 Processor -- start 2024-02-21T07:42:11.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.976+0000 7f5826400640 1 -- start start 2024-02-21T07:42:11.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.977+0000 7f5826400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f582017cfb0 0x7f582018a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f5826400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f58200f7fc0 0x7f58200f8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f5826400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5820184720 con 0x7f58200f8960 2024-02-21T07:42:11.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f5826400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5820184a00 con 0x7f58200f7fc0 2024-02-21T07:42:11.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f5826400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5820184ce0 con 0x7f582017cfb0 2024-02-21T07:42:11.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f581ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f58200f7fc0 0x7f58200f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f581ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f58200f7fc0 0x7f58200f8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40438/0 (socket says 172.21.15.69:40438) 2024-02-21T07:42:11.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f581ea00640 1 -- 172.21.15.69:0/1929819975 learned_addr learned my addr 172.21.15.69:0/1929819975 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:11.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f581f400640 1 --2- 172.21.15.69:0/1929819975 >> v2:172.21.15.184:3300/0 conn(0x7f582017cfb0 0x7f582018a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f581ea00640 1 -- 172.21.15.69:0/1929819975 >> v2:172.21.15.184:3300/0 conn(0x7f582017cfb0 msgr2=0x7f582018a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:11.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f581ea00640 1 --2- 172.21.15.69:0/1929819975 >> v2:172.21.15.184:3300/0 conn(0x7f582017cfb0 0x7f582018a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f581ea00640 1 -- 172.21.15.69:0/1929819975 >> v1:172.21.15.69:6789/0 conn(0x7f58200f8960 legacy=0x7f5820071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f581ea00640 1 -- 172.21.15.69:0/1929819975 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820184fc0 con 0x7f58200f7fc0 2024-02-21T07:42:11.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.978+0000 7f581e000640 1 -- 172.21.15.69:0/1929819975 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482665510 0 0) 0x7f5820184720 con 0x7f58200f8960 2024-02-21T07:42:11.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.980+0000 7f581ea00640 1 --2- 172.21.15.69:0/1929819975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58200f7fc0 0x7f58200f8420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58200fafb0 tx=0x7f580c02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c996f54285f8cf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:11.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.980+0000 7f581e000640 1 -- 172.21.15.69:0/1929819975 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c031870 con 0x7f58200f7fc0 2024-02-21T07:42:11.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.980+0000 7f581e000640 1 -- 172.21.15.69:0/1929819975 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c0319d0 con 0x7f58200f7fc0 2024-02-21T07:42:11.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.980+0000 7f581e000640 1 -- 172.21.15.69:0/1929819975 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c031d60 con 0x7f58200f7fc0 2024-02-21T07:42:11.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.980+0000 7f5826400640 1 -- 172.21.15.69:0/1929819975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58200f7fc0 msgr2=0x7f58200f8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.980+0000 7f5826400640 1 --2- 172.21.15.69:0/1929819975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58200f7fc0 0x7f58200f8420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58200fafb0 tx=0x7f580c02b910 comp rx=0 tx=0).stop 2024-02-21T07:42:11.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.981+0000 7f5826400640 1 -- 172.21.15.69:0/1929819975 shutdown_connections 2024-02-21T07:42:11.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.981+0000 7f5826400640 1 --2- 172.21.15.69:0/1929819975 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58200f7fc0 0x7f58200f8420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.981+0000 7f5826400640 1 --2- 172.21.15.69:0/1929819975 >> v2:172.21.15.184:3300/0 conn(0x7f582017cfb0 0x7f582018a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.981+0000 7f5826400640 1 -- 172.21.15.69:0/1929819975 >> 172.21.15.69:0/1929819975 conn(0x7f58200ce380 msgr2=0x7f58200ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:11.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.981+0000 7f5826400640 1 -- 172.21.15.69:0/1929819975 shutdown_connections 2024-02-21T07:42:11.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.981+0000 7f5826400640 1 -- 172.21.15.69:0/1929819975 wait complete. 2024-02-21T07:42:11.988 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:42:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.983+0000 7f5826400640 1 Processor -- start 2024-02-21T07:42:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.983+0000 7f5826400640 1 -- start start 2024-02-21T07:42:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f5826400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58200f7fc0 0x7f58200f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f5826400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58200f8960 0x7f58200f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f5826400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582017cfb0 0x7f582016cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f5826400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5820171410 con 0x7f582017cfb0 2024-02-21T07:42:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f5826400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582016d280 con 0x7f58200f8960 2024-02-21T07:42:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f5826400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58200f15a0 con 0x7f58200f7fc0 2024-02-21T07:42:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f581fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582017cfb0 0x7f582016cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f581fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582017cfb0 0x7f582016cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42874/0 (socket says 172.21.15.69:42874) 2024-02-21T07:42:11.992 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:42:11.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f581fe00640 1 -- 172.21.15.69:0/3600529980 learned_addr learned my addr 172.21.15.69:0/3600529980 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:11.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f581ea00640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58200f8960 0x7f58200f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.984+0000 7f581f400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58200f7fc0 0x7f58200f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f581fe00640 1 -- 172.21.15.69:0/3600529980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58200f7fc0 msgr2=0x7f58200f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f581fe00640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58200f7fc0 0x7f58200f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f581fe00640 1 -- 172.21.15.69:0/3600529980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58200f8960 msgr2=0x7f58200f2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f581fe00640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58200f8960 0x7f58200f2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f581fe00640 1 -- 172.21.15.69:0/3600529980 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c0094d0 con 0x7f582017cfb0 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f581f400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58200f7fc0 0x7f58200f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f581fe00640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582017cfb0 0x7f582016cd40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f581800c760 tx=0x7f581800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f5817400640 1 -- 172.21.15.69:0/3600529980 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818003da0 con 0x7f582017cfb0 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f5817400640 1 -- 172.21.15.69:0/3600529980 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581800ce70 con 0x7f582017cfb0 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f5817400640 1 -- 172.21.15.69:0/3600529980 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5818005290 con 0x7f582017cfb0 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f5826400640 1 -- 172.21.15.69:0/3600529980 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58200f1880 con 0x7f582017cfb0 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.985+0000 7f5826400640 1 -- 172.21.15.69:0/3600529980 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58200f1e40 con 0x7f582017cfb0 2024-02-21T07:42:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.987+0000 7f5826400640 1 -- 172.21.15.69:0/3600529980 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5820069cf0 con 0x7f582017cfb0 2024-02-21T07:42:11.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.988+0000 7f5817400640 1 -- 172.21.15.69:0/3600529980 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f58180053f0 con 0x7f582017cfb0 2024-02-21T07:42:11.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.989+0000 7f5817400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f580009f0a0 0x7f58000a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:11.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.990+0000 7f5817400640 1 -- 172.21.15.69:0/3600529980 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f58180c9a40 con 0x7f582017cfb0 2024-02-21T07:42:11.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.990+0000 7f581f400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f580009f0a0 0x7f58000a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:11.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.991+0000 7f581f400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f580009f0a0 0x7f58000a1560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f582021c2a0 tx=0x7f5810008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:11.997 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:42:12.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:11.995+0000 7f5817400640 1 -- 172.21.15.69:0/3600529980 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5818093800 con 0x7f582017cfb0 2024-02-21T07:42:12.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.231+0000 7f5826400640 1 -- 172.21.15.69:0/3600529980 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f58200cb200 con 0x7f582017cfb0 2024-02-21T07:42:12.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.232+0000 7f5817400640 1 -- 172.21.15.69:0/3600529980 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5818095730 con 0x7f582017cfb0 2024-02-21T07:42:12.238 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-21T07:42:12.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 -- 172.21.15.69:0/3600529980 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f580009f0a0 msgr2=0x7f58000a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:12.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f580009f0a0 0x7f58000a1560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f582021c2a0 tx=0x7f5810008040 comp rx=0 tx=0).stop 2024-02-21T07:42:12.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 -- 172.21.15.69:0/3600529980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582017cfb0 msgr2=0x7f582016cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:12.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582017cfb0 0x7f582016cd40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f581800c760 tx=0x7f581800cc20 comp rx=0 tx=0).stop 2024-02-21T07:42:12.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 -- 172.21.15.69:0/3600529980 shutdown_connections 2024-02-21T07:42:12.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f580009f0a0 0x7f58000a1560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:12.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f582017cfb0 0x7f582016cd40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:12.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f58200f8960 0x7f58200f2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:12.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 --2- 172.21.15.69:0/3600529980 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58200f7fc0 0x7f58200f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:12.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 -- 172.21.15.69:0/3600529980 >> 172.21.15.69:0/3600529980 conn(0x7f58200ce380 msgr2=0x7f58200708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:12.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 -- 172.21.15.69:0/3600529980 shutdown_connections 2024-02-21T07:42:12.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:12.235+0000 7f5826400640 1 -- 172.21.15.69:0/3600529980 wait complete. 2024-02-21T07:42:12.259 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-21T07:42:12.259 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T07:42:12.259 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2024-02-21T07:42:12.259 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-02-21T07:42:12.259 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:42:12.259 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-21T07:42:12.259 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-21T07:42:12.259 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T07:42:12.260 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-02-21T07:42:12.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:12.260 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2024-02-21T07:42:12.312 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T07:42:12.312 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T07:42:12.312 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T07:42:12.312 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:42:12.312 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2024-02-21T07:42:12.312 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:42:12.312 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:42:12.312 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:42:12.312 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2024-02-21T07:42:12.312 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:42:12.313 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:42:12.313 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2024-02-21T07:42:12.313 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:42:12.313 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:42:12.313 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T07:42:12.313 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:42:12.313 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T07:42:12.313 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42617sec preferred_lft 42617sec 2024-02-21T07:42:12.313 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link proto kernel_ll 2024-02-21T07:42:12.313 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:42:12.314 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-21T07:42:12.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:12.315 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2024-02-21T07:42:12.315 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-02-21T07:42:12.315 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add name ceph-brx type bridge 2024-02-21T07:42:12.315 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr flush dev ceph-brx 2024-02-21T07:42:12.315 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set ceph-brx up 2024-02-21T07:42:12.315 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-21T07:42:12.315 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-02-21T07:42:12.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:12.731 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T07:42:12.802 INFO:teuthology.orchestra.run.smithi069.stdout:1 2024-02-21T07:42:12.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:12.805 DEBUG:teuthology.orchestra.run.smithi069:> route 2024-02-21T07:42:12.870 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2024-02-21T07:42:12.871 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T07:42:12.871 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T07:42:12.871 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T07:42:12.871 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T07:42:12.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:12.872 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2024-02-21T07:42:12.872 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-02-21T07:42:12.872 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T07:42:12.872 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T07:42:12.872 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T07:42:12.872 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-02-21T07:42:13.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:13.605 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-02-21T07:42:13.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:13.647 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2024-02-21T07:42:13.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:13.736 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2024-02-21T07:42:13.736 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-02-21T07:42:13.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:42:13.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-02-21T07:42:13.736 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-02-21T07:42:13.861 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-02-21T07:42:13.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:13.862 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2024-02-21T07:42:13.862 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-02-21T07:42:13.862 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-02-21T07:42:13.862 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-21T07:42:13.862 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-02-21T07:42:13.862 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-02-21T07:42:13.862 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-02-21T07:42:13.862 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-02-21T07:42:14.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:14.126 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2024-02-21T07:42:14.126 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-02-21T07:42:14.126 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2024-02-21T07:42:14.126 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.0 master ceph-brx 2024-02-21T07:42:14.126 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-02-21T07:42:14.271 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-02-21T07:42:14.271 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T07:42:14.271 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:42:14.312 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-02-21T07:42:14.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T07:42:14.312 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:42:14.403 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2024-02-21T07:42:14.497 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2024-02-21T07:42:14.551 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/selinux 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2024-02-21T07:42:14.552 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysctl.service 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/nfs/rpc_pipefs 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-6 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-9 2024-02-21T07:42:14.553 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2024-02-21T07:42:14.554 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:42:14.554 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:42:14.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:14.555 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2024-02-21T07:42:14.601 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-21T07:42:14.601 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-02-21T07:42:14.606 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2024-02-21T07:42:14.674 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2024-02-21T07:42:14.711 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2024-02-21T07:42:14.712 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2024-02-21T07:42:14.712 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2024-02-21T07:42:14.712 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2024-02-21T07:42:14.712 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2024-02-21T07:42:14.712 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2024-02-21T07:42:14.712 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2024-02-21T07:42:14.712 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2024-02-21T07:42:14.712 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2024-02-21T07:42:14.712 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2024-02-21T07:42:14.712 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/selinux 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysctl.service 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/nfs/rpc_pipefs 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2024-02-21T07:42:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-6 2024-02-21T07:42:14.714 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-9 2024-02-21T07:42:14.714 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2024-02-21T07:42:14.714 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:42:14.714 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:42:14.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:14.715 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2024-02-21T07:42:14.783 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi069.stderr:2024-02-21T07:42:14.778+0000 7f9739635480 -1 init, newargv = 0x55a97806d380 newargc=15 2024-02-21T07:42:14.784 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi069.stderr:ceph-fuse[44639]: starting ceph client 2024-02-21T07:42:14.795 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi069.stderr:ceph-fuse[44639]: starting fuse 2024-02-21T07:42:14.798 INFO:teuthology.orchestra.run.smithi069.stdout:39 2024-02-21T07:42:14.799 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2024-02-21T07:42:14.799 DEBUG:teuthology.orchestra.run.smithi069:> sudo stdin-killer -- python3 -c ' 2024-02-21T07:42:14.799 DEBUG:teuthology.orchestra.run.smithi069:> import glob 2024-02-21T07:42:14.799 DEBUG:teuthology.orchestra.run.smithi069:> import re 2024-02-21T07:42:14.799 DEBUG:teuthology.orchestra.run.smithi069:> import os 2024-02-21T07:42:14.799 DEBUG:teuthology.orchestra.run.smithi069:> import subprocess 2024-02-21T07:42:14.799 DEBUG:teuthology.orchestra.run.smithi069:> 2024-02-21T07:42:14.799 DEBUG:teuthology.orchestra.run.smithi069:> def _find_admin_socket(client_name): 2024-02-21T07:42:14.799 DEBUG:teuthology.orchestra.run.smithi069:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-02-21T07:42:14.799 DEBUG:teuthology.orchestra.run.smithi069:> files = glob.glob(asok_path) 2024-02-21T07:42:14.799 DEBUG:teuthology.orchestra.run.smithi069:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> # Given a non-glob path, it better be there 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> if "*" not in asok_path: 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> assert(len(files) == 1) 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> return files[0] 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> for f in files: 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> contents = proc_f.read() 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> if mountpoint in contents: 2024-02-21T07:42:14.800 DEBUG:teuthology.orchestra.run.smithi069:> return f 2024-02-21T07:42:14.801 DEBUG:teuthology.orchestra.run.smithi069:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-21T07:42:14.801 DEBUG:teuthology.orchestra.run.smithi069:> 2024-02-21T07:42:14.801 DEBUG:teuthology.orchestra.run.smithi069:> print(_find_admin_socket("client.admin")) 2024-02-21T07:42:14.801 DEBUG:teuthology.orchestra.run.smithi069:> ' 2024-02-21T07:42:14.989 INFO:teuthology.orchestra.run.smithi069.stdout:/var/run/ceph/ceph-client.admin.44639.asok 2024-02-21T07:42:14.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-21T07:42:15.004 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44639.asok 2024-02-21T07:42:15.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:15.005 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44639.asok status 2024-02-21T07:42:15.234 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:42:15.234 INFO:teuthology.orchestra.run.smithi069.stdout: "metadata": { 2024-02-21T07:42:15.234 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_sha1": "25296a8f176256aea5ed8b5850b25167dce0ae33", 2024-02-21T07:42:15.234 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 19.0.0-1514-g25296a8f (25296a8f176256aea5ed8b5850b25167dce0ae33) squid (dev)", 2024-02-21T07:42:15.235 INFO:teuthology.orchestra.run.smithi069.stdout: "entity_id": "admin", 2024-02-21T07:42:15.235 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": "smithi069", 2024-02-21T07:42:15.235 INFO:teuthology.orchestra.run.smithi069.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-02-21T07:42:15.235 INFO:teuthology.orchestra.run.smithi069.stdout: "pid": "44639", 2024-02-21T07:42:15.235 INFO:teuthology.orchestra.run.smithi069.stdout: "root": "/" 2024-02-21T07:42:15.235 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:42:15.235 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_count": 0, 2024-02-21T07:42:15.235 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_pinned_count": 0, 2024-02-21T07:42:15.235 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4508, 2024-02-21T07:42:15.236 INFO:teuthology.orchestra.run.smithi069.stdout: "inst": { 2024-02-21T07:42:15.236 INFO:teuthology.orchestra.run.smithi069.stdout: "name": { 2024-02-21T07:42:15.236 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "client", 2024-02-21T07:42:15.236 INFO:teuthology.orchestra.run.smithi069.stdout: "num": 4508 2024-02-21T07:42:15.236 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:42:15.236 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2024-02-21T07:42:15.236 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2024-02-21T07:42:15.236 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-02-21T07:42:15.237 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 887806375 2024-02-21T07:42:15.237 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:42:15.237 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:42:15.237 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2024-02-21T07:42:15.237 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2024-02-21T07:42:15.237 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-02-21T07:42:15.237 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 887806375 2024-02-21T07:42:15.237 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:42:15.237 INFO:teuthology.orchestra.run.smithi069.stdout: "inst_str": "client.4508 172.21.15.69:0/887806375", 2024-02-21T07:42:15.238 INFO:teuthology.orchestra.run.smithi069.stdout: "addr_str": "172.21.15.69:0/887806375", 2024-02-21T07:42:15.238 INFO:teuthology.orchestra.run.smithi069.stdout: "inode_count": 1, 2024-02-21T07:42:15.238 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_epoch": 7, 2024-02-21T07:42:15.238 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch": 29, 2024-02-21T07:42:15.238 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch_barrier": 0, 2024-02-21T07:42:15.238 INFO:teuthology.orchestra.run.smithi069.stdout: "blocklisted": false, 2024-02-21T07:42:15.238 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs" 2024-02-21T07:42:15.238 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:42:15.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:15.248 DEBUG:teuthology.orchestra.run.smithi069:> stat --file-system '--printf=%T 2024-02-21T07:42:15.248 DEBUG:teuthology.orchestra.run.smithi069:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:42:15.301 INFO:teuthology.orchestra.run.smithi069.stdout:fuseblk 2024-02-21T07:42:15.301 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:42:15.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:15.301 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:42:15.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:15.389 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-02-21T07:42:15.471 INFO:teuthology.orchestra.run.smithi069.stdout:# file: . 2024-02-21T07:42:15.472 INFO:teuthology.orchestra.run.smithi069.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-02-21T07:42:15.472 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:15.473 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:42:15.473 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:42:15.525 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:15.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.724+0000 7f47a0c00640 1 Processor -- start 2024-02-21T07:42:15.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.724+0000 7f47a0c00640 1 -- start start 2024-02-21T07:42:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.726+0000 7f47a0c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f479c186230 0x7f479c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.726+0000 7f47a0c00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c06dcd0 con 0x7f479c183d30 2024-02-21T07:42:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.727+0000 7f47a0c00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0f5640 con 0x7f479c183000 2024-02-21T07:42:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.727+0000 7f47a0c00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c1833e0 con 0x7f479c186230 2024-02-21T07:42:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.727+0000 7f4791400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f479c183d30 0x7f479c185b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45566/0 (socket says 172.21.15.69:45566) 2024-02-21T07:42:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.727+0000 7f4791400640 1 -- 172.21.15.69:0/2683481686 learned_addr learned my addr 172.21.15.69:0/2683481686 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.727+0000 7f479a800640 1 --2- 172.21.15.69:0/2683481686 >> v2:172.21.15.184:3300/0 conn(0x7f479c186230 0x7f479c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.727+0000 7f4799400640 1 -- 172.21.15.69:0/2683481686 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960617226 0 0) 0x7f479c06dcd0 con 0x7f479c183d30 2024-02-21T07:42:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.727+0000 7f4799400640 1 -- 172.21.15.69:0/2683481686 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4780003520 con 0x7f479c183d30 2024-02-21T07:42:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.727+0000 7f479a800640 1 -- 172.21.15.69:0/2683481686 >> v1:172.21.15.184:6789/0 conn(0x7f479c183000 legacy=0x7f479c183620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.727+0000 7f479a800640 1 -- 172.21.15.69:0/2683481686 >> v1:172.21.15.69:6789/0 conn(0x7f479c183d30 legacy=0x7f479c185b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.727+0000 7f479a800640 1 -- 172.21.15.69:0/2683481686 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0d0750 con 0x7f479c186230 2024-02-21T07:42:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.728+0000 7f479a800640 1 --2- 172.21.15.69:0/2683481686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f479c186230 0x7f479c0cf790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4794009d90 tx=0x7f479402be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=423d61d10ecd83f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.729+0000 7f4799400640 1 -- 172.21.15.69:0/2683481686 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479402cbe0 con 0x7f479c186230 2024-02-21T07:42:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.729+0000 7f4799400640 1 -- 172.21.15.69:0/2683481686 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479402cd40 con 0x7f479c186230 2024-02-21T07:42:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.729+0000 7f4799400640 1 -- 172.21.15.69:0/2683481686 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794034660 con 0x7f479c186230 2024-02-21T07:42:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.729+0000 7f47a0c00640 1 -- 172.21.15.69:0/2683481686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f479c186230 msgr2=0x7f479c0cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.729+0000 7f47a0c00640 1 --2- 172.21.15.69:0/2683481686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f479c186230 0x7f479c0cf790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4794009d90 tx=0x7f479402be30 comp rx=0 tx=0).stop 2024-02-21T07:42:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.729+0000 7f47a0c00640 1 -- 172.21.15.69:0/2683481686 shutdown_connections 2024-02-21T07:42:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.729+0000 7f47a0c00640 1 --2- 172.21.15.69:0/2683481686 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f479c186230 0x7f479c0cf790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.729+0000 7f47a0c00640 1 -- 172.21.15.69:0/2683481686 >> 172.21.15.69:0/2683481686 conn(0x7f479c0f69c0 msgr2=0x7f479c0f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.730+0000 7f47a0c00640 1 -- 172.21.15.69:0/2683481686 shutdown_connections 2024-02-21T07:42:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.730+0000 7f47a0c00640 1 -- 172.21.15.69:0/2683481686 wait complete. 2024-02-21T07:42:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.732+0000 7f47a0c00640 1 Processor -- start 2024-02-21T07:42:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.732+0000 7f47a0c00640 1 -- start start 2024-02-21T07:42:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f47a0c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f479c183000 0x7f479c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f47a0c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f479c183d30 0x7f479c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f47a0c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f479c186230 0x7f479c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f47a0c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0f62a0 con 0x7f479c183d30 2024-02-21T07:42:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f47a0c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c21fe20 con 0x7f479c186230 2024-02-21T07:42:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f47a0c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c15e9e0 con 0x7f479c183000 2024-02-21T07:42:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f4791400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f479c183d30 0x7f479c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f4791400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f479c183d30 0x7f479c15d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42878/0 (socket says 172.21.15.69:42878) 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f4791400640 1 -- 172.21.15.69:0/3099442408 learned_addr learned my addr 172.21.15.69:0/3099442408 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f479a800640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f479c186230 0x7f479c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.733+0000 7f4799e00640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f479c183000 0x7f479c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f4791400640 1 -- 172.21.15.69:0/3099442408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f479c183000 msgr2=0x7f479c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f4791400640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f479c183000 0x7f479c15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f4791400640 1 -- 172.21.15.69:0/3099442408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f479c186230 msgr2=0x7f479c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f4791400640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f479c186230 0x7f479c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f4791400640 1 -- 172.21.15.69:0/3099442408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794009a70 con 0x7f479c183d30 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f4791400640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f479c183d30 0x7f479c15d4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f478400c430 tx=0x7f478400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f4792a00640 1 -- 172.21.15.69:0/3099442408 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784005ce0 con 0x7f479c183d30 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f4792a00640 1 -- 172.21.15.69:0/3099442408 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4784005e40 con 0x7f479c183d30 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f47a0c00640 1 -- 172.21.15.69:0/3099442408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c15ddd0 con 0x7f479c183d30 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f4792a00640 1 -- 172.21.15.69:0/3099442408 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840072f0 con 0x7f479c183d30 2024-02-21T07:42:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.734+0000 7f47a0c00640 1 -- 172.21.15.69:0/3099442408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c15e390 con 0x7f479c183d30 2024-02-21T07:42:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.735+0000 7f47a0c00640 1 -- 172.21.15.69:0/3099442408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c21ffb0 con 0x7f479c183d30 2024-02-21T07:42:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.737+0000 7f4792a00640 1 -- 172.21.15.69:0/3099442408 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4784007450 con 0x7f479c183d30 2024-02-21T07:42:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.740+0000 7f4792a00640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f477809f0a0 0x7f47780a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.740+0000 7f4792a00640 1 -- 172.21.15.69:0/3099442408 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f47840c9190 con 0x7f479c183d30 2024-02-21T07:42:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.740+0000 7f4799e00640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f477809f0a0 0x7f47780a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.741+0000 7f4799e00640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f477809f0a0 0x7f47780a1560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f478c007fd0 tx=0x7f478c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:15.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.745+0000 7f4792a00640 1 -- 172.21.15.69:0/3099442408 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4784096b10 con 0x7f479c183d30 2024-02-21T07:42:15.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.941+0000 7f47a0c00640 1 -- 172.21.15.69:0/3099442408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f479c069d50 con 0x7f479c183d30 2024-02-21T07:42:15.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.944+0000 7f4792a00640 1 -- 172.21.15.69:0/3099442408 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7f4784017090 con 0x7f479c183d30 2024-02-21T07:42:15.951 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.947+0000 7f47a0c00640 1 -- 172.21.15.69:0/3099442408 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f477809f0a0 msgr2=0x7f47780a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.947+0000 7f47a0c00640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f477809f0a0 0x7f47780a1560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f478c007fd0 tx=0x7f478c009040 comp rx=0 tx=0).stop 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.947+0000 7f47a0c00640 1 -- 172.21.15.69:0/3099442408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f479c183d30 msgr2=0x7f479c15d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.947+0000 7f47a0c00640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f479c183d30 0x7f479c15d4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f478400c430 tx=0x7f478400c8f0 comp rx=0 tx=0).stop 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.948+0000 7f47a0c00640 1 -- 172.21.15.69:0/3099442408 shutdown_connections 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.948+0000 7f47a0c00640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f477809f0a0 0x7f47780a1560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.948+0000 7f47a0c00640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f479c186230 0x7f479c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.948+0000 7f47a0c00640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f479c183d30 0x7f479c15d4f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.948+0000 7f47a0c00640 1 --2- 172.21.15.69:0/3099442408 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f479c183000 0x7f479c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.948+0000 7f47a0c00640 1 -- 172.21.15.69:0/3099442408 >> 172.21.15.69:0/3099442408 conn(0x7f479c0f69c0 msgr2=0x7f479c0f47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.948+0000 7f47a0c00640 1 -- 172.21.15.69:0/3099442408 shutdown_connections 2024-02-21T07:42:15.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:15.948+0000 7f47a0c00640 1 -- 172.21.15.69:0/3099442408 wait complete. 2024-02-21T07:42:15.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:41:56.520105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:42:00.759386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:42:01.409274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:42:05.025537+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:42:15.972 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:42:16.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.179+0000 7fa422800640 1 Processor -- start 2024-02-21T07:42:16.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.179+0000 7fa422800640 1 -- start start 2024-02-21T07:42:16.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.181+0000 7fa422800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa41c180690 0x7fa41c184570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.181+0000 7fa422800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa41c18a7c0 0x7fa41c0f1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.181+0000 7fa422800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c1863e0 con 0x7fa41c184ab0 2024-02-21T07:42:16.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.181+0000 7fa422800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c185060 con 0x7fa41c18a7c0 2024-02-21T07:42:16.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.181+0000 7fa422800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c185340 con 0x7fa41c180690 2024-02-21T07:42:16.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.182+0000 7fa421400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa41c180690 0x7fa41c184570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.182+0000 7fa420a00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fa41c184ab0 0x7fa41c18a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:50636/0 (socket says 172.21.15.69:50636) 2024-02-21T07:42:16.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.182+0000 7fa420a00640 1 -- 172.21.15.69:0/1840327394 learned_addr learned my addr 172.21.15.69:0/1840327394 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:16.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.182+0000 7fa421e00640 1 --2- 172.21.15.69:0/1840327394 >> v2:172.21.15.69:3300/0 conn(0x7fa41c18a7c0 0x7fa41c0f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.182+0000 7fa41be00640 1 -- 172.21.15.69:0/1840327394 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596780153 0 0) 0x7fa41c1863e0 con 0x7fa41c184ab0 2024-02-21T07:42:16.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.182+0000 7fa41be00640 1 -- 172.21.15.69:0/1840327394 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa404003520 con 0x7fa41c184ab0 2024-02-21T07:42:16.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.182+0000 7fa421400640 1 -- 172.21.15.69:0/1840327394 >> v2:172.21.15.69:3300/0 conn(0x7fa41c18a7c0 msgr2=0x7fa41c0f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:16.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.182+0000 7fa421400640 1 --2- 172.21.15.69:0/1840327394 >> v2:172.21.15.69:3300/0 conn(0x7fa41c18a7c0 0x7fa41c0f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.182+0000 7fa421400640 1 -- 172.21.15.69:0/1840327394 >> v1:172.21.15.184:6789/0 conn(0x7fa41c184ab0 legacy=0x7fa41c18a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.182+0000 7fa421400640 1 -- 172.21.15.69:0/1840327394 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c185620 con 0x7fa41c180690 2024-02-21T07:42:16.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.184+0000 7fa421400640 1 --2- 172.21.15.69:0/1840327394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa41c180690 0x7fa41c184570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa41c0cf2d0 tx=0x7fa41002b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbc213e7b64c98e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:16.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.184+0000 7fa41be00640 1 -- 172.21.15.69:0/1840327394 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410031710 con 0x7fa41c180690 2024-02-21T07:42:16.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.184+0000 7fa41be00640 1 -- 172.21.15.69:0/1840327394 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41002f050 con 0x7fa41c180690 2024-02-21T07:42:16.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.184+0000 7fa41be00640 1 -- 172.21.15.69:0/1840327394 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa410031a90 con 0x7fa41c180690 2024-02-21T07:42:16.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.185+0000 7fa422800640 1 -- 172.21.15.69:0/1840327394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa41c180690 msgr2=0x7fa41c184570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.185+0000 7fa422800640 1 --2- 172.21.15.69:0/1840327394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa41c180690 0x7fa41c184570 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa41c0cf2d0 tx=0x7fa41002b7b0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.185+0000 7fa422800640 1 -- 172.21.15.69:0/1840327394 shutdown_connections 2024-02-21T07:42:16.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.185+0000 7fa422800640 1 --2- 172.21.15.69:0/1840327394 >> v2:172.21.15.69:3300/0 conn(0x7fa41c18a7c0 0x7fa41c0f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.185+0000 7fa422800640 1 --2- 172.21.15.69:0/1840327394 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa41c180690 0x7fa41c184570 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.185+0000 7fa422800640 1 -- 172.21.15.69:0/1840327394 >> 172.21.15.69:0/1840327394 conn(0x7fa41c0ce1b0 msgr2=0x7fa41c0ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:16.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.185+0000 7fa422800640 1 -- 172.21.15.69:0/1840327394 shutdown_connections 2024-02-21T07:42:16.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.185+0000 7fa422800640 1 -- 172.21.15.69:0/1840327394 wait complete. 2024-02-21T07:42:16.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.187+0000 7fa422800640 1 Processor -- start 2024-02-21T07:42:16.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.187+0000 7fa422800640 1 -- start start 2024-02-21T07:42:16.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.188+0000 7fa422800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa41c180690 0x7fa41c168c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.188+0000 7fa422800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa41c184ab0 0x7fa41c06b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.188+0000 7fa422800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa41c18a7c0 0x7fa41c06beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.188+0000 7fa422800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0cc350 con 0x7fa41c18a7c0 2024-02-21T07:42:16.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.188+0000 7fa422800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0cdd70 con 0x7fa41c184ab0 2024-02-21T07:42:16.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.188+0000 7fa422800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0cce80 con 0x7fa41c180690 2024-02-21T07:42:16.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa421400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa41c180690 0x7fa41c168c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa421e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa41c18a7c0 0x7fa41c06beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa421400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa41c180690 0x7fa41c168c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:56220/0 (socket says 172.21.15.69:56220) 2024-02-21T07:42:16.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa421400640 1 -- 172.21.15.69:0/1952580940 learned_addr learned my addr 172.21.15.69:0/1952580940 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa420a00640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa41c184ab0 0x7fa41c06b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa421e00640 1 -- 172.21.15.69:0/1952580940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa41c180690 msgr2=0x7fa41c168c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa421e00640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa41c180690 0x7fa41c168c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa421e00640 1 -- 172.21.15.69:0/1952580940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa41c184ab0 msgr2=0x7fa41c06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa421e00640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa41c184ab0 0x7fa41c06b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa421e00640 1 -- 172.21.15.69:0/1952580940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410009400 con 0x7fa41c18a7c0 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.189+0000 7fa421e00640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa41c18a7c0 0x7fa41c06beb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa41400eba0 tx=0x7fa41400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.190+0000 7fa419600640 1 -- 172.21.15.69:0/1952580940 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41400cd20 con 0x7fa41c18a7c0 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.190+0000 7fa419600640 1 -- 172.21.15.69:0/1952580940 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41400f040 con 0x7fa41c18a7c0 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.190+0000 7fa419600640 1 -- 172.21.15.69:0/1952580940 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140146c0 con 0x7fa41c18a7c0 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.190+0000 7fa422800640 1 -- 172.21.15.69:0/1952580940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c0cd160 con 0x7fa41c18a7c0 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.190+0000 7fa422800640 1 -- 172.21.15.69:0/1952580940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c0cd720 con 0x7fa41c18a7c0 2024-02-21T07:42:16.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.191+0000 7fa422800640 1 -- 172.21.15.69:0/1952580940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c0cdf20 con 0x7fa41c18a7c0 2024-02-21T07:42:16.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.193+0000 7fa419600640 1 -- 172.21.15.69:0/1952580940 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa414014820 con 0x7fa41c18a7c0 2024-02-21T07:42:16.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.194+0000 7fa419600640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3fc09f0a0 0x7fa3fc0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.194+0000 7fa419600640 1 -- 172.21.15.69:0/1952580940 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa4140ca6b0 con 0x7fa41c18a7c0 2024-02-21T07:42:16.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.195+0000 7fa421400640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3fc09f0a0 0x7fa3fc0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.195+0000 7fa421400640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3fc09f0a0 0x7fa3fc0a1560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa41002b7f0 tx=0x7fa410008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:16.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.198+0000 7fa419600640 1 -- 172.21.15.69:0/1952580940 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa41c0cdf20 con 0x7fa41c18a7c0 2024-02-21T07:42:16.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.389+0000 7fa422800640 1 -- 172.21.15.69:0/1952580940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa41c0f57a0 con 0x7fa41c18a7c0 2024-02-21T07:42:16.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.390+0000 7fa419600640 1 -- 172.21.15.69:0/1952580940 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa414094500 con 0x7fa41c18a7c0 2024-02-21T07:42:16.396 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-02-21T07:42:16.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 -- 172.21.15.69:0/1952580940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3fc09f0a0 msgr2=0x7fa3fc0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3fc09f0a0 0x7fa3fc0a1560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa41002b7f0 tx=0x7fa410008030 comp rx=0 tx=0).stop 2024-02-21T07:42:16.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 -- 172.21.15.69:0/1952580940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa41c18a7c0 msgr2=0x7fa41c06beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa41c18a7c0 0x7fa41c06beb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa41400eba0 tx=0x7fa41400c490 comp rx=0 tx=0).stop 2024-02-21T07:42:16.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 -- 172.21.15.69:0/1952580940 shutdown_connections 2024-02-21T07:42:16.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3fc09f0a0 0x7fa3fc0a1560 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa41c18a7c0 0x7fa41c06beb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa41c184ab0 0x7fa41c06b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 --2- 172.21.15.69:0/1952580940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa41c180690 0x7fa41c168c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 -- 172.21.15.69:0/1952580940 >> 172.21.15.69:0/1952580940 conn(0x7fa41c0ce1b0 msgr2=0x7fa41c1840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:16.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 -- 172.21.15.69:0/1952580940 shutdown_connections 2024-02-21T07:42:16.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.392+0000 7fa422800640 1 -- 172.21.15.69:0/1952580940 wait complete. 2024-02-21T07:42:16.415 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:42:16.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.609+0000 7f7c87400640 1 Processor -- start 2024-02-21T07:42:16.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.609+0000 7f7c87400640 1 -- start start 2024-02-21T07:42:16.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c87400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7c8006fff0 0x7f7c800f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c87400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8006f160 con 0x7f7c80066ca0 2024-02-21T07:42:16.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c87400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c801869b0 con 0x7f7c801842b0 2024-02-21T07:42:16.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c87400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c8018adf0 con 0x7f7c8006fff0 2024-02-21T07:42:16.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c84a00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f7c801842b0 0x7f7c8006ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:50648/0 (socket says 172.21.15.69:50648) 2024-02-21T07:42:16.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c84a00640 1 -- 172.21.15.69:0/3965973574 learned_addr learned my addr 172.21.15.69:0/3965973574 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:16.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c85400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7c8006fff0 0x7f7c800f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c7f400640 1 -- 172.21.15.69:0/3965973574 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499749513 0 0) 0x7f7c801869b0 con 0x7f7c801842b0 2024-02-21T07:42:16.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c7f400640 1 -- 172.21.15.69:0/3965973574 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c68003520 con 0x7f7c801842b0 2024-02-21T07:42:16.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c85400640 1 -- 172.21.15.69:0/3965973574 >> v1:172.21.15.184:6789/0 conn(0x7f7c801842b0 legacy=0x7f7c8006ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c85400640 1 -- 172.21.15.69:0/3965973574 >> v1:172.21.15.174:6789/0 conn(0x7f7c80066ca0 legacy=0x7f7c8006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c7f400640 1 -- 172.21.15.69:0/3965973574 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905437740 0 0) 0x7f7c6c001110 con 0x7f7c80066ca0 2024-02-21T07:42:16.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.611+0000 7f7c85400640 1 -- 172.21.15.69:0/3965973574 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c80186c90 con 0x7f7c8006fff0 2024-02-21T07:42:16.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.612+0000 7f7c85400640 1 --2- 172.21.15.69:0/3965973574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c8006fff0 0x7f7c800f9810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009d90 tx=0x7f7c7802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd19e18f87eb04da server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:16.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.613+0000 7f7c7f400640 1 -- 172.21.15.69:0/3965973574 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7802cbd0 con 0x7f7c8006fff0 2024-02-21T07:42:16.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.613+0000 7f7c7f400640 1 -- 172.21.15.69:0/3965973574 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7802cd30 con 0x7f7c8006fff0 2024-02-21T07:42:16.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.613+0000 7f7c7f400640 1 -- 172.21.15.69:0/3965973574 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7802cea0 con 0x7f7c8006fff0 2024-02-21T07:42:16.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.613+0000 7f7c87400640 1 -- 172.21.15.69:0/3965973574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c8006fff0 msgr2=0x7f7c800f9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.613+0000 7f7c87400640 1 --2- 172.21.15.69:0/3965973574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c8006fff0 0x7f7c800f9810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7c78009d90 tx=0x7f7c7802be20 comp rx=0 tx=0).stop 2024-02-21T07:42:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.613+0000 7f7c87400640 1 -- 172.21.15.69:0/3965973574 shutdown_connections 2024-02-21T07:42:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.613+0000 7f7c87400640 1 --2- 172.21.15.69:0/3965973574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c8006fff0 0x7f7c800f9810 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.613+0000 7f7c87400640 1 -- 172.21.15.69:0/3965973574 >> 172.21.15.69:0/3965973574 conn(0x7f7c800f7250 msgr2=0x7f7c800f7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.613+0000 7f7c87400640 1 -- 172.21.15.69:0/3965973574 shutdown_connections 2024-02-21T07:42:16.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.613+0000 7f7c87400640 1 -- 172.21.15.69:0/3965973574 wait complete. 2024-02-21T07:42:16.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.615+0000 7f7c87400640 1 Processor -- start 2024-02-21T07:42:16.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.615+0000 7f7c87400640 1 -- start start 2024-02-21T07:42:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c87400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c80066ca0 0x7f7c800f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c87400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8006fff0 0x7f7c800ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c87400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c8021f840 0x7f7c8016b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c87400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c800cda20 con 0x7f7c8021f840 2024-02-21T07:42:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c87400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c800f70a0 con 0x7f7c8006fff0 2024-02-21T07:42:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c87400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c801786b0 con 0x7f7c80066ca0 2024-02-21T07:42:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c85400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c8021f840 0x7f7c8016b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c85400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c8021f840 0x7f7c8016b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42894/0 (socket says 172.21.15.69:42894) 2024-02-21T07:42:16.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c85400640 1 -- 172.21.15.69:0/4149886495 learned_addr learned my addr 172.21.15.69:0/4149886495 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:16.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c84a00640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c80066ca0 0x7f7c800f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c7fe00640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8006fff0 0x7f7c800ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c85400640 1 -- 172.21.15.69:0/4149886495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c80066ca0 msgr2=0x7f7c800f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c85400640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c80066ca0 0x7f7c800f6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c85400640 1 -- 172.21.15.69:0/4149886495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8006fff0 msgr2=0x7f7c800ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c85400640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8006fff0 0x7f7c800ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.617+0000 7f7c85400640 1 -- 172.21.15.69:0/4149886495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c78009a70 con 0x7f7c8021f840 2024-02-21T07:42:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.618+0000 7f7c85400640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c8021f840 0x7f7c8016b3d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c78037040 tx=0x7f7c78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.618+0000 7f7c7cc00640 1 -- 172.21.15.69:0/4149886495 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7802cea0 con 0x7f7c8021f840 2024-02-21T07:42:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.618+0000 7f7c7cc00640 1 -- 172.21.15.69:0/4149886495 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c78040670 con 0x7f7c8021f840 2024-02-21T07:42:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.618+0000 7f7c87400640 1 -- 172.21.15.69:0/4149886495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c800cd460 con 0x7f7c8021f840 2024-02-21T07:42:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.618+0000 7f7c7cc00640 1 -- 172.21.15.69:0/4149886495 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78040a20 con 0x7f7c8021f840 2024-02-21T07:42:16.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.618+0000 7f7c87400640 1 -- 172.21.15.69:0/4149886495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c801788e0 con 0x7f7c8021f840 2024-02-21T07:42:16.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.619+0000 7f7c87400640 1 -- 172.21.15.69:0/4149886495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c80069d50 con 0x7f7c8021f840 2024-02-21T07:42:16.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.621+0000 7f7c7cc00640 1 -- 172.21.15.69:0/4149886495 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7c78040b80 con 0x7f7c8021f840 2024-02-21T07:42:16.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.622+0000 7f7c7cc00640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c6009f0d0 0x7f7c600a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:16.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.622+0000 7f7c7cc00640 1 -- 172.21.15.69:0/4149886495 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f7c780ec330 con 0x7f7c8021f840 2024-02-21T07:42:16.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.623+0000 7f7c84a00640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c6009f0d0 0x7f7c600a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:16.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.623+0000 7f7c84a00640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c6009f0d0 0x7f7c600a1590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c740011e0 tx=0x7f7c74007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:16.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.626+0000 7f7c7cc00640 1 -- 172.21.15.69:0/4149886495 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c780b60f0 con 0x7f7c8021f840 2024-02-21T07:42:16.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.819+0000 7f7c87400640 1 -- 172.21.15.69:0/4149886495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c800668e0 con 0x7f7c8021f840 2024-02-21T07:42:16.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.820+0000 7f7c7cc00640 1 -- 172.21.15.69:0/4149886495 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c78009450 con 0x7f7c8021f840 2024-02-21T07:42:16.826 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:42:16.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.822+0000 7f7c87400640 1 -- 172.21.15.69:0/4149886495 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c6009f0d0 msgr2=0x7f7c600a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.822+0000 7f7c87400640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c6009f0d0 0x7f7c600a1590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7c740011e0 tx=0x7f7c74007d30 comp rx=0 tx=0).stop 2024-02-21T07:42:16.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.822+0000 7f7c87400640 1 -- 172.21.15.69:0/4149886495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c8021f840 msgr2=0x7f7c8016b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:16.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.822+0000 7f7c87400640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c8021f840 0x7f7c8016b3d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c78037040 tx=0x7f7c78004a40 comp rx=0 tx=0).stop 2024-02-21T07:42:16.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.822+0000 7f7c87400640 1 -- 172.21.15.69:0/4149886495 shutdown_connections 2024-02-21T07:42:16.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.822+0000 7f7c87400640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c6009f0d0 0x7f7c600a1590 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.822+0000 7f7c87400640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c8021f840 0x7f7c8016b3d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.822+0000 7f7c87400640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c8006fff0 0x7f7c800ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.822+0000 7f7c87400640 1 --2- 172.21.15.69:0/4149886495 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c80066ca0 0x7f7c800f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:16.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.822+0000 7f7c87400640 1 -- 172.21.15.69:0/4149886495 >> 172.21.15.69:0/4149886495 conn(0x7f7c800f7250 msgr2=0x7f7c8006d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:16.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.823+0000 7f7c87400640 1 -- 172.21.15.69:0/4149886495 shutdown_connections 2024-02-21T07:42:16.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:16.823+0000 7f7c87400640 1 -- 172.21.15.69:0/4149886495 wait complete. 2024-02-21T07:42:16.848 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:42:17.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.054+0000 7f4acf200640 1 Processor -- start 2024-02-21T07:42:17.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.054+0000 7f4acf200640 1 -- start start 2024-02-21T07:42:17.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.056+0000 7f4acf200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4ad018a0b0 0x7f4ad018a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.056+0000 7f4acf200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4ad00f1930 0x7f4ad00f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.056+0000 7f4acf200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad01863e0 con 0x7f4ad0180690 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.056+0000 7f4acf200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad0185060 con 0x7f4ad018a0b0 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.056+0000 7f4acf200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad0185340 con 0x7f4ad00f1930 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.056+0000 7f4ac7e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4ad018a0b0 0x7f4ad018a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.056+0000 7f4ac7e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4ad018a0b0 0x7f4ad018a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42906/0 (socket says 172.21.15.69:42906) 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.056+0000 7f4ac7e00640 1 -- 172.21.15.69:0/1375577655 learned_addr learned my addr 172.21.15.69:0/1375577655 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.056+0000 7f4ace800640 1 --2- 172.21.15.69:0/1375577655 >> v2:172.21.15.174:3300/0 conn(0x7f4ad00f1930 0x7f4ad00f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.057+0000 7f4ac7e00640 1 -- 172.21.15.69:0/1375577655 >> v2:172.21.15.174:3300/0 conn(0x7f4ad00f1930 msgr2=0x7f4ad00f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.057+0000 7f4ac7e00640 1 --2- 172.21.15.69:0/1375577655 >> v2:172.21.15.174:3300/0 conn(0x7f4ad00f1930 0x7f4ad00f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.057+0000 7f4ac7e00640 1 -- 172.21.15.69:0/1375577655 >> v1:172.21.15.174:6789/0 conn(0x7f4ad0180690 legacy=0x7f4ad0184570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.057+0000 7f4ac7e00640 1 -- 172.21.15.69:0/1375577655 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0185620 con 0x7f4ad018a0b0 2024-02-21T07:42:17.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.058+0000 7f4ac7e00640 1 --2- 172.21.15.69:0/1375577655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ad018a0b0 0x7f4ad018a530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00cbb00 tx=0x7f4ab802b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b3d25a42a295aa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:17.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.058+0000 7f4acd400640 1 -- 172.21.15.69:0/1375577655 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8030710 con 0x7f4ad018a0b0 2024-02-21T07:42:17.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.058+0000 7f4acd400640 1 -- 172.21.15.69:0/1375577655 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab802e050 con 0x7f4ad018a0b0 2024-02-21T07:42:17.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.058+0000 7f4acd400640 1 -- 172.21.15.69:0/1375577655 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8030a90 con 0x7f4ad018a0b0 2024-02-21T07:42:17.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.059+0000 7f4acf200640 1 -- 172.21.15.69:0/1375577655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ad018a0b0 msgr2=0x7f4ad018a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.059+0000 7f4acf200640 1 --2- 172.21.15.69:0/1375577655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ad018a0b0 0x7f4ad018a530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00cbb00 tx=0x7f4ab802b760 comp rx=0 tx=0).stop 2024-02-21T07:42:17.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.059+0000 7f4acf200640 1 -- 172.21.15.69:0/1375577655 shutdown_connections 2024-02-21T07:42:17.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.059+0000 7f4acf200640 1 --2- 172.21.15.69:0/1375577655 >> v2:172.21.15.174:3300/0 conn(0x7f4ad00f1930 0x7f4ad00f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.059+0000 7f4acf200640 1 --2- 172.21.15.69:0/1375577655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ad018a0b0 0x7f4ad018a530 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.059+0000 7f4acf200640 1 -- 172.21.15.69:0/1375577655 >> 172.21.15.69:0/1375577655 conn(0x7f4ad00ce1b0 msgr2=0x7f4ad00ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:17.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.059+0000 7f4acf200640 1 -- 172.21.15.69:0/1375577655 shutdown_connections 2024-02-21T07:42:17.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.059+0000 7f4acf200640 1 -- 172.21.15.69:0/1375577655 wait complete. 2024-02-21T07:42:17.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.061+0000 7f4acf200640 1 Processor -- start 2024-02-21T07:42:17.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.061+0000 7f4acf200640 1 -- start start 2024-02-21T07:42:17.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.062+0000 7f4acf200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad00f1930 0x7f4ad021eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.062+0000 7f4acf200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad0180690 0x7f4ad0160c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.062+0000 7f4acf200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ad018a0b0 0x7f4ad006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.062+0000 7f4acf200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0189950 con 0x7f4ad018a0b0 2024-02-21T07:42:17.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.062+0000 7f4acf200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad006acc0 con 0x7f4ad00f1930 2024-02-21T07:42:17.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.062+0000 7f4acf200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad021f420 con 0x7f4ad0180690 2024-02-21T07:42:17.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4acde00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad00f1930 0x7f4ad021eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4ace800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ad018a0b0 0x7f4ad006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4acde00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad00f1930 0x7f4ad021eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40482/0 (socket says 172.21.15.69:40482) 2024-02-21T07:42:17.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4acde00640 1 -- 172.21.15.69:0/3553033264 learned_addr learned my addr 172.21.15.69:0/3553033264 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4ac7e00640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad0180690 0x7f4ad0160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4ace800640 1 -- 172.21.15.69:0/3553033264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad0180690 msgr2=0x7f4ad0160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4ace800640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad0180690 0x7f4ad0160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4ace800640 1 -- 172.21.15.69:0/3553033264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad00f1930 msgr2=0x7f4ad021eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4ace800640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad00f1930 0x7f4ad021eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4ace800640 1 -- 172.21.15.69:0/3553033264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80094d0 con 0x7f4ad018a0b0 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4acde00640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad00f1930 0x7f4ad021eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.063+0000 7f4ace800640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ad018a0b0 0x7f4ad006b760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800eba0 tx=0x7f4ac800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.064+0000 7f4ac6000640 1 -- 172.21.15.69:0/3553033264 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800cd20 con 0x7f4ad018a0b0 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.064+0000 7f4ac6000640 1 -- 172.21.15.69:0/3553033264 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac800f040 con 0x7f4ad018a0b0 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.064+0000 7f4ac6000640 1 -- 172.21.15.69:0/3553033264 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac80146c0 con 0x7f4ad018a0b0 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.064+0000 7f4acf200640 1 -- 172.21.15.69:0/3553033264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad0189390 con 0x7f4ad018a0b0 2024-02-21T07:42:17.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.064+0000 7f4acf200640 1 -- 172.21.15.69:0/3553033264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad006af60 con 0x7f4ad018a0b0 2024-02-21T07:42:17.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.065+0000 7f4acf200640 1 -- 172.21.15.69:0/3553033264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad006ab20 con 0x7f4ad018a0b0 2024-02-21T07:42:17.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.067+0000 7f4ac6000640 1 -- 172.21.15.69:0/3553033264 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f4ac8014820 con 0x7f4ad018a0b0 2024-02-21T07:42:17.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.068+0000 7f4ac6000640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4aac09f0a0 0x7f4aac0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.068+0000 7f4ac6000640 1 -- 172.21.15.69:0/3553033264 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f4ac80ca730 con 0x7f4ad018a0b0 2024-02-21T07:42:17.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.068+0000 7f4acde00640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4aac09f0a0 0x7f4aac0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.069+0000 7f4acde00640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4aac09f0a0 0x7f4aac0a1560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0001db0 tx=0x7f4ac0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:17.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.072+0000 7f4ac6000640 1 -- 172.21.15.69:0/3553033264 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4ad006ab20 con 0x7f4ad018a0b0 2024-02-21T07:42:17.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.265+0000 7f4acf200640 1 -- 172.21.15.69:0/3553033264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ad006ab20 con 0x7f4ad018a0b0 2024-02-21T07:42:17.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.266+0000 7f4ac6000640 1 -- 172.21.15.69:0/3553033264 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ad006ab20 con 0x7f4ad018a0b0 2024-02-21T07:42:17.272 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-02-21T07:42:17.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.268+0000 7f4acf200640 1 -- 172.21.15.69:0/3553033264 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4aac09f0a0 msgr2=0x7f4aac0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.268+0000 7f4acf200640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4aac09f0a0 0x7f4aac0a1560 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0001db0 tx=0x7f4ac0009040 comp rx=0 tx=0).stop 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.268+0000 7f4acf200640 1 -- 172.21.15.69:0/3553033264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ad018a0b0 msgr2=0x7f4ad006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.268+0000 7f4acf200640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ad018a0b0 0x7f4ad006b760 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800eba0 tx=0x7f4ac800c490 comp rx=0 tx=0).stop 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.268+0000 7f4acf200640 1 -- 172.21.15.69:0/3553033264 shutdown_connections 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.268+0000 7f4acf200640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4aac09f0a0 0x7f4aac0a1560 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.268+0000 7f4acf200640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ad018a0b0 0x7f4ad006b760 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.268+0000 7f4acf200640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ad0180690 0x7f4ad0160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.268+0000 7f4acf200640 1 --2- 172.21.15.69:0/3553033264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ad00f1930 0x7f4ad021eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.268+0000 7f4acf200640 1 -- 172.21.15.69:0/3553033264 >> 172.21.15.69:0/3553033264 conn(0x7f4ad00ce1b0 msgr2=0x7f4ad00cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.269+0000 7f4acf200640 1 -- 172.21.15.69:0/3553033264 shutdown_connections 2024-02-21T07:42:17.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.269+0000 7f4acf200640 1 -- 172.21.15.69:0/3553033264 wait complete. 2024-02-21T07:42:17.292 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:42:17.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.496+0000 7f85d6000640 1 Processor -- start 2024-02-21T07:42:17.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.496+0000 7f85d6000640 1 -- start start 2024-02-21T07:42:17.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.498+0000 7f85d6000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f85d017f700 0x7f85d0183670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.498+0000 7f85d6000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f85d01850e0 0x7f85d00cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.498+0000 7f85d6000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d0184c50 con 0x7f85d0185cc0 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.498+0000 7f85d6000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d0185560 con 0x7f85d01850e0 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.498+0000 7f85d6000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d0183d60 con 0x7f85d017f700 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.498+0000 7f85cfe00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f85d0185cc0 0x7f85d0186130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45578/0 (socket says 172.21.15.69:45578) 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.498+0000 7f85cfe00640 1 -- 172.21.15.69:0/1497192896 learned_addr learned my addr 172.21.15.69:0/1497192896 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.498+0000 7f85c7e00640 1 --2- 172.21.15.69:0/1497192896 >> v2:172.21.15.174:3300/0 conn(0x7f85d01850e0 0x7f85d00cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.498+0000 7f85cf400640 1 --2- 172.21.15.69:0/1497192896 >> v2:172.21.15.184:3300/0 conn(0x7f85d017f700 0x7f85d0183670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.499+0000 7f85cea00640 1 -- 172.21.15.69:0/1497192896 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917592204 0 0) 0x7f85d0184c50 con 0x7f85d0185cc0 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.499+0000 7f85cea00640 1 -- 172.21.15.69:0/1497192896 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b4003520 con 0x7f85d0185cc0 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.499+0000 7f85c7e00640 1 -- 172.21.15.69:0/1497192896 >> v2:172.21.15.184:3300/0 conn(0x7f85d017f700 msgr2=0x7f85d0183670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.499+0000 7f85c7e00640 1 --2- 172.21.15.69:0/1497192896 >> v2:172.21.15.184:3300/0 conn(0x7f85d017f700 0x7f85d0183670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.499+0000 7f85c7e00640 1 -- 172.21.15.69:0/1497192896 >> v1:172.21.15.69:6789/0 conn(0x7f85d0185cc0 legacy=0x7f85d0186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.499+0000 7f85c7e00640 1 -- 172.21.15.69:0/1497192896 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0184040 con 0x7f85d01850e0 2024-02-21T07:42:17.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.499+0000 7f85cf400640 1 --2- 172.21.15.69:0/1497192896 >> v2:172.21.15.184:3300/0 conn(0x7f85d017f700 0x7f85d0183670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:17.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.500+0000 7f85c7e00640 1 --2- 172.21.15.69:0/1497192896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85d01850e0 0x7f85d00cf750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85d00cbee0 tx=0x7f85b802b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc4e9a6127f4410 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:17.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.500+0000 7f85cea00640 1 -- 172.21.15.69:0/1497192896 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8031710 con 0x7f85d01850e0 2024-02-21T07:42:17.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.500+0000 7f85cea00640 1 -- 172.21.15.69:0/1497192896 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b802f050 con 0x7f85d01850e0 2024-02-21T07:42:17.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.500+0000 7f85cea00640 1 -- 172.21.15.69:0/1497192896 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8031a90 con 0x7f85d01850e0 2024-02-21T07:42:17.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.501+0000 7f85d6000640 1 -- 172.21.15.69:0/1497192896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85d01850e0 msgr2=0x7f85d00cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.501+0000 7f85d6000640 1 --2- 172.21.15.69:0/1497192896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85d01850e0 0x7f85d00cf750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85d00cbee0 tx=0x7f85b802b7b0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.501+0000 7f85d6000640 1 -- 172.21.15.69:0/1497192896 shutdown_connections 2024-02-21T07:42:17.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.501+0000 7f85d6000640 1 --2- 172.21.15.69:0/1497192896 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85d01850e0 0x7f85d00cf750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.501+0000 7f85d6000640 1 --2- 172.21.15.69:0/1497192896 >> v2:172.21.15.184:3300/0 conn(0x7f85d017f700 0x7f85d0183670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.501+0000 7f85d6000640 1 -- 172.21.15.69:0/1497192896 >> 172.21.15.69:0/1497192896 conn(0x7f85d00ce3d0 msgr2=0x7f85d00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:17.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.501+0000 7f85d6000640 1 -- 172.21.15.69:0/1497192896 shutdown_connections 2024-02-21T07:42:17.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.501+0000 7f85d6000640 1 -- 172.21.15.69:0/1497192896 wait complete. 2024-02-21T07:42:17.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.503+0000 7f85d6000640 1 Processor -- start 2024-02-21T07:42:17.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.503+0000 7f85d6000640 1 -- start start 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.504+0000 7f85d6000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d017f700 0x7f85d017eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.504+0000 7f85d6000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85d01850e0 0x7f85d00f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.504+0000 7f85d6000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85d0185cc0 0x7f85d0161220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.504+0000 7f85d6000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00f1630 con 0x7f85d0185cc0 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.504+0000 7f85d6000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00f1910 con 0x7f85d01850e0 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.504+0000 7f85d6000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00f1bf0 con 0x7f85d017f700 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85d0185cc0 0x7f85d0161220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cf400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d017f700 0x7f85d017eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85d0185cc0 0x7f85d0161220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42926/0 (socket says 172.21.15.69:42926) 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cfe00640 1 -- 172.21.15.69:0/3848652049 learned_addr learned my addr 172.21.15.69:0/3848652049 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:17.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85c7e00640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85d01850e0 0x7f85d00f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cf400640 1 -- 172.21.15.69:0/3848652049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85d01850e0 msgr2=0x7f85d00f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cf400640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85d01850e0 0x7f85d00f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cf400640 1 -- 172.21.15.69:0/3848652049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85d0185cc0 msgr2=0x7f85d0161220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cf400640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85d0185cc0 0x7f85d0161220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cf400640 1 -- 172.21.15.69:0/3848652049 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0009400 con 0x7f85d017f700 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cfe00640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85d0185cc0 0x7f85d0161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.505+0000 7f85cf400640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d017f700 0x7f85d017eb60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85c000e870 tx=0x7f85c000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.506+0000 7f85c7400640 1 -- 172.21.15.69:0/3848652049 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c000c940 con 0x7f85d017f700 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.506+0000 7f85c7400640 1 -- 172.21.15.69:0/3848652049 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c000caa0 con 0x7f85d017f700 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.506+0000 7f85c7400640 1 -- 172.21.15.69:0/3848652049 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c000ce30 con 0x7f85d017f700 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.506+0000 7f85d6000640 1 -- 172.21.15.69:0/3848652049 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b8009400 con 0x7f85d017f700 2024-02-21T07:42:17.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.506+0000 7f85d6000640 1 -- 172.21.15.69:0/3848652049 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d00f21b0 con 0x7f85d017f700 2024-02-21T07:42:17.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.507+0000 7f85d6000640 1 -- 172.21.15.69:0/3848652049 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d0069d50 con 0x7f85d017f700 2024-02-21T07:42:17.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.509+0000 7f85c7400640 1 -- 172.21.15.69:0/3848652049 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f85c0013470 con 0x7f85d017f700 2024-02-21T07:42:17.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.510+0000 7f85c7400640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f85ac09f0d0 0x7f85ac0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.510+0000 7f85c7400640 1 -- 172.21.15.69:0/3848652049 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f85c00c9c00 con 0x7f85d017f700 2024-02-21T07:42:17.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.510+0000 7f85c7e00640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f85ac09f0d0 0x7f85ac0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.511+0000 7f85c7e00640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f85ac09f0d0 0x7f85ac0a1590 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85b8035000 tx=0x7f85b8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:17.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.514+0000 7f85c7400640 1 -- 172.21.15.69:0/3848652049 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f85c0093aa0 con 0x7f85d017f700 2024-02-21T07:42:17.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.711+0000 7f85d6000640 1 -- 172.21.15.69:0/3848652049 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f85d00f1d30 con 0x7f85d017f700 2024-02-21T07:42:17.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.712+0000 7f85c7400640 1 -- 172.21.15.69:0/3848652049 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f85d00f1d30 con 0x7f85d017f700 2024-02-21T07:42:17.718 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:42:17.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 -- 172.21.15.69:0/3848652049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f85ac09f0d0 msgr2=0x7f85ac0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f85ac09f0d0 0x7f85ac0a1590 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85b8035000 tx=0x7f85b8008030 comp rx=0 tx=0).stop 2024-02-21T07:42:17.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 -- 172.21.15.69:0/3848652049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d017f700 msgr2=0x7f85d017eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d017f700 0x7f85d017eb60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85c000e870 tx=0x7f85c000ed30 comp rx=0 tx=0).stop 2024-02-21T07:42:17.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 -- 172.21.15.69:0/3848652049 shutdown_connections 2024-02-21T07:42:17.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f85ac09f0d0 0x7f85ac0a1590 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85d0185cc0 0x7f85d0161220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f85d01850e0 0x7f85d00f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 --2- 172.21.15.69:0/3848652049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d017f700 0x7f85d017eb60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 -- 172.21.15.69:0/3848652049 >> 172.21.15.69:0/3848652049 conn(0x7f85d00ce3d0 msgr2=0x7f85d0179d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:17.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 -- 172.21.15.69:0/3848652049 shutdown_connections 2024-02-21T07:42:17.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.716+0000 7f85d6000640 1 -- 172.21.15.69:0/3848652049 wait complete. 2024-02-21T07:42:17.740 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T07:42:17.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.938+0000 7fa02a000640 1 Processor -- start 2024-02-21T07:42:17.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.938+0000 7fa02a000640 1 -- start start 2024-02-21T07:42:17.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.940+0000 7fa02a000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa024183fa0 0x7fa0240cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.940+0000 7fa02a000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0240ce230 con 0x7fa0240f6310 2024-02-21T07:42:17.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.940+0000 7fa02a000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa02406dcd0 con 0x7fa024188980 2024-02-21T07:42:17.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.940+0000 7fa02a000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa024184380 con 0x7fa024183fa0 2024-02-21T07:42:17.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.940+0000 7fa023400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa024183fa0 0x7fa0240cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.940+0000 7fa022a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa0240f6310 0x7fa024188270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45582/0 (socket says 172.21.15.69:45582) 2024-02-21T07:42:17.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.940+0000 7fa022a00640 1 -- 172.21.15.69:0/1095084998 learned_addr learned my addr 172.21.15.69:0/1095084998 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:17.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.941+0000 7fa023400640 1 -- 172.21.15.69:0/1095084998 >> v1:172.21.15.174:6789/0 conn(0x7fa024188980 legacy=0x7fa024186730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.941+0000 7fa023400640 1 -- 172.21.15.69:0/1095084998 >> v1:172.21.15.69:6789/0 conn(0x7fa0240f6310 legacy=0x7fa024188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.941+0000 7fa022000640 1 -- 172.21.15.69:0/1095084998 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838674412 0 0) 0x7fa02406dcd0 con 0x7fa024188980 2024-02-21T07:42:17.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.941+0000 7fa023400640 1 -- 172.21.15.69:0/1095084998 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0240cd6b0 con 0x7fa024183fa0 2024-02-21T07:42:17.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.942+0000 7fa023400640 1 --2- 172.21.15.69:0/1095084998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024183fa0 0x7fa0240cd090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa014009d90 tx=0x7fa01402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93faafa30e599173 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:17.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.942+0000 7fa022000640 1 -- 172.21.15.69:0/1095084998 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01402cbd0 con 0x7fa024183fa0 2024-02-21T07:42:17.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.942+0000 7fa022000640 1 -- 172.21.15.69:0/1095084998 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01402cd30 con 0x7fa024183fa0 2024-02-21T07:42:17.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.942+0000 7fa022000640 1 -- 172.21.15.69:0/1095084998 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01402cea0 con 0x7fa024183fa0 2024-02-21T07:42:17.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.943+0000 7fa02a000640 1 -- 172.21.15.69:0/1095084998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024183fa0 msgr2=0x7fa0240cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.943+0000 7fa02a000640 1 --2- 172.21.15.69:0/1095084998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024183fa0 0x7fa0240cd090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa014009d90 tx=0x7fa01402be20 comp rx=0 tx=0).stop 2024-02-21T07:42:17.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.943+0000 7fa02a000640 1 -- 172.21.15.69:0/1095084998 shutdown_connections 2024-02-21T07:42:17.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.943+0000 7fa02a000640 1 --2- 172.21.15.69:0/1095084998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024183fa0 0x7fa0240cd090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.943+0000 7fa02a000640 1 -- 172.21.15.69:0/1095084998 >> 172.21.15.69:0/1095084998 conn(0x7fa0240f69c0 msgr2=0x7fa0240f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:17.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.943+0000 7fa02a000640 1 -- 172.21.15.69:0/1095084998 shutdown_connections 2024-02-21T07:42:17.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.943+0000 7fa02a000640 1 -- 172.21.15.69:0/1095084998 wait complete. 2024-02-21T07:42:17.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.946+0000 7fa02a000640 1 Processor -- start 2024-02-21T07:42:17.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.946+0000 7fa02a000640 1 -- start start 2024-02-21T07:42:17.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.947+0000 7fa02a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0240f6310 0x7fa024179af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.947+0000 7fa02a000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa024183fa0 0x7fa02421ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.947+0000 7fa02a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024188980 0x7fa02421f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.947+0000 7fa02a000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa024221910 con 0x7fa024188980 2024-02-21T07:42:17.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.947+0000 7fa02a000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa024220a20 con 0x7fa024183fa0 2024-02-21T07:42:17.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.947+0000 7fa02a000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa024220d00 con 0x7fa0240f6310 2024-02-21T07:42:17.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa023e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024188980 0x7fa02421f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa023e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024188980 0x7fa02421f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42950/0 (socket says 172.21.15.69:42950) 2024-02-21T07:42:17.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa022a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa024183fa0 0x7fa02421ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa023e00640 1 -- 172.21.15.69:0/501494713 learned_addr learned my addr 172.21.15.69:0/501494713 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:17.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa023400640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0240f6310 0x7fa024179af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa022a00640 1 -- 172.21.15.69:0/501494713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0240f6310 msgr2=0x7fa024179af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa022a00640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0240f6310 0x7fa024179af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa022a00640 1 -- 172.21.15.69:0/501494713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024188980 msgr2=0x7fa02421f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:17.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa022a00640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024188980 0x7fa02421f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:17.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa022a00640 1 -- 172.21.15.69:0/501494713 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014009a70 con 0x7fa024183fa0 2024-02-21T07:42:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.948+0000 7fa023e00640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024188980 0x7fa02421f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.949+0000 7fa022a00640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa024183fa0 0x7fa02421ec30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c440 tx=0x7fa00c00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.949+0000 7fa01b400640 1 -- 172.21.15.69:0/501494713 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c005ce0 con 0x7fa024183fa0 2024-02-21T07:42:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.949+0000 7fa01b400640 1 -- 172.21.15.69:0/501494713 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c005e40 con 0x7fa024183fa0 2024-02-21T07:42:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.949+0000 7fa01b400640 1 -- 172.21.15.69:0/501494713 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c0072d0 con 0x7fa024183fa0 2024-02-21T07:42:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.949+0000 7fa02a000640 1 -- 172.21.15.69:0/501494713 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa024220fe0 con 0x7fa024183fa0 2024-02-21T07:42:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.949+0000 7fa02a000640 1 -- 172.21.15.69:0/501494713 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0242215a0 con 0x7fa024183fa0 2024-02-21T07:42:17.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.950+0000 7fa02a000640 1 -- 172.21.15.69:0/501494713 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02421c580 con 0x7fa024183fa0 2024-02-21T07:42:17.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.952+0000 7fa01b400640 1 -- 172.21.15.69:0/501494713 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa00c007430 con 0x7fa024183fa0 2024-02-21T07:42:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.954+0000 7fa01b400640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa00009f0d0 0x7fa0000a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:17.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.954+0000 7fa01b400640 1 -- 172.21.15.69:0/501494713 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa00c0c90e0 con 0x7fa024183fa0 2024-02-21T07:42:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.954+0000 7fa023400640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa00009f0d0 0x7fa0000a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:17.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.955+0000 7fa023400640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa00009f0d0 0x7fa0000a1590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa014036000 tx=0x7fa014030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:17.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:17.956+0000 7fa01b400640 1 -- 172.21.15.69:0/501494713 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa00c093020 con 0x7fa024183fa0 2024-02-21T07:42:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.166+0000 7fa02a000640 1 -- 172.21.15.69:0/501494713 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa02421c580 con 0x7fa024183fa0 2024-02-21T07:42:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.167+0000 7fa01b400640 1 -- 172.21.15.69:0/501494713 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa02421c580 con 0x7fa024183fa0 2024-02-21T07:42:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2024-02-21T07:42:18.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 -- 172.21.15.69:0/501494713 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa00009f0d0 msgr2=0x7fa0000a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa00009f0d0 0x7fa0000a1590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa014036000 tx=0x7fa014030000 comp rx=0 tx=0).stop 2024-02-21T07:42:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 -- 172.21.15.69:0/501494713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa024183fa0 msgr2=0x7fa02421ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa024183fa0 0x7fa02421ec30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c440 tx=0x7fa00c00c900 comp rx=0 tx=0).stop 2024-02-21T07:42:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 -- 172.21.15.69:0/501494713 shutdown_connections 2024-02-21T07:42:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa00009f0d0 0x7fa0000a1590 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa024188980 0x7fa02421f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa024183fa0 0x7fa02421ec30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 --2- 172.21.15.69:0/501494713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa0240f6310 0x7fa024179af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 -- 172.21.15.69:0/501494713 >> 172.21.15.69:0/501494713 conn(0x7fa0240f69c0 msgr2=0x7fa0240f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 -- 172.21.15.69:0/501494713 shutdown_connections 2024-02-21T07:42:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.170+0000 7fa02a000640 1 -- 172.21.15.69:0/501494713 wait complete. 2024-02-21T07:42:18.195 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:42:18.195 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:42:18.243 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:18.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.502+0000 7fe459e00640 1 Processor -- start 2024-02-21T07:42:18.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.503+0000 7fe459e00640 1 -- start start 2024-02-21T07:42:18.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.504+0000 7fe459e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe45406ef40 0x7fe45406f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe459e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe45406f860 0x7fe45418b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe459e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe454183030 con 0x7fe45418b560 2024-02-21T07:42:18.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe459e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe454189f80 con 0x7fe45406f860 2024-02-21T07:42:18.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe459e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45418a260 con 0x7fe45406ef40 2024-02-21T07:42:18.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe44a000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe45406f860 0x7fe45418b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe452a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe45406ef40 0x7fe45406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe44a000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe45406f860 0x7fe45418b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40520/0 (socket says 172.21.15.69:40520) 2024-02-21T07:42:18.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe44a000640 1 -- 172.21.15.69:0/2964305515 learned_addr learned my addr 172.21.15.69:0/2964305515 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:18.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe453400640 1 --1- 172.21.15.69:0/2964305515 >> v1:172.21.15.174:6789/0 conn(0x7fe45418b560 0x7fe45408cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:52226/0 (socket says 172.21.15.69:52226) 2024-02-21T07:42:18.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe452a00640 1 -- 172.21.15.69:0/2964305515 >> v2:172.21.15.174:3300/0 conn(0x7fe45406f860 msgr2=0x7fe45418b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:18.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe452a00640 1 --2- 172.21.15.69:0/2964305515 >> v2:172.21.15.174:3300/0 conn(0x7fe45406f860 0x7fe45418b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe452a00640 1 -- 172.21.15.69:0/2964305515 >> v1:172.21.15.174:6789/0 conn(0x7fe45418b560 legacy=0x7fe45408cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.505+0000 7fe452a00640 1 -- 172.21.15.69:0/2964305515 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45418a540 con 0x7fe45406ef40 2024-02-21T07:42:18.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.507+0000 7fe452a00640 1 --2- 172.21.15.69:0/2964305515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45406ef40 0x7fe45406f320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe45407b860 tx=0x7fe44402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35e66f3c7f8a1fe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:18.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.507+0000 7fe452000640 1 -- 172.21.15.69:0/2964305515 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe444031830 con 0x7fe45406ef40 2024-02-21T07:42:18.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.507+0000 7fe452000640 1 -- 172.21.15.69:0/2964305515 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe444031990 con 0x7fe45406ef40 2024-02-21T07:42:18.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.507+0000 7fe452000640 1 -- 172.21.15.69:0/2964305515 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe444031d20 con 0x7fe45406ef40 2024-02-21T07:42:18.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.507+0000 7fe459e00640 1 -- 172.21.15.69:0/2964305515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45406ef40 msgr2=0x7fe45406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.507+0000 7fe459e00640 1 --2- 172.21.15.69:0/2964305515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45406ef40 0x7fe45406f320 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe45407b860 tx=0x7fe44402b8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.508+0000 7fe459e00640 1 -- 172.21.15.69:0/2964305515 shutdown_connections 2024-02-21T07:42:18.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.508+0000 7fe459e00640 1 --2- 172.21.15.69:0/2964305515 >> v2:172.21.15.174:3300/0 conn(0x7fe45406f860 0x7fe45418b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.508+0000 7fe459e00640 1 --2- 172.21.15.69:0/2964305515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45406ef40 0x7fe45406f320 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.508+0000 7fe459e00640 1 -- 172.21.15.69:0/2964305515 >> 172.21.15.69:0/2964305515 conn(0x7fe4540f8b30 msgr2=0x7fe4540f8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:18.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.508+0000 7fe459e00640 1 -- 172.21.15.69:0/2964305515 shutdown_connections 2024-02-21T07:42:18.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.508+0000 7fe459e00640 1 -- 172.21.15.69:0/2964305515 wait complete. 2024-02-21T07:42:18.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.510+0000 7fe459e00640 1 Processor -- start 2024-02-21T07:42:18.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.510+0000 7fe459e00640 1 -- start start 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.511+0000 7fe459e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45406ef40 0x7fe454161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.511+0000 7fe459e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe45406f860 0x7fe45421ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.511+0000 7fe459e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe45418b560 0x7fe45421f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.511+0000 7fe459e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45421f9c0 con 0x7fe45406f860 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.511+0000 7fe459e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45421fca0 con 0x7fe45418b560 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.511+0000 7fe459e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe454213090 con 0x7fe45406ef40 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.511+0000 7fe44a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe45406f860 0x7fe45421ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.511+0000 7fe44a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe45406f860 0x7fe45421ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42960/0 (socket says 172.21.15.69:42960) 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.511+0000 7fe44a000640 1 -- 172.21.15.69:0/1029230794 learned_addr learned my addr 172.21.15.69:0/1029230794 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.511+0000 7fe452a00640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45406ef40 0x7fe454161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.512+0000 7fe453400640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe45418b560 0x7fe45421f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.512+0000 7fe44a000640 1 -- 172.21.15.69:0/1029230794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45406ef40 msgr2=0x7fe454161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.512+0000 7fe44a000640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45406ef40 0x7fe454161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.512+0000 7fe44a000640 1 -- 172.21.15.69:0/1029230794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe45418b560 msgr2=0x7fe45421f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.512+0000 7fe44a000640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe45418b560 0x7fe45421f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.512+0000 7fe44a000640 1 -- 172.21.15.69:0/1029230794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444009400 con 0x7fe45406f860 2024-02-21T07:42:18.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.512+0000 7fe44a000640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe45406f860 0x7fe45421ee10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009fd0 tx=0x7fe43c00ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:18.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.512+0000 7fe44be00640 1 -- 172.21.15.69:0/1029230794 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00c940 con 0x7fe45406f860 2024-02-21T07:42:18.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.512+0000 7fe44be00640 1 -- 172.21.15.69:0/1029230794 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c00caa0 con 0x7fe45406f860 2024-02-21T07:42:18.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.513+0000 7fe44be00640 1 -- 172.21.15.69:0/1029230794 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c00ce30 con 0x7fe45406f860 2024-02-21T07:42:18.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.513+0000 7fe459e00640 1 -- 172.21.15.69:0/1029230794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe454189920 con 0x7fe45406f860 2024-02-21T07:42:18.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.513+0000 7fe459e00640 1 -- 172.21.15.69:0/1029230794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe454213650 con 0x7fe45406f860 2024-02-21T07:42:18.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.514+0000 7fe459e00640 1 -- 172.21.15.69:0/1029230794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45408e900 con 0x7fe45406f860 2024-02-21T07:42:18.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.516+0000 7fe44be00640 1 -- 172.21.15.69:0/1029230794 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe43c013470 con 0x7fe45406f860 2024-02-21T07:42:18.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.518+0000 7fe44be00640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe43009f0a0 0x7fe4300a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.518+0000 7fe44be00640 1 -- 172.21.15.69:0/1029230794 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe43c0c9be0 con 0x7fe45406f860 2024-02-21T07:42:18.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.518+0000 7fe452a00640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe43009f0a0 0x7fe4300a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.519+0000 7fe452a00640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe43009f0a0 0x7fe4300a1560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe444036000 tx=0x7fe44403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.522+0000 7fe44be00640 1 -- 172.21.15.69:0/1029230794 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe43c093a80 con 0x7fe45406f860 2024-02-21T07:42:18.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.713+0000 7fe459e00640 1 -- 172.21.15.69:0/1029230794 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe454069d50 con 0x7fe45406f860 2024-02-21T07:42:18.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.716+0000 7fe44be00640 1 -- 172.21.15.69:0/1029230794 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7fe43c097140 con 0x7fe45406f860 2024-02-21T07:42:18.723 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:18.723 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:18.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.718+0000 7fe459e00640 1 -- 172.21.15.69:0/1029230794 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe43009f0a0 msgr2=0x7fe4300a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.718+0000 7fe459e00640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe43009f0a0 0x7fe4300a1560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe444036000 tx=0x7fe44403c040 comp rx=0 tx=0).stop 2024-02-21T07:42:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.718+0000 7fe459e00640 1 -- 172.21.15.69:0/1029230794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe45406f860 msgr2=0x7fe45421ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.718+0000 7fe459e00640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe45406f860 0x7fe45421ee10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009fd0 tx=0x7fe43c00ed40 comp rx=0 tx=0).stop 2024-02-21T07:42:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.719+0000 7fe459e00640 1 -- 172.21.15.69:0/1029230794 shutdown_connections 2024-02-21T07:42:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.719+0000 7fe459e00640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe43009f0a0 0x7fe4300a1560 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.719+0000 7fe459e00640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe45418b560 0x7fe45421f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.719+0000 7fe459e00640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe45406f860 0x7fe45421ee10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.719+0000 7fe459e00640 1 --2- 172.21.15.69:0/1029230794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe45406ef40 0x7fe454161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.719+0000 7fe459e00640 1 -- 172.21.15.69:0/1029230794 >> 172.21.15.69:0/1029230794 conn(0x7fe4540f8b30 msgr2=0x7fe454189010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.719+0000 7fe459e00640 1 -- 172.21.15.69:0/1029230794 shutdown_connections 2024-02-21T07:42:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.719+0000 7fe459e00640 1 -- 172.21.15.69:0/1029230794 wait complete. 2024-02-21T07:42:18.743 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:41:56.520105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:42:00.759386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:42:01.409274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:42:05.025537+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:42:18.743 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:42:18.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.948+0000 7f9908a00640 1 Processor -- start 2024-02-21T07:42:18.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.949+0000 7f9908a00640 1 -- start start 2024-02-21T07:42:18.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.950+0000 7f9908a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9904183d40 0x7f99040f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.950+0000 7f9908a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f990415e9e0 0x7f990415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.950+0000 7f9908a00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9904184250 con 0x7f9904182f00 2024-02-21T07:42:18.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.950+0000 7f9908a00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99041851b0 con 0x7f990415e9e0 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.950+0000 7f9908a00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9904184530 con 0x7f9904183d40 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.950+0000 7f9903400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f9904182f00 0x7f9904183630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44084/0 (socket says 172.21.15.69:44084) 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.950+0000 7f9903400640 1 -- 172.21.15.69:0/3567249695 learned_addr learned my addr 172.21.15.69:0/3567249695 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.951+0000 7f9903e00640 1 --2- 172.21.15.69:0/3567249695 >> v2:172.21.15.174:3300/0 conn(0x7f990415e9e0 0x7f990415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.951+0000 7f98faa00640 1 --2- 172.21.15.69:0/3567249695 >> v2:172.21.15.184:3300/0 conn(0x7f9904183d40 0x7f99040f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.951+0000 7f9902a00640 1 -- 172.21.15.69:0/3567249695 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249411852 0 0) 0x7f9904184250 con 0x7f9904182f00 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.951+0000 7f9902a00640 1 -- 172.21.15.69:0/3567249695 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98e8003520 con 0x7f9904182f00 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.951+0000 7f9903e00640 1 -- 172.21.15.69:0/3567249695 >> v2:172.21.15.184:3300/0 conn(0x7f9904183d40 msgr2=0x7f99040f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.951+0000 7f9903e00640 1 --2- 172.21.15.69:0/3567249695 >> v2:172.21.15.184:3300/0 conn(0x7f9904183d40 0x7f99040f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.951+0000 7f9903e00640 1 -- 172.21.15.69:0/3567249695 >> v1:172.21.15.69:6789/0 conn(0x7f9904182f00 legacy=0x7f9904183630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.951+0000 7f9903e00640 1 -- 172.21.15.69:0/3567249695 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904184810 con 0x7f990415e9e0 2024-02-21T07:42:18.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.952+0000 7f9903e00640 1 --2- 172.21.15.69:0/3567249695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f990415e9e0 0x7f990415ee90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f990408d3e0 tx=0x7f98fc02be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb2a3bb516c6a4ad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:18.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.952+0000 7f9902a00640 1 -- 172.21.15.69:0/3567249695 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc02cbf0 con 0x7f990415e9e0 2024-02-21T07:42:18.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.952+0000 7f9902a00640 1 -- 172.21.15.69:0/3567249695 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc02cd50 con 0x7f990415e9e0 2024-02-21T07:42:18.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.952+0000 7f9902a00640 1 -- 172.21.15.69:0/3567249695 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc034660 con 0x7f990415e9e0 2024-02-21T07:42:18.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.953+0000 7f9908a00640 1 -- 172.21.15.69:0/3567249695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f990415e9e0 msgr2=0x7f990415ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.953+0000 7f9908a00640 1 --2- 172.21.15.69:0/3567249695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f990415e9e0 0x7f990415ee90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f990408d3e0 tx=0x7f98fc02be40 comp rx=0 tx=0).stop 2024-02-21T07:42:18.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.953+0000 7f9908a00640 1 -- 172.21.15.69:0/3567249695 shutdown_connections 2024-02-21T07:42:18.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.953+0000 7f9908a00640 1 --2- 172.21.15.69:0/3567249695 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f990415e9e0 0x7f990415ee90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.953+0000 7f9908a00640 1 --2- 172.21.15.69:0/3567249695 >> v2:172.21.15.184:3300/0 conn(0x7f9904183d40 0x7f99040f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.953+0000 7f9908a00640 1 -- 172.21.15.69:0/3567249695 >> 172.21.15.69:0/3567249695 conn(0x7f99040ce1b0 msgr2=0x7f99040ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:18.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.953+0000 7f9908a00640 1 -- 172.21.15.69:0/3567249695 shutdown_connections 2024-02-21T07:42:18.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.953+0000 7f9908a00640 1 -- 172.21.15.69:0/3567249695 wait complete. 2024-02-21T07:42:18.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.955+0000 7f9908a00640 1 Processor -- start 2024-02-21T07:42:18.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.955+0000 7f9908a00640 1 -- start start 2024-02-21T07:42:18.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f9908a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f990415e9e0 0x7f9904155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f9908a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904182f00 0x7f9904155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f9908a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904183d40 0x7f9904160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f9908a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904173b20 con 0x7f990415e9e0 2024-02-21T07:42:18.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f9908a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904158a50 con 0x7f9904182f00 2024-02-21T07:42:18.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f9908a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99041605e0 con 0x7f9904183d40 2024-02-21T07:42:18.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f9903400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f990415e9e0 0x7f9904155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f98faa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904182f00 0x7f9904155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f98faa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904182f00 0x7f9904155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:33182/0 (socket says 172.21.15.69:33182) 2024-02-21T07:42:18.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f98faa00640 1 -- 172.21.15.69:0/157507510 learned_addr learned my addr 172.21.15.69:0/157507510 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:18.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f9903e00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904183d40 0x7f9904160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f98faa00640 1 -- 172.21.15.69:0/157507510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904183d40 msgr2=0x7f9904160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f98faa00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904183d40 0x7f9904160a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f98faa00640 1 -- 172.21.15.69:0/157507510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f990415e9e0 msgr2=0x7f9904155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:18.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f98faa00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f990415e9e0 0x7f9904155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:18.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f98faa00640 1 -- 172.21.15.69:0/157507510 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc009a70 con 0x7f9904182f00 2024-02-21T07:42:18.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.957+0000 7f9903400640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f990415e9e0 0x7f9904155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.958+0000 7f98faa00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904182f00 0x7f9904155b60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00e840 tx=0x7f98ec00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.958+0000 7f98fbe00640 1 -- 172.21.15.69:0/157507510 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec0094f0 con 0x7f9904182f00 2024-02-21T07:42:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.958+0000 7f98fbe00640 1 -- 172.21.15.69:0/157507510 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ec00c8e0 con 0x7f9904182f00 2024-02-21T07:42:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.958+0000 7f9908a00640 1 -- 172.21.15.69:0/157507510 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990415f9d0 con 0x7f9904182f00 2024-02-21T07:42:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.958+0000 7f98fbe00640 1 -- 172.21.15.69:0/157507510 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ec00cc70 con 0x7f9904182f00 2024-02-21T07:42:18.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.958+0000 7f9908a00640 1 -- 172.21.15.69:0/157507510 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f990415ff90 con 0x7f9904182f00 2024-02-21T07:42:18.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.959+0000 7f9908a00640 1 -- 172.21.15.69:0/157507510 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9904160790 con 0x7f9904182f00 2024-02-21T07:42:18.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.962+0000 7f98fbe00640 1 -- 172.21.15.69:0/157507510 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f98ec013470 con 0x7f9904182f00 2024-02-21T07:42:18.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.963+0000 7f98fbe00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f98e009f0a0 0x7f98e00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:18.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.963+0000 7f98fbe00640 1 -- 172.21.15.69:0/157507510 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f98ec0ca2d0 con 0x7f9904182f00 2024-02-21T07:42:18.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.963+0000 7f9903400640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f98e009f0a0 0x7f98e00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:18.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.964+0000 7f9903400640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f98e009f0a0 0x7f98e00a1560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005880 tx=0x7f98f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:18.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:18.965+0000 7f98fbe00640 1 -- 172.21.15.69:0/157507510 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f98ec0940e0 con 0x7f9904182f00 2024-02-21T07:42:19.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.154+0000 7f9908a00640 1 -- 172.21.15.69:0/157507510 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9904069c10 con 0x7f9904182f00 2024-02-21T07:42:19.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.155+0000 7f98fbe00640 1 -- 172.21.15.69:0/157507510 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98ec0210a0 con 0x7f9904182f00 2024-02-21T07:42:19.161 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-02-21T07:42:19.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 -- 172.21.15.69:0/157507510 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f98e009f0a0 msgr2=0x7f98e00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f98e009f0a0 0x7f98e00a1560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005880 tx=0x7f98f4009040 comp rx=0 tx=0).stop 2024-02-21T07:42:19.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 -- 172.21.15.69:0/157507510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904182f00 msgr2=0x7f9904155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904182f00 0x7f9904155b60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f98ec00e840 tx=0x7f98ec00ed00 comp rx=0 tx=0).stop 2024-02-21T07:42:19.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 -- 172.21.15.69:0/157507510 shutdown_connections 2024-02-21T07:42:19.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f98e009f0a0 0x7f98e00a1560 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9904183d40 0x7f9904160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9904182f00 0x7f9904155b60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 --2- 172.21.15.69:0/157507510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f990415e9e0 0x7f9904155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 -- 172.21.15.69:0/157507510 >> 172.21.15.69:0/157507510 conn(0x7f99040ce1b0 msgr2=0x7f990406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:19.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 -- 172.21.15.69:0/157507510 shutdown_connections 2024-02-21T07:42:19.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.158+0000 7f9908a00640 1 -- 172.21.15.69:0/157507510 wait complete. 2024-02-21T07:42:19.183 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:42:19.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.369+0000 7f6331a00640 1 Processor -- start 2024-02-21T07:42:19.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.370+0000 7f6331a00640 1 -- start start 2024-02-21T07:42:19.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.372+0000 7f6331a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f632c17f700 0x7f632c183670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.372+0000 7f6331a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f632c1850e0 0x7f632c0cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.372+0000 7f6331a00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f632c184c50 con 0x7f632c185cc0 2024-02-21T07:42:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.372+0000 7f6331a00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632c185560 con 0x7f632c17f700 2024-02-21T07:42:19.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.372+0000 7f6331a00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632c183d60 con 0x7f632c1850e0 2024-02-21T07:42:19.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.372+0000 7f632b400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f632c185cc0 0x7f632c186130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44096/0 (socket says 172.21.15.69:44096) 2024-02-21T07:42:19.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.372+0000 7f632aa00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f632c17f700 0x7f632c183670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.372+0000 7f632b400640 1 -- 172.21.15.69:0/2198528509 learned_addr learned my addr 172.21.15.69:0/2198528509 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:19.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.372+0000 7f6322000640 1 --2- 172.21.15.69:0/2198528509 >> v2:172.21.15.174:3300/0 conn(0x7f632c1850e0 0x7f632c0cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.373+0000 7f632aa00640 1 -- 172.21.15.69:0/2198528509 >> v2:172.21.15.174:3300/0 conn(0x7f632c1850e0 msgr2=0x7f632c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:19.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.373+0000 7f632aa00640 1 --2- 172.21.15.69:0/2198528509 >> v2:172.21.15.174:3300/0 conn(0x7f632c1850e0 0x7f632c0cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.373+0000 7f632aa00640 1 -- 172.21.15.69:0/2198528509 >> v1:172.21.15.69:6789/0 conn(0x7f632c185cc0 legacy=0x7f632c186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.373+0000 7f632aa00640 1 -- 172.21.15.69:0/2198528509 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c184040 con 0x7f632c17f700 2024-02-21T07:42:19.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.373+0000 7f632a000640 1 -- 172.21.15.69:0/2198528509 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113051462 0 0) 0x7f632c184c50 con 0x7f632c185cc0 2024-02-21T07:42:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.374+0000 7f632aa00640 1 --2- 172.21.15.69:0/2198528509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 0x7f632c183670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f632c0cbeb0 tx=0x7f631c02df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f49051d08ba052f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.374+0000 7f632a000640 1 -- 172.21.15.69:0/2198528509 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c02ed30 con 0x7f632c17f700 2024-02-21T07:42:19.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.374+0000 7f632a000640 1 -- 172.21.15.69:0/2198528509 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c02ee90 con 0x7f632c17f700 2024-02-21T07:42:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.374+0000 7f632a000640 1 -- 172.21.15.69:0/2198528509 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c036660 con 0x7f632c17f700 2024-02-21T07:42:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.375+0000 7f6331a00640 1 -- 172.21.15.69:0/2198528509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 msgr2=0x7f632c183670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.375+0000 7f6331a00640 1 --2- 172.21.15.69:0/2198528509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 0x7f632c183670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f632c0cbeb0 tx=0x7f631c02df80 comp rx=0 tx=0).stop 2024-02-21T07:42:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.375+0000 7f6331a00640 1 -- 172.21.15.69:0/2198528509 shutdown_connections 2024-02-21T07:42:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.375+0000 7f6331a00640 1 --2- 172.21.15.69:0/2198528509 >> v2:172.21.15.174:3300/0 conn(0x7f632c1850e0 0x7f632c0cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.375+0000 7f6331a00640 1 --2- 172.21.15.69:0/2198528509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 0x7f632c183670 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.375+0000 7f6331a00640 1 -- 172.21.15.69:0/2198528509 >> 172.21.15.69:0/2198528509 conn(0x7f632c0ce3d0 msgr2=0x7f632c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.375+0000 7f6331a00640 1 -- 172.21.15.69:0/2198528509 shutdown_connections 2024-02-21T07:42:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.375+0000 7f6331a00640 1 -- 172.21.15.69:0/2198528509 wait complete. 2024-02-21T07:42:19.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.377+0000 7f6331a00640 1 Processor -- start 2024-02-21T07:42:19.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.377+0000 7f6331a00640 1 -- start start 2024-02-21T07:42:19.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f6331a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 0x7f632c1677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f6331a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f632c1850e0 0x7f632c0f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f6331a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f632c185cc0 0x7f632c0f16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f6331a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c21e7b0 con 0x7f632c17f700 2024-02-21T07:42:19.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f6331a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c0eda30 con 0x7f632c1850e0 2024-02-21T07:42:19.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f6331a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632c0f1c00 con 0x7f632c185cc0 2024-02-21T07:42:19.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f632aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 0x7f632c1677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f632aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 0x7f632c1677d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35144/0 (socket says 172.21.15.69:35144) 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f632aa00640 1 -- 172.21.15.69:0/1807875843 learned_addr learned my addr 172.21.15.69:0/1807875843 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f6322000640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f632c1850e0 0x7f632c0f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.378+0000 7f632b400640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f632c185cc0 0x7f632c0f16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f632aa00640 1 -- 172.21.15.69:0/1807875843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f632c185cc0 msgr2=0x7f632c0f16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f632aa00640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f632c185cc0 0x7f632c0f16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f632aa00640 1 -- 172.21.15.69:0/1807875843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f632c1850e0 msgr2=0x7f632c0f1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f632aa00640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f632c1850e0 0x7f632c0f1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f632aa00640 1 -- 172.21.15.69:0/1807875843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c00b6a0 con 0x7f632c17f700 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f632aa00640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 0x7f632c1677d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f631c039040 tx=0x7f631c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f6323400640 1 -- 172.21.15.69:0/1807875843 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c03f640 con 0x7f632c17f700 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f6323400640 1 -- 172.21.15.69:0/1807875843 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c03f7a0 con 0x7f632c17f700 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f6323400640 1 -- 172.21.15.69:0/1807875843 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c03fb50 con 0x7f632c17f700 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f6331a00640 1 -- 172.21.15.69:0/1807875843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632c21e9c0 con 0x7f632c17f700 2024-02-21T07:42:19.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.379+0000 7f6331a00640 1 -- 172.21.15.69:0/1807875843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f632c21ef80 con 0x7f632c17f700 2024-02-21T07:42:19.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.381+0000 7f6331a00640 1 -- 172.21.15.69:0/1807875843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632c0edba0 con 0x7f632c17f700 2024-02-21T07:42:19.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.382+0000 7f6323400640 1 -- 172.21.15.69:0/1807875843 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f631c03d070 con 0x7f632c17f700 2024-02-21T07:42:19.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.384+0000 7f6323400640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f630809f0a0 0x7f63080a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.385+0000 7f6323400640 1 -- 172.21.15.69:0/1807875843 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f631c0ebd50 con 0x7f632c17f700 2024-02-21T07:42:19.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.385+0000 7f6322000640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f630809f0a0 0x7f63080a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.386+0000 7f6322000640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f630809f0a0 0x7f63080a1560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f632c189600 tx=0x7f6314009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:19.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.388+0000 7f6323400640 1 -- 172.21.15.69:0/1807875843 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f631c0b5cf0 con 0x7f632c17f700 2024-02-21T07:42:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.583+0000 7f6331a00640 1 -- 172.21.15.69:0/1807875843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f632c069d50 con 0x7f632c17f700 2024-02-21T07:42:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.584+0000 7f6323400640 1 -- 172.21.15.69:0/1807875843 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f631c0430a0 con 0x7f632c17f700 2024-02-21T07:42:19.589 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:42:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 -- 172.21.15.69:0/1807875843 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f630809f0a0 msgr2=0x7f63080a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f630809f0a0 0x7f63080a1560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f632c189600 tx=0x7f6314009190 comp rx=0 tx=0).stop 2024-02-21T07:42:19.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 -- 172.21.15.69:0/1807875843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 msgr2=0x7f632c1677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 0x7f632c1677d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f631c039040 tx=0x7f631c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 -- 172.21.15.69:0/1807875843 shutdown_connections 2024-02-21T07:42:19.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f630809f0a0 0x7f63080a1560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f632c185cc0 0x7f632c0f16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f632c1850e0 0x7f632c0f1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 --2- 172.21.15.69:0/1807875843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f632c17f700 0x7f632c1677d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 -- 172.21.15.69:0/1807875843 >> 172.21.15.69:0/1807875843 conn(0x7f632c0ce3d0 msgr2=0x7f632c183570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:19.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.586+0000 7f6331a00640 1 -- 172.21.15.69:0/1807875843 shutdown_connections 2024-02-21T07:42:19.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.587+0000 7f6331a00640 1 -- 172.21.15.69:0/1807875843 wait complete. 2024-02-21T07:42:19.612 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:42:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.812+0000 7f6f47e00640 1 Processor -- start 2024-02-21T07:42:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.813+0000 7f6f47e00640 1 -- start start 2024-02-21T07:42:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.815+0000 7f6f47e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6f4017f550 0x7f6f400f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.815+0000 7f6f47e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f40189f40 con 0x7f6f400fa350 2024-02-21T07:42:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.815+0000 7f6f47e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4017f930 con 0x7f6f400fa7c0 2024-02-21T07:42:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.815+0000 7f6f47e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f400ff310 con 0x7f6f4017f550 2024-02-21T07:42:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.815+0000 7f6f44a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6f400fa350 0x7f6f4018afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44108/0 (socket says 172.21.15.69:44108) 2024-02-21T07:42:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.815+0000 7f6f44a00640 1 -- 172.21.15.69:0/2373569741 learned_addr learned my addr 172.21.15.69:0/2373569741 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:19.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.815+0000 7f6f45400640 1 --2- 172.21.15.69:0/2373569741 >> v2:172.21.15.174:3300/0 conn(0x7f6f4017f550 0x7f6f400f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.816+0000 7f6f3fe00640 1 -- 172.21.15.69:0/2373569741 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927744969 0 0) 0x7f6f40189f40 con 0x7f6f400fa350 2024-02-21T07:42:19.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.816+0000 7f6f3fe00640 1 -- 172.21.15.69:0/2373569741 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f28003520 con 0x7f6f400fa350 2024-02-21T07:42:19.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.816+0000 7f6f3fe00640 1 -- 172.21.15.69:0/2373569741 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908667041 0 0) 0x7f6f4017f930 con 0x7f6f400fa7c0 2024-02-21T07:42:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.816+0000 7f6f3fe00640 1 -- 172.21.15.69:0/2373569741 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f40189f40 con 0x7f6f400fa7c0 2024-02-21T07:42:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.816+0000 7f6f45400640 1 -- 172.21.15.69:0/2373569741 >> v1:172.21.15.174:6789/0 conn(0x7f6f400fa7c0 legacy=0x7f6f4018b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.816+0000 7f6f45400640 1 -- 172.21.15.69:0/2373569741 >> v1:172.21.15.69:6789/0 conn(0x7f6f400fa350 legacy=0x7f6f4018afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.816+0000 7f6f45400640 1 -- 172.21.15.69:0/2373569741 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400fac50 con 0x7f6f4017f550 2024-02-21T07:42:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.817+0000 7f6f45400640 1 --2- 172.21.15.69:0/2373569741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f4017f550 0x7f6f400f9e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f340097a0 tx=0x7f6f3402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=375f5fcc4f9812b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.818+0000 7f6f3fe00640 1 -- 172.21.15.69:0/2373569741 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f34031830 con 0x7f6f4017f550 2024-02-21T07:42:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.818+0000 7f6f3fe00640 1 -- 172.21.15.69:0/2373569741 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f34031990 con 0x7f6f4017f550 2024-02-21T07:42:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.818+0000 7f6f3fe00640 1 -- 172.21.15.69:0/2373569741 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f34031d20 con 0x7f6f4017f550 2024-02-21T07:42:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.818+0000 7f6f47e00640 1 -- 172.21.15.69:0/2373569741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f4017f550 msgr2=0x7f6f400f9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.818+0000 7f6f47e00640 1 --2- 172.21.15.69:0/2373569741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f4017f550 0x7f6f400f9e10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6f340097a0 tx=0x7f6f3402b8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.818+0000 7f6f47e00640 1 -- 172.21.15.69:0/2373569741 shutdown_connections 2024-02-21T07:42:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.818+0000 7f6f47e00640 1 --2- 172.21.15.69:0/2373569741 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f4017f550 0x7f6f400f9e10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.818+0000 7f6f47e00640 1 -- 172.21.15.69:0/2373569741 >> 172.21.15.69:0/2373569741 conn(0x7f6f400668e0 msgr2=0x7f6f40066cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:19.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.818+0000 7f6f47e00640 1 -- 172.21.15.69:0/2373569741 shutdown_connections 2024-02-21T07:42:19.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.818+0000 7f6f47e00640 1 -- 172.21.15.69:0/2373569741 wait complete. 2024-02-21T07:42:19.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.820+0000 7f6f47e00640 1 Processor -- start 2024-02-21T07:42:19.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.821+0000 7f6f47e00640 1 -- start start 2024-02-21T07:42:19.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f47e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f400fa350 0x7f6f40168390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f47e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4017f550 0x7f6f4021ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f47e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f4021f340 0x7f6f4017d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f47e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f401840f0 con 0x7f6f4017f550 2024-02-21T07:42:19.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f47e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4017dff0 con 0x7f6f400fa350 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f47e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4017e2d0 con 0x7f6f4021f340 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f44a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4017f550 0x7f6f4021ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f44a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4017f550 0x7f6f4021ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35152/0 (socket says 172.21.15.69:35152) 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f44a00640 1 -- 172.21.15.69:0/3508710405 learned_addr learned my addr 172.21.15.69:0/3508710405 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f45400640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f400fa350 0x7f6f40168390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f45e00640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f4021f340 0x7f6f4017d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f44a00640 1 -- 172.21.15.69:0/3508710405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f4021f340 msgr2=0x7f6f4017d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f44a00640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f4021f340 0x7f6f4017d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f44a00640 1 -- 172.21.15.69:0/3508710405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f400fa350 msgr2=0x7f6f40168390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.822+0000 7f6f44a00640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f400fa350 0x7f6f40168390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.823+0000 7f6f44a00640 1 -- 172.21.15.69:0/3508710405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f34009400 con 0x7f6f4017f550 2024-02-21T07:42:19.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.823+0000 7f6f44a00640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4017f550 0x7f6f4021ee00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c3c0 tx=0x7f6f2c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:19.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.823+0000 7f6f3d600640 1 -- 172.21.15.69:0/3508710405 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c005da0 con 0x7f6f4017f550 2024-02-21T07:42:19.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.823+0000 7f6f3d600640 1 -- 172.21.15.69:0/3508710405 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c0070d0 con 0x7f6f4017f550 2024-02-21T07:42:19.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.823+0000 7f6f47e00640 1 -- 172.21.15.69:0/3508710405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f4017e5b0 con 0x7f6f4017f550 2024-02-21T07:42:19.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.823+0000 7f6f3d600640 1 -- 172.21.15.69:0/3508710405 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c007460 con 0x7f6f4017f550 2024-02-21T07:42:19.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.823+0000 7f6f47e00640 1 -- 172.21.15.69:0/3508710405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4017eb70 con 0x7f6f4017f550 2024-02-21T07:42:19.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.825+0000 7f6f47e00640 1 -- 172.21.15.69:0/3508710405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f40184260 con 0x7f6f4017f550 2024-02-21T07:42:19.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.826+0000 7f6f3d600640 1 -- 172.21.15.69:0/3508710405 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f6f2c0075c0 con 0x7f6f4017f550 2024-02-21T07:42:19.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.828+0000 7f6f3d600640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f2009f0d0 0x7f6f200a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:19.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.828+0000 7f6f3d600640 1 -- 172.21.15.69:0/3508710405 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f6f2c0c9080 con 0x7f6f4017f550 2024-02-21T07:42:19.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.828+0000 7f6f45400640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f2009f0d0 0x7f6f200a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:19.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.829+0000 7f6f45400640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f2009f0d0 0x7f6f200a1590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f34036000 tx=0x7f6f3403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:19.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:19.831+0000 7f6f3d600640 1 -- 172.21.15.69:0/3508710405 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6f40184260 con 0x7f6f4017f550 2024-02-21T07:42:20.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.015+0000 7f6f47e00640 1 -- 172.21.15.69:0/3508710405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f40184230 con 0x7f6f4017f550 2024-02-21T07:42:20.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.016+0000 7f6f3d600640 1 -- 172.21.15.69:0/3508710405 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f2c017070 con 0x7f6f4017f550 2024-02-21T07:42:20.022 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-02-21T07:42:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 -- 172.21.15.69:0/3508710405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f2009f0d0 msgr2=0x7f6f200a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f2009f0d0 0x7f6f200a1590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f34036000 tx=0x7f6f3403c040 comp rx=0 tx=0).stop 2024-02-21T07:42:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 -- 172.21.15.69:0/3508710405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4017f550 msgr2=0x7f6f4021ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4017f550 0x7f6f4021ee00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c3c0 tx=0x7f6f2c00c880 comp rx=0 tx=0).stop 2024-02-21T07:42:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 -- 172.21.15.69:0/3508710405 shutdown_connections 2024-02-21T07:42:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f2009f0d0 0x7f6f200a1590 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f4021f340 0x7f6f4017d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f4017f550 0x7f6f4021ee00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 --2- 172.21.15.69:0/3508710405 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f400fa350 0x7f6f40168390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 -- 172.21.15.69:0/3508710405 >> 172.21.15.69:0/3508710405 conn(0x7f6f400668e0 msgr2=0x7f6f40174c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 -- 172.21.15.69:0/3508710405 shutdown_connections 2024-02-21T07:42:20.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.018+0000 7f6f47e00640 1 -- 172.21.15.69:0/3508710405 wait complete. 2024-02-21T07:42:20.041 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:42:20.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.240+0000 7fe4bd200640 1 Processor -- start 2024-02-21T07:42:20.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.240+0000 7fe4bd200640 1 -- start start 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.242+0000 7fe4bd200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe4b8183ea0 0x7fe4b81846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.242+0000 7fe4bd200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe4b8184c20 0x7fe4b80ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.242+0000 7fe4bd200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b81850b0 con 0x7fe4b80eeb80 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.242+0000 7fe4bd200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b8186010 con 0x7fe4b8183ea0 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.242+0000 7fe4bd200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b8185390 con 0x7fe4b8184c20 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.242+0000 7fe4b5e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe4b8183ea0 0x7fe4b81846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.243+0000 7fe4b5e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe4b8183ea0 0x7fe4b81846e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:33234/0 (socket says 172.21.15.69:33234) 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.243+0000 7fe4b5e00640 1 -- 172.21.15.69:0/1934208580 learned_addr learned my addr 172.21.15.69:0/1934208580 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.243+0000 7fe4b5400640 1 --2- 172.21.15.69:0/1934208580 >> v2:172.21.15.184:3300/0 conn(0x7fe4b8184c20 0x7fe4b80ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.243+0000 7fe4b5e00640 1 -- 172.21.15.69:0/1934208580 >> v2:172.21.15.184:3300/0 conn(0x7fe4b8184c20 msgr2=0x7fe4b80ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.243+0000 7fe4b5e00640 1 --2- 172.21.15.69:0/1934208580 >> v2:172.21.15.184:3300/0 conn(0x7fe4b8184c20 0x7fe4b80ee640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.243+0000 7fe4b5e00640 1 -- 172.21.15.69:0/1934208580 >> v1:172.21.15.184:6789/0 conn(0x7fe4b80eeb80 legacy=0x7fe4b8186bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.243+0000 7fe4b5e00640 1 -- 172.21.15.69:0/1934208580 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b8185670 con 0x7fe4b8183ea0 2024-02-21T07:42:20.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.243+0000 7fe4b4a00640 1 -- 172.21.15.69:0/1934208580 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810328868 0 0) 0x7fe4b81850b0 con 0x7fe4b80eeb80 2024-02-21T07:42:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.243+0000 7fe4b5400640 1 --2- 172.21.15.69:0/1934208580 >> v2:172.21.15.184:3300/0 conn(0x7fe4b8184c20 0x7fe4b80ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.244+0000 7fe4b5e00640 1 --2- 172.21.15.69:0/1934208580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4b8183ea0 0x7fe4b81846e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80faf60 tx=0x7fe4a802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60db355b2baca8e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.244+0000 7fe4b4a00640 1 -- 172.21.15.69:0/1934208580 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8031870 con 0x7fe4b8183ea0 2024-02-21T07:42:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.245+0000 7fe4b4a00640 1 -- 172.21.15.69:0/1934208580 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a80319d0 con 0x7fe4b8183ea0 2024-02-21T07:42:20.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.245+0000 7fe4b4a00640 1 -- 172.21.15.69:0/1934208580 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8031d60 con 0x7fe4b8183ea0 2024-02-21T07:42:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.245+0000 7fe4bd200640 1 -- 172.21.15.69:0/1934208580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4b8183ea0 msgr2=0x7fe4b81846e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.245+0000 7fe4bd200640 1 --2- 172.21.15.69:0/1934208580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4b8183ea0 0x7fe4b81846e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80faf60 tx=0x7fe4a802b910 comp rx=0 tx=0).stop 2024-02-21T07:42:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.245+0000 7fe4bd200640 1 -- 172.21.15.69:0/1934208580 shutdown_connections 2024-02-21T07:42:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.245+0000 7fe4bd200640 1 --2- 172.21.15.69:0/1934208580 >> v2:172.21.15.184:3300/0 conn(0x7fe4b8184c20 0x7fe4b80ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.245+0000 7fe4bd200640 1 --2- 172.21.15.69:0/1934208580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4b8183ea0 0x7fe4b81846e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.245+0000 7fe4bd200640 1 -- 172.21.15.69:0/1934208580 >> 172.21.15.69:0/1934208580 conn(0x7fe4b80ce3d0 msgr2=0x7fe4b80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.245+0000 7fe4bd200640 1 -- 172.21.15.69:0/1934208580 shutdown_connections 2024-02-21T07:42:20.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.245+0000 7fe4bd200640 1 -- 172.21.15.69:0/1934208580 wait complete. 2024-02-21T07:42:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.248+0000 7fe4bd200640 1 Processor -- start 2024-02-21T07:42:20.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.248+0000 7fe4bd200640 1 -- start start 2024-02-21T07:42:20.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.249+0000 7fe4bd200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80eeb80 0x7fe4b81725d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4bd200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4b8183ea0 0x7fe4b8172b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4bd200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4b8221880 0x7fe4b8221cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4bd200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8220840 con 0x7fe4b8221880 2024-02-21T07:42:20.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4bd200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8220ae0 con 0x7fe4b8183ea0 2024-02-21T07:42:20.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4bd200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b8220dc0 con 0x7fe4b80eeb80 2024-02-21T07:42:20.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4b5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80eeb80 0x7fe4b81725d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4b6800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4b8221880 0x7fe4b8221cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4b5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80eeb80 0x7fe4b81725d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:44330/0 (socket says 172.21.15.69:44330) 2024-02-21T07:42:20.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4b5e00640 1 -- 172.21.15.69:0/1133210769 learned_addr learned my addr 172.21.15.69:0/1133210769 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:20.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4b5400640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4b8183ea0 0x7fe4b8172b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4b5e00640 1 -- 172.21.15.69:0/1133210769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4b8183ea0 msgr2=0x7fe4b8172b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4b5e00640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4b8183ea0 0x7fe4b8172b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4b5e00640 1 -- 172.21.15.69:0/1133210769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4b8221880 msgr2=0x7fe4b8221cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4b5e00640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4b8221880 0x7fe4b8221cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.250+0000 7fe4b5e00640 1 -- 172.21.15.69:0/1133210769 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4009400 con 0x7fe4b80eeb80 2024-02-21T07:42:20.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.251+0000 7fe4b5e00640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80eeb80 0x7fe4b81725d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe4a802b950 tx=0x7fe4a80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:20.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.251+0000 7fe4ae000640 1 -- 172.21.15.69:0/1133210769 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a803abe0 con 0x7fe4b80eeb80 2024-02-21T07:42:20.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.251+0000 7fe4ae000640 1 -- 172.21.15.69:0/1133210769 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a803ad60 con 0x7fe4b80eeb80 2024-02-21T07:42:20.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.251+0000 7fe4bd200640 1 -- 172.21.15.69:0/1133210769 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a80094d0 con 0x7fe4b80eeb80 2024-02-21T07:42:20.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.251+0000 7fe4ae000640 1 -- 172.21.15.69:0/1133210769 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8044630 con 0x7fe4b80eeb80 2024-02-21T07:42:20.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.251+0000 7fe4bd200640 1 -- 172.21.15.69:0/1133210769 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b8221380 con 0x7fe4b80eeb80 2024-02-21T07:42:20.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.252+0000 7fe4bd200640 1 -- 172.21.15.69:0/1133210769 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b8221510 con 0x7fe4b80eeb80 2024-02-21T07:42:20.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.254+0000 7fe4ae000640 1 -- 172.21.15.69:0/1133210769 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe4a804d450 con 0x7fe4b80eeb80 2024-02-21T07:42:20.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.255+0000 7fe4ae000640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe49809f0a0 0x7fe4980a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.256+0000 7fe4ae000640 1 -- 172.21.15.69:0/1133210769 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe4a802d040 con 0x7fe4b80eeb80 2024-02-21T07:42:20.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.256+0000 7fe4b5400640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe49809f0a0 0x7fe4980a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.256+0000 7fe4b5400640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe49809f0a0 0x7fe4980a1560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4b808d330 tx=0x7fe4a4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:20.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.259+0000 7fe4ae000640 1 -- 172.21.15.69:0/1133210769 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe4a80b5d80 con 0x7fe4b80eeb80 2024-02-21T07:42:20.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.455+0000 7fe4bd200640 1 -- 172.21.15.69:0/1133210769 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe4b8069d50 con 0x7fe4b80eeb80 2024-02-21T07:42:20.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.456+0000 7fe4ae000640 1 -- 172.21.15.69:0/1133210769 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe4a8035020 con 0x7fe4b80eeb80 2024-02-21T07:42:20.462 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 -- 172.21.15.69:0/1133210769 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe49809f0a0 msgr2=0x7fe4980a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe49809f0a0 0x7fe4980a1560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4b808d330 tx=0x7fe4a4009190 comp rx=0 tx=0).stop 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 -- 172.21.15.69:0/1133210769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80eeb80 msgr2=0x7fe4b81725d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80eeb80 0x7fe4b81725d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe4a802b950 tx=0x7fe4a80046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 -- 172.21.15.69:0/1133210769 shutdown_connections 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe49809f0a0 0x7fe4980a1560 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4b8221880 0x7fe4b8221cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4b8183ea0 0x7fe4b8172b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 --2- 172.21.15.69:0/1133210769 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe4b80eeb80 0x7fe4b81725d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 -- 172.21.15.69:0/1133210769 >> 172.21.15.69:0/1133210769 conn(0x7fe4b80ce3d0 msgr2=0x7fe4b80f92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 -- 172.21.15.69:0/1133210769 shutdown_connections 2024-02-21T07:42:20.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.459+0000 7fe4bd200640 1 -- 172.21.15.69:0/1133210769 wait complete. 2024-02-21T07:42:20.485 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T07:42:20.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.692+0000 7f7237200640 1 Processor -- start 2024-02-21T07:42:20.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.693+0000 7f7237200640 1 -- start start 2024-02-21T07:42:20.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.695+0000 7f7237200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f723815dad0 0x7f72380fd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.695+0000 7f7237200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72381897f0 con 0x7f7238189d50 2024-02-21T07:42:20.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.695+0000 7f7237200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72380fc3c0 con 0x7f7238160c10 2024-02-21T07:42:20.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.695+0000 7f7237200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72380fdc80 con 0x7f723815dad0 2024-02-21T07:42:20.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.695+0000 7f7235e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f723815dad0 0x7f72380fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.695+0000 7f7235400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f7238189d50 0x7f7238160500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:38750/0 (socket says 172.21.15.69:38750) 2024-02-21T07:42:20.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.695+0000 7f7235400640 1 -- 172.21.15.69:0/94946482 learned_addr learned my addr 172.21.15.69:0/94946482 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:20.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.696+0000 7f7235e00640 1 -- 172.21.15.69:0/94946482 >> v1:172.21.15.184:6789/0 conn(0x7f7238160c10 legacy=0x7f72380d55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.696+0000 7f7235e00640 1 -- 172.21.15.69:0/94946482 >> v1:172.21.15.174:6789/0 conn(0x7f7238189d50 legacy=0x7f7238160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.696+0000 7f7234a00640 1 -- 172.21.15.69:0/94946482 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917397209 0 0) 0x7f72380fc3c0 con 0x7f7238160c10 2024-02-21T07:42:20.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.696+0000 7f7235e00640 1 -- 172.21.15.69:0/94946482 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72380fc6a0 con 0x7f723815dad0 2024-02-21T07:42:20.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.697+0000 7f7235e00640 1 --2- 172.21.15.69:0/94946482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 0x7f72380fd740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f72280097a0 tx=0x7f722802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb8744394d06a734 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:20.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.697+0000 7f7234a00640 1 -- 172.21.15.69:0/94946482 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228030710 con 0x7f723815dad0 2024-02-21T07:42:20.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.697+0000 7f7234a00640 1 -- 172.21.15.69:0/94946482 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722802e050 con 0x7f723815dad0 2024-02-21T07:42:20.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.697+0000 7f7234a00640 1 -- 172.21.15.69:0/94946482 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228030a90 con 0x7f723815dad0 2024-02-21T07:42:20.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.698+0000 7f7237200640 1 -- 172.21.15.69:0/94946482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 msgr2=0x7f72380fd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.698+0000 7f7237200640 1 --2- 172.21.15.69:0/94946482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 0x7f72380fd740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f72280097a0 tx=0x7f722802b790 comp rx=0 tx=0).stop 2024-02-21T07:42:20.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.698+0000 7f7237200640 1 -- 172.21.15.69:0/94946482 shutdown_connections 2024-02-21T07:42:20.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.698+0000 7f7237200640 1 --2- 172.21.15.69:0/94946482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 0x7f72380fd740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.698+0000 7f7237200640 1 -- 172.21.15.69:0/94946482 >> 172.21.15.69:0/94946482 conn(0x7f72380d2c90 msgr2=0x7f72380d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:20.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.698+0000 7f7237200640 1 -- 172.21.15.69:0/94946482 shutdown_connections 2024-02-21T07:42:20.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.698+0000 7f7237200640 1 -- 172.21.15.69:0/94946482 wait complete. 2024-02-21T07:42:20.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.700+0000 7f7237200640 1 Processor -- start 2024-02-21T07:42:20.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.700+0000 7f7237200640 1 -- start start 2024-02-21T07:42:20.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.701+0000 7f7237200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 0x7f7238221d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.701+0000 7f7237200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7238160c10 0x7f7238222260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.701+0000 7f7237200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7238189d50 0x7f7238163300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.701+0000 7f7237200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238222ce0 con 0x7f7238160c10 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.701+0000 7f7237200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72382227a0 con 0x7f723815dad0 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.701+0000 7f7237200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238222a00 con 0x7f7238189d50 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.701+0000 7f7235e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 0x7f7238221d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.701+0000 7f7235400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7238160c10 0x7f7238222260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.701+0000 7f7235e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 0x7f7238221d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:33268/0 (socket says 172.21.15.69:33268) 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.701+0000 7f7235e00640 1 -- 172.21.15.69:0/262506515 learned_addr learned my addr 172.21.15.69:0/262506515 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.702+0000 7f7236800640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7238189d50 0x7f7238163300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.702+0000 7f7235e00640 1 -- 172.21.15.69:0/262506515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7238189d50 msgr2=0x7f7238163300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.702+0000 7f7235e00640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7238189d50 0x7f7238163300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.702+0000 7f7235e00640 1 -- 172.21.15.69:0/262506515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7238160c10 msgr2=0x7f7238222260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.702+0000 7f7235e00640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7238160c10 0x7f7238222260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.702+0000 7f7235e00640 1 -- 172.21.15.69:0/262506515 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7228009400 con 0x7f723815dad0 2024-02-21T07:42:20.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.702+0000 7f7235400640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7238160c10 0x7f7238222260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:20.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.702+0000 7f7235e00640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 0x7f7238221d20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7228000c00 tx=0x7f72280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:20.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.702+0000 7f722e000640 1 -- 172.21.15.69:0/262506515 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280329d0 con 0x7f723815dad0 2024-02-21T07:42:20.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.703+0000 7f722e000640 1 -- 172.21.15.69:0/262506515 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228032b50 con 0x7f723815dad0 2024-02-21T07:42:20.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.703+0000 7f7237200640 1 -- 172.21.15.69:0/262506515 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723821fdc0 con 0x7f723815dad0 2024-02-21T07:42:20.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.703+0000 7f722e000640 1 -- 172.21.15.69:0/262506515 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722803c470 con 0x7f723815dad0 2024-02-21T07:42:20.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.703+0000 7f7237200640 1 -- 172.21.15.69:0/262506515 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7238220380 con 0x7f723815dad0 2024-02-21T07:42:20.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.704+0000 7f7237200640 1 -- 172.21.15.69:0/262506515 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723806cba0 con 0x7f723815dad0 2024-02-21T07:42:20.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.706+0000 7f722e000640 1 -- 172.21.15.69:0/262506515 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7228039040 con 0x7f723815dad0 2024-02-21T07:42:20.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.707+0000 7f722e000640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f721409f0a0 0x7f72140a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:20.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.707+0000 7f722e000640 1 -- 172.21.15.69:0/262506515 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f72280ebbd0 con 0x7f723815dad0 2024-02-21T07:42:20.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.707+0000 7f7235400640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f721409f0a0 0x7f72140a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:20.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.708+0000 7f7235400640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f721409f0a0 0x7f72140a1560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7220007fd0 tx=0x7f7220007e60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:20.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.709+0000 7f722e000640 1 -- 172.21.15.69:0/262506515 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f72280b59e0 con 0x7f723815dad0 2024-02-21T07:42:20.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.918+0000 7f7237200640 1 -- 172.21.15.69:0/262506515 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7238069c10 con 0x7f723815dad0 2024-02-21T07:42:20.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.919+0000 7f722e000640 1 -- 172.21.15.69:0/262506515 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f72280b7910 con 0x7f723815dad0 2024-02-21T07:42:20.925 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2024-02-21T07:42:20.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 -- 172.21.15.69:0/262506515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f721409f0a0 msgr2=0x7f72140a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f721409f0a0 0x7f72140a1560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7220007fd0 tx=0x7f7220007e60 comp rx=0 tx=0).stop 2024-02-21T07:42:20.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 -- 172.21.15.69:0/262506515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 msgr2=0x7f7238221d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:20.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 0x7f7238221d20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7228000c00 tx=0x7f72280046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 -- 172.21.15.69:0/262506515 shutdown_connections 2024-02-21T07:42:20.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f721409f0a0 0x7f72140a1560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7238189d50 0x7f7238163300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7238160c10 0x7f7238222260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 --2- 172.21.15.69:0/262506515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f723815dad0 0x7f7238221d20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:20.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 -- 172.21.15.69:0/262506515 >> 172.21.15.69:0/262506515 conn(0x7f72380d2c90 msgr2=0x7f723818a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:20.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 -- 172.21.15.69:0/262506515 shutdown_connections 2024-02-21T07:42:20.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:20.922+0000 7f7237200640 1 -- 172.21.15.69:0/262506515 wait complete. 2024-02-21T07:42:20.947 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi069.front.sepia.ceph.com... 2024-02-21T07:42:20.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:20.947 DEBUG:teuthology.orchestra.run.smithi069:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-02-21T07:42:21.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi069.stderr:ceph-fuse[44639]: fuse finished with error 0 and tester_r 0 2024-02-21T07:42:21.027 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:42:27.129 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:42:27.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:27.129 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-02-21T07:42:27.199 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:27.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.405+0000 7f0045200640 1 Processor -- start 2024-02-21T07:42:27.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.405+0000 7f0045200640 1 -- start start 2024-02-21T07:42:27.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.407+0000 7f0045200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0040187740 con 0x7f0040183fa0 2024-02-21T07:42:27.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.407+0000 7f0045200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400ce230 con 0x7f00400cd090 2024-02-21T07:42:27.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.407+0000 7f0045200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0040184380 con 0x7f00400f6310 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.407+0000 7f003de00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f0040183fa0 0x7f0040188270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44110/0 (socket says 172.21.15.69:44110) 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.407+0000 7f003de00640 1 -- 172.21.15.69:0/770086507 learned_addr learned my addr 172.21.15.69:0/770086507 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.407+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166712813 0 0) 0x7f0040184380 con 0x7f00400f6310 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.407+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0024003520 con 0x7f00400f6310 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.407+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021510551 0 0) 0x7f0040187740 con 0x7f0040183fa0 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.407+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0040184380 con 0x7f0040183fa0 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894474778 0 0) 0x7f00400ce230 con 0x7f00400cd090 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0040187740 con 0x7f00400cd090 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4280665121 0 0) 0x7f0024003520 con 0x7f00400f6310 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 >> v1:172.21.15.174:6789/0 conn(0x7f00400cd090 legacy=0x7f0040188980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 >> v1:172.21.15.69:6789/0 conn(0x7f0040183fa0 legacy=0x7f0040188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00400cd6b0 con 0x7f00400f6310 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f00380019f0 con 0x7f00400f6310 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 >> v1:172.21.15.184:6789/0 conn(0x7f00400f6310 legacy=0x7f004006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0024004d20 0x7f0024005100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00240037b0 0x7f0024003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0024004340 0x7f002400ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0030001210 con 0x7f00240037b0 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002400c2e0 con 0x7f0024004340 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002400c4a0 con 0x7f0024004d20 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003de00640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0024004d20 0x7f0024005100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003d400640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00240037b0 0x7f0024003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.408+0000 7f003e800640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0024004340 0x7f002400ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.409+0000 7f003de00640 1 -- 172.21.15.69:0/770086507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0024004340 msgr2=0x7f002400ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:27.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.409+0000 7f003de00640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0024004340 0x7f002400ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.409+0000 7f003de00640 1 -- 172.21.15.69:0/770086507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00240037b0 msgr2=0x7f0024003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:27.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.409+0000 7f003de00640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00240037b0 0x7f0024003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.409+0000 7f003de00640 1 -- 172.21.15.69:0/770086507 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024003520 con 0x7f0024004d20 2024-02-21T07:42:27.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.409+0000 7f003e800640 1 -- 172.21.15.69:0/770086507 reap_dead start 2024-02-21T07:42:27.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.409+0000 7f003d400640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00240037b0 0x7f0024003c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:27.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.410+0000 7f003de00640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0024004d20 0x7f0024005100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0030007f80 tx=0x7f00240057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5575615ec4c320b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:27.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.410+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030004b60 con 0x7f0024004d20 2024-02-21T07:42:27.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.410+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0030004cc0 con 0x7f0024004d20 2024-02-21T07:42:27.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.410+0000 7f003ca00640 1 -- 172.21.15.69:0/770086507 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030007310 con 0x7f0024004d20 2024-02-21T07:42:27.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.411+0000 7f0045200640 1 -- 172.21.15.69:0/770086507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0024004d20 msgr2=0x7f0024005100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.411+0000 7f0045200640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0024004d20 0x7f0024005100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0030007f80 tx=0x7f00240057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.411+0000 7f0045200640 1 -- 172.21.15.69:0/770086507 shutdown_connections 2024-02-21T07:42:27.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.411+0000 7f0045200640 1 --2- 172.21.15.69:0/770086507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0024004d20 0x7f0024005100 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.411+0000 7f0045200640 1 -- 172.21.15.69:0/770086507 >> 172.21.15.69:0/770086507 conn(0x7f00400f69c0 msgr2=0x7f00400f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:27.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.411+0000 7f0045200640 1 -- 172.21.15.69:0/770086507 shutdown_connections 2024-02-21T07:42:27.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.411+0000 7f0045200640 1 -- 172.21.15.69:0/770086507 wait complete. 2024-02-21T07:42:27.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.413+0000 7f0045200640 1 Processor -- start 2024-02-21T07:42:27.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.413+0000 7f0045200640 1 -- start start 2024-02-21T07:42:27.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f0045200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0024004d20 0x7f004021b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f0045200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f004021d160 0x7f0040179030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f0045200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0040160910 0x7f0040218040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f0045200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004021bde0 con 0x7f0024004d20 2024-02-21T07:42:27.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f0045200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004021c0c0 con 0x7f0040160910 2024-02-21T07:42:27.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f0045200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004021c3a0 con 0x7f004021d160 2024-02-21T07:42:27.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f003de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0024004d20 0x7f004021b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f003de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0024004d20 0x7f004021b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35178/0 (socket says 172.21.15.69:35178) 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f003de00640 1 -- 172.21.15.69:0/3382511675 learned_addr learned my addr 172.21.15.69:0/3382511675 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f003e800640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0040160910 0x7f0040218040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.414+0000 7f003d400640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f004021d160 0x7f0040179030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.415+0000 7f003de00640 1 -- 172.21.15.69:0/3382511675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f004021d160 msgr2=0x7f0040179030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.415+0000 7f003de00640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f004021d160 0x7f0040179030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.415+0000 7f003de00640 1 -- 172.21.15.69:0/3382511675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0040160910 msgr2=0x7f0040218040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.415+0000 7f003de00640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0040160910 0x7f0040218040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.415+0000 7f003de00640 1 -- 172.21.15.69:0/3382511675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004021c680 con 0x7f0024004d20 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.415+0000 7f003de00640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0024004d20 0x7f004021b540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0030007f80 tx=0x7f0030001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.415+0000 7f0036000640 1 -- 172.21.15.69:0/3382511675 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003003d070 con 0x7f0024004d20 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.415+0000 7f0036000640 1 -- 172.21.15.69:0/3382511675 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0030004e30 con 0x7f0024004d20 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.415+0000 7f0036000640 1 -- 172.21.15.69:0/3382511675 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030007560 con 0x7f0024004d20 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.415+0000 7f0045200640 1 -- 172.21.15.69:0/3382511675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004021c960 con 0x7f0024004d20 2024-02-21T07:42:27.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.416+0000 7f0045200640 1 -- 172.21.15.69:0/3382511675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004021ba80 con 0x7f0024004d20 2024-02-21T07:42:27.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.417+0000 7f0045200640 1 -- 172.21.15.69:0/3382511675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00400d1f20 con 0x7f0024004d20 2024-02-21T07:42:27.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.418+0000 7f0036000640 1 -- 172.21.15.69:0/3382511675 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f0030032040 con 0x7f0024004d20 2024-02-21T07:42:27.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.421+0000 7f0036000640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f002009f0a0 0x7f00200a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.421+0000 7f0036000640 1 -- 172.21.15.69:0/3382511675 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f00300eb1c0 con 0x7f0024004d20 2024-02-21T07:42:27.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.421+0000 7f003d400640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f002009f0a0 0x7f00200a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.422+0000 7f003d400640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f002009f0a0 0x7f00200a1560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f00400ce820 tx=0x7f002c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:27.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.425+0000 7f0036000640 1 -- 172.21.15.69:0/3382511675 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f00300b4fb0 con 0x7f0024004d20 2024-02-21T07:42:27.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.619+0000 7f0045200640 1 -- 172.21.15.69:0/3382511675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f004021c4e0 con 0x7f0024004d20 2024-02-21T07:42:27.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.623+0000 7f0036000640 1 -- 172.21.15.69:0/3382511675 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7f004021c4e0 con 0x7f0024004d20 2024-02-21T07:42:27.629 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:27.630 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:27.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.625+0000 7f0045200640 1 -- 172.21.15.69:0/3382511675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f002009f0a0 msgr2=0x7f00200a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.625+0000 7f0045200640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f002009f0a0 0x7f00200a1560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f00400ce820 tx=0x7f002c009040 comp rx=0 tx=0).stop 2024-02-21T07:42:27.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.626+0000 7f0045200640 1 -- 172.21.15.69:0/3382511675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0024004d20 msgr2=0x7f004021b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.626+0000 7f0045200640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0024004d20 0x7f004021b540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0030007f80 tx=0x7f0030001730 comp rx=0 tx=0).stop 2024-02-21T07:42:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.626+0000 7f0045200640 1 -- 172.21.15.69:0/3382511675 shutdown_connections 2024-02-21T07:42:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.626+0000 7f0045200640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f002009f0a0 0x7f00200a1560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.626+0000 7f0045200640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0040160910 0x7f0040218040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.626+0000 7f0045200640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f004021d160 0x7f0040179030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.626+0000 7f0045200640 1 --2- 172.21.15.69:0/3382511675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0024004d20 0x7f004021b540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.626+0000 7f0045200640 1 -- 172.21.15.69:0/3382511675 >> 172.21.15.69:0/3382511675 conn(0x7f00400f69c0 msgr2=0x7f00400f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.626+0000 7f0045200640 1 -- 172.21.15.69:0/3382511675 shutdown_connections 2024-02-21T07:42:27.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.626+0000 7f0045200640 1 -- 172.21.15.69:0/3382511675 wait complete. 2024-02-21T07:42:27.650 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:27.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.847+0000 7fa5f5e00640 1 Processor -- start 2024-02-21T07:42:27.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.847+0000 7fa5f5e00640 1 -- start start 2024-02-21T07:42:27.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.849+0000 7fa5f5e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa5f01888c0 0x7fa5f00fa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.849+0000 7fa5f5e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f0188dd0 con 0x7fa5f0185fa0 2024-02-21T07:42:27.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.849+0000 7fa5f5e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f01890b0 con 0x7fa5f0186380 2024-02-21T07:42:27.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.849+0000 7fa5f5e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f0189950 con 0x7fa5f01888c0 2024-02-21T07:42:27.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.849+0000 7fa5eea00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa5f0185fa0 0x7fa5f00fd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44114/0 (socket says 172.21.15.69:44114) 2024-02-21T07:42:27.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.849+0000 7fa5eea00640 1 -- 172.21.15.69:0/3711791170 learned_addr learned my addr 172.21.15.69:0/3711791170 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:27.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.849+0000 7fa5ef400640 1 --2- 172.21.15.69:0/3711791170 >> v2:172.21.15.174:3300/0 conn(0x7fa5f01888c0 0x7fa5f00fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.850+0000 7fa5ee000640 1 -- 172.21.15.69:0/3711791170 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170567542 0 0) 0x7fa5f01890b0 con 0x7fa5f0186380 2024-02-21T07:42:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.850+0000 7fa5ee000640 1 -- 172.21.15.69:0/3711791170 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d4003520 con 0x7fa5f0186380 2024-02-21T07:42:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.850+0000 7fa5ee000640 1 -- 172.21.15.69:0/3711791170 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985778282 0 0) 0x7fa5f0188dd0 con 0x7fa5f0185fa0 2024-02-21T07:42:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.850+0000 7fa5ee000640 1 -- 172.21.15.69:0/3711791170 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5f01890b0 con 0x7fa5f0185fa0 2024-02-21T07:42:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.850+0000 7fa5ef400640 1 -- 172.21.15.69:0/3711791170 >> v1:172.21.15.184:6789/0 conn(0x7fa5f0186380 legacy=0x7fa5f00fa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.850+0000 7fa5ef400640 1 -- 172.21.15.69:0/3711791170 >> v1:172.21.15.69:6789/0 conn(0x7fa5f0185fa0 legacy=0x7fa5f00fd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.850+0000 7fa5ef400640 1 -- 172.21.15.69:0/3711791170 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0189390 con 0x7fa5f01888c0 2024-02-21T07:42:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.851+0000 7fa5ef400640 1 --2- 172.21.15.69:0/3711791170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f01888c0 0x7fa5f00fa870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009d90 tx=0x7fa5e802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b615ebceda03decd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.851+0000 7fa5ee000640 1 -- 172.21.15.69:0/3711791170 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e802cc60 con 0x7fa5f01888c0 2024-02-21T07:42:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.851+0000 7fa5ee000640 1 -- 172.21.15.69:0/3711791170 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e802cdc0 con 0x7fa5f01888c0 2024-02-21T07:42:27.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.851+0000 7fa5ee000640 1 -- 172.21.15.69:0/3711791170 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8034660 con 0x7fa5f01888c0 2024-02-21T07:42:27.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.852+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3711791170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f01888c0 msgr2=0x7fa5f00fa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.852+0000 7fa5f5e00640 1 --2- 172.21.15.69:0/3711791170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f01888c0 0x7fa5f00fa870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009d90 tx=0x7fa5e802beb0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.852+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3711791170 shutdown_connections 2024-02-21T07:42:27.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.852+0000 7fa5f5e00640 1 --2- 172.21.15.69:0/3711791170 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f01888c0 0x7fa5f00fa870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.852+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3711791170 >> 172.21.15.69:0/3711791170 conn(0x7fa5f0071dd0 msgr2=0x7fa5f00668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:27.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.852+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3711791170 shutdown_connections 2024-02-21T07:42:27.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.852+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3711791170 wait complete. 2024-02-21T07:42:27.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.854+0000 7fa5f5e00640 1 Processor -- start 2024-02-21T07:42:27.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.854+0000 7fa5f5e00640 1 -- start start 2024-02-21T07:42:27.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5f5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f0185fa0 0x7fa5f00d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5f5e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5f01888c0 0x7fa5f0177730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5f5e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f021f6a0 0x7fa5f02217a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5f5e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f02226a0 con 0x7fa5f01888c0 2024-02-21T07:42:27.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5f5e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f02223c0 con 0x7fa5f021f6a0 2024-02-21T07:42:27.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5f5e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00d0810 con 0x7fa5f0185fa0 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5e6000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5f01888c0 0x7fa5f0177730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5e6000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5f01888c0 0x7fa5f0177730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35184/0 (socket says 172.21.15.69:35184) 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5e6000640 1 -- 172.21.15.69:0/3520352978 learned_addr learned my addr 172.21.15.69:0/3520352978 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5eea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f0185fa0 0x7fa5f00d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5ef400640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f021f6a0 0x7fa5f02217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5e6000640 1 -- 172.21.15.69:0/3520352978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f0185fa0 msgr2=0x7fa5f00d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5e6000640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f0185fa0 0x7fa5f00d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5e6000640 1 -- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f021f6a0 msgr2=0x7fa5f02217a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5e6000640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f021f6a0 0x7fa5f02217a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5e6000640 1 -- 172.21.15.69:0/3520352978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009a70 con 0x7fa5f01888c0 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.856+0000 7fa5ef400640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f021f6a0 0x7fa5f02217a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:27.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.857+0000 7fa5e6000640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5f01888c0 0x7fa5f0177730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800c430 tx=0x7fa5d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:27.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.857+0000 7fa5e7e00640 1 -- 172.21.15.69:0/3520352978 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80052d0 con 0x7fa5f01888c0 2024-02-21T07:42:27.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.857+0000 7fa5e7e00640 1 -- 172.21.15.69:0/3520352978 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d8005430 con 0x7fa5f01888c0 2024-02-21T07:42:27.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.857+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3520352978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00d0af0 con 0x7fa5f01888c0 2024-02-21T07:42:27.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.857+0000 7fa5e7e00640 1 -- 172.21.15.69:0/3520352978 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8003810 con 0x7fa5f01888c0 2024-02-21T07:42:27.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.857+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3520352978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00d10b0 con 0x7fa5f01888c0 2024-02-21T07:42:27.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.858+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3520352978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f0069d50 con 0x7fa5f01888c0 2024-02-21T07:42:27.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.860+0000 7fa5e7e00640 1 -- 172.21.15.69:0/3520352978 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa5d8003970 con 0x7fa5f01888c0 2024-02-21T07:42:27.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.861+0000 7fa5e7e00640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa5cc09f0a0 0x7fa5cc0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:27.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.862+0000 7fa5e7e00640 1 -- 172.21.15.69:0/3520352978 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa5d80c91a0 con 0x7fa5f01888c0 2024-02-21T07:42:27.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.862+0000 7fa5eea00640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa5cc09f0a0 0x7fa5cc0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:27.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.862+0000 7fa5eea00640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa5cc09f0a0 0x7fa5cc0a1560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0000f60 tx=0x7fa5e0007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:27.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:27.866+0000 7fa5e7e00640 1 -- 172.21.15.69:0/3520352978 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa5d8092f90 con 0x7fa5f01888c0 2024-02-21T07:42:28.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.063+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3520352978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5f00fd0f0 con 0x7fa5f01888c0 2024-02-21T07:42:28.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.065+0000 7fa5e7e00640 1 -- 172.21.15.69:0/3520352978 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7fa5d8096650 con 0x7fa5f01888c0 2024-02-21T07:42:28.071 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:28.071 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:28.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa5cc09f0a0 msgr2=0x7fa5cc0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:28.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa5cc09f0a0 0x7fa5cc0a1560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0000f60 tx=0x7fa5e0007d50 comp rx=0 tx=0).stop 2024-02-21T07:42:28.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3520352978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5f01888c0 msgr2=0x7fa5f0177730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:28.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5f01888c0 0x7fa5f0177730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800c430 tx=0x7fa5d800c8f0 comp rx=0 tx=0).stop 2024-02-21T07:42:28.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3520352978 shutdown_connections 2024-02-21T07:42:28.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa5cc09f0a0 0x7fa5cc0a1560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:28.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa5f021f6a0 0x7fa5f02217a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:28.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa5f01888c0 0x7fa5f0177730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:28.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 --2- 172.21.15.69:0/3520352978 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa5f0185fa0 0x7fa5f00d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:28.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3520352978 >> 172.21.15.69:0/3520352978 conn(0x7fa5f0071dd0 msgr2=0x7fa5f00668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:28.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.068+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3520352978 shutdown_connections 2024-02-21T07:42:28.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.069+0000 7fa5f5e00640 1 -- 172.21.15.69:0/3520352978 wait complete. 2024-02-21T07:42:28.095 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-21T07:42:28.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.304+0000 7fa92e200640 1 Processor -- start 2024-02-21T07:42:28.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.305+0000 7fa92e200640 1 -- start start 2024-02-21T07:42:28.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.307+0000 7fa92e200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa92817f4f0 0x7fa9280d45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.307+0000 7fa92e200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92818a4a0 con 0x7fa92817f110 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.307+0000 7fa92e200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9280d4ca0 con 0x7fa9280d6020 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.307+0000 7fa92e200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9280d4f80 con 0x7fa92817f4f0 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.307+0000 7fa92ce00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa92817f110 0x7fa928189d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44130/0 (socket says 172.21.15.69:44130) 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.307+0000 7fa92ce00640 1 -- 172.21.15.69:0/1532797002 learned_addr learned my addr 172.21.15.69:0/1532797002 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.307+0000 7fa927e00640 1 --2- 172.21.15.69:0/1532797002 >> v2:172.21.15.69:3300/0 conn(0x7fa92817f4f0 0x7fa9280d45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.307+0000 7fa927400640 1 -- 172.21.15.69:0/1532797002 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 57426444 0 0) 0x7fa92818a4a0 con 0x7fa92817f110 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.307+0000 7fa927400640 1 -- 172.21.15.69:0/1532797002 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa910003520 con 0x7fa92817f110 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.308+0000 7fa927400640 1 -- 172.21.15.69:0/1532797002 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865096289 0 0) 0x7fa9280d4ca0 con 0x7fa9280d6020 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.308+0000 7fa927400640 1 -- 172.21.15.69:0/1532797002 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa92818a4a0 con 0x7fa9280d6020 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.308+0000 7fa927e00640 1 -- 172.21.15.69:0/1532797002 >> v1:172.21.15.174:6789/0 conn(0x7fa9280d6020 legacy=0x7fa9281888a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.308+0000 7fa927400640 1 -- 172.21.15.69:0/1532797002 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1971788807 0 0) 0x7fa910003520 con 0x7fa92817f110 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.308+0000 7fa927e00640 1 -- 172.21.15.69:0/1532797002 >> v1:172.21.15.69:6789/0 conn(0x7fa92817f110 legacy=0x7fa928189d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:28.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.308+0000 7fa927e00640 1 -- 172.21.15.69:0/1532797002 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9280d5260 con 0x7fa92817f4f0 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.309+0000 7fa927e00640 1 --2- 172.21.15.69:0/1532797002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f4f0 0x7fa9280d45d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa9140097a0 tx=0x7fa91402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0082a9d102e70bb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.309+0000 7fa927400640 1 -- 172.21.15.69:0/1532797002 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91402f050 con 0x7fa92817f4f0 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.309+0000 7fa927400640 1 -- 172.21.15.69:0/1532797002 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa914031500 con 0x7fa92817f4f0 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.309+0000 7fa927400640 1 -- 172.21.15.69:0/1532797002 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91c001670 con 0x7fa92817f4f0 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.310+0000 7fa92e200640 1 -- 172.21.15.69:0/1532797002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f4f0 msgr2=0x7fa9280d45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.310+0000 7fa92e200640 1 --2- 172.21.15.69:0/1532797002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f4f0 0x7fa9280d45d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa9140097a0 tx=0x7fa91402b820 comp rx=0 tx=0).stop 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.310+0000 7fa92e200640 1 -- 172.21.15.69:0/1532797002 shutdown_connections 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.310+0000 7fa92e200640 1 --2- 172.21.15.69:0/1532797002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f4f0 0x7fa9280d45d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.310+0000 7fa92e200640 1 -- 172.21.15.69:0/1532797002 >> 172.21.15.69:0/1532797002 conn(0x7fa9280d2c10 msgr2=0x7fa9280d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.310+0000 7fa92e200640 1 -- 172.21.15.69:0/1532797002 shutdown_connections 2024-02-21T07:42:28.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.310+0000 7fa92e200640 1 -- 172.21.15.69:0/1532797002 wait complete. 2024-02-21T07:42:28.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.312+0000 7fa92e200640 1 Processor -- start 2024-02-21T07:42:28.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.312+0000 7fa92e200640 1 -- start start 2024-02-21T07:42:28.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.313+0000 7fa92e200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9280d6020 0x7fa92816f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.313+0000 7fa92e200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f110 0x7fa928179820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.313+0000 7fa92e200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa92817f4f0 0x7fa928179d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.313+0000 7fa92e200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92817a5b0 con 0x7fa92817f110 2024-02-21T07:42:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.313+0000 7fa92e200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92817a890 con 0x7fa92817f4f0 2024-02-21T07:42:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.313+0000 7fa92e200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92817ab70 con 0x7fa9280d6020 2024-02-21T07:42:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.313+0000 7fa927e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f110 0x7fa928179820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.313+0000 7fa927e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f110 0x7fa928179820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35198/0 (socket says 172.21.15.69:35198) 2024-02-21T07:42:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.313+0000 7fa927e00640 1 -- 172.21.15.69:0/2243219220 learned_addr learned my addr 172.21.15.69:0/2243219220 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.313+0000 7fa92ce00640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9280d6020 0x7fa92816f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.314+0000 7fa92d800640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa92817f4f0 0x7fa928179d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.314+0000 7fa927e00640 1 -- 172.21.15.69:0/2243219220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9280d6020 msgr2=0x7fa92816f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.314+0000 7fa927e00640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9280d6020 0x7fa92816f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.314+0000 7fa927e00640 1 -- 172.21.15.69:0/2243219220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa92817f4f0 msgr2=0x7fa928179d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.314+0000 7fa927e00640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa92817f4f0 0x7fa928179d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.314+0000 7fa927e00640 1 -- 172.21.15.69:0/2243219220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914009400 con 0x7fa92817f110 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.314+0000 7fa927e00640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f110 0x7fa928179820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa91402b860 tx=0x7fa9140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.315+0000 7fa924c00640 1 -- 172.21.15.69:0/2243219220 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914033880 con 0x7fa92817f110 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.315+0000 7fa924c00640 1 -- 172.21.15.69:0/2243219220 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9140339e0 con 0x7fa92817f110 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.315+0000 7fa924c00640 1 -- 172.21.15.69:0/2243219220 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914033d90 con 0x7fa92817f110 2024-02-21T07:42:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.315+0000 7fa92e200640 1 -- 172.21.15.69:0/2243219220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92817ae50 con 0x7fa92817f110 2024-02-21T07:42:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.315+0000 7fa92e200640 1 -- 172.21.15.69:0/2243219220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92817b410 con 0x7fa92817f110 2024-02-21T07:42:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.316+0000 7fa92e200640 1 -- 172.21.15.69:0/2243219220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa928069c10 con 0x7fa92817f110 2024-02-21T07:42:28.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.318+0000 7fa924c00640 1 -- 172.21.15.69:0/2243219220 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa91403a040 con 0x7fa92817f110 2024-02-21T07:42:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.319+0000 7fa924c00640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa90809f0a0 0x7fa9080a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.319+0000 7fa924c00640 1 -- 172.21.15.69:0/2243219220 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa9140eb2e0 con 0x7fa92817f110 2024-02-21T07:42:28.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.319+0000 7fa92ce00640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa90809f0a0 0x7fa9080a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:28.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.320+0000 7fa92ce00640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa90809f0a0 0x7fa9080a1560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa91c005880 tx=0x7fa91c0016b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:28.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.323+0000 7fa924c00640 1 -- 172.21.15.69:0/2243219220 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9140b50a0 con 0x7fa92817f110 2024-02-21T07:42:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:28.553+0000 7fa92e200640 1 -- 172.21.15.69:0/2243219220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa9280d37d0 con 0x7fa92817f110 2024-02-21T07:42:29.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.080+0000 7fa924c00640 1 -- 172.21.15.69:0/2243219220 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa9140b6fd0 con 0x7fa92817f110 2024-02-21T07:42:29.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 -- 172.21.15.69:0/2243219220 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa90809f0a0 msgr2=0x7fa9080a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:29.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa90809f0a0 0x7fa9080a1560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa91c005880 tx=0x7fa91c0016b0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 -- 172.21.15.69:0/2243219220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f110 msgr2=0x7fa928179820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:29.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f110 0x7fa928179820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa91402b860 tx=0x7fa9140046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 -- 172.21.15.69:0/2243219220 shutdown_connections 2024-02-21T07:42:29.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa90809f0a0 0x7fa9080a1560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa92817f4f0 0x7fa928179d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa92817f110 0x7fa928179820 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 --2- 172.21.15.69:0/2243219220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9280d6020 0x7fa92816f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 -- 172.21.15.69:0/2243219220 >> 172.21.15.69:0/2243219220 conn(0x7fa9280d2c10 msgr2=0x7fa9280d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:29.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 -- 172.21.15.69:0/2243219220 shutdown_connections 2024-02-21T07:42:29.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.083+0000 7fa92e200640 1 -- 172.21.15.69:0/2243219220 wait complete. 2024-02-21T07:42:29.110 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-02-21T07:42:29.110 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-02-21T07:42:29.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.317+0000 7f24bfc00640 1 Processor -- start 2024-02-21T07:42:29.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.317+0000 7f24bfc00640 1 -- start start 2024-02-21T07:42:29.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.319+0000 7f24bfc00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f24b818b3e0 0x7f24b818d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:29.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.319+0000 7f24bfc00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f24b818d7f0 0x7f24b80f4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:29.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.320+0000 7f24bfc00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b818b940 con 0x7f24b8186df0 2024-02-21T07:42:29.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.320+0000 7f24bfc00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b818bc20 con 0x7f24b818b3e0 2024-02-21T07:42:29.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.320+0000 7f24bfc00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b818bf00 con 0x7f24b818d7f0 2024-02-21T07:42:29.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.320+0000 7f24afe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f24b818b3e0 0x7f24b818d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:29.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.320+0000 7f24bd200640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f24b8186df0 0x7f24b818acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47688/0 (socket says 172.21.15.69:47688) 2024-02-21T07:42:29.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.320+0000 7f24bd200640 1 -- 172.21.15.69:0/1536152251 learned_addr learned my addr 172.21.15.69:0/1536152251 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:29.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.320+0000 7f24bdc00640 1 --2- 172.21.15.69:0/1536152251 >> v2:172.21.15.184:3300/0 conn(0x7f24b818d7f0 0x7f24b80f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:29.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.320+0000 7f24b7e00640 1 -- 172.21.15.69:0/1536152251 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410608640 0 0) 0x7f24b818b940 con 0x7f24b8186df0 2024-02-21T07:42:29.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.321+0000 7f24b7e00640 1 -- 172.21.15.69:0/1536152251 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f249c003520 con 0x7f24b8186df0 2024-02-21T07:42:29.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.321+0000 7f24afe00640 1 -- 172.21.15.69:0/1536152251 >> v2:172.21.15.184:3300/0 conn(0x7f24b818d7f0 msgr2=0x7f24b80f4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:29.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.321+0000 7f24afe00640 1 --2- 172.21.15.69:0/1536152251 >> v2:172.21.15.184:3300/0 conn(0x7f24b818d7f0 0x7f24b80f4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.321+0000 7f24afe00640 1 -- 172.21.15.69:0/1536152251 >> v1:172.21.15.69:6789/0 conn(0x7f24b8186df0 legacy=0x7f24b818acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:29.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.321+0000 7f24afe00640 1 -- 172.21.15.69:0/1536152251 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b818c1e0 con 0x7f24b818b3e0 2024-02-21T07:42:29.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.321+0000 7f24bdc00640 1 --2- 172.21.15.69:0/1536152251 >> v2:172.21.15.184:3300/0 conn(0x7f24b818d7f0 0x7f24b80f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.322+0000 7f24afe00640 1 --2- 172.21.15.69:0/1536152251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818b3e0 0x7f24b818d2b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24b80cf4d0 tx=0x7f24a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c2b991d7432c88 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.322+0000 7f24b7e00640 1 -- 172.21.15.69:0/1536152251 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a002e070 con 0x7f24b818b3e0 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.322+0000 7f24b7e00640 1 -- 172.21.15.69:0/1536152251 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a00315a0 con 0x7f24b818b3e0 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.322+0000 7f24b7e00640 1 -- 172.21.15.69:0/1536152251 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0031930 con 0x7f24b818b3e0 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.323+0000 7f24bfc00640 1 -- 172.21.15.69:0/1536152251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818b3e0 msgr2=0x7f24b818d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.323+0000 7f24bfc00640 1 --2- 172.21.15.69:0/1536152251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818b3e0 0x7f24b818d2b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24b80cf4d0 tx=0x7f24a002b840 comp rx=0 tx=0).stop 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.323+0000 7f24bfc00640 1 -- 172.21.15.69:0/1536152251 shutdown_connections 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.323+0000 7f24bfc00640 1 --2- 172.21.15.69:0/1536152251 >> v2:172.21.15.184:3300/0 conn(0x7f24b818d7f0 0x7f24b80f4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.323+0000 7f24bfc00640 1 --2- 172.21.15.69:0/1536152251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818b3e0 0x7f24b818d2b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.323+0000 7f24bfc00640 1 -- 172.21.15.69:0/1536152251 >> 172.21.15.69:0/1536152251 conn(0x7f24b80ce3d0 msgr2=0x7f24b80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:29.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.323+0000 7f24bfc00640 1 -- 172.21.15.69:0/1536152251 shutdown_connections 2024-02-21T07:42:29.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.323+0000 7f24bfc00640 1 -- 172.21.15.69:0/1536152251 wait complete. 2024-02-21T07:42:29.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.325+0000 7f24bfc00640 1 Processor -- start 2024-02-21T07:42:29.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.325+0000 7f24bfc00640 1 -- start start 2024-02-21T07:42:29.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.326+0000 7f24bfc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24b8186df0 0x7f24b80ea9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:29.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.326+0000 7f24bfc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b818b3e0 0x7f24b816e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:29.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.326+0000 7f24bfc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818d7f0 0x7f24b8224cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:29.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.326+0000 7f24bfc00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b82248d0 con 0x7f24b818d7f0 2024-02-21T07:42:29.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.326+0000 7f24bfc00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80eaf10 con 0x7f24b818b3e0 2024-02-21T07:42:29.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.326+0000 7f24bfc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b80ec630 con 0x7f24b8186df0 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.326+0000 7f24bdc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818d7f0 0x7f24b8224cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24bdc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818d7f0 0x7f24b8224cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39706/0 (socket says 172.21.15.69:39706) 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24bdc00640 1 -- 172.21.15.69:0/2771681100 learned_addr learned my addr 172.21.15.69:0/2771681100 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24bd200640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24b8186df0 0x7f24b80ea9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24afe00640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b818b3e0 0x7f24b816e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24bdc00640 1 -- 172.21.15.69:0/2771681100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24b8186df0 msgr2=0x7f24b80ea9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24bdc00640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24b8186df0 0x7f24b80ea9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24bdc00640 1 -- 172.21.15.69:0/2771681100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b818b3e0 msgr2=0x7f24b816e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24bdc00640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b818b3e0 0x7f24b816e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24bdc00640 1 -- 172.21.15.69:0/2771681100 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a0009400 con 0x7f24b818d7f0 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24bd200640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24b8186df0 0x7f24b80ea9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24bdc00640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818d7f0 0x7f24b8224cf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24b0007df0 tx=0x7f24b000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.327+0000 7f24b5600640 1 -- 172.21.15.69:0/2771681100 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0003990 con 0x7f24b818d7f0 2024-02-21T07:42:29.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.328+0000 7f24b5600640 1 -- 172.21.15.69:0/2771681100 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b000f040 con 0x7f24b818d7f0 2024-02-21T07:42:29.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.328+0000 7f24bfc00640 1 -- 172.21.15.69:0/2771681100 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b80ec910 con 0x7f24b818d7f0 2024-02-21T07:42:29.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.328+0000 7f24b5600640 1 -- 172.21.15.69:0/2771681100 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0003d30 con 0x7f24b818d7f0 2024-02-21T07:42:29.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.328+0000 7f24bfc00640 1 -- 172.21.15.69:0/2771681100 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b82244f0 con 0x7f24b818d7f0 2024-02-21T07:42:29.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.329+0000 7f24bfc00640 1 -- 172.21.15.69:0/2771681100 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b80ece30 con 0x7f24b818d7f0 2024-02-21T07:42:29.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.331+0000 7f24b5600640 1 -- 172.21.15.69:0/2771681100 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f24b0004030 con 0x7f24b818d7f0 2024-02-21T07:42:29.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.333+0000 7f24b5600640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f249409f0d0 0x7f24940a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:29.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.333+0000 7f24b5600640 1 -- 172.21.15.69:0/2771681100 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f24b00c9dd0 con 0x7f24b818d7f0 2024-02-21T07:42:29.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.333+0000 7f24bd200640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f249409f0d0 0x7f24940a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:29.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.334+0000 7f24bd200640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f249409f0d0 0x7f24940a1590 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f24a8007fd0 tx=0x7f24a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:29.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.337+0000 7f24b5600640 1 -- 172.21.15.69:0/2771681100 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f24b80ece30 con 0x7f24b818d7f0 2024-02-21T07:42:29.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:29.572+0000 7f24bfc00640 1 -- 172.21.15.69:0/2771681100 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f24b8224350 con 0x7f24b818d7f0 2024-02-21T07:42:30.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.083+0000 7f24b5600640 1 -- 172.21.15.69:0/2771681100 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f24b8224350 con 0x7f24b818d7f0 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 -- 172.21.15.69:0/2771681100 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f249409f0d0 msgr2=0x7f24940a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f249409f0d0 0x7f24940a1590 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f24a8007fd0 tx=0x7f24a8009040 comp rx=0 tx=0).stop 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 -- 172.21.15.69:0/2771681100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818d7f0 msgr2=0x7f24b8224cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818d7f0 0x7f24b8224cf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24b0007df0 tx=0x7f24b000d4a0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 -- 172.21.15.69:0/2771681100 shutdown_connections 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f249409f0d0 0x7f24940a1590 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24b818d7f0 0x7f24b8224cf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f24b818b3e0 0x7f24b816e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 --2- 172.21.15.69:0/2771681100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24b8186df0 0x7f24b80ea9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 -- 172.21.15.69:0/2771681100 >> 172.21.15.69:0/2771681100 conn(0x7f24b80ce3d0 msgr2=0x7f24b80f0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:30.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 -- 172.21.15.69:0/2771681100 shutdown_connections 2024-02-21T07:42:30.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.087+0000 7f24bfc00640 1 -- 172.21.15.69:0/2771681100 wait complete. 2024-02-21T07:42:30.118 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-02-21T07:42:30.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.302+0000 7fdf73800640 1 Processor -- start 2024-02-21T07:42:30.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.303+0000 7fdf73800640 1 -- start start 2024-02-21T07:42:30.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.305+0000 7fdf73800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdf6c0fa520 0x7fdf6c18afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:30.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.305+0000 7fdf73800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdf6c18b500 0x7fdf6c18c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:30.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.305+0000 7fdf73800640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c189f40 con 0x7fdf6c17f550 2024-02-21T07:42:30.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.305+0000 7fdf73800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c0ff310 con 0x7fdf6c0fa520 2024-02-21T07:42:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.305+0000 7fdf73800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c0fa990 con 0x7fdf6c18b500 2024-02-21T07:42:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.305+0000 7fdf6be00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdf6c0fa520 0x7fdf6c18afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.305+0000 7fdf6be00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdf6c0fa520 0x7fdf6c18afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39720/0 (socket says 172.21.15.69:39720) 2024-02-21T07:42:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.305+0000 7fdf6be00640 1 -- 172.21.15.69:0/3688997835 learned_addr learned my addr 172.21.15.69:0/3688997835 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.305+0000 7fdf71800640 1 --2- 172.21.15.69:0/3688997835 >> v2:172.21.15.174:3300/0 conn(0x7fdf6c18b500 0x7fdf6c18c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.306+0000 7fdf6be00640 1 -- 172.21.15.69:0/3688997835 >> v2:172.21.15.174:3300/0 conn(0x7fdf6c18b500 msgr2=0x7fdf6c18c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.306+0000 7fdf6be00640 1 --2- 172.21.15.69:0/3688997835 >> v2:172.21.15.174:3300/0 conn(0x7fdf6c18b500 0x7fdf6c18c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.306+0000 7fdf6be00640 1 -- 172.21.15.69:0/3688997835 >> v1:172.21.15.174:6789/0 conn(0x7fdf6c17f550 legacy=0x7fdf6c0f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:30.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.306+0000 7fdf6be00640 1 -- 172.21.15.69:0/3688997835 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c17f930 con 0x7fdf6c0fa520 2024-02-21T07:42:30.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.307+0000 7fdf6be00640 1 --2- 172.21.15.69:0/3688997835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c0fa520 0x7fdf6c18afc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0d0a30 tx=0x7fdf5c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3226bf17d2fd3bae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:30.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.307+0000 7fdf6b400640 1 -- 172.21.15.69:0/3688997835 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c02ca80 con 0x7fdf6c0fa520 2024-02-21T07:42:30.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.307+0000 7fdf6b400640 1 -- 172.21.15.69:0/3688997835 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c02cbe0 con 0x7fdf6c0fa520 2024-02-21T07:42:30.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.307+0000 7fdf6b400640 1 -- 172.21.15.69:0/3688997835 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c0343f0 con 0x7fdf6c0fa520 2024-02-21T07:42:30.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.308+0000 7fdf73800640 1 -- 172.21.15.69:0/3688997835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c0fa520 msgr2=0x7fdf6c18afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:30.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.308+0000 7fdf73800640 1 --2- 172.21.15.69:0/3688997835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c0fa520 0x7fdf6c18afc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0d0a30 tx=0x7fdf5c02bee0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.308+0000 7fdf73800640 1 -- 172.21.15.69:0/3688997835 shutdown_connections 2024-02-21T07:42:30.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.308+0000 7fdf73800640 1 --2- 172.21.15.69:0/3688997835 >> v2:172.21.15.174:3300/0 conn(0x7fdf6c18b500 0x7fdf6c18c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.308+0000 7fdf73800640 1 --2- 172.21.15.69:0/3688997835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c0fa520 0x7fdf6c18afc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.308+0000 7fdf73800640 1 -- 172.21.15.69:0/3688997835 >> 172.21.15.69:0/3688997835 conn(0x7fdf6c0668e0 msgr2=0x7fdf6c066cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:30.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.308+0000 7fdf73800640 1 -- 172.21.15.69:0/3688997835 shutdown_connections 2024-02-21T07:42:30.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.308+0000 7fdf73800640 1 -- 172.21.15.69:0/3688997835 wait complete. 2024-02-21T07:42:30.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.310+0000 7fdf73800640 1 Processor -- start 2024-02-21T07:42:30.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.310+0000 7fdf73800640 1 -- start start 2024-02-21T07:42:30.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.311+0000 7fdf73800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf6c0fa520 0x7fdf6c168390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:30.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.311+0000 7fdf73800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf6c17f550 0x7fdf6c184840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.311+0000 7fdf73800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c18b500 0x7fdf6c0d0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.311+0000 7fdf73800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0d1800 con 0x7fdf6c18b500 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.311+0000 7fdf73800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0d1520 con 0x7fdf6c0fa520 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.311+0000 7fdf73800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c17a9f0 con 0x7fdf6c17f550 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf71800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c18b500 0x7fdf6c0d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf71800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c18b500 0x7fdf6c0d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39728/0 (socket says 172.21.15.69:39728) 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf71800640 1 -- 172.21.15.69:0/659038657 learned_addr learned my addr 172.21.15.69:0/659038657 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf70e00640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf6c0fa520 0x7fdf6c168390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf6be00640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf6c17f550 0x7fdf6c184840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf71800640 1 -- 172.21.15.69:0/659038657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf6c17f550 msgr2=0x7fdf6c184840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf71800640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf6c17f550 0x7fdf6c184840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf71800640 1 -- 172.21.15.69:0/659038657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf6c0fa520 msgr2=0x7fdf6c168390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf71800640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf6c0fa520 0x7fdf6c168390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:30.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf71800640 1 -- 172.21.15.69:0/659038657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c009b30 con 0x7fdf6c18b500 2024-02-21T07:42:30.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf6be00640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf6c17f550 0x7fdf6c184840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:30.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf71800640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c18b500 0x7fdf6c0d0770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400e7f0 tx=0x7fdf6400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:30.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.312+0000 7fdf68c00640 1 -- 172.21.15.69:0/659038657 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64009510 con 0x7fdf6c18b500 2024-02-21T07:42:30.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.313+0000 7fdf68c00640 1 -- 172.21.15.69:0/659038657 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6400ee40 con 0x7fdf6c18b500 2024-02-21T07:42:30.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.313+0000 7fdf68c00640 1 -- 172.21.15.69:0/659038657 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6400cb80 con 0x7fdf6c18b500 2024-02-21T07:42:30.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.313+0000 7fdf73800640 1 -- 172.21.15.69:0/659038657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6c17acd0 con 0x7fdf6c18b500 2024-02-21T07:42:30.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.313+0000 7fdf73800640 1 -- 172.21.15.69:0/659038657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c17b290 con 0x7fdf6c18b500 2024-02-21T07:42:30.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.314+0000 7fdf73800640 1 -- 172.21.15.69:0/659038657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6c0d05b0 con 0x7fdf6c18b500 2024-02-21T07:42:30.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.316+0000 7fdf68c00640 1 -- 172.21.15.69:0/659038657 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fdf6400cce0 con 0x7fdf6c18b500 2024-02-21T07:42:30.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.317+0000 7fdf68c00640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdf4809f0d0 0x7fdf480a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:30.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.317+0000 7fdf68c00640 1 -- 172.21.15.69:0/659038657 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fdf640c9c80 con 0x7fdf6c18b500 2024-02-21T07:42:30.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.317+0000 7fdf70e00640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdf4809f0d0 0x7fdf480a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:30.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.318+0000 7fdf70e00640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdf4809f0d0 0x7fdf480a1590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdf540016e0 tx=0x7fdf54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:30.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.321+0000 7fdf68c00640 1 -- 172.21.15.69:0/659038657 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdf640939e0 con 0x7fdf6c18b500 2024-02-21T07:42:30.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:30.556+0000 7fdf73800640 1 -- 172.21.15.69:0/659038657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fdf6c17b4b0 con 0x7fdf6c18b500 2024-02-21T07:42:31.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.095+0000 7fdf68c00640 1 -- 172.21.15.69:0/659038657 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7fdf64095910 con 0x7fdf6c18b500 2024-02-21T07:42:31.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.099+0000 7fdf73800640 1 -- 172.21.15.69:0/659038657 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdf4809f0d0 msgr2=0x7fdf480a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:31.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.099+0000 7fdf73800640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdf4809f0d0 0x7fdf480a1590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdf540016e0 tx=0x7fdf54009040 comp rx=0 tx=0).stop 2024-02-21T07:42:31.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.099+0000 7fdf73800640 1 -- 172.21.15.69:0/659038657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c18b500 msgr2=0x7fdf6c0d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.099+0000 7fdf73800640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c18b500 0x7fdf6c0d0770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400e7f0 tx=0x7fdf6400ebf0 comp rx=0 tx=0).stop 2024-02-21T07:42:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.099+0000 7fdf73800640 1 -- 172.21.15.69:0/659038657 shutdown_connections 2024-02-21T07:42:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.099+0000 7fdf73800640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdf4809f0d0 0x7fdf480a1590 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.099+0000 7fdf73800640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf6c18b500 0x7fdf6c0d0770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.099+0000 7fdf73800640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdf6c17f550 0x7fdf6c184840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.099+0000 7fdf73800640 1 --2- 172.21.15.69:0/659038657 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdf6c0fa520 0x7fdf6c168390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.099+0000 7fdf73800640 1 -- 172.21.15.69:0/659038657 >> 172.21.15.69:0/659038657 conn(0x7fdf6c0668e0 msgr2=0x7fdf6c17cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.100+0000 7fdf73800640 1 -- 172.21.15.69:0/659038657 shutdown_connections 2024-02-21T07:42:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.100+0000 7fdf73800640 1 -- 172.21.15.69:0/659038657 wait complete. 2024-02-21T07:42:31.133 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-02-21T07:42:31.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.309+0000 7fcfe5e00640 1 Processor -- start 2024-02-21T07:42:31.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.309+0000 7fcfe5e00640 1 -- start start 2024-02-21T07:42:31.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.311+0000 7fcfe5e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcfe00ee640 0x7fcfe00eead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:31.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.311+0000 7fcfe5e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe00ef010 con 0x7fcfe0186bc0 2024-02-21T07:42:31.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.311+0000 7fcfe5e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe0187720 con 0x7fcfe0183ea0 2024-02-21T07:42:31.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.311+0000 7fcfe5e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe0186010 con 0x7fcfe00ee640 2024-02-21T07:42:31.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.311+0000 7fcfdf400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fcfe0186bc0 0x7fcfe0187010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47694/0 (socket says 172.21.15.69:47694) 2024-02-21T07:42:31.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.311+0000 7fcfdf400640 1 -- 172.21.15.69:0/3017743373 learned_addr learned my addr 172.21.15.69:0/3017743373 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:31.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.311+0000 7fcfde000640 1 --2- 172.21.15.69:0/3017743373 >> v2:172.21.15.69:3300/0 conn(0x7fcfe00ee640 0x7fcfe00eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.312+0000 7fcfdd600640 1 -- 172.21.15.69:0/3017743373 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293759767 0 0) 0x7fcfe00ef010 con 0x7fcfe0186bc0 2024-02-21T07:42:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.312+0000 7fcfde000640 1 -- 172.21.15.69:0/3017743373 >> v1:172.21.15.174:6789/0 conn(0x7fcfe0183ea0 legacy=0x7fcfe01846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.312+0000 7fcfde000640 1 -- 172.21.15.69:0/3017743373 >> v1:172.21.15.69:6789/0 conn(0x7fcfe0186bc0 legacy=0x7fcfe0187010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.312+0000 7fcfde000640 1 -- 172.21.15.69:0/3017743373 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe0184df0 con 0x7fcfe00ee640 2024-02-21T07:42:31.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.313+0000 7fcfde000640 1 --2- 172.21.15.69:0/3017743373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe00ee640 0x7fcfe00eead0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009720 tx=0x7fcfcc02b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e3606dae148f17 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:31.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.313+0000 7fcfdd600640 1 -- 172.21.15.69:0/3017743373 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc030710 con 0x7fcfe00ee640 2024-02-21T07:42:31.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.313+0000 7fcfdd600640 1 -- 172.21.15.69:0/3017743373 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc02e050 con 0x7fcfe00ee640 2024-02-21T07:42:31.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.313+0000 7fcfdd600640 1 -- 172.21.15.69:0/3017743373 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc030a90 con 0x7fcfe00ee640 2024-02-21T07:42:31.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.313+0000 7fcfe5e00640 1 -- 172.21.15.69:0/3017743373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe00ee640 msgr2=0x7fcfe00eead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:31.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.313+0000 7fcfe5e00640 1 --2- 172.21.15.69:0/3017743373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe00ee640 0x7fcfe00eead0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009720 tx=0x7fcfcc02b6a0 comp rx=0 tx=0).stop 2024-02-21T07:42:31.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.314+0000 7fcfe5e00640 1 -- 172.21.15.69:0/3017743373 shutdown_connections 2024-02-21T07:42:31.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.314+0000 7fcfe5e00640 1 --2- 172.21.15.69:0/3017743373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe00ee640 0x7fcfe00eead0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:31.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.314+0000 7fcfe5e00640 1 -- 172.21.15.69:0/3017743373 >> 172.21.15.69:0/3017743373 conn(0x7fcfe00ce3d0 msgr2=0x7fcfe00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:31.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.314+0000 7fcfe5e00640 1 -- 172.21.15.69:0/3017743373 shutdown_connections 2024-02-21T07:42:31.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.314+0000 7fcfe5e00640 1 -- 172.21.15.69:0/3017743373 wait complete. 2024-02-21T07:42:31.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.315+0000 7fcfe5e00640 1 Processor -- start 2024-02-21T07:42:31.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.316+0000 7fcfe5e00640 1 -- start start 2024-02-21T07:42:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfe5e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe00ee640 0x7fcfe0170380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfe5e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe0183ea0 0x7fcfe0176030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfe5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfe0186bc0 0x7fcfe02200b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfe5e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe021f8f0 con 0x7fcfe0183ea0 2024-02-21T07:42:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfe5e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe021ea20 con 0x7fcfe00ee640 2024-02-21T07:42:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfe5e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe021ed00 con 0x7fcfe0186bc0 2024-02-21T07:42:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfde000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe0183ea0 0x7fcfe0176030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfde000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe0183ea0 0x7fcfe0176030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39758/0 (socket says 172.21.15.69:39758) 2024-02-21T07:42:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfde000640 1 -- 172.21.15.69:0/694735675 learned_addr learned my addr 172.21.15.69:0/694735675 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfdea00640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe00ee640 0x7fcfe0170380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfdf400640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfe0186bc0 0x7fcfe02200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfde000640 1 -- 172.21.15.69:0/694735675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfe0186bc0 msgr2=0x7fcfe02200b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfde000640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfe0186bc0 0x7fcfe02200b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfde000640 1 -- 172.21.15.69:0/694735675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe00ee640 msgr2=0x7fcfe0170380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.317+0000 7fcfde000640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe00ee640 0x7fcfe0170380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.318+0000 7fcfde000640 1 -- 172.21.15.69:0/694735675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc009400 con 0x7fcfe0183ea0 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.318+0000 7fcfde000640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe0183ea0 0x7fcfe0176030 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009720 tx=0x7fcfcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.318+0000 7fcfd7400640 1 -- 172.21.15.69:0/694735675 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc004230 con 0x7fcfe0183ea0 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.318+0000 7fcfd7400640 1 -- 172.21.15.69:0/694735675 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc0043b0 con 0x7fcfe0183ea0 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.318+0000 7fcfd7400640 1 -- 172.21.15.69:0/694735675 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc004520 con 0x7fcfe0183ea0 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.318+0000 7fcfe5e00640 1 -- 172.21.15.69:0/694735675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe021efe0 con 0x7fcfe0183ea0 2024-02-21T07:42:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.318+0000 7fcfe5e00640 1 -- 172.21.15.69:0/694735675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe021fb90 con 0x7fcfe0183ea0 2024-02-21T07:42:31.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.319+0000 7fcfe5e00640 1 -- 172.21.15.69:0/694735675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe021fd80 con 0x7fcfe0183ea0 2024-02-21T07:42:31.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.321+0000 7fcfd7400640 1 -- 172.21.15.69:0/694735675 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fcfcc039040 con 0x7fcfe0183ea0 2024-02-21T07:42:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.322+0000 7fcfd7400640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcfc009f0a0 0x7fcfc00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.323+0000 7fcfd7400640 1 -- 172.21.15.69:0/694735675 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fcfcc0eb990 con 0x7fcfe0183ea0 2024-02-21T07:42:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.323+0000 7fcfdea00640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcfc009f0a0 0x7fcfc00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:31.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.324+0000 7fcfdea00640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcfc009f0a0 0x7fcfc00a1560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0000f60 tx=0x7fcfd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:31.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.326+0000 7fcfd7400640 1 -- 172.21.15.69:0/694735675 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfcc0b57a0 con 0x7fcfe0183ea0 2024-02-21T07:42:31.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:31.555+0000 7fcfe5e00640 1 -- 172.21.15.69:0/694735675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fcfe0069d50 con 0x7fcfe0183ea0 2024-02-21T07:42:31.640 INFO:tasks.ceph.mds.a.smithi069.stderr:2024-02-21T07:42:31.634+0000 7f62a1600640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-02-21T07:42:32.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.106+0000 7fcfd7400640 1 -- 172.21.15.69:0/694735675 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7fcfcc0370b0 con 0x7fcfe0183ea0 2024-02-21T07:42:32.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.110+0000 7fcfe5e00640 1 -- 172.21.15.69:0/694735675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcfc009f0a0 msgr2=0x7fcfc00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.110+0000 7fcfe5e00640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcfc009f0a0 0x7fcfc00a1560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0000f60 tx=0x7fcfd0009040 comp rx=0 tx=0).stop 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.110+0000 7fcfe5e00640 1 -- 172.21.15.69:0/694735675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe0183ea0 msgr2=0x7fcfe0176030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.110+0000 7fcfe5e00640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe0183ea0 0x7fcfe0176030 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc009720 tx=0x7fcfcc0046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.111+0000 7fcfe5e00640 1 -- 172.21.15.69:0/694735675 shutdown_connections 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.111+0000 7fcfe5e00640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcfc009f0a0 0x7fcfc00a1560 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.111+0000 7fcfe5e00640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfe0186bc0 0x7fcfe02200b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.111+0000 7fcfe5e00640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfe0183ea0 0x7fcfe0176030 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.111+0000 7fcfe5e00640 1 --2- 172.21.15.69:0/694735675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfe00ee640 0x7fcfe0170380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.111+0000 7fcfe5e00640 1 -- 172.21.15.69:0/694735675 >> 172.21.15.69:0/694735675 conn(0x7fcfe00ce3d0 msgr2=0x7fcfe00eea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.111+0000 7fcfe5e00640 1 -- 172.21.15.69:0/694735675 shutdown_connections 2024-02-21T07:42:32.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.111+0000 7fcfe5e00640 1 -- 172.21.15.69:0/694735675 wait complete. 2024-02-21T07:42:32.142 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-02-21T07:42:32.143 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-02-21T07:42:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.334+0000 7fbe55e00640 1 Processor -- start 2024-02-21T07:42:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.334+0000 7fbe55e00640 1 -- start start 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.336+0000 7fbe55e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbe500fb840 0x7fbe5018a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.336+0000 7fbe55e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5018bae0 con 0x7fbe50182b70 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.336+0000 7fbe55e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5018abf0 con 0x7fbe5006ac20 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.336+0000 7fbe55e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5018aed0 con 0x7fbe500fb840 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.336+0000 7fbe54a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fbe50182b70 0x7fbe50189df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47704/0 (socket says 172.21.15.69:47704) 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.336+0000 7fbe54a00640 1 -- 172.21.15.69:0/3670322187 learned_addr learned my addr 172.21.15.69:0/3670322187 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.337+0000 7fbe47e00640 1 --2- 172.21.15.69:0/3670322187 >> v2:172.21.15.184:3300/0 conn(0x7fbe500fb840 0x7fbe5018a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.337+0000 7fbe4fe00640 1 -- 172.21.15.69:0/3670322187 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536812949 0 0) 0x7fbe5018bae0 con 0x7fbe50182b70 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.337+0000 7fbe4fe00640 1 -- 172.21.15.69:0/3670322187 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe34003520 con 0x7fbe50182b70 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.337+0000 7fbe47e00640 1 -- 172.21.15.69:0/3670322187 >> v1:172.21.15.174:6789/0 conn(0x7fbe5006ac20 legacy=0x7fbe5006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.337+0000 7fbe4fe00640 1 -- 172.21.15.69:0/3670322187 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229988040 0 0) 0x7fbe5018abf0 con 0x7fbe5006ac20 2024-02-21T07:42:32.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.337+0000 7fbe47e00640 1 -- 172.21.15.69:0/3670322187 >> v1:172.21.15.69:6789/0 conn(0x7fbe50182b70 legacy=0x7fbe50189df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.337+0000 7fbe47e00640 1 -- 172.21.15.69:0/3670322187 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5018b1b0 con 0x7fbe500fb840 2024-02-21T07:42:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.338+0000 7fbe47e00640 1 --2- 172.21.15.69:0/3670322187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe500fb840 0x7fbe5018a500 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe380097a0 tx=0x7fbe3802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92d2d46bd3a70d5e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.339+0000 7fbe4fe00640 1 -- 172.21.15.69:0/3670322187 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38031830 con 0x7fbe500fb840 2024-02-21T07:42:32.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.339+0000 7fbe4fe00640 1 -- 172.21.15.69:0/3670322187 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe38031990 con 0x7fbe500fb840 2024-02-21T07:42:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.339+0000 7fbe4fe00640 1 -- 172.21.15.69:0/3670322187 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38031d20 con 0x7fbe500fb840 2024-02-21T07:42:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.339+0000 7fbe55e00640 1 -- 172.21.15.69:0/3670322187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe500fb840 msgr2=0x7fbe5018a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.339+0000 7fbe55e00640 1 --2- 172.21.15.69:0/3670322187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe500fb840 0x7fbe5018a500 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe380097a0 tx=0x7fbe3802b8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.339+0000 7fbe55e00640 1 -- 172.21.15.69:0/3670322187 shutdown_connections 2024-02-21T07:42:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.339+0000 7fbe55e00640 1 --2- 172.21.15.69:0/3670322187 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe500fb840 0x7fbe5018a500 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.339+0000 7fbe55e00640 1 -- 172.21.15.69:0/3670322187 >> 172.21.15.69:0/3670322187 conn(0x7fbe500d2ae0 msgr2=0x7fbe500d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.339+0000 7fbe55e00640 1 -- 172.21.15.69:0/3670322187 shutdown_connections 2024-02-21T07:42:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.339+0000 7fbe55e00640 1 -- 172.21.15.69:0/3670322187 wait complete. 2024-02-21T07:42:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.341+0000 7fbe55e00640 1 Processor -- start 2024-02-21T07:42:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.341+0000 7fbe55e00640 1 -- start start 2024-02-21T07:42:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.342+0000 7fbe55e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe5006ac20 0x7fbe50167690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.342+0000 7fbe55e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe500fb840 0x7fbe5021eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe55e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe50182b70 0x7fbe5021f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe55e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5021f600 con 0x7fbe50182b70 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe55e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50181c70 con 0x7fbe500fb840 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe55e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe50181f50 con 0x7fbe5006ac20 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe54a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe5006ac20 0x7fbe50167690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe54a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe5006ac20 0x7fbe50167690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:60742/0 (socket says 172.21.15.69:60742) 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe54a00640 1 -- 172.21.15.69:0/1385755545 learned_addr learned my addr 172.21.15.69:0/1385755545 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe55400640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe50182b70 0x7fbe5021f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe47e00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe500fb840 0x7fbe5021eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe54a00640 1 -- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe500fb840 msgr2=0x7fbe5021eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe54a00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe500fb840 0x7fbe5021eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe54a00640 1 -- 172.21.15.69:0/1385755545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe50182b70 msgr2=0x7fbe5021f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe54a00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe50182b70 0x7fbe5021f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe54a00640 1 -- 172.21.15.69:0/1385755545 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe38009400 con 0x7fbe5006ac20 2024-02-21T07:42:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe47e00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe500fb840 0x7fbe5021eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.343+0000 7fbe54a00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe5006ac20 0x7fbe50167690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c410 tx=0x7fbe4000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.344+0000 7fbe4d600640 1 -- 172.21.15.69:0/1385755545 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40005ce0 con 0x7fbe5006ac20 2024-02-21T07:42:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.344+0000 7fbe4d600640 1 -- 172.21.15.69:0/1385755545 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40005e40 con 0x7fbe5006ac20 2024-02-21T07:42:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.344+0000 7fbe4d600640 1 -- 172.21.15.69:0/1385755545 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400072f0 con 0x7fbe5006ac20 2024-02-21T07:42:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.344+0000 7fbe55e00640 1 -- 172.21.15.69:0/1385755545 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe50182230 con 0x7fbe5006ac20 2024-02-21T07:42:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.344+0000 7fbe55e00640 1 -- 172.21.15.69:0/1385755545 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe500d3f50 con 0x7fbe5006ac20 2024-02-21T07:42:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.345+0000 7fbe55e00640 1 -- 172.21.15.69:0/1385755545 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe500d6010 con 0x7fbe5006ac20 2024-02-21T07:42:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.347+0000 7fbe4d600640 1 -- 172.21.15.69:0/1385755545 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fbe40007510 con 0x7fbe5006ac20 2024-02-21T07:42:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.348+0000 7fbe4d600640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbe2c09f0a0 0x7fbe2c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.348+0000 7fbe4d600640 1 -- 172.21.15.69:0/1385755545 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fbe400c9410 con 0x7fbe5006ac20 2024-02-21T07:42:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.348+0000 7fbe47e00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbe2c09f0a0 0x7fbe2c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.349+0000 7fbe47e00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbe2c09f0a0 0x7fbe2c0a1560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe38036000 tx=0x7fbe3803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:32.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.350+0000 7fbe4d600640 1 -- 172.21.15.69:0/1385755545 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbe40093170 con 0x7fbe5006ac20 2024-02-21T07:42:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.573+0000 7fbe55e00640 1 -- 172.21.15.69:0/1385755545 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe50069c10 con 0x7fbe2c09f0a0 2024-02-21T07:42:32.584 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:42:32.578+0000 7f197c0b9640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T07:42:32.585 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:42:32.578+0000 7f197c0b9640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T07:42:32.585 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:42:32.578+0000 7f197c0b9640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T07:42:32.585 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:42:32.578+0000 7f197c0b9640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T07:42:32.585 INFO:tasks.ceph.mgr.y.smithi174.stderr:2024-02-21T07:42:32.578+0000 7f197c0b9640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T07:42:32.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.620+0000 7fbe4d600640 1 -- 172.21.15.69:0/1385755545 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbe50069c10 con 0x7fbe2c09f0a0 2024-02-21T07:42:32.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.622+0000 7fbe55e00640 1 -- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbe2c09f0a0 msgr2=0x7fbe2c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.622+0000 7fbe55e00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbe2c09f0a0 0x7fbe2c0a1560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbe38036000 tx=0x7fbe3803c040 comp rx=0 tx=0).stop 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.622+0000 7fbe55e00640 1 -- 172.21.15.69:0/1385755545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe5006ac20 msgr2=0x7fbe50167690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.622+0000 7fbe55e00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe5006ac20 0x7fbe50167690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c410 tx=0x7fbe4000c8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.623+0000 7fbe55e00640 1 -- 172.21.15.69:0/1385755545 shutdown_connections 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.623+0000 7fbe55e00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbe2c09f0a0 0x7fbe2c0a1560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.623+0000 7fbe55e00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe50182b70 0x7fbe5021f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.623+0000 7fbe55e00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbe500fb840 0x7fbe5021eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.623+0000 7fbe55e00640 1 --2- 172.21.15.69:0/1385755545 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe5006ac20 0x7fbe50167690 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.623+0000 7fbe55e00640 1 -- 172.21.15.69:0/1385755545 >> 172.21.15.69:0/1385755545 conn(0x7fbe500d2ae0 msgr2=0x7fbe5006b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.623+0000 7fbe55e00640 1 -- 172.21.15.69:0/1385755545 shutdown_connections 2024-02-21T07:42:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.623+0000 7fbe55e00640 1 -- 172.21.15.69:0/1385755545 wait complete. 2024-02-21T07:42:32.646 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-02-21T07:42:32.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.858+0000 7fa65be00640 1 Processor -- start 2024-02-21T07:42:32.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.858+0000 7fa65be00640 1 -- start start 2024-02-21T07:42:32.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.860+0000 7fa65be00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa654187bd0 0x7fa654188080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.861+0000 7fa65be00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa6541885c0 0x7fa654071140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.861+0000 7fa65be00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540cfda0 con 0x7fa654182af0 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.861+0000 7fa65be00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa654189a60 con 0x7fa6541885c0 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.861+0000 7fa65be00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65418cfd0 con 0x7fa654187bd0 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.861+0000 7fa659400640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fa654182af0 0x7fa65418c8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:57052/0 (socket says 172.21.15.69:57052) 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.861+0000 7fa659400640 1 -- 172.21.15.69:0/2667705651 learned_addr learned my addr 172.21.15.69:0/2667705651 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.861+0000 7fa658a00640 1 --2- 172.21.15.69:0/2667705651 >> v2:172.21.15.184:3300/0 conn(0x7fa654187bd0 0x7fa654188080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.861+0000 7fa659e00640 1 --2- 172.21.15.69:0/2667705651 >> v2:172.21.15.174:3300/0 conn(0x7fa6541885c0 0x7fa654071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.861+0000 7fa653e00640 1 -- 172.21.15.69:0/2667705651 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287258438 0 0) 0x7fa6540cfda0 con 0x7fa654182af0 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.861+0000 7fa653e00640 1 -- 172.21.15.69:0/2667705651 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa63c003520 con 0x7fa654182af0 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.862+0000 7fa658a00640 1 -- 172.21.15.69:0/2667705651 >> v2:172.21.15.174:3300/0 conn(0x7fa6541885c0 msgr2=0x7fa654071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.862+0000 7fa653e00640 1 -- 172.21.15.69:0/2667705651 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3195859994 0 0) 0x7fa63c003520 con 0x7fa654182af0 2024-02-21T07:42:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.862+0000 7fa658a00640 1 --2- 172.21.15.69:0/2667705651 >> v2:172.21.15.174:3300/0 conn(0x7fa6541885c0 0x7fa654071140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.862+0000 7fa658a00640 1 -- 172.21.15.69:0/2667705651 >> v1:172.21.15.184:6789/0 conn(0x7fa654182af0 legacy=0x7fa65418c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.862+0000 7fa658a00640 1 -- 172.21.15.69:0/2667705651 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654182ed0 con 0x7fa654187bd0 2024-02-21T07:42:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.862+0000 7fa659e00640 1 --2- 172.21.15.69:0/2667705651 >> v2:172.21.15.174:3300/0 conn(0x7fa6541885c0 0x7fa654071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.863+0000 7fa658a00640 1 --2- 172.21.15.69:0/2667705651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa654187bd0 0x7fa654188080 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa6540fe0d0 tx=0x7fa64402b680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13e63d9c1214f928 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.863+0000 7fa653e00640 1 -- 172.21.15.69:0/2667705651 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648001690 con 0x7fa654187bd0 2024-02-21T07:42:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.863+0000 7fa653e00640 1 -- 172.21.15.69:0/2667705651 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64402e050 con 0x7fa654187bd0 2024-02-21T07:42:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.863+0000 7fa653e00640 1 -- 172.21.15.69:0/2667705651 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa644030710 con 0x7fa654187bd0 2024-02-21T07:42:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.864+0000 7fa65be00640 1 -- 172.21.15.69:0/2667705651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa654187bd0 msgr2=0x7fa654188080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.864+0000 7fa65be00640 1 --2- 172.21.15.69:0/2667705651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa654187bd0 0x7fa654188080 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa6540fe0d0 tx=0x7fa64402b680 comp rx=0 tx=0).stop 2024-02-21T07:42:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.864+0000 7fa65be00640 1 -- 172.21.15.69:0/2667705651 shutdown_connections 2024-02-21T07:42:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.864+0000 7fa65be00640 1 --2- 172.21.15.69:0/2667705651 >> v2:172.21.15.174:3300/0 conn(0x7fa6541885c0 0x7fa654071140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.864+0000 7fa65be00640 1 --2- 172.21.15.69:0/2667705651 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa654187bd0 0x7fa654188080 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.864+0000 7fa65be00640 1 -- 172.21.15.69:0/2667705651 >> 172.21.15.69:0/2667705651 conn(0x7fa6540fe280 msgr2=0x7fa6540fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:32.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.864+0000 7fa65be00640 1 -- 172.21.15.69:0/2667705651 shutdown_connections 2024-02-21T07:42:32.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.864+0000 7fa65be00640 1 -- 172.21.15.69:0/2667705651 wait complete. 2024-02-21T07:42:32.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.866+0000 7fa65be00640 1 Processor -- start 2024-02-21T07:42:32.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.866+0000 7fa65be00640 1 -- start start 2024-02-21T07:42:32.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.867+0000 7fa65be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa654182af0 0x7fa654171ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.867+0000 7fa65be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa654187bd0 0x7fa65421e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.867+0000 7fa65be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6541885c0 0x7fa654173860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.867+0000 7fa65be00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654180310 con 0x7fa654187bd0 2024-02-21T07:42:32.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.867+0000 7fa65be00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6541808d0 con 0x7fa654182af0 2024-02-21T07:42:32.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.867+0000 7fa65be00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65421eca0 con 0x7fa6541885c0 2024-02-21T07:42:32.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.868+0000 7fa658a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa654187bd0 0x7fa65421e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.868+0000 7fa659e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6541885c0 0x7fa654173860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.868+0000 7fa659400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa654182af0 0x7fa654171ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.868+0000 7fa658a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa654187bd0 0x7fa65421e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39770/0 (socket says 172.21.15.69:39770) 2024-02-21T07:42:32.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.868+0000 7fa658a00640 1 -- 172.21.15.69:0/4033193339 learned_addr learned my addr 172.21.15.69:0/4033193339 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:32.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.868+0000 7fa659e00640 1 -- 172.21.15.69:0/4033193339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa654182af0 msgr2=0x7fa654171ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.868+0000 7fa659e00640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa654182af0 0x7fa654171ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.868+0000 7fa659e00640 1 -- 172.21.15.69:0/4033193339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa654187bd0 msgr2=0x7fa65421e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:32.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.868+0000 7fa659e00640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa654187bd0 0x7fa65421e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:32.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.868+0000 7fa659e00640 1 -- 172.21.15.69:0/4033193339 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c009a70 con 0x7fa6541885c0 2024-02-21T07:42:32.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.869+0000 7fa659e00640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6541885c0 0x7fa654173860 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009db0 tx=0x7fa64c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:32.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.869+0000 7fa651600640 1 -- 172.21.15.69:0/4033193339 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c00ccd0 con 0x7fa6541885c0 2024-02-21T07:42:32.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.869+0000 7fa651600640 1 -- 172.21.15.69:0/4033193339 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c00f040 con 0x7fa6541885c0 2024-02-21T07:42:32.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.869+0000 7fa651600640 1 -- 172.21.15.69:0/4033193339 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c003bd0 con 0x7fa6541885c0 2024-02-21T07:42:32.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.869+0000 7fa65be00640 1 -- 172.21.15.69:0/4033193339 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa644009400 con 0x7fa6541885c0 2024-02-21T07:42:32.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.869+0000 7fa65be00640 1 -- 172.21.15.69:0/4033193339 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65421f1f0 con 0x7fa6541885c0 2024-02-21T07:42:32.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.870+0000 7fa65be00640 1 -- 172.21.15.69:0/4033193339 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa654069d50 con 0x7fa6541885c0 2024-02-21T07:42:32.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.872+0000 7fa651600640 1 -- 172.21.15.69:0/4033193339 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 5) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa64c014480 con 0x7fa6541885c0 2024-02-21T07:42:32.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.873+0000 7fa651600640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa63809f0a0 0x7fa6380a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:32.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.873+0000 7fa651600640 1 -- 172.21.15.69:0/4033193339 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa64c0ca570 con 0x7fa6541885c0 2024-02-21T07:42:32.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.874+0000 7fa659400640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa63809f0a0 0x7fa6380a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:32.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.874+0000 7fa659400640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa63809f0a0 0x7fa6380a1560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa6480017c0 tx=0x7fa648001250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:32.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:32.878+0000 7fa651600640 1 -- 172.21.15.69:0/4033193339 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa64c0942d0 con 0x7fa6541885c0 2024-02-21T07:42:33.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.101+0000 7fa65be00640 1 -- 172.21.15.69:0/4033193339 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fa654186e10 con 0x7fa63809f0a0 2024-02-21T07:42:33.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.138+0000 7fa651600640 1 -- 172.21.15.69:0/4033193339 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa64800f8e0 con 0x7fa63809f0a0 2024-02-21T07:42:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.141+0000 7fa65be00640 1 -- 172.21.15.69:0/4033193339 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa63809f0a0 msgr2=0x7fa6380a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.141+0000 7fa65be00640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa63809f0a0 0x7fa6380a1560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa6480017c0 tx=0x7fa648001250 comp rx=0 tx=0).stop 2024-02-21T07:42:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.141+0000 7fa65be00640 1 -- 172.21.15.69:0/4033193339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6541885c0 msgr2=0x7fa654173860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.141+0000 7fa65be00640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6541885c0 0x7fa654173860 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009db0 tx=0x7fa64c00c490 comp rx=0 tx=0).stop 2024-02-21T07:42:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.141+0000 7fa65be00640 1 -- 172.21.15.69:0/4033193339 shutdown_connections 2024-02-21T07:42:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.141+0000 7fa65be00640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa63809f0a0 0x7fa6380a1560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.141+0000 7fa65be00640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6541885c0 0x7fa654173860 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.141+0000 7fa65be00640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa654187bd0 0x7fa65421e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.141+0000 7fa65be00640 1 --2- 172.21.15.69:0/4033193339 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa654182af0 0x7fa654171ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.141+0000 7fa65be00640 1 -- 172.21.15.69:0/4033193339 >> 172.21.15.69:0/4033193339 conn(0x7fa6540fe280 msgr2=0x7fa65418c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.142+0000 7fa65be00640 1 -- 172.21.15.69:0/4033193339 shutdown_connections 2024-02-21T07:42:33.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.142+0000 7fa65be00640 1 -- 172.21.15.69:0/4033193339 wait complete. 2024-02-21T07:42:33.168 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-02-21T07:42:33.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.383+0000 7fe1d8e00640 1 Processor -- start 2024-02-21T07:42:33.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.383+0000 7fe1d8e00640 1 -- start start 2024-02-21T07:42:33.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.385+0000 7fe1d8e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe1d4183f80 0x7fe1d406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:33.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.385+0000 7fe1d8e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d40f6710 con 0x7fe1d40f48c0 2024-02-21T07:42:33.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.385+0000 7fe1d8e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d40f5b90 con 0x7fe1d4188300 2024-02-21T07:42:33.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.385+0000 7fe1d8e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d40f5e70 con 0x7fe1d4183f80 2024-02-21T07:42:33.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.385+0000 7fe1d2800640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe1d40f48c0 0x7fe1d40f4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47710/0 (socket says 172.21.15.69:47710) 2024-02-21T07:42:33.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.385+0000 7fe1d2800640 1 -- 172.21.15.69:0/1991722254 learned_addr learned my addr 172.21.15.69:0/1991722254 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:33.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.385+0000 7fe1d1e00640 1 --2- 172.21.15.69:0/1991722254 >> v2:172.21.15.184:3300/0 conn(0x7fe1d4183f80 0x7fe1d406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:33.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.386+0000 7fe1d0a00640 1 -- 172.21.15.69:0/1991722254 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081175608 0 0) 0x7fe1d40f5b90 con 0x7fe1d4188300 2024-02-21T07:42:33.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.386+0000 7fe1d0a00640 1 -- 172.21.15.69:0/1991722254 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b8003520 con 0x7fe1d4188300 2024-02-21T07:42:33.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.386+0000 7fe1d0a00640 1 -- 172.21.15.69:0/1991722254 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881340248 0 0) 0x7fe1d40f6710 con 0x7fe1d40f48c0 2024-02-21T07:42:33.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.386+0000 7fe1d0a00640 1 -- 172.21.15.69:0/1991722254 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1d40f5b90 con 0x7fe1d40f48c0 2024-02-21T07:42:33.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.386+0000 7fe1d1e00640 1 -- 172.21.15.69:0/1991722254 >> v1:172.21.15.174:6789/0 conn(0x7fe1d4188300 legacy=0x7fe1d4188760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.386+0000 7fe1d1e00640 1 -- 172.21.15.69:0/1991722254 >> v1:172.21.15.69:6789/0 conn(0x7fe1d40f48c0 legacy=0x7fe1d40f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.386+0000 7fe1d1e00640 1 -- 172.21.15.69:0/1991722254 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d40f6150 con 0x7fe1d4183f80 2024-02-21T07:42:33.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.387+0000 7fe1d1e00640 1 --2- 172.21.15.69:0/1991722254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1d4183f80 0x7fe1d406d6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40097a0 tx=0x7fe1c402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60fdd129eb685e3a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:33.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.388+0000 7fe1d0a00640 1 -- 172.21.15.69:0/1991722254 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c402e070 con 0x7fe1d4183f80 2024-02-21T07:42:33.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.388+0000 7fe1d0a00640 1 -- 172.21.15.69:0/1991722254 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c40315a0 con 0x7fe1d4183f80 2024-02-21T07:42:33.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.388+0000 7fe1d0a00640 1 -- 172.21.15.69:0/1991722254 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4031930 con 0x7fe1d4183f80 2024-02-21T07:42:33.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.389+0000 7fe1d8e00640 1 -- 172.21.15.69:0/1991722254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1d4183f80 msgr2=0x7fe1d406d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.389+0000 7fe1d8e00640 1 --2- 172.21.15.69:0/1991722254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1d4183f80 0x7fe1d406d6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40097a0 tx=0x7fe1c402b840 comp rx=0 tx=0).stop 2024-02-21T07:42:33.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.389+0000 7fe1d8e00640 1 -- 172.21.15.69:0/1991722254 shutdown_connections 2024-02-21T07:42:33.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.389+0000 7fe1d8e00640 1 --2- 172.21.15.69:0/1991722254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1d4183f80 0x7fe1d406d6c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.389+0000 7fe1d8e00640 1 -- 172.21.15.69:0/1991722254 >> 172.21.15.69:0/1991722254 conn(0x7fe1d40f6ba0 msgr2=0x7fe1d40f6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:33.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.389+0000 7fe1d8e00640 1 -- 172.21.15.69:0/1991722254 shutdown_connections 2024-02-21T07:42:33.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.389+0000 7fe1d8e00640 1 -- 172.21.15.69:0/1991722254 wait complete. 2024-02-21T07:42:33.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.391+0000 7fe1d8e00640 1 Processor -- start 2024-02-21T07:42:33.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.391+0000 7fe1d8e00640 1 -- start start 2024-02-21T07:42:33.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.392+0000 7fe1d8e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d40f48c0 0x7fe1d4174290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:33.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.392+0000 7fe1d8e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1d4183f80 0x7fe1d41747d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:33.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.392+0000 7fe1d8e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1d4188300 0x7fe1d41685f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:33.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.392+0000 7fe1d8e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4175370 con 0x7fe1d40f48c0 2024-02-21T07:42:33.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.392+0000 7fe1d8e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d421e3e0 con 0x7fe1d4188300 2024-02-21T07:42:33.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.392+0000 7fe1d8e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d421daf0 con 0x7fe1d4183f80 2024-02-21T07:42:33.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d1e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d40f48c0 0x7fe1d4174290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:33.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d1e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d40f48c0 0x7fe1d4174290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39782/0 (socket says 172.21.15.69:39782) 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d1e00640 1 -- 172.21.15.69:0/2410782280 learned_addr learned my addr 172.21.15.69:0/2410782280 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d1400640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1d4183f80 0x7fe1d41747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d2800640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1d4188300 0x7fe1d41685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d1e00640 1 -- 172.21.15.69:0/2410782280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1d4183f80 msgr2=0x7fe1d41747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d1e00640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1d4183f80 0x7fe1d41747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d1e00640 1 -- 172.21.15.69:0/2410782280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1d4188300 msgr2=0x7fe1d41685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d1e00640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1d4188300 0x7fe1d41685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d1e00640 1 -- 172.21.15.69:0/2410782280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c4009400 con 0x7fe1d40f48c0 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.393+0000 7fe1d1e00640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d40f48c0 0x7fe1d4174290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4034040 tx=0x7fe1c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.394+0000 7fe1ca000640 1 -- 172.21.15.69:0/2410782280 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4032630 con 0x7fe1d40f48c0 2024-02-21T07:42:33.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.394+0000 7fe1ca000640 1 -- 172.21.15.69:0/2410782280 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c4032790 con 0x7fe1d40f48c0 2024-02-21T07:42:33.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.394+0000 7fe1ca000640 1 -- 172.21.15.69:0/2410782280 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4032b40 con 0x7fe1d40f48c0 2024-02-21T07:42:33.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.394+0000 7fe1d8e00640 1 -- 172.21.15.69:0/2410782280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d4175090 con 0x7fe1d40f48c0 2024-02-21T07:42:33.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.394+0000 7fe1d8e00640 1 -- 172.21.15.69:0/2410782280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d421e070 con 0x7fe1d40f48c0 2024-02-21T07:42:33.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.395+0000 7fe1d8e00640 1 -- 172.21.15.69:0/2410782280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d421e200 con 0x7fe1d40f48c0 2024-02-21T07:42:33.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.397+0000 7fe1ca000640 1 -- 172.21.15.69:0/2410782280 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe1c404e430 con 0x7fe1d40f48c0 2024-02-21T07:42:33.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.398+0000 7fe1ca000640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe1b409f130 0x7fe1b40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:33.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.398+0000 7fe1ca000640 1 -- 172.21.15.69:0/2410782280 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe1c40ebd90 con 0x7fe1d40f48c0 2024-02-21T07:42:33.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.399+0000 7fe1d1400640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe1b409f130 0x7fe1b40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:33.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.399+0000 7fe1d1400640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe1b409f130 0x7fe1b40a15f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe1d417f650 tx=0x7fe1c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:33.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.403+0000 7fe1ca000640 1 -- 172.21.15.69:0/2410782280 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1c40b5990 con 0x7fe1d40f48c0 2024-02-21T07:42:33.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.626+0000 7fe1d8e00640 1 -- 172.21.15.69:0/2410782280 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1d4184360 con 0x7fe1b409f130 2024-02-21T07:42:33.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.631+0000 7fe1ca000640 1 -- 172.21.15.69:0/2410782280 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fe1c0001450 con 0x7fe1b409f130 2024-02-21T07:42:33.637 INFO:teuthology.orchestra.run.smithi069.stdout:/volumes/qa/sv_0/6b5cb1a2-6a6a-46ed-a184-a9467cf7949b 2024-02-21T07:42:33.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 -- 172.21.15.69:0/2410782280 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe1b409f130 msgr2=0x7fe1b40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe1b409f130 0x7fe1b40a15f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe1d417f650 tx=0x7fe1c0009040 comp rx=0 tx=0).stop 2024-02-21T07:42:33.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 -- 172.21.15.69:0/2410782280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d40f48c0 msgr2=0x7fe1d4174290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d40f48c0 0x7fe1d4174290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4034040 tx=0x7fe1c40046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 -- 172.21.15.69:0/2410782280 shutdown_connections 2024-02-21T07:42:33.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe1b409f130 0x7fe1b40a15f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe1d4188300 0x7fe1d41685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1d4183f80 0x7fe1d41747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 --2- 172.21.15.69:0/2410782280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d40f48c0 0x7fe1d4174290 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 -- 172.21.15.69:0/2410782280 >> 172.21.15.69:0/2410782280 conn(0x7fe1d40f6ba0 msgr2=0x7fe1d4188760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:33.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 -- 172.21.15.69:0/2410782280 shutdown_connections 2024-02-21T07:42:33.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.634+0000 7fe1d8e00640 1 -- 172.21.15.69:0/2410782280 wait complete. 2024-02-21T07:42:33.660 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-02-21T07:42:33.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.871+0000 7f1b4ce00640 1 Processor -- start 2024-02-21T07:42:33.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.871+0000 7f1b4ce00640 1 -- start start 2024-02-21T07:42:33.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.873+0000 7f1b4ce00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1b480cd730 0x7f1b4818d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:33.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.873+0000 7f1b4ce00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b480ccb90 con 0x7f1b48186fc0 2024-02-21T07:42:33.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.873+0000 7f1b4ce00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b480f55e0 con 0x7f1b480f4fd0 2024-02-21T07:42:33.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.873+0000 7f1b4ce00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b480f58c0 con 0x7f1b480cd730 2024-02-21T07:42:33.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.873+0000 7f1b46800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1b480cd730 0x7f1b4818d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:33.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.873+0000 7f1b45e00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f1b48186fc0 0x7f1b480f48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:43590/0 (socket says 172.21.15.69:43590) 2024-02-21T07:42:33.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.873+0000 7f1b45e00640 1 -- 172.21.15.69:0/1553716606 learned_addr learned my addr 172.21.15.69:0/1553716606 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:33.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.874+0000 7f1b45400640 1 -- 172.21.15.69:0/1553716606 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384197919 0 0) 0x7f1b480ccb90 con 0x7f1b48186fc0 2024-02-21T07:42:33.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.874+0000 7f1b45400640 1 -- 172.21.15.69:0/1553716606 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b2c003520 con 0x7f1b48186fc0 2024-02-21T07:42:33.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.874+0000 7f1b46800640 1 -- 172.21.15.69:0/1553716606 >> v1:172.21.15.184:6789/0 conn(0x7f1b480f4fd0 legacy=0x7f1b480cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.874+0000 7f1b45400640 1 -- 172.21.15.69:0/1553716606 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127715226 0 0) 0x7f1b480f55e0 con 0x7f1b480f4fd0 2024-02-21T07:42:33.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.874+0000 7f1b46800640 1 -- 172.21.15.69:0/1553716606 >> v1:172.21.15.174:6789/0 conn(0x7f1b48186fc0 legacy=0x7f1b480f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.874+0000 7f1b46800640 1 -- 172.21.15.69:0/1553716606 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b480cc540 con 0x7f1b480cd730 2024-02-21T07:42:33.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.875+0000 7f1b46800640 1 --2- 172.21.15.69:0/1553716606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 0x7f1b4818d010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009d90 tx=0x7f1b4002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5475fa82c984b78 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:33.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.876+0000 7f1b45400640 1 -- 172.21.15.69:0/1553716606 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4002cbd0 con 0x7f1b480cd730 2024-02-21T07:42:33.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.876+0000 7f1b45400640 1 -- 172.21.15.69:0/1553716606 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4002cd30 con 0x7f1b480cd730 2024-02-21T07:42:33.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.876+0000 7f1b45400640 1 -- 172.21.15.69:0/1553716606 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4002cea0 con 0x7f1b480cd730 2024-02-21T07:42:33.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.876+0000 7f1b4ce00640 1 -- 172.21.15.69:0/1553716606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 msgr2=0x7f1b4818d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.876+0000 7f1b4ce00640 1 --2- 172.21.15.69:0/1553716606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 0x7f1b4818d010 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b40009d90 tx=0x7f1b4002be20 comp rx=0 tx=0).stop 2024-02-21T07:42:33.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.876+0000 7f1b4ce00640 1 -- 172.21.15.69:0/1553716606 shutdown_connections 2024-02-21T07:42:33.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.876+0000 7f1b4ce00640 1 --2- 172.21.15.69:0/1553716606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 0x7f1b4818d010 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.876+0000 7f1b4ce00640 1 -- 172.21.15.69:0/1553716606 >> 172.21.15.69:0/1553716606 conn(0x7f1b480f6ba0 msgr2=0x7f1b480f6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:33.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.876+0000 7f1b4ce00640 1 -- 172.21.15.69:0/1553716606 shutdown_connections 2024-02-21T07:42:33.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.876+0000 7f1b4ce00640 1 -- 172.21.15.69:0/1553716606 wait complete. 2024-02-21T07:42:33.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.878+0000 7f1b4ce00640 1 Processor -- start 2024-02-21T07:42:33.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.878+0000 7f1b4ce00640 1 -- start start 2024-02-21T07:42:33.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.879+0000 7f1b4ce00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 0x7f1b480f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:33.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b4ce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b480f4fd0 0x7f1b48224220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:33.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b4ce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b48186fc0 0x7f1b48224760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:33.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b4ce00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480f8050 con 0x7f1b480f4fd0 2024-02-21T07:42:33.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b4ce00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480f9660 con 0x7f1b48186fc0 2024-02-21T07:42:33.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b4ce00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480f82e0 con 0x7f1b480cd730 2024-02-21T07:42:33.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b3fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b480f4fd0 0x7f1b48224220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:33.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b45e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 0x7f1b480f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:33.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b45e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 0x7f1b480f7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:60824/0 (socket says 172.21.15.69:60824) 2024-02-21T07:42:33.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b45e00640 1 -- 172.21.15.69:0/3980434624 learned_addr learned my addr 172.21.15.69:0/3980434624 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:33.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b46800640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b48186fc0 0x7f1b48224760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:33.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b45e00640 1 -- 172.21.15.69:0/3980434624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b48186fc0 msgr2=0x7f1b48224760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b45e00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b48186fc0 0x7f1b48224760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b45e00640 1 -- 172.21.15.69:0/3980434624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b480f4fd0 msgr2=0x7f1b48224220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:33.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b45e00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b480f4fd0 0x7f1b48224220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:33.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.880+0000 7f1b45e00640 1 -- 172.21.15.69:0/3980434624 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b40009a70 con 0x7f1b480cd730 2024-02-21T07:42:33.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.881+0000 7f1b45e00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 0x7f1b480f7b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800c410 tx=0x7f1b3800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:33.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.881+0000 7f1b3e000640 1 -- 172.21.15.69:0/3980434624 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38005ce0 con 0x7f1b480cd730 2024-02-21T07:42:33.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.881+0000 7f1b3e000640 1 -- 172.21.15.69:0/3980434624 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b38005e40 con 0x7f1b480cd730 2024-02-21T07:42:33.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.881+0000 7f1b3e000640 1 -- 172.21.15.69:0/3980434624 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b380072f0 con 0x7f1b480cd730 2024-02-21T07:42:33.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.881+0000 7f1b4ce00640 1 -- 172.21.15.69:0/3980434624 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b480f85c0 con 0x7f1b480cd730 2024-02-21T07:42:33.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.881+0000 7f1b4ce00640 1 -- 172.21.15.69:0/3980434624 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b480f8b80 con 0x7f1b480cd730 2024-02-21T07:42:33.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.882+0000 7f1b4ce00640 1 -- 172.21.15.69:0/3980434624 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b48069d50 con 0x7f1b480cd730 2024-02-21T07:42:33.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.884+0000 7f1b3e000640 1 -- 172.21.15.69:0/3980434624 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1b38007510 con 0x7f1b480cd730 2024-02-21T07:42:33.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.885+0000 7f1b3e000640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2409f130 0x7f1b240a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:33.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.885+0000 7f1b3e000640 1 -- 172.21.15.69:0/3980434624 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f1b380c91d0 con 0x7f1b480cd730 2024-02-21T07:42:33.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.886+0000 7f1b3fe00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2409f130 0x7f1b240a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:33.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.886+0000 7f1b3fe00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2409f130 0x7f1b240a15f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1b480f6690 tx=0x7f1b30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:33.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:33.890+0000 7f1b3e000640 1 -- 172.21.15.69:0/3980434624 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b38092f90 con 0x7f1b480cd730 2024-02-21T07:42:34.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.115+0000 7f1b4ce00640 1 -- 172.21.15.69:0/3980434624 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b4806dcd0 con 0x7f1b2409f130 2024-02-21T07:42:34.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.159+0000 7f1b3e000640 1 -- 172.21.15.69:0/3980434624 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1b300013e0 con 0x7f1b2409f130 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 -- 172.21.15.69:0/3980434624 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2409f130 msgr2=0x7f1b240a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2409f130 0x7f1b240a15f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1b480f6690 tx=0x7f1b30009040 comp rx=0 tx=0).stop 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 -- 172.21.15.69:0/3980434624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 msgr2=0x7f1b480f7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 0x7f1b480f7b10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800c410 tx=0x7f1b3800c8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 -- 172.21.15.69:0/3980434624 shutdown_connections 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2409f130 0x7f1b240a15f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b48186fc0 0x7f1b48224760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b480f4fd0 0x7f1b48224220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 --2- 172.21.15.69:0/3980434624 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b480cd730 0x7f1b480f7b10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 -- 172.21.15.69:0/3980434624 >> 172.21.15.69:0/3980434624 conn(0x7f1b480f6ba0 msgr2=0x7f1b481862c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 -- 172.21.15.69:0/3980434624 shutdown_connections 2024-02-21T07:42:34.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.162+0000 7f1b4ce00640 1 -- 172.21.15.69:0/3980434624 wait complete. 2024-02-21T07:42:34.188 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-02-21T07:42:34.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.400+0000 7fcf2ce00640 1 Processor -- start 2024-02-21T07:42:34.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.400+0000 7fcf2ce00640 1 -- start start 2024-02-21T07:42:34.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.402+0000 7fcf2ce00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcf2818c980 0x7fcf28187b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.402+0000 7fcf2ce00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf281880d0 con 0x7fcf2817f350 2024-02-21T07:42:34.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf2ce00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf281866e0 con 0x7fcf280fcf50 2024-02-21T07:42:34.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf2ce00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf28189730 con 0x7fcf2818c980 2024-02-21T07:42:34.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf27400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fcf2817f350 0x7fcf28187480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47722/0 (socket says 172.21.15.69:47722) 2024-02-21T07:42:34.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf27400640 1 -- 172.21.15.69:0/3115323356 learned_addr learned my addr 172.21.15.69:0/3115323356 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:34.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf26a00640 1 --2- 172.21.15.69:0/3115323356 >> v2:172.21.15.69:3300/0 conn(0x7fcf2818c980 0x7fcf28187b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf26000640 1 -- 172.21.15.69:0/3115323356 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623034360 0 0) 0x7fcf281880d0 con 0x7fcf2817f350 2024-02-21T07:42:34.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf26000640 1 -- 172.21.15.69:0/3115323356 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf0c003520 con 0x7fcf2817f350 2024-02-21T07:42:34.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf26000640 1 -- 172.21.15.69:0/3115323356 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719045959 0 0) 0x7fcf281866e0 con 0x7fcf280fcf50 2024-02-21T07:42:34.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf26000640 1 -- 172.21.15.69:0/3115323356 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf281880d0 con 0x7fcf280fcf50 2024-02-21T07:42:34.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf26a00640 1 -- 172.21.15.69:0/3115323356 >> v1:172.21.15.184:6789/0 conn(0x7fcf280fcf50 legacy=0x7fcf280fd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf26a00640 1 -- 172.21.15.69:0/3115323356 >> v1:172.21.15.69:6789/0 conn(0x7fcf2817f350 legacy=0x7fcf28187480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.403+0000 7fcf26a00640 1 -- 172.21.15.69:0/3115323356 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280d5d90 con 0x7fcf2818c980 2024-02-21T07:42:34.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.405+0000 7fcf26a00640 1 --2- 172.21.15.69:0/3115323356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2818c980 0x7fcf28187b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf100097a0 tx=0x7fcf1002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2287c61775d40be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:34.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.405+0000 7fcf26000640 1 -- 172.21.15.69:0/3115323356 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10030610 con 0x7fcf2818c980 2024-02-21T07:42:34.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.405+0000 7fcf26000640 1 -- 172.21.15.69:0/3115323356 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10030770 con 0x7fcf2818c980 2024-02-21T07:42:34.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.405+0000 7fcf26000640 1 -- 172.21.15.69:0/3115323356 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10030b00 con 0x7fcf2818c980 2024-02-21T07:42:34.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.405+0000 7fcf2ce00640 1 -- 172.21.15.69:0/3115323356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2818c980 msgr2=0x7fcf28187b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.405+0000 7fcf2ce00640 1 --2- 172.21.15.69:0/3115323356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2818c980 0x7fcf28187b90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcf100097a0 tx=0x7fcf1002b960 comp rx=0 tx=0).stop 2024-02-21T07:42:34.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.406+0000 7fcf2ce00640 1 -- 172.21.15.69:0/3115323356 shutdown_connections 2024-02-21T07:42:34.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.406+0000 7fcf2ce00640 1 --2- 172.21.15.69:0/3115323356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2818c980 0x7fcf28187b90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.406+0000 7fcf2ce00640 1 -- 172.21.15.69:0/3115323356 >> 172.21.15.69:0/3115323356 conn(0x7fcf280668e0 msgr2=0x7fcf28066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:34.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.406+0000 7fcf2ce00640 1 -- 172.21.15.69:0/3115323356 shutdown_connections 2024-02-21T07:42:34.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.406+0000 7fcf2ce00640 1 -- 172.21.15.69:0/3115323356 wait complete. 2024-02-21T07:42:34.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.408+0000 7fcf2ce00640 1 Processor -- start 2024-02-21T07:42:34.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.408+0000 7fcf2ce00640 1 -- start start 2024-02-21T07:42:34.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf2ce00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf280fcf50 0x7fcf2808e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf2ce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2817f350 0x7fcf281672b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf2ce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf2818c980 0x7fcf281677f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf2ce00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2817e000 con 0x7fcf2817f350 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf2ce00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2817d0a0 con 0x7fcf2818c980 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf2ce00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2817d380 con 0x7fcf280fcf50 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf26a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2817f350 0x7fcf281672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf26a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2817f350 0x7fcf281672b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39816/0 (socket says 172.21.15.69:39816) 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf26a00640 1 -- 172.21.15.69:0/230316812 learned_addr learned my addr 172.21.15.69:0/230316812 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf27400640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf280fcf50 0x7fcf2808e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.409+0000 7fcf27e00640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf2818c980 0x7fcf281677f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf26a00640 1 -- 172.21.15.69:0/230316812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf280fcf50 msgr2=0x7fcf2808e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf26a00640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf280fcf50 0x7fcf2808e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf26a00640 1 -- 172.21.15.69:0/230316812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf2818c980 msgr2=0x7fcf281677f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf26a00640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf2818c980 0x7fcf281677f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf26a00640 1 -- 172.21.15.69:0/230316812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf10009400 con 0x7fcf2817f350 2024-02-21T07:42:34.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf27400640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf280fcf50 0x7fcf2808e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:34.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf26a00640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2817f350 0x7fcf281672b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcf10000c00 tx=0x7fcf10004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:34.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf1f400640 1 -- 172.21.15.69:0/230316812 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1003e040 con 0x7fcf2817f350 2024-02-21T07:42:34.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf1f400640 1 -- 172.21.15.69:0/230316812 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10039980 con 0x7fcf2817f350 2024-02-21T07:42:34.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf1f400640 1 -- 172.21.15.69:0/230316812 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf10039d30 con 0x7fcf2817f350 2024-02-21T07:42:34.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf2ce00640 1 -- 172.21.15.69:0/230316812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2817d660 con 0x7fcf2817f350 2024-02-21T07:42:34.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.410+0000 7fcf2ce00640 1 -- 172.21.15.69:0/230316812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2817dc20 con 0x7fcf2817f350 2024-02-21T07:42:34.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.411+0000 7fcf2ce00640 1 -- 172.21.15.69:0/230316812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf28073f60 con 0x7fcf2817f350 2024-02-21T07:42:34.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.413+0000 7fcf1f400640 1 -- 172.21.15.69:0/230316812 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fcf100443f0 con 0x7fcf2817f350 2024-02-21T07:42:34.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.415+0000 7fcf1f400640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf0409f130 0x7fcf040a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.415+0000 7fcf1f400640 1 -- 172.21.15.69:0/230316812 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fcf100ebe80 con 0x7fcf2817f350 2024-02-21T07:42:34.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.416+0000 7fcf27400640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf0409f130 0x7fcf040a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.418+0000 7fcf1f400640 1 -- 172.21.15.69:0/230316812 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcf100b5a80 con 0x7fcf2817f350 2024-02-21T07:42:34.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.418+0000 7fcf27400640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf0409f130 0x7fcf040a15f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcf180012e0 tx=0x7fcf18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:34.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.643+0000 7fcf2ce00640 1 -- 172.21.15.69:0/230316812 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf28186f60 con 0x7fcf0409f130 2024-02-21T07:42:34.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.648+0000 7fcf1f400640 1 -- 172.21.15.69:0/230316812 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fcf1800edc0 con 0x7fcf0409f130 2024-02-21T07:42:34.654 INFO:teuthology.orchestra.run.smithi069.stdout:/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844 2024-02-21T07:42:34.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 -- 172.21.15.69:0/230316812 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf0409f130 msgr2=0x7fcf040a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf0409f130 0x7fcf040a15f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcf180012e0 tx=0x7fcf18009040 comp rx=0 tx=0).stop 2024-02-21T07:42:34.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 -- 172.21.15.69:0/230316812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2817f350 msgr2=0x7fcf281672b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2817f350 0x7fcf281672b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcf10000c00 tx=0x7fcf10004730 comp rx=0 tx=0).stop 2024-02-21T07:42:34.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 -- 172.21.15.69:0/230316812 shutdown_connections 2024-02-21T07:42:34.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf0409f130 0x7fcf040a15f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcf2818c980 0x7fcf281677f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf2817f350 0x7fcf281672b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 --2- 172.21.15.69:0/230316812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcf280fcf50 0x7fcf2808e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 -- 172.21.15.69:0/230316812 >> 172.21.15.69:0/230316812 conn(0x7fcf280668e0 msgr2=0x7fcf281898a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:34.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 -- 172.21.15.69:0/230316812 shutdown_connections 2024-02-21T07:42:34.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.650+0000 7fcf2ce00640 1 -- 172.21.15.69:0/230316812 wait complete. 2024-02-21T07:42:34.676 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:42:34.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.882+0000 7f0bd0800640 1 Processor -- start 2024-02-21T07:42:34.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.882+0000 7f0bd0800640 1 -- start start 2024-02-21T07:42:34.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.884+0000 7f0bd0800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0bc80f4e60 0x7f0bc80f8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.884+0000 7f0bd0800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0bc8185b00 0x7f0bc8182dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.884+0000 7f0bd0800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc80f5350 con 0x7f0bc80f7e40 2024-02-21T07:42:34.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.884+0000 7f0bd0800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc8189460 con 0x7f0bc8185b00 2024-02-21T07:42:34.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.884+0000 7f0bd0800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc80f5630 con 0x7f0bc80f4e60 2024-02-21T07:42:34.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.884+0000 7f0bce800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0bc8185b00 0x7f0bc8182dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.884+0000 7f0bcde00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0bc80f7e40 0x7f0bc80f8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:57096/0 (socket says 172.21.15.69:57096) 2024-02-21T07:42:34.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.884+0000 7f0bcde00640 1 -- 172.21.15.69:0/2765013675 learned_addr learned my addr 172.21.15.69:0/2765013675 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:34.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.884+0000 7f0bcd400640 1 --2- 172.21.15.69:0/2765013675 >> v2:172.21.15.174:3300/0 conn(0x7f0bc80f4e60 0x7f0bc80f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.884+0000 7f0bcca00640 1 -- 172.21.15.69:0/2765013675 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719391861 0 0) 0x7f0bc80f5350 con 0x7f0bc80f7e40 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.885+0000 7f0bcca00640 1 -- 172.21.15.69:0/2765013675 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb0003520 con 0x7f0bc80f7e40 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.885+0000 7f0bce800640 1 -- 172.21.15.69:0/2765013675 >> v2:172.21.15.174:3300/0 conn(0x7f0bc80f4e60 msgr2=0x7f0bc80f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.885+0000 7f0bce800640 1 --2- 172.21.15.69:0/2765013675 >> v2:172.21.15.174:3300/0 conn(0x7f0bc80f4e60 0x7f0bc80f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.885+0000 7f0bce800640 1 -- 172.21.15.69:0/2765013675 >> v1:172.21.15.184:6789/0 conn(0x7f0bc80f7e40 legacy=0x7f0bc80f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.885+0000 7f0bce800640 1 -- 172.21.15.69:0/2765013675 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc80f5910 con 0x7f0bc8185b00 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.885+0000 7f0bcd400640 1 --2- 172.21.15.69:0/2765013675 >> v2:172.21.15.174:3300/0 conn(0x7f0bc80f4e60 0x7f0bc80f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.886+0000 7f0bce800640 1 --2- 172.21.15.69:0/2765013675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc8185b00 0x7f0bc8182dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80eda40 tx=0x7f0bc402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b118e54cf27519 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.886+0000 7f0bcca00640 1 -- 172.21.15.69:0/2765013675 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc402cc70 con 0x7f0bc8185b00 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.886+0000 7f0bcca00640 1 -- 172.21.15.69:0/2765013675 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc402cdd0 con 0x7f0bc8185b00 2024-02-21T07:42:34.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.886+0000 7f0bcca00640 1 -- 172.21.15.69:0/2765013675 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4034660 con 0x7f0bc8185b00 2024-02-21T07:42:34.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.886+0000 7f0bd0800640 1 -- 172.21.15.69:0/2765013675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc8185b00 msgr2=0x7f0bc8182dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.886+0000 7f0bd0800640 1 --2- 172.21.15.69:0/2765013675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc8185b00 0x7f0bc8182dd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80eda40 tx=0x7f0bc402bec0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.887+0000 7f0bd0800640 1 -- 172.21.15.69:0/2765013675 shutdown_connections 2024-02-21T07:42:34.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.887+0000 7f0bd0800640 1 --2- 172.21.15.69:0/2765013675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc8185b00 0x7f0bc8182dd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.887+0000 7f0bd0800640 1 --2- 172.21.15.69:0/2765013675 >> v2:172.21.15.174:3300/0 conn(0x7f0bc80f4e60 0x7f0bc80f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.887+0000 7f0bd0800640 1 -- 172.21.15.69:0/2765013675 >> 172.21.15.69:0/2765013675 conn(0x7f0bc80f69c0 msgr2=0x7f0bc80f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:34.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.887+0000 7f0bd0800640 1 -- 172.21.15.69:0/2765013675 shutdown_connections 2024-02-21T07:42:34.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.887+0000 7f0bd0800640 1 -- 172.21.15.69:0/2765013675 wait complete. 2024-02-21T07:42:34.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.889+0000 7f0bd0800640 1 Processor -- start 2024-02-21T07:42:34.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.889+0000 7f0bd0800640 1 -- start start 2024-02-21T07:42:34.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bd0800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bc80f4e60 0x7f0bc816c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bd0800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bc80f7e40 0x7f0bc814ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bd0800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc8185b00 0x7f0bc814ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bd0800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80cd250 con 0x7f0bc8185b00 2024-02-21T07:42:34.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bd0800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc821fd30 con 0x7f0bc80f7e40 2024-02-21T07:42:34.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bd0800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc80cc9b0 con 0x7f0bc80f4e60 2024-02-21T07:42:34.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bce800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc8185b00 0x7f0bc814ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bcd400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bc80f7e40 0x7f0bc814ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bcd400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bc80f7e40 0x7f0bc814ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:50942/0 (socket says 172.21.15.69:50942) 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bcd400640 1 -- 172.21.15.69:0/1465362821 learned_addr learned my addr 172.21.15.69:0/1465362821 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.890+0000 7f0bcde00640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bc80f4e60 0x7f0bc816c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bce800640 1 -- 172.21.15.69:0/1465362821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bc80f4e60 msgr2=0x7f0bc816c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bce800640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bc80f4e60 0x7f0bc816c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bce800640 1 -- 172.21.15.69:0/1465362821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bc80f7e40 msgr2=0x7f0bc814ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bce800640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bc80f7e40 0x7f0bc814ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bce800640 1 -- 172.21.15.69:0/1465362821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb8009400 con 0x7f0bc8185b00 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bcd400640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bc80f7e40 0x7f0bc814ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bce800640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc8185b00 0x7f0bc814ef90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80cf440 tx=0x7f0bc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bc2000640 1 -- 172.21.15.69:0/1465362821 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4040650 con 0x7f0bc8185b00 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bc2000640 1 -- 172.21.15.69:0/1465362821 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40407b0 con 0x7f0bc8185b00 2024-02-21T07:42:34.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bc2000640 1 -- 172.21.15.69:0/1465362821 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4040b60 con 0x7f0bc8185b00 2024-02-21T07:42:34.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.891+0000 7f0bd0800640 1 -- 172.21.15.69:0/1465362821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc4009a70 con 0x7f0bc8185b00 2024-02-21T07:42:34.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.892+0000 7f0bd0800640 1 -- 172.21.15.69:0/1465362821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc80ccf70 con 0x7f0bc8185b00 2024-02-21T07:42:34.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.893+0000 7f0bd0800640 1 -- 172.21.15.69:0/1465362821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc8069d50 con 0x7f0bc8185b00 2024-02-21T07:42:34.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.895+0000 7f0bc2000640 1 -- 172.21.15.69:0/1465362821 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f0bc4040cc0 con 0x7f0bc8185b00 2024-02-21T07:42:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.897+0000 7f0bc2000640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bac09f130 0x7f0bac0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.897+0000 7f0bc2000640 1 -- 172.21.15.69:0/1465362821 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f0bc40ec5d0 con 0x7f0bc8185b00 2024-02-21T07:42:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.897+0000 7f0bcde00640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bac09f130 0x7f0bac0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.898+0000 7f0bcde00640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bac09f130 0x7f0bac0a15f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc005880 tx=0x7f0bbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:34.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:34.901+0000 7f0bc2000640 1 -- 172.21.15.69:0/1465362821 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0bc40b6580 con 0x7f0bc8185b00 2024-02-21T07:42:35.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.139+0000 7f0bd0800640 1 -- 172.21.15.69:0/1465362821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bc821fe70 con 0x7f0bc8185b00 2024-02-21T07:42:35.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.140+0000 7f0bc2000640 1 -- 172.21.15.69:0/1465362821 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f0bc4009450 con 0x7f0bc8185b00 2024-02-21T07:42:35.146 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:35.146 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:33.311078+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:42:35.146 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 18 2024-02-21T07:42:35.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.142+0000 7f0bd0800640 1 -- 172.21.15.69:0/1465362821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bac09f130 msgr2=0x7f0bac0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.142+0000 7f0bd0800640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bac09f130 0x7f0bac0a15f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc005880 tx=0x7f0bbc009040 comp rx=0 tx=0).stop 2024-02-21T07:42:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.142+0000 7f0bd0800640 1 -- 172.21.15.69:0/1465362821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc8185b00 msgr2=0x7f0bc814ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.142+0000 7f0bd0800640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc8185b00 0x7f0bc814ef90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0bc80cf440 tx=0x7f0bc4004a40 comp rx=0 tx=0).stop 2024-02-21T07:42:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.143+0000 7f0bd0800640 1 -- 172.21.15.69:0/1465362821 shutdown_connections 2024-02-21T07:42:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.143+0000 7f0bd0800640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0bac09f130 0x7f0bac0a15f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.143+0000 7f0bd0800640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc8185b00 0x7f0bc814ef90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.143+0000 7f0bd0800640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0bc80f7e40 0x7f0bc814ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.143+0000 7f0bd0800640 1 --2- 172.21.15.69:0/1465362821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0bc80f4e60 0x7f0bc816c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.143+0000 7f0bd0800640 1 -- 172.21.15.69:0/1465362821 >> 172.21.15.69:0/1465362821 conn(0x7f0bc80f69c0 msgr2=0x7f0bc80f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.143+0000 7f0bd0800640 1 -- 172.21.15.69:0/1465362821 shutdown_connections 2024-02-21T07:42:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.143+0000 7f0bd0800640 1 -- 172.21.15.69:0/1465362821 wait complete. 2024-02-21T07:42:35.168 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:35.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.372+0000 7fe488400640 1 Processor -- start 2024-02-21T07:42:35.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.372+0000 7fe488400640 1 -- start start 2024-02-21T07:42:35.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.374+0000 7fe488400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe4800cd090 0x7fe4800f6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.374+0000 7fe488400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe480188980 0x7fe480186730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.374+0000 7fe488400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4800ce230 con 0x7fe480183fa0 2024-02-21T07:42:35.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.374+0000 7fe488400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48006dcd0 con 0x7fe4800cd090 2024-02-21T07:42:35.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.374+0000 7fe488400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe480184380 con 0x7fe480188980 2024-02-21T07:42:35.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.374+0000 7fe485000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe4800cd090 0x7fe4800f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.375+0000 7fe485a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe480183fa0 0x7fe480188270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47728/0 (socket says 172.21.15.69:47728) 2024-02-21T07:42:35.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.375+0000 7fe485a00640 1 -- 172.21.15.69:0/114123994 learned_addr learned my addr 172.21.15.69:0/114123994 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:35.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.375+0000 7fe486400640 1 --2- 172.21.15.69:0/114123994 >> v2:172.21.15.174:3300/0 conn(0x7fe480188980 0x7fe480186730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.375+0000 7fe485000640 1 -- 172.21.15.69:0/114123994 >> v2:172.21.15.174:3300/0 conn(0x7fe480188980 msgr2=0x7fe480186730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:35.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.375+0000 7fe485000640 1 --2- 172.21.15.69:0/114123994 >> v2:172.21.15.174:3300/0 conn(0x7fe480188980 0x7fe480186730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.375+0000 7fe485000640 1 -- 172.21.15.69:0/114123994 >> v1:172.21.15.69:6789/0 conn(0x7fe480183fa0 legacy=0x7fe480188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.375+0000 7fe485000640 1 -- 172.21.15.69:0/114123994 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800cd6b0 con 0x7fe4800cd090 2024-02-21T07:42:35.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.376+0000 7fe485000640 1 --2- 172.21.15.69:0/114123994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4800cd090 0x7fe4800f6310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe48006cbe0 tx=0x7fe46c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b68d11b0f4fadc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:35.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.376+0000 7fe47fe00640 1 -- 172.21.15.69:0/114123994 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c031710 con 0x7fe4800cd090 2024-02-21T07:42:35.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.376+0000 7fe47fe00640 1 -- 172.21.15.69:0/114123994 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c02f050 con 0x7fe4800cd090 2024-02-21T07:42:35.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.376+0000 7fe47fe00640 1 -- 172.21.15.69:0/114123994 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c031a90 con 0x7fe4800cd090 2024-02-21T07:42:35.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.377+0000 7fe488400640 1 -- 172.21.15.69:0/114123994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4800cd090 msgr2=0x7fe4800f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.377+0000 7fe488400640 1 --2- 172.21.15.69:0/114123994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4800cd090 0x7fe4800f6310 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe48006cbe0 tx=0x7fe46c02b7b0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.377+0000 7fe488400640 1 -- 172.21.15.69:0/114123994 shutdown_connections 2024-02-21T07:42:35.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.377+0000 7fe488400640 1 --2- 172.21.15.69:0/114123994 >> v2:172.21.15.174:3300/0 conn(0x7fe480188980 0x7fe480186730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.377+0000 7fe488400640 1 --2- 172.21.15.69:0/114123994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4800cd090 0x7fe4800f6310 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.377+0000 7fe488400640 1 -- 172.21.15.69:0/114123994 >> 172.21.15.69:0/114123994 conn(0x7fe4800f69c0 msgr2=0x7fe4800f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:35.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.377+0000 7fe488400640 1 -- 172.21.15.69:0/114123994 shutdown_connections 2024-02-21T07:42:35.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.377+0000 7fe488400640 1 -- 172.21.15.69:0/114123994 wait complete. 2024-02-21T07:42:35.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.379+0000 7fe488400640 1 Processor -- start 2024-02-21T07:42:35.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.379+0000 7fe488400640 1 -- start start 2024-02-21T07:42:35.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.380+0000 7fe488400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4800cd090 0x7fe48016df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.380+0000 7fe488400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe480183fa0 0x7fe48021fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.380+0000 7fe488400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480188980 0x7fe480220210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.380+0000 7fe488400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480211ac0 con 0x7fe480183fa0 2024-02-21T07:42:35.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.380+0000 7fe488400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480210b60 con 0x7fe4800cd090 2024-02-21T07:42:35.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.380+0000 7fe488400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480210e40 con 0x7fe480188980 2024-02-21T07:42:35.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe485000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe480183fa0 0x7fe48021fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe485000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe480183fa0 0x7fe48021fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39860/0 (socket says 172.21.15.69:39860) 2024-02-21T07:42:35.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe485000640 1 -- 172.21.15.69:0/1737785762 learned_addr learned my addr 172.21.15.69:0/1737785762 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:35.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe485a00640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4800cd090 0x7fe48016df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe486400640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480188980 0x7fe480220210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe485000640 1 -- 172.21.15.69:0/1737785762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480188980 msgr2=0x7fe480220210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe485000640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480188980 0x7fe480220210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe485000640 1 -- 172.21.15.69:0/1737785762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4800cd090 msgr2=0x7fe48016df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe485000640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4800cd090 0x7fe48016df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe485000640 1 -- 172.21.15.69:0/1737785762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c009400 con 0x7fe480183fa0 2024-02-21T07:42:35.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.381+0000 7fe485000640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe480183fa0 0x7fe48021fcd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe46c000c00 tx=0x7fe46c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:35.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.382+0000 7fe47d600640 1 -- 172.21.15.69:0/1737785762 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c03c8d0 con 0x7fe480183fa0 2024-02-21T07:42:35.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.382+0000 7fe47d600640 1 -- 172.21.15.69:0/1737785762 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c03ca30 con 0x7fe480183fa0 2024-02-21T07:42:35.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.382+0000 7fe47d600640 1 -- 172.21.15.69:0/1737785762 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c03cde0 con 0x7fe480183fa0 2024-02-21T07:42:35.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.382+0000 7fe488400640 1 -- 172.21.15.69:0/1737785762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480211120 con 0x7fe480183fa0 2024-02-21T07:42:35.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.382+0000 7fe488400640 1 -- 172.21.15.69:0/1737785762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4802116e0 con 0x7fe480183fa0 2024-02-21T07:42:35.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.383+0000 7fe488400640 1 -- 172.21.15.69:0/1737785762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe480211c00 con 0x7fe480183fa0 2024-02-21T07:42:35.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.385+0000 7fe47d600640 1 -- 172.21.15.69:0/1737785762 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe46c03a040 con 0x7fe480183fa0 2024-02-21T07:42:35.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.386+0000 7fe47d600640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46009f130 0x7fe4600a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.386+0000 7fe47d600640 1 -- 172.21.15.69:0/1737785762 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe46c0eb060 con 0x7fe480183fa0 2024-02-21T07:42:35.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.387+0000 7fe485a00640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46009f130 0x7fe4600a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.387+0000 7fe485a00640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46009f130 0x7fe4600a15f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe474007fd0 tx=0x7fe474007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:35.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.390+0000 7fe47d600640 1 -- 172.21.15.69:0/1737785762 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe46c0b4d50 con 0x7fe480183fa0 2024-02-21T07:42:35.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.589+0000 7fe488400640 1 -- 172.21.15.69:0/1737785762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe480069d50 con 0x7fe480183fa0 2024-02-21T07:42:35.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.591+0000 7fe47d600640 1 -- 172.21.15.69:0/1737785762 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7fe46c0b8410 con 0x7fe480183fa0 2024-02-21T07:42:35.598 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:35.598 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:35.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.594+0000 7fe488400640 1 -- 172.21.15.69:0/1737785762 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46009f130 msgr2=0x7fe4600a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.594+0000 7fe488400640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46009f130 0x7fe4600a15f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe474007fd0 tx=0x7fe474007e80 comp rx=0 tx=0).stop 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.594+0000 7fe488400640 1 -- 172.21.15.69:0/1737785762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe480183fa0 msgr2=0x7fe48021fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.594+0000 7fe488400640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe480183fa0 0x7fe48021fcd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe46c000c00 tx=0x7fe46c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.594+0000 7fe488400640 1 -- 172.21.15.69:0/1737785762 shutdown_connections 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.594+0000 7fe488400640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46009f130 0x7fe4600a15f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.594+0000 7fe488400640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe480188980 0x7fe480220210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.594+0000 7fe488400640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe480183fa0 0x7fe48021fcd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.594+0000 7fe488400640 1 --2- 172.21.15.69:0/1737785762 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe4800cd090 0x7fe48016df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.594+0000 7fe488400640 1 -- 172.21.15.69:0/1737785762 >> 172.21.15.69:0/1737785762 conn(0x7fe4800f69c0 msgr2=0x7fe4800cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.595+0000 7fe488400640 1 -- 172.21.15.69:0/1737785762 shutdown_connections 2024-02-21T07:42:35.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.595+0000 7fe488400640 1 -- 172.21.15.69:0/1737785762 wait complete. 2024-02-21T07:42:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-21T07:42:35.619 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:42:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.827+0000 7f8417400640 1 Processor -- start 2024-02-21T07:42:35.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.827+0000 7f8417400640 1 -- start start 2024-02-21T07:42:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.829+0000 7f8417400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f84100cd090 0x7f84100f6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.829+0000 7f8417400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84100ce230 con 0x7f8410188980 2024-02-21T07:42:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.829+0000 7f8417400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841006dcd0 con 0x7f8410183fa0 2024-02-21T07:42:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.829+0000 7f8417400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8410184380 con 0x7f84100cd090 2024-02-21T07:42:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.829+0000 7f8415400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8410188980 0x7f8410186730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47734/0 (socket says 172.21.15.69:47734) 2024-02-21T07:42:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.829+0000 7f8415400640 1 -- 172.21.15.69:0/1697205115 learned_addr learned my addr 172.21.15.69:0/1697205115 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:35.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.829+0000 7f8407e00640 1 --2- 172.21.15.69:0/1697205115 >> v2:172.21.15.69:3300/0 conn(0x7f84100cd090 0x7f84100f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.830+0000 7f840fe00640 1 -- 172.21.15.69:0/1697205115 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619001421 0 0) 0x7f84100ce230 con 0x7f8410188980 2024-02-21T07:42:35.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.830+0000 7f840fe00640 1 -- 172.21.15.69:0/1697205115 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f4003520 con 0x7f8410188980 2024-02-21T07:42:35.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.830+0000 7f8407e00640 1 -- 172.21.15.69:0/1697205115 >> v1:172.21.15.174:6789/0 conn(0x7f8410183fa0 legacy=0x7f8410188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.830+0000 7f8407e00640 1 -- 172.21.15.69:0/1697205115 >> v1:172.21.15.69:6789/0 conn(0x7f8410188980 legacy=0x7f8410186730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.830+0000 7f8407e00640 1 -- 172.21.15.69:0/1697205115 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100cd6b0 con 0x7f84100cd090 2024-02-21T07:42:35.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.831+0000 7f8407e00640 1 --2- 172.21.15.69:0/1697205115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84100cd090 0x7f84100f6310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83f80097a0 tx=0x7f83f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d81a55e7f2a860 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:35.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.831+0000 7f840fe00640 1 -- 172.21.15.69:0/1697205115 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f802e070 con 0x7f84100cd090 2024-02-21T07:42:35.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.831+0000 7f840fe00640 1 -- 172.21.15.69:0/1697205115 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f80315a0 con 0x7f84100cd090 2024-02-21T07:42:35.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.831+0000 7f840fe00640 1 -- 172.21.15.69:0/1697205115 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8031930 con 0x7f84100cd090 2024-02-21T07:42:35.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.832+0000 7f8417400640 1 -- 172.21.15.69:0/1697205115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84100cd090 msgr2=0x7f84100f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.832+0000 7f8417400640 1 --2- 172.21.15.69:0/1697205115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84100cd090 0x7f84100f6310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83f80097a0 tx=0x7f83f802b840 comp rx=0 tx=0).stop 2024-02-21T07:42:35.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.832+0000 7f8417400640 1 -- 172.21.15.69:0/1697205115 shutdown_connections 2024-02-21T07:42:35.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.832+0000 7f8417400640 1 --2- 172.21.15.69:0/1697205115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84100cd090 0x7f84100f6310 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.832+0000 7f8417400640 1 -- 172.21.15.69:0/1697205115 >> 172.21.15.69:0/1697205115 conn(0x7f84100f69c0 msgr2=0x7f84100f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:35.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.832+0000 7f8417400640 1 -- 172.21.15.69:0/1697205115 shutdown_connections 2024-02-21T07:42:35.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.832+0000 7f8417400640 1 -- 172.21.15.69:0/1697205115 wait complete. 2024-02-21T07:42:35.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.834+0000 7f8417400640 1 Processor -- start 2024-02-21T07:42:35.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.834+0000 7f8417400640 1 -- start start 2024-02-21T07:42:35.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.835+0000 7f8417400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100cd090 0x7f84100f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.835+0000 7f8417400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8410183fa0 0x7f84102203f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.835+0000 7f8417400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8410188980 0x7f84101714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.835+0000 7f8417400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100f2e10 con 0x7f8410183fa0 2024-02-21T07:42:35.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.835+0000 7f8417400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410220930 con 0x7f8410188980 2024-02-21T07:42:35.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.835+0000 7f8417400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100f1590 con 0x7f84100cd090 2024-02-21T07:42:35.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.836+0000 7f8407e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8410183fa0 0x7f84102203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.836+0000 7f8407e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8410183fa0 0x7f84102203f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39868/0 (socket says 172.21.15.69:39868) 2024-02-21T07:42:35.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.836+0000 7f8407e00640 1 -- 172.21.15.69:0/942691376 learned_addr learned my addr 172.21.15.69:0/942691376 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:35.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.836+0000 7f8414a00640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100cd090 0x7f84100f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.836+0000 7f8415400640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8410188980 0x7f84101714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.836+0000 7f8407e00640 1 -- 172.21.15.69:0/942691376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100cd090 msgr2=0x7f84100f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.836+0000 7f8407e00640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100cd090 0x7f84100f28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.836+0000 7f8407e00640 1 -- 172.21.15.69:0/942691376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8410188980 msgr2=0x7f84101714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:35.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.836+0000 7f8407e00640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8410188980 0x7f84101714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:35.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.836+0000 7f8407e00640 1 -- 172.21.15.69:0/942691376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8009400 con 0x7f8410183fa0 2024-02-21T07:42:35.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.837+0000 7f8407e00640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8410183fa0 0x7f84102203f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f83f8034040 tx=0x7f83f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.837+0000 7f840d600640 1 -- 172.21.15.69:0/942691376 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8032840 con 0x7f8410183fa0 2024-02-21T07:42:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.837+0000 7f840d600640 1 -- 172.21.15.69:0/942691376 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f80329c0 con 0x7f8410183fa0 2024-02-21T07:42:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.837+0000 7f840d600640 1 -- 172.21.15.69:0/942691376 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8032d70 con 0x7f8410183fa0 2024-02-21T07:42:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.837+0000 7f8417400640 1 -- 172.21.15.69:0/942691376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84100f1830 con 0x7f8410183fa0 2024-02-21T07:42:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.837+0000 7f8417400640 1 -- 172.21.15.69:0/942691376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84100f1df0 con 0x7f8410183fa0 2024-02-21T07:42:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.838+0000 7f8417400640 1 -- 172.21.15.69:0/942691376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8410069d50 con 0x7f8410183fa0 2024-02-21T07:42:35.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.840+0000 7f840d600640 1 -- 172.21.15.69:0/942691376 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f83f804e430 con 0x7f8410183fa0 2024-02-21T07:42:35.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.841+0000 7f840d600640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f83ec09f130 0x7f83ec0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:35.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.841+0000 7f840d600640 1 -- 172.21.15.69:0/942691376 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f83f80ebc10 con 0x7f8410183fa0 2024-02-21T07:42:35.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.841+0000 7f8414a00640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f83ec09f130 0x7f83ec0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:35.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.842+0000 7f8414a00640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f83ec09f130 0x7f83ec0a15f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f841017ea30 tx=0x7f8400009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:35.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:35.845+0000 7f840d600640 1 -- 172.21.15.69:0/942691376 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f83f80b58a0 con 0x7f8410183fa0 2024-02-21T07:42:36.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.037+0000 7f8417400640 1 -- 172.21.15.69:0/942691376 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84100cdf50 con 0x7f83ec09f130 2024-02-21T07:42:36.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.051+0000 7f840d600640 1 -- 172.21.15.69:0/942691376 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368029 (secure 0 0 0) 0x7f8400001d10 con 0x7f83ec09f130 2024-02-21T07:42:36.063 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:36.065 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-02-21T07:42:36.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.057+0000 7f8417400640 1 -- 172.21.15.69:0/942691376 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f83ec09f130 msgr2=0x7f83ec0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.057+0000 7f8417400640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f83ec09f130 0x7f83ec0a15f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f841017ea30 tx=0x7f8400009040 comp rx=0 tx=0).stop 2024-02-21T07:42:36.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.057+0000 7f8417400640 1 -- 172.21.15.69:0/942691376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8410183fa0 msgr2=0x7f84102203f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.057+0000 7f8417400640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8410183fa0 0x7f84102203f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f83f8034040 tx=0x7f83f80046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.057+0000 7f8417400640 1 -- 172.21.15.69:0/942691376 shutdown_connections 2024-02-21T07:42:36.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.057+0000 7f8417400640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f83ec09f130 0x7f83ec0a15f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.057+0000 7f8417400640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8410188980 0x7f84101714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.057+0000 7f8417400640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8410183fa0 0x7f84102203f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.057+0000 7f8417400640 1 --2- 172.21.15.69:0/942691376 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f84100cd090 0x7f84100f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.057+0000 7f8417400640 1 -- 172.21.15.69:0/942691376 >> 172.21.15.69:0/942691376 conn(0x7f84100f69c0 msgr2=0x7f84100f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:36.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.058+0000 7f8417400640 1 -- 172.21.15.69:0/942691376 shutdown_connections 2024-02-21T07:42:36.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.058+0000 7f8417400640 1 -- 172.21.15.69:0/942691376 wait complete. 2024-02-21T07:42:36.083 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-02-21T07:42:34.449821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596414,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":269,"num_write_kb":2969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":329152,"kb_used_data":4944,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132132928,"statfs":{"total":1159641169920,"available":1159304118272,"internally_reserved":0,"allocated":5062656,"data_stored":2885518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":331855161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1547,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003659"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417824+0000","last_change":"2024-02-21T07:42:01.938302+0000","last_active":"2024-02-21T07:42:10.417824+0000","last_peered":"2024-02-21T07:42:10.417824+0000","last_clean":"2024-02-21T07:42:10.417824+0000","last_became_active":"2024-02-21T07:42:01.935737+0000","last_became_peered":"2024-02-21T07:42:01.935737+0000","last_unstale":"2024-02-21T07:42:10.417824+0000","last_undegraded":"2024-02-21T07:42:10.417824+0000","last_fullsized":"2024-02-21T07:42:10.417824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997031+0000","last_change":"2024-02-21T07:42:02.963926+0000","last_active":"2024-02-21T07:42:07.997031+0000","last_peered":"2024-02-21T07:42:07.997031+0000","last_clean":"2024-02-21T07:42:07.997031+0000","last_became_active":"2024-02-21T07:42:02.963585+0000","last_became_peered":"2024-02-21T07:42:02.963585+0000","last_unstale":"2024-02-21T07:42:07.997031+0000","last_undegraded":"2024-02-21T07:42:07.997031+0000","last_fullsized":"2024-02-21T07:42:07.997031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840648+0000","last_change":"2024-02-21T07:42:07.017236+0000","last_active":"2024-02-21T07:42:09.840648+0000","last_peered":"2024-02-21T07:42:09.840648+0000","last_clean":"2024-02-21T07:42:09.840648+0000","last_became_active":"2024-02-21T07:42:07.016750+0000","last_became_peered":"2024-02-21T07:42:07.016750+0000","last_unstale":"2024-02-21T07:42:09.840648+0000","last_undegraded":"2024-02-21T07:42:09.840648+0000","last_fullsized":"2024-02-21T07:42:09.840648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997515+0000","last_change":"2024-02-21T07:42:01.947176+0000","last_active":"2024-02-21T07:42:07.997515+0000","last_peered":"2024-02-21T07:42:07.997515+0000","last_clean":"2024-02-21T07:42:07.997515+0000","last_became_active":"2024-02-21T07:42:01.946831+0000","last_became_peered":"2024-02-21T07:42:01.946831+0000","last_unstale":"2024-02-21T07:42:07.997515+0000","last_undegraded":"2024-02-21T07:42:07.997515+0000","last_fullsized":"2024-02-21T07:42:07.997515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293106+0000","last_change":"2024-02-21T07:42:02.970038+0000","last_active":"2024-02-21T07:42:08.293106+0000","last_peered":"2024-02-21T07:42:08.293106+0000","last_clean":"2024-02-21T07:42:08.293106+0000","last_became_active":"2024-02-21T07:42:02.969433+0000","last_became_peered":"2024-02-21T07:42:02.969433+0000","last_unstale":"2024-02-21T07:42:08.293106+0000","last_undegraded":"2024-02-21T07:42:08.293106+0000","last_fullsized":"2024-02-21T07:42:08.293106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157309+0000","last_change":"2024-02-21T07:42:07.009585+0000","last_active":"2024-02-21T07:42:10.157309+0000","last_peered":"2024-02-21T07:42:10.157309+0000","last_clean":"2024-02-21T07:42:10.157309+0000","last_became_active":"2024-02-21T07:42:07.009264+0000","last_became_peered":"2024-02-21T07:42:07.009264+0000","last_unstale":"2024-02-21T07:42:10.157309+0000","last_undegraded":"2024-02-21T07:42:10.157309+0000","last_fullsized":"2024-02-21T07:42:10.157309+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993872+0000","last_change":"2024-02-21T07:42:01.930474+0000","last_active":"2024-02-21T07:42:07.993872+0000","last_peered":"2024-02-21T07:42:07.993872+0000","last_clean":"2024-02-21T07:42:07.993872+0000","last_became_active":"2024-02-21T07:42:01.930173+0000","last_became_peered":"2024-02-21T07:42:01.930173+0000","last_unstale":"2024-02-21T07:42:07.993872+0000","last_undegraded":"2024-02-21T07:42:07.993872+0000","last_fullsized":"2024-02-21T07:42:07.993872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:42.554637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186921+0000","last_change":"2024-02-21T07:42:02.955640+0000","last_active":"2024-02-21T07:42:08.186921+0000","last_peered":"2024-02-21T07:42:08.186921+0000","last_clean":"2024-02-21T07:42:08.186921+0000","last_became_active":"2024-02-21T07:42:02.955341+0000","last_became_peered":"2024-02-21T07:42:02.955341+0000","last_unstale":"2024-02-21T07:42:08.186921+0000","last_undegraded":"2024-02-21T07:42:08.186921+0000","last_fullsized":"2024-02-21T07:42:08.186921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157595+0000","last_change":"2024-02-21T07:42:07.013240+0000","last_active":"2024-02-21T07:42:10.157595+0000","last_peered":"2024-02-21T07:42:10.157595+0000","last_clean":"2024-02-21T07:42:10.157595+0000","last_became_active":"2024-02-21T07:42:07.012852+0000","last_became_peered":"2024-02-21T07:42:07.012852+0000","last_unstale":"2024-02-21T07:42:10.157595+0000","last_undegraded":"2024-02-21T07:42:10.157595+0000","last_fullsized":"2024-02-21T07:42:10.157595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993794+0000","last_change":"2024-02-21T07:42:01.933225+0000","last_active":"2024-02-21T07:42:07.993794+0000","last_peered":"2024-02-21T07:42:07.993794+0000","last_clean":"2024-02-21T07:42:07.993794+0000","last_became_active":"2024-02-21T07:42:01.932908+0000","last_became_peered":"2024-02-21T07:42:01.932908+0000","last_unstale":"2024-02-21T07:42:07.993794+0000","last_undegraded":"2024-02-21T07:42:07.993794+0000","last_fullsized":"2024-02-21T07:42:07.993794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113448+0000","last_change":"2024-02-21T07:42:02.965143+0000","last_active":"2024-02-21T07:42:08.113448+0000","last_peered":"2024-02-21T07:42:08.113448+0000","last_clean":"2024-02-21T07:42:08.113448+0000","last_became_active":"2024-02-21T07:42:02.964614+0000","last_became_peered":"2024-02-21T07:42:02.964614+0000","last_unstale":"2024-02-21T07:42:08.113448+0000","last_undegraded":"2024-02-21T07:42:08.113448+0000","last_fullsized":"2024-02-21T07:42:08.113448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157408+0000","last_change":"2024-02-21T07:42:07.017243+0000","last_active":"2024-02-21T07:42:10.157408+0000","last_peered":"2024-02-21T07:42:10.157408+0000","last_clean":"2024-02-21T07:42:10.157408+0000","last_became_active":"2024-02-21T07:42:07.016898+0000","last_became_peered":"2024-02-21T07:42:07.016898+0000","last_unstale":"2024-02-21T07:42:10.157408+0000","last_undegraded":"2024-02-21T07:42:10.157408+0000","last_fullsized":"2024-02-21T07:42:10.157408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124848+0000","last_change":"2024-02-21T07:42:02.961021+0000","last_active":"2024-02-21T07:42:10.124848+0000","last_peered":"2024-02-21T07:42:10.124848+0000","last_clean":"2024-02-21T07:42:10.124848+0000","last_became_active":"2024-02-21T07:42:02.960723+0000","last_became_peered":"2024-02-21T07:42:02.960723+0000","last_unstale":"2024-02-21T07:42:10.124848+0000","last_undegraded":"2024-02-21T07:42:10.124848+0000","last_fullsized":"2024-02-21T07:42:10.124848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.105781+0000","last_change":"2024-02-21T07:42:01.928055+0000","last_active":"2024-02-21T07:42:30.105781+0000","last_peered":"2024-02-21T07:42:30.105781+0000","last_clean":"2024-02-21T07:42:30.105781+0000","last_became_active":"2024-02-21T07:42:01.927733+0000","last_became_peered":"2024-02-21T07:42:01.927733+0000","last_unstale":"2024-02-21T07:42:30.105781+0000","last_undegraded":"2024-02-21T07:42:30.105781+0000","last_fullsized":"2024-02-21T07:42:30.105781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157702+0000","last_change":"2024-02-21T07:42:07.124695+0000","last_active":"2024-02-21T07:42:10.157702+0000","last_peered":"2024-02-21T07:42:10.157702+0000","last_clean":"2024-02-21T07:42:10.157702+0000","last_became_active":"2024-02-21T07:42:07.123973+0000","last_became_peered":"2024-02-21T07:42:07.123973+0000","last_unstale":"2024-02-21T07:42:10.157702+0000","last_undegraded":"2024-02-21T07:42:10.157702+0000","last_fullsized":"2024-02-21T07:42:10.157702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996795+0000","last_change":"2024-02-21T07:42:02.982537+0000","last_active":"2024-02-21T07:42:07.996795+0000","last_peered":"2024-02-21T07:42:07.996795+0000","last_clean":"2024-02-21T07:42:07.996795+0000","last_became_active":"2024-02-21T07:42:02.982222+0000","last_became_peered":"2024-02-21T07:42:02.982222+0000","last_unstale":"2024-02-21T07:42:07.996795+0000","last_undegraded":"2024-02-21T07:42:07.996795+0000","last_fullsized":"2024-02-21T07:42:07.996795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840584+0000","last_change":"2024-02-21T07:42:01.942392+0000","last_active":"2024-02-21T07:42:09.840584+0000","last_peered":"2024-02-21T07:42:09.840584+0000","last_clean":"2024-02-21T07:42:09.840584+0000","last_became_active":"2024-02-21T07:42:01.942152+0000","last_became_peered":"2024-02-21T07:42:01.942152+0000","last_unstale":"2024-02-21T07:42:09.840584+0000","last_undegraded":"2024-02-21T07:42:09.840584+0000","last_fullsized":"2024-02-21T07:42:09.840584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157473+0000","last_change":"2024-02-21T07:42:07.015054+0000","last_active":"2024-02-21T07:42:10.157473+0000","last_peered":"2024-02-21T07:42:10.157473+0000","last_clean":"2024-02-21T07:42:10.157473+0000","last_became_active":"2024-02-21T07:42:07.014713+0000","last_became_peered":"2024-02-21T07:42:07.014713+0000","last_unstale":"2024-02-21T07:42:10.157473+0000","last_undegraded":"2024-02-21T07:42:10.157473+0000","last_fullsized":"2024-02-21T07:42:10.157473+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192537+0000","last_change":"2024-02-21T07:42:02.970973+0000","last_active":"2024-02-21T07:42:09.192537+0000","last_peered":"2024-02-21T07:42:09.192537+0000","last_clean":"2024-02-21T07:42:09.192537+0000","last_became_active":"2024-02-21T07:42:02.970644+0000","last_became_peered":"2024-02-21T07:42:02.970644+0000","last_unstale":"2024-02-21T07:42:09.192537+0000","last_undegraded":"2024-02-21T07:42:09.192537+0000","last_fullsized":"2024-02-21T07:42:09.192537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.109446+0000","last_change":"2024-02-21T07:42:01.947758+0000","last_active":"2024-02-21T07:42:30.109446+0000","last_peered":"2024-02-21T07:42:30.109446+0000","last_clean":"2024-02-21T07:42:30.109446+0000","last_became_active":"2024-02-21T07:42:01.947407+0000","last_became_peered":"2024-02-21T07:42:01.947407+0000","last_unstale":"2024-02-21T07:42:30.109446+0000","last_undegraded":"2024-02-21T07:42:30.109446+0000","last_fullsized":"2024-02-21T07:42:30.109446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417671+0000","last_change":"2024-02-21T07:42:07.023243+0000","last_active":"2024-02-21T07:42:10.417671+0000","last_peered":"2024-02-21T07:42:10.417671+0000","last_clean":"2024-02-21T07:42:10.417671+0000","last_became_active":"2024-02-21T07:42:07.022308+0000","last_became_peered":"2024-02-21T07:42:07.022308+0000","last_unstale":"2024-02-21T07:42:10.417671+0000","last_undegraded":"2024-02-21T07:42:10.417671+0000","last_fullsized":"2024-02-21T07:42:10.417671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:24.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993327+0000","last_change":"2024-02-21T07:42:02.963456+0000","last_active":"2024-02-21T07:42:07.993327+0000","last_peered":"2024-02-21T07:42:07.993327+0000","last_clean":"2024-02-21T07:42:07.993327+0000","last_became_active":"2024-02-21T07:42:02.963049+0000","last_became_peered":"2024-02-21T07:42:02.963049+0000","last_unstale":"2024-02-21T07:42:07.993327+0000","last_undegraded":"2024-02-21T07:42:07.993327+0000","last_fullsized":"2024-02-21T07:42:07.993327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.106442+0000","last_change":"2024-02-21T07:42:01.930737+0000","last_active":"2024-02-21T07:42:30.106442+0000","last_peered":"2024-02-21T07:42:30.106442+0000","last_clean":"2024-02-21T07:42:30.106442+0000","last_became_active":"2024-02-21T07:42:01.930465+0000","last_became_peered":"2024-02-21T07:42:01.930465+0000","last_unstale":"2024-02-21T07:42:30.106442+0000","last_undegraded":"2024-02-21T07:42:30.106442+0000","last_fullsized":"2024-02-21T07:42:30.106442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:08:11.073826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157596+0000","last_change":"2024-02-21T07:42:07.124659+0000","last_active":"2024-02-21T07:42:10.157596+0000","last_peered":"2024-02-21T07:42:10.157596+0000","last_clean":"2024-02-21T07:42:10.157596+0000","last_became_active":"2024-02-21T07:42:07.124217+0000","last_became_peered":"2024-02-21T07:42:07.124217+0000","last_unstale":"2024-02-21T07:42:10.157596+0000","last_undegraded":"2024-02-21T07:42:10.157596+0000","last_fullsized":"2024-02-21T07:42:10.157596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293041+0000","last_change":"2024-02-21T07:42:02.980306+0000","last_active":"2024-02-21T07:42:08.293041+0000","last_peered":"2024-02-21T07:42:08.293041+0000","last_clean":"2024-02-21T07:42:08.293041+0000","last_became_active":"2024-02-21T07:42:02.978879+0000","last_became_peered":"2024-02-21T07:42:02.978879+0000","last_unstale":"2024-02-21T07:42:08.293041+0000","last_undegraded":"2024-02-21T07:42:08.293041+0000","last_fullsized":"2024-02-21T07:42:08.293041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.104999+0000","last_change":"2024-02-21T07:42:01.931986+0000","last_active":"2024-02-21T07:42:30.104999+0000","last_peered":"2024-02-21T07:42:30.104999+0000","last_clean":"2024-02-21T07:42:30.104999+0000","last_became_active":"2024-02-21T07:42:01.931671+0000","last_became_peered":"2024-02-21T07:42:01.931671+0000","last_unstale":"2024-02-21T07:42:30.104999+0000","last_undegraded":"2024-02-21T07:42:30.104999+0000","last_fullsized":"2024-02-21T07:42:30.104999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840491+0000","last_change":"2024-02-21T07:42:06.999795+0000","last_active":"2024-02-21T07:42:09.840491+0000","last_peered":"2024-02-21T07:42:09.840491+0000","last_clean":"2024-02-21T07:42:09.840491+0000","last_became_active":"2024-02-21T07:42:06.999315+0000","last_became_peered":"2024-02-21T07:42:06.999315+0000","last_unstale":"2024-02-21T07:42:09.840491+0000","last_undegraded":"2024-02-21T07:42:09.840491+0000","last_fullsized":"2024-02-21T07:42:09.840491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997838+0000","last_change":"2024-02-21T07:42:02.968914+0000","last_active":"2024-02-21T07:42:07.997838+0000","last_peered":"2024-02-21T07:42:07.997838+0000","last_clean":"2024-02-21T07:42:07.997838+0000","last_became_active":"2024-02-21T07:42:02.961877+0000","last_became_peered":"2024-02-21T07:42:02.961877+0000","last_unstale":"2024-02-21T07:42:07.997838+0000","last_undegraded":"2024-02-21T07:42:07.997838+0000","last_fullsized":"2024-02-21T07:42:07.997838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416115+0000","last_change":"2024-02-21T07:42:01.937837+0000","last_active":"2024-02-21T07:42:10.416115+0000","last_peered":"2024-02-21T07:42:10.416115+0000","last_clean":"2024-02-21T07:42:10.416115+0000","last_became_active":"2024-02-21T07:42:01.937536+0000","last_became_peered":"2024-02-21T07:42:01.937536+0000","last_unstale":"2024-02-21T07:42:10.416115+0000","last_undegraded":"2024-02-21T07:42:10.416115+0000","last_fullsized":"2024-02-21T07:42:10.416115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995749+0000","last_change":"2024-02-21T07:42:07.125588+0000","last_active":"2024-02-21T07:42:07.995749+0000","last_peered":"2024-02-21T07:42:07.995749+0000","last_clean":"2024-02-21T07:42:07.995749+0000","last_became_active":"2024-02-21T07:42:07.124044+0000","last_became_peered":"2024-02-21T07:42:07.124044+0000","last_unstale":"2024-02-21T07:42:07.995749+0000","last_undegraded":"2024-02-21T07:42:07.995749+0000","last_fullsized":"2024-02-21T07:42:07.995749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992717+0000","last_change":"2024-02-21T07:42:02.961820+0000","last_active":"2024-02-21T07:42:07.992717+0000","last_peered":"2024-02-21T07:42:07.992717+0000","last_clean":"2024-02-21T07:42:07.992717+0000","last_became_active":"2024-02-21T07:42:02.961478+0000","last_became_peered":"2024-02-21T07:42:02.961478+0000","last_unstale":"2024-02-21T07:42:07.992717+0000","last_undegraded":"2024-02-21T07:42:07.992717+0000","last_fullsized":"2024-02-21T07:42:07.992717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993999+0000","last_change":"2024-02-21T07:42:01.947736+0000","last_active":"2024-02-21T07:42:07.993999+0000","last_peered":"2024-02-21T07:42:07.993999+0000","last_clean":"2024-02-21T07:42:07.993999+0000","last_became_active":"2024-02-21T07:42:01.947443+0000","last_became_peered":"2024-02-21T07:42:01.947443+0000","last_unstale":"2024-02-21T07:42:07.993999+0000","last_undegraded":"2024-02-21T07:42:07.993999+0000","last_fullsized":"2024-02-21T07:42:07.993999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:17.915214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192630+0000","last_change":"2024-02-21T07:42:07.008819+0000","last_active":"2024-02-21T07:42:09.192630+0000","last_peered":"2024-02-21T07:42:09.192630+0000","last_clean":"2024-02-21T07:42:09.192630+0000","last_became_active":"2024-02-21T07:42:07.008423+0000","last_became_peered":"2024-02-21T07:42:07.008423+0000","last_unstale":"2024-02-21T07:42:09.192630+0000","last_undegraded":"2024-02-21T07:42:09.192630+0000","last_fullsized":"2024-02-21T07:42:09.192630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413836+0000","last_change":"2024-02-21T07:42:02.975343+0000","last_active":"2024-02-21T07:42:10.413836+0000","last_peered":"2024-02-21T07:42:10.413836+0000","last_clean":"2024-02-21T07:42:10.413836+0000","last_became_active":"2024-02-21T07:42:02.975041+0000","last_became_peered":"2024-02-21T07:42:02.975041+0000","last_unstale":"2024-02-21T07:42:10.413836+0000","last_undegraded":"2024-02-21T07:42:10.413836+0000","last_fullsized":"2024-02-21T07:42:10.413836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416113+0000","last_change":"2024-02-21T07:42:01.935020+0000","last_active":"2024-02-21T07:42:10.416113+0000","last_peered":"2024-02-21T07:42:10.416113+0000","last_clean":"2024-02-21T07:42:10.416113+0000","last_became_active":"2024-02-21T07:42:01.934752+0000","last_became_peered":"2024-02-21T07:42:01.934752+0000","last_unstale":"2024-02-21T07:42:10.416113+0000","last_undegraded":"2024-02-21T07:42:10.416113+0000","last_fullsized":"2024-02-21T07:42:10.416113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993582+0000","last_change":"2024-02-21T07:42:07.124477+0000","last_active":"2024-02-21T07:42:07.993582+0000","last_peered":"2024-02-21T07:42:07.993582+0000","last_clean":"2024-02-21T07:42:07.993582+0000","last_became_active":"2024-02-21T07:42:07.123915+0000","last_became_peered":"2024-02-21T07:42:07.123915+0000","last_unstale":"2024-02-21T07:42:07.993582+0000","last_undegraded":"2024-02-21T07:42:07.993582+0000","last_fullsized":"2024-02-21T07:42:07.993582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413746+0000","last_change":"2024-02-21T07:42:02.964531+0000","last_active":"2024-02-21T07:42:10.413746+0000","last_peered":"2024-02-21T07:42:10.413746+0000","last_clean":"2024-02-21T07:42:10.413746+0000","last_became_active":"2024-02-21T07:42:02.964185+0000","last_became_peered":"2024-02-21T07:42:02.964185+0000","last_unstale":"2024-02-21T07:42:10.413746+0000","last_undegraded":"2024-02-21T07:42:10.413746+0000","last_fullsized":"2024-02-21T07:42:10.413746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124533+0000","last_change":"2024-02-21T07:42:01.934093+0000","last_active":"2024-02-21T07:42:10.124533+0000","last_peered":"2024-02-21T07:42:10.124533+0000","last_clean":"2024-02-21T07:42:10.124533+0000","last_became_active":"2024-02-21T07:42:01.933841+0000","last_became_peered":"2024-02-21T07:42:01.933841+0000","last_unstale":"2024-02-21T07:42:10.124533+0000","last_undegraded":"2024-02-21T07:42:10.124533+0000","last_fullsized":"2024-02-21T07:42:10.124533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992564+0000","last_change":"2024-02-21T07:42:07.018134+0000","last_active":"2024-02-21T07:42:07.992564+0000","last_peered":"2024-02-21T07:42:07.992564+0000","last_clean":"2024-02-21T07:42:07.992564+0000","last_became_active":"2024-02-21T07:42:07.017670+0000","last_became_peered":"2024-02-21T07:42:07.017670+0000","last_unstale":"2024-02-21T07:42:07.992564+0000","last_undegraded":"2024-02-21T07:42:07.992564+0000","last_fullsized":"2024-02-21T07:42:07.992564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113034+0000","last_change":"2024-02-21T07:42:02.962279+0000","last_active":"2024-02-21T07:42:08.113034+0000","last_peered":"2024-02-21T07:42:08.113034+0000","last_clean":"2024-02-21T07:42:08.113034+0000","last_became_active":"2024-02-21T07:42:02.961965+0000","last_became_peered":"2024-02-21T07:42:02.961965+0000","last_unstale":"2024-02-21T07:42:08.113034+0000","last_undegraded":"2024-02-21T07:42:08.113034+0000","last_fullsized":"2024-02-21T07:42:08.113034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.991858+0000","last_change":"2024-02-21T07:42:01.948478+0000","last_active":"2024-02-21T07:42:07.991858+0000","last_peered":"2024-02-21T07:42:07.991858+0000","last_clean":"2024-02-21T07:42:07.991858+0000","last_became_active":"2024-02-21T07:42:01.948184+0000","last_became_peered":"2024-02-21T07:42:01.948184+0000","last_unstale":"2024-02-21T07:42:07.991858+0000","last_undegraded":"2024-02-21T07:42:07.991858+0000","last_fullsized":"2024-02-21T07:42:07.991858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993308+0000","last_change":"2024-02-21T07:42:07.124759+0000","last_active":"2024-02-21T07:42:07.993308+0000","last_peered":"2024-02-21T07:42:07.993308+0000","last_clean":"2024-02-21T07:42:07.993308+0000","last_became_active":"2024-02-21T07:42:07.124275+0000","last_became_peered":"2024-02-21T07:42:07.124275+0000","last_unstale":"2024-02-21T07:42:07.993308+0000","last_undegraded":"2024-02-21T07:42:07.993308+0000","last_fullsized":"2024-02-21T07:42:07.993308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.991454+0000","last_change":"2024-02-21T07:42:02.961213+0000","last_active":"2024-02-21T07:42:07.991454+0000","last_peered":"2024-02-21T07:42:07.991454+0000","last_clean":"2024-02-21T07:42:07.991454+0000","last_became_active":"2024-02-21T07:42:02.960477+0000","last_became_peered":"2024-02-21T07:42:02.960477+0000","last_unstale":"2024-02-21T07:42:07.991454+0000","last_undegraded":"2024-02-21T07:42:07.991454+0000","last_fullsized":"2024-02-21T07:42:07.991454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124605+0000","last_change":"2024-02-21T07:42:01.928302+0000","last_active":"2024-02-21T07:42:10.124605+0000","last_peered":"2024-02-21T07:42:10.124605+0000","last_clean":"2024-02-21T07:42:10.124605+0000","last_became_active":"2024-02-21T07:42:01.927234+0000","last_became_peered":"2024-02-21T07:42:01.927234+0000","last_unstale":"2024-02-21T07:42:10.124605+0000","last_undegraded":"2024-02-21T07:42:10.124605+0000","last_fullsized":"2024-02-21T07:42:10.124605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113596+0000","last_change":"2024-02-21T07:42:07.124715+0000","last_active":"2024-02-21T07:42:08.113596+0000","last_peered":"2024-02-21T07:42:08.113596+0000","last_clean":"2024-02-21T07:42:08.113596+0000","last_became_active":"2024-02-21T07:42:07.124248+0000","last_became_peered":"2024-02-21T07:42:07.124248+0000","last_unstale":"2024-02-21T07:42:08.113596+0000","last_undegraded":"2024-02-21T07:42:08.113596+0000","last_fullsized":"2024-02-21T07:42:08.113596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:17:21.721728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996414+0000","last_change":"2024-02-21T07:42:02.971762+0000","last_active":"2024-02-21T07:42:07.996414+0000","last_peered":"2024-02-21T07:42:07.996414+0000","last_clean":"2024-02-21T07:42:07.996414+0000","last_became_active":"2024-02-21T07:42:02.970032+0000","last_became_peered":"2024-02-21T07:42:02.970032+0000","last_unstale":"2024-02-21T07:42:07.996414+0000","last_undegraded":"2024-02-21T07:42:07.996414+0000","last_fullsized":"2024-02-21T07:42:07.996414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.106916+0000","last_change":"2024-02-21T07:42:01.932968+0000","last_active":"2024-02-21T07:42:30.106916+0000","last_peered":"2024-02-21T07:42:30.106916+0000","last_clean":"2024-02-21T07:42:30.106916+0000","last_became_active":"2024-02-21T07:42:01.932620+0000","last_became_peered":"2024-02-21T07:42:01.932620+0000","last_unstale":"2024-02-21T07:42:30.106916+0000","last_undegraded":"2024-02-21T07:42:30.106916+0000","last_fullsized":"2024-02-21T07:42:30.106916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124899+0000","last_change":"2024-02-21T07:41:57.883808+0000","last_active":"2024-02-21T07:42:10.124899+0000","last_peered":"2024-02-21T07:42:10.124899+0000","last_clean":"2024-02-21T07:42:10.124899+0000","last_became_active":"2024-02-21T07:41:57.883530+0000","last_became_peered":"2024-02-21T07:41:57.883530+0000","last_unstale":"2024-02-21T07:42:10.124899+0000","last_undegraded":"2024-02-21T07:42:10.124899+0000","last_fullsized":"2024-02-21T07:42:10.124899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_clean_scrub_stamp":"2024-02-21T07:41:56.862963+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:09:51.756066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125228+0000","last_change":"2024-02-21T07:42:07.011954+0000","last_active":"2024-02-21T07:42:10.125228+0000","last_peered":"2024-02-21T07:42:10.125228+0000","last_clean":"2024-02-21T07:42:10.125228+0000","last_became_active":"2024-02-21T07:42:07.011654+0000","last_became_peered":"2024-02-21T07:42:07.011654+0000","last_unstale":"2024-02-21T07:42:10.125228+0000","last_undegraded":"2024-02-21T07:42:10.125228+0000","last_fullsized":"2024-02-21T07:42:10.125228+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125300+0000","last_change":"2024-02-21T07:42:02.956569+0000","last_active":"2024-02-21T07:42:10.125300+0000","last_peered":"2024-02-21T07:42:10.125300+0000","last_clean":"2024-02-21T07:42:10.125300+0000","last_became_active":"2024-02-21T07:42:02.956232+0000","last_became_peered":"2024-02-21T07:42:02.956232+0000","last_unstale":"2024-02-21T07:42:10.125300+0000","last_undegraded":"2024-02-21T07:42:10.125300+0000","last_fullsized":"2024-02-21T07:42:10.125300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840756+0000","last_change":"2024-02-21T07:42:01.926736+0000","last_active":"2024-02-21T07:42:09.840756+0000","last_peered":"2024-02-21T07:42:09.840756+0000","last_clean":"2024-02-21T07:42:09.840756+0000","last_became_active":"2024-02-21T07:42:01.926454+0000","last_became_peered":"2024-02-21T07:42:01.926454+0000","last_unstale":"2024-02-21T07:42:09.840756+0000","last_undegraded":"2024-02-21T07:42:09.840756+0000","last_fullsized":"2024-02-21T07:42:09.840756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186824+0000","last_change":"2024-02-21T07:42:07.003371+0000","last_active":"2024-02-21T07:42:08.186824+0000","last_peered":"2024-02-21T07:42:08.186824+0000","last_clean":"2024-02-21T07:42:08.186824+0000","last_became_active":"2024-02-21T07:42:07.002940+0000","last_became_peered":"2024-02-21T07:42:07.002940+0000","last_unstale":"2024-02-21T07:42:08.186824+0000","last_undegraded":"2024-02-21T07:42:08.186824+0000","last_fullsized":"2024-02-21T07:42:08.186824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:17.859796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125133+0000","last_change":"2024-02-21T07:42:02.976255+0000","last_active":"2024-02-21T07:42:10.125133+0000","last_peered":"2024-02-21T07:42:10.125133+0000","last_clean":"2024-02-21T07:42:10.125133+0000","last_became_active":"2024-02-21T07:42:02.975927+0000","last_became_peered":"2024-02-21T07:42:02.975927+0000","last_unstale":"2024-02-21T07:42:10.125133+0000","last_undegraded":"2024-02-21T07:42:10.125133+0000","last_fullsized":"2024-02-21T07:42:10.125133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113676+0000","last_change":"2024-02-21T07:42:01.932488+0000","last_active":"2024-02-21T07:42:08.113676+0000","last_peered":"2024-02-21T07:42:08.113676+0000","last_clean":"2024-02-21T07:42:08.113676+0000","last_became_active":"2024-02-21T07:42:01.932131+0000","last_became_peered":"2024-02-21T07:42:01.932131+0000","last_unstale":"2024-02-21T07:42:08.113676+0000","last_undegraded":"2024-02-21T07:42:08.113676+0000","last_fullsized":"2024-02-21T07:42:08.113676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292501+0000","last_change":"2024-02-21T07:42:07.017329+0000","last_active":"2024-02-21T07:42:08.292501+0000","last_peered":"2024-02-21T07:42:08.292501+0000","last_clean":"2024-02-21T07:42:08.292501+0000","last_became_active":"2024-02-21T07:42:07.016916+0000","last_became_peered":"2024-02-21T07:42:07.016916+0000","last_unstale":"2024-02-21T07:42:08.292501+0000","last_undegraded":"2024-02-21T07:42:08.292501+0000","last_fullsized":"2024-02-21T07:42:08.292501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125268+0000","last_change":"2024-02-21T07:42:02.959157+0000","last_active":"2024-02-21T07:42:10.125268+0000","last_peered":"2024-02-21T07:42:10.125268+0000","last_clean":"2024-02-21T07:42:10.125268+0000","last_became_active":"2024-02-21T07:42:02.958593+0000","last_became_peered":"2024-02-21T07:42:02.958593+0000","last_unstale":"2024-02-21T07:42:10.125268+0000","last_undegraded":"2024-02-21T07:42:10.125268+0000","last_fullsized":"2024-02-21T07:42:10.125268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:55.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993221+0000","last_change":"2024-02-21T07:42:01.949434+0000","last_active":"2024-02-21T07:42:07.993221+0000","last_peered":"2024-02-21T07:42:07.993221+0000","last_clean":"2024-02-21T07:42:07.993221+0000","last_became_active":"2024-02-21T07:42:01.948805+0000","last_became_peered":"2024-02-21T07:42:01.948805+0000","last_unstale":"2024-02-21T07:42:07.993221+0000","last_undegraded":"2024-02-21T07:42:07.993221+0000","last_fullsized":"2024-02-21T07:42:07.993221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.112966+0000","last_change":"2024-02-21T07:42:07.003190+0000","last_active":"2024-02-21T07:42:08.112966+0000","last_peered":"2024-02-21T07:42:08.112966+0000","last_clean":"2024-02-21T07:42:08.112966+0000","last_became_active":"2024-02-21T07:42:07.002780+0000","last_became_peered":"2024-02-21T07:42:07.002780+0000","last_unstale":"2024-02-21T07:42:08.112966+0000","last_undegraded":"2024-02-21T07:42:08.112966+0000","last_fullsized":"2024-02-21T07:42:08.112966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192778+0000","last_change":"2024-02-21T07:42:02.959569+0000","last_active":"2024-02-21T07:42:09.192778+0000","last_peered":"2024-02-21T07:42:09.192778+0000","last_clean":"2024-02-21T07:42:09.192778+0000","last_became_active":"2024-02-21T07:42:02.959146+0000","last_became_peered":"2024-02-21T07:42:02.959146+0000","last_unstale":"2024-02-21T07:42:09.192778+0000","last_undegraded":"2024-02-21T07:42:09.192778+0000","last_fullsized":"2024-02-21T07:42:09.192778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993746+0000","last_change":"2024-02-21T07:42:01.926878+0000","last_active":"2024-02-21T07:42:07.993746+0000","last_peered":"2024-02-21T07:42:07.993746+0000","last_clean":"2024-02-21T07:42:07.993746+0000","last_became_active":"2024-02-21T07:42:01.926212+0000","last_became_peered":"2024-02-21T07:42:01.926212+0000","last_unstale":"2024-02-21T07:42:07.993746+0000","last_undegraded":"2024-02-21T07:42:07.993746+0000","last_fullsized":"2024-02-21T07:42:07.993746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113080+0000","last_change":"2024-02-21T07:42:07.017443+0000","last_active":"2024-02-21T07:42:08.113080+0000","last_peered":"2024-02-21T07:42:08.113080+0000","last_clean":"2024-02-21T07:42:08.113080+0000","last_became_active":"2024-02-21T07:42:07.016918+0000","last_became_peered":"2024-02-21T07:42:07.016918+0000","last_unstale":"2024-02-21T07:42:08.113080+0000","last_undegraded":"2024-02-21T07:42:08.113080+0000","last_fullsized":"2024-02-21T07:42:08.113080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:49:35.717727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113122+0000","last_change":"2024-02-21T07:42:02.965178+0000","last_active":"2024-02-21T07:42:08.113122+0000","last_peered":"2024-02-21T07:42:08.113122+0000","last_clean":"2024-02-21T07:42:08.113122+0000","last_became_active":"2024-02-21T07:42:02.964846+0000","last_became_peered":"2024-02-21T07:42:02.964846+0000","last_unstale":"2024-02-21T07:42:08.113122+0000","last_undegraded":"2024-02-21T07:42:08.113122+0000","last_fullsized":"2024-02-21T07:42:08.113122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'10","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.107819+0000","last_change":"2024-02-21T07:42:01.946183+0000","last_active":"2024-02-21T07:42:30.107819+0000","last_peered":"2024-02-21T07:42:30.107819+0000","last_clean":"2024-02-21T07:42:30.107819+0000","last_became_active":"2024-02-21T07:42:01.945960+0000","last_became_peered":"2024-02-21T07:42:01.945960+0000","last_unstale":"2024-02-21T07:42:30.107819+0000","last_undegraded":"2024-02-21T07:42:30.107819+0000","last_fullsized":"2024-02-21T07:42:30.107819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993395+0000","last_change":"2024-02-21T07:42:07.021166+0000","last_active":"2024-02-21T07:42:07.993395+0000","last_peered":"2024-02-21T07:42:07.993395+0000","last_clean":"2024-02-21T07:42:07.993395+0000","last_became_active":"2024-02-21T07:42:07.017128+0000","last_became_peered":"2024-02-21T07:42:07.017128+0000","last_unstale":"2024-02-21T07:42:07.993395+0000","last_undegraded":"2024-02-21T07:42:07.993395+0000","last_fullsized":"2024-02-21T07:42:07.993395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124773+0000","last_change":"2024-02-21T07:42:02.960144+0000","last_active":"2024-02-21T07:42:10.124773+0000","last_peered":"2024-02-21T07:42:10.124773+0000","last_clean":"2024-02-21T07:42:10.124773+0000","last_became_active":"2024-02-21T07:42:02.959714+0000","last_became_peered":"2024-02-21T07:42:02.959714+0000","last_unstale":"2024-02-21T07:42:10.124773+0000","last_undegraded":"2024-02-21T07:42:10.124773+0000","last_fullsized":"2024-02-21T07:42:10.124773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157327+0000","last_change":"2024-02-21T07:42:01.930429+0000","last_active":"2024-02-21T07:42:10.157327+0000","last_peered":"2024-02-21T07:42:10.157327+0000","last_clean":"2024-02-21T07:42:10.157327+0000","last_became_active":"2024-02-21T07:42:01.930076+0000","last_became_peered":"2024-02-21T07:42:01.930076+0000","last_unstale":"2024-02-21T07:42:10.157327+0000","last_undegraded":"2024-02-21T07:42:10.157327+0000","last_fullsized":"2024-02-21T07:42:10.157327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417833+0000","last_change":"2024-02-21T07:42:07.025234+0000","last_active":"2024-02-21T07:42:10.417833+0000","last_peered":"2024-02-21T07:42:10.417833+0000","last_clean":"2024-02-21T07:42:10.417833+0000","last_became_active":"2024-02-21T07:42:07.024452+0000","last_became_peered":"2024-02-21T07:42:07.024452+0000","last_unstale":"2024-02-21T07:42:10.417833+0000","last_undegraded":"2024-02-21T07:42:10.417833+0000","last_fullsized":"2024-02-21T07:42:10.417833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124980+0000","last_change":"2024-02-21T07:42:02.958015+0000","last_active":"2024-02-21T07:42:10.124980+0000","last_peered":"2024-02-21T07:42:10.124980+0000","last_clean":"2024-02-21T07:42:10.124980+0000","last_became_active":"2024-02-21T07:42:02.956436+0000","last_became_peered":"2024-02-21T07:42:02.956436+0000","last_unstale":"2024-02-21T07:42:10.124980+0000","last_undegraded":"2024-02-21T07:42:10.124980+0000","last_fullsized":"2024-02-21T07:42:10.124980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:39.265082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.109516+0000","last_change":"2024-02-21T07:42:01.943079+0000","last_active":"2024-02-21T07:42:30.109516+0000","last_peered":"2024-02-21T07:42:30.109516+0000","last_clean":"2024-02-21T07:42:30.109516+0000","last_became_active":"2024-02-21T07:42:01.942831+0000","last_became_peered":"2024-02-21T07:42:01.942831+0000","last_unstale":"2024-02-21T07:42:30.109516+0000","last_undegraded":"2024-02-21T07:42:30.109516+0000","last_fullsized":"2024-02-21T07:42:30.109516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192731+0000","last_change":"2024-02-21T07:42:07.015228+0000","last_active":"2024-02-21T07:42:09.192731+0000","last_peered":"2024-02-21T07:42:09.192731+0000","last_clean":"2024-02-21T07:42:09.192731+0000","last_became_active":"2024-02-21T07:42:07.014798+0000","last_became_peered":"2024-02-21T07:42:07.014798+0000","last_unstale":"2024-02-21T07:42:09.192731+0000","last_undegraded":"2024-02-21T07:42:09.192731+0000","last_fullsized":"2024-02-21T07:42:09.192731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.991844+0000","last_change":"2024-02-21T07:42:02.965287+0000","last_active":"2024-02-21T07:42:07.991844+0000","last_peered":"2024-02-21T07:42:07.991844+0000","last_clean":"2024-02-21T07:42:07.991844+0000","last_became_active":"2024-02-21T07:42:02.960780+0000","last_became_peered":"2024-02-21T07:42:02.960780+0000","last_unstale":"2024-02-21T07:42:07.991844+0000","last_undegraded":"2024-02-21T07:42:07.991844+0000","last_fullsized":"2024-02-21T07:42:07.991844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.109733+0000","last_change":"2024-02-21T07:42:01.932401+0000","last_active":"2024-02-21T07:42:30.109733+0000","last_peered":"2024-02-21T07:42:30.109733+0000","last_clean":"2024-02-21T07:42:30.109733+0000","last_became_active":"2024-02-21T07:42:01.932108+0000","last_became_peered":"2024-02-21T07:42:01.932108+0000","last_unstale":"2024-02-21T07:42:30.109733+0000","last_undegraded":"2024-02-21T07:42:30.109733+0000","last_fullsized":"2024-02-21T07:42:30.109733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113526+0000","last_change":"2024-02-21T07:42:07.018725+0000","last_active":"2024-02-21T07:42:08.113526+0000","last_peered":"2024-02-21T07:42:08.113526+0000","last_clean":"2024-02-21T07:42:08.113526+0000","last_became_active":"2024-02-21T07:42:07.018322+0000","last_became_peered":"2024-02-21T07:42:07.018322+0000","last_unstale":"2024-02-21T07:42:08.113526+0000","last_undegraded":"2024-02-21T07:42:08.113526+0000","last_fullsized":"2024-02-21T07:42:08.113526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:04:05.896966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993773+0000","last_change":"2024-02-21T07:42:02.963384+0000","last_active":"2024-02-21T07:42:07.993773+0000","last_peered":"2024-02-21T07:42:07.993773+0000","last_clean":"2024-02-21T07:42:07.993773+0000","last_became_active":"2024-02-21T07:42:02.963098+0000","last_became_peered":"2024-02-21T07:42:02.963098+0000","last_unstale":"2024-02-21T07:42:07.993773+0000","last_undegraded":"2024-02-21T07:42:07.993773+0000","last_fullsized":"2024-02-21T07:42:07.993773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.104485+0000","last_change":"2024-02-21T07:42:01.936472+0000","last_active":"2024-02-21T07:42:30.104485+0000","last_peered":"2024-02-21T07:42:30.104485+0000","last_clean":"2024-02-21T07:42:30.104485+0000","last_became_active":"2024-02-21T07:42:01.936181+0000","last_became_peered":"2024-02-21T07:42:01.936181+0000","last_unstale":"2024-02-21T07:42:30.104485+0000","last_undegraded":"2024-02-21T07:42:30.104485+0000","last_fullsized":"2024-02-21T07:42:30.104485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416924+0000","last_change":"2024-02-21T07:42:07.013938+0000","last_active":"2024-02-21T07:42:10.416924+0000","last_peered":"2024-02-21T07:42:10.416924+0000","last_clean":"2024-02-21T07:42:10.416924+0000","last_became_active":"2024-02-21T07:42:07.013409+0000","last_became_peered":"2024-02-21T07:42:07.013409+0000","last_unstale":"2024-02-21T07:42:10.416924+0000","last_undegraded":"2024-02-21T07:42:10.416924+0000","last_fullsized":"2024-02-21T07:42:10.416924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:52:00.302670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186924+0000","last_change":"2024-02-21T07:42:02.960084+0000","last_active":"2024-02-21T07:42:08.186924+0000","last_peered":"2024-02-21T07:42:08.186924+0000","last_clean":"2024-02-21T07:42:08.186924+0000","last_became_active":"2024-02-21T07:42:02.959610+0000","last_became_peered":"2024-02-21T07:42:02.959610+0000","last_unstale":"2024-02-21T07:42:08.186924+0000","last_undegraded":"2024-02-21T07:42:08.186924+0000","last_fullsized":"2024-02-21T07:42:08.186924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113700+0000","last_change":"2024-02-21T07:42:01.946668+0000","last_active":"2024-02-21T07:42:08.113700+0000","last_peered":"2024-02-21T07:42:08.113700+0000","last_clean":"2024-02-21T07:42:08.113700+0000","last_became_active":"2024-02-21T07:42:01.946454+0000","last_became_peered":"2024-02-21T07:42:01.946454+0000","last_unstale":"2024-02-21T07:42:08.113700+0000","last_undegraded":"2024-02-21T07:42:08.113700+0000","last_fullsized":"2024-02-21T07:42:08.113700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157319+0000","last_change":"2024-02-21T07:42:07.013560+0000","last_active":"2024-02-21T07:42:10.157319+0000","last_peered":"2024-02-21T07:42:10.157319+0000","last_clean":"2024-02-21T07:42:10.157319+0000","last_became_active":"2024-02-21T07:42:07.012952+0000","last_became_peered":"2024-02-21T07:42:07.012952+0000","last_unstale":"2024-02-21T07:42:10.157319+0000","last_undegraded":"2024-02-21T07:42:10.157319+0000","last_fullsized":"2024-02-21T07:42:10.157319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293193+0000","last_change":"2024-02-21T07:42:02.969725+0000","last_active":"2024-02-21T07:42:08.293193+0000","last_peered":"2024-02-21T07:42:08.293193+0000","last_clean":"2024-02-21T07:42:08.293193+0000","last_became_active":"2024-02-21T07:42:02.969125+0000","last_became_peered":"2024-02-21T07:42:02.969125+0000","last_unstale":"2024-02-21T07:42:08.293193+0000","last_undegraded":"2024-02-21T07:42:08.293193+0000","last_fullsized":"2024-02-21T07:42:08.293193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.109584+0000","last_change":"2024-02-21T07:42:01.931035+0000","last_active":"2024-02-21T07:42:30.109584+0000","last_peered":"2024-02-21T07:42:30.109584+0000","last_clean":"2024-02-21T07:42:30.109584+0000","last_became_active":"2024-02-21T07:42:01.930665+0000","last_became_peered":"2024-02-21T07:42:01.930665+0000","last_unstale":"2024-02-21T07:42:30.109584+0000","last_undegraded":"2024-02-21T07:42:30.109584+0000","last_fullsized":"2024-02-21T07:42:30.109584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416501+0000","last_change":"2024-02-21T07:42:07.022730+0000","last_active":"2024-02-21T07:42:10.416501+0000","last_peered":"2024-02-21T07:42:10.416501+0000","last_clean":"2024-02-21T07:42:10.416501+0000","last_became_active":"2024-02-21T07:42:07.022349+0000","last_became_peered":"2024-02-21T07:42:07.022349+0000","last_unstale":"2024-02-21T07:42:10.416501+0000","last_undegraded":"2024-02-21T07:42:10.416501+0000","last_fullsized":"2024-02-21T07:42:10.416501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:17.859796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.187028+0000","last_change":"2024-02-21T07:42:02.956416+0000","last_active":"2024-02-21T07:42:08.187028+0000","last_peered":"2024-02-21T07:42:08.187028+0000","last_clean":"2024-02-21T07:42:08.187028+0000","last_became_active":"2024-02-21T07:42:02.956098+0000","last_became_peered":"2024-02-21T07:42:02.956098+0000","last_unstale":"2024-02-21T07:42:08.187028+0000","last_undegraded":"2024-02-21T07:42:08.187028+0000","last_fullsized":"2024-02-21T07:42:08.187028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.106723+0000","last_change":"2024-02-21T07:42:01.937810+0000","last_active":"2024-02-21T07:42:30.106723+0000","last_peered":"2024-02-21T07:42:30.106723+0000","last_clean":"2024-02-21T07:42:30.106723+0000","last_became_active":"2024-02-21T07:42:01.937555+0000","last_became_peered":"2024-02-21T07:42:01.937555+0000","last_unstale":"2024-02-21T07:42:30.106723+0000","last_undegraded":"2024-02-21T07:42:30.106723+0000","last_fullsized":"2024-02-21T07:42:30.106723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996295+0000","last_change":"2024-02-21T07:42:07.013284+0000","last_active":"2024-02-21T07:42:07.996295+0000","last_peered":"2024-02-21T07:42:07.996295+0000","last_clean":"2024-02-21T07:42:07.996295+0000","last_became_active":"2024-02-21T07:42:07.012412+0000","last_became_peered":"2024-02-21T07:42:07.012412+0000","last_unstale":"2024-02-21T07:42:07.996295+0000","last_undegraded":"2024-02-21T07:42:07.996295+0000","last_fullsized":"2024-02-21T07:42:07.996295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292443+0000","last_change":"2024-02-21T07:42:07.016945+0000","last_active":"2024-02-21T07:42:08.292443+0000","last_peered":"2024-02-21T07:42:08.292443+0000","last_clean":"2024-02-21T07:42:08.292443+0000","last_became_active":"2024-02-21T07:42:07.016572+0000","last_became_peered":"2024-02-21T07:42:07.016572+0000","last_unstale":"2024-02-21T07:42:08.292443+0000","last_undegraded":"2024-02-21T07:42:08.292443+0000","last_fullsized":"2024-02-21T07:42:08.292443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416578+0000","last_change":"2024-02-21T07:42:02.977972+0000","last_active":"2024-02-21T07:42:10.416578+0000","last_peered":"2024-02-21T07:42:10.416578+0000","last_clean":"2024-02-21T07:42:10.416578+0000","last_became_active":"2024-02-21T07:42:02.977632+0000","last_became_peered":"2024-02-21T07:42:02.977632+0000","last_unstale":"2024-02-21T07:42:10.416578+0000","last_undegraded":"2024-02-21T07:42:10.416578+0000","last_fullsized":"2024-02-21T07:42:10.416578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113265+0000","last_change":"2024-02-21T07:42:01.930402+0000","last_active":"2024-02-21T07:42:08.113265+0000","last_peered":"2024-02-21T07:42:08.113265+0000","last_clean":"2024-02-21T07:42:08.113265+0000","last_became_active":"2024-02-21T07:42:01.930084+0000","last_became_peered":"2024-02-21T07:42:01.930084+0000","last_unstale":"2024-02-21T07:42:08.113265+0000","last_undegraded":"2024-02-21T07:42:08.113265+0000","last_fullsized":"2024-02-21T07:42:08.113265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192889+0000","last_change":"2024-02-21T07:42:07.016859+0000","last_active":"2024-02-21T07:42:09.192889+0000","last_peered":"2024-02-21T07:42:09.192889+0000","last_clean":"2024-02-21T07:42:09.192889+0000","last_became_active":"2024-02-21T07:42:07.016372+0000","last_became_peered":"2024-02-21T07:42:07.016372+0000","last_unstale":"2024-02-21T07:42:09.192889+0000","last_undegraded":"2024-02-21T07:42:09.192889+0000","last_fullsized":"2024-02-21T07:42:09.192889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995924+0000","last_change":"2024-02-21T07:42:02.948576+0000","last_active":"2024-02-21T07:42:07.995924+0000","last_peered":"2024-02-21T07:42:07.995924+0000","last_clean":"2024-02-21T07:42:07.995924+0000","last_became_active":"2024-02-21T07:42:02.947666+0000","last_became_peered":"2024-02-21T07:42:02.947666+0000","last_unstale":"2024-02-21T07:42:07.995924+0000","last_undegraded":"2024-02-21T07:42:07.995924+0000","last_fullsized":"2024-02-21T07:42:07.995924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.991579+0000","last_change":"2024-02-21T07:42:01.929126+0000","last_active":"2024-02-21T07:42:07.991579+0000","last_peered":"2024-02-21T07:42:07.991579+0000","last_clean":"2024-02-21T07:42:07.991579+0000","last_became_active":"2024-02-21T07:42:01.928667+0000","last_became_peered":"2024-02-21T07:42:01.928667+0000","last_unstale":"2024-02-21T07:42:07.991579+0000","last_undegraded":"2024-02-21T07:42:07.991579+0000","last_fullsized":"2024-02-21T07:42:07.991579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413484+0000","last_change":"2024-02-21T07:42:01.933903+0000","last_active":"2024-02-21T07:42:10.413484+0000","last_peered":"2024-02-21T07:42:10.413484+0000","last_clean":"2024-02-21T07:42:10.413484+0000","last_became_active":"2024-02-21T07:42:01.933578+0000","last_became_peered":"2024-02-21T07:42:01.933578+0000","last_unstale":"2024-02-21T07:42:10.413484+0000","last_undegraded":"2024-02-21T07:42:10.413484+0000","last_fullsized":"2024-02-21T07:42:10.413484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113230+0000","last_change":"2024-02-21T07:42:02.964660+0000","last_active":"2024-02-21T07:42:08.113230+0000","last_peered":"2024-02-21T07:42:08.113230+0000","last_clean":"2024-02-21T07:42:08.113230+0000","last_became_active":"2024-02-21T07:42:02.964389+0000","last_became_peered":"2024-02-21T07:42:02.964389+0000","last_unstale":"2024-02-21T07:42:08.113230+0000","last_undegraded":"2024-02-21T07:42:08.113230+0000","last_fullsized":"2024-02-21T07:42:08.113230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840629+0000","last_change":"2024-02-21T07:42:07.015720+0000","last_active":"2024-02-21T07:42:09.840629+0000","last_peered":"2024-02-21T07:42:09.840629+0000","last_clean":"2024-02-21T07:42:09.840629+0000","last_became_active":"2024-02-21T07:42:07.015315+0000","last_became_peered":"2024-02-21T07:42:07.015315+0000","last_unstale":"2024-02-21T07:42:09.840629+0000","last_undegraded":"2024-02-21T07:42:09.840629+0000","last_fullsized":"2024-02-21T07:42:09.840629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'5","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.108464+0000","last_change":"2024-02-21T07:42:01.927978+0000","last_active":"2024-02-21T07:42:30.108464+0000","last_peered":"2024-02-21T07:42:30.108464+0000","last_clean":"2024-02-21T07:42:30.108464+0000","last_became_active":"2024-02-21T07:42:01.927661+0000","last_became_peered":"2024-02-21T07:42:01.927661+0000","last_unstale":"2024-02-21T07:42:30.108464+0000","last_undegraded":"2024-02-21T07:42:30.108464+0000","last_fullsized":"2024-02-21T07:42:30.108464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993701+0000","last_change":"2024-02-21T07:42:02.971175+0000","last_active":"2024-02-21T07:42:07.993701+0000","last_peered":"2024-02-21T07:42:07.993701+0000","last_clean":"2024-02-21T07:42:07.993701+0000","last_became_active":"2024-02-21T07:42:02.970886+0000","last_became_peered":"2024-02-21T07:42:02.970886+0000","last_unstale":"2024-02-21T07:42:07.993701+0000","last_undegraded":"2024-02-21T07:42:07.993701+0000","last_fullsized":"2024-02-21T07:42:07.993701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840892+0000","last_change":"2024-02-21T07:42:07.003267+0000","last_active":"2024-02-21T07:42:09.840892+0000","last_peered":"2024-02-21T07:42:09.840892+0000","last_clean":"2024-02-21T07:42:09.840892+0000","last_became_active":"2024-02-21T07:42:07.002824+0000","last_became_peered":"2024-02-21T07:42:07.002824+0000","last_unstale":"2024-02-21T07:42:09.840892+0000","last_undegraded":"2024-02-21T07:42:09.840892+0000","last_fullsized":"2024-02-21T07:42:09.840892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192386+0000","last_change":"2024-02-21T07:42:02.960884+0000","last_active":"2024-02-21T07:42:09.192386+0000","last_peered":"2024-02-21T07:42:09.192386+0000","last_clean":"2024-02-21T07:42:09.192386+0000","last_became_active":"2024-02-21T07:42:02.960515+0000","last_became_peered":"2024-02-21T07:42:02.960515+0000","last_unstale":"2024-02-21T07:42:09.192386+0000","last_undegraded":"2024-02-21T07:42:09.192386+0000","last_fullsized":"2024-02-21T07:42:09.192386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840732+0000","last_change":"2024-02-21T07:42:02.960807+0000","last_active":"2024-02-21T07:42:09.840732+0000","last_peered":"2024-02-21T07:42:09.840732+0000","last_clean":"2024-02-21T07:42:09.840732+0000","last_became_active":"2024-02-21T07:42:02.960478+0000","last_became_peered":"2024-02-21T07:42:02.960478+0000","last_unstale":"2024-02-21T07:42:09.840732+0000","last_undegraded":"2024-02-21T07:42:09.840732+0000","last_fullsized":"2024-02-21T07:42:09.840732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840455+0000","last_change":"2024-02-21T07:42:02.966666+0000","last_active":"2024-02-21T07:42:09.840455+0000","last_peered":"2024-02-21T07:42:09.840455+0000","last_clean":"2024-02-21T07:42:09.840455+0000","last_became_active":"2024-02-21T07:42:02.966350+0000","last_became_peered":"2024-02-21T07:42:02.966350+0000","last_unstale":"2024-02-21T07:42:09.840455+0000","last_undegraded":"2024-02-21T07:42:09.840455+0000","last_fullsized":"2024-02-21T07:42:09.840455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292232+0000","last_change":"2024-02-21T07:42:02.973149+0000","last_active":"2024-02-21T07:42:08.292232+0000","last_peered":"2024-02-21T07:42:08.292232+0000","last_clean":"2024-02-21T07:42:08.292232+0000","last_became_active":"2024-02-21T07:42:02.972869+0000","last_became_peered":"2024-02-21T07:42:02.972869+0000","last_unstale":"2024-02-21T07:42:08.292232+0000","last_undegraded":"2024-02-21T07:42:08.292232+0000","last_fullsized":"2024-02-21T07:42:08.292232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992632+0000","last_change":"2024-02-21T07:42:02.957623+0000","last_active":"2024-02-21T07:42:07.992632+0000","last_peered":"2024-02-21T07:42:07.992632+0000","last_clean":"2024-02-21T07:42:07.992632+0000","last_became_active":"2024-02-21T07:42:02.956527+0000","last_became_peered":"2024-02-21T07:42:02.956527+0000","last_unstale":"2024-02-21T07:42:07.992632+0000","last_undegraded":"2024-02-21T07:42:07.992632+0000","last_fullsized":"2024-02-21T07:42:07.992632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192705+0000","last_change":"2024-02-21T07:42:02.961369+0000","last_active":"2024-02-21T07:42:09.192705+0000","last_peered":"2024-02-21T07:42:09.192705+0000","last_clean":"2024-02-21T07:42:09.192705+0000","last_became_active":"2024-02-21T07:42:02.961075+0000","last_became_peered":"2024-02-21T07:42:02.961075+0000","last_unstale":"2024-02-21T07:42:09.192705+0000","last_undegraded":"2024-02-21T07:42:09.192705+0000","last_fullsized":"2024-02-21T07:42:09.192705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840881+0000","last_change":"2024-02-21T07:42:02.960461+0000","last_active":"2024-02-21T07:42:09.840881+0000","last_peered":"2024-02-21T07:42:09.840881+0000","last_clean":"2024-02-21T07:42:09.840881+0000","last_became_active":"2024-02-21T07:42:02.960168+0000","last_became_peered":"2024-02-21T07:42:02.960168+0000","last_unstale":"2024-02-21T07:42:09.840881+0000","last_undegraded":"2024-02-21T07:42:09.840881+0000","last_fullsized":"2024-02-21T07:42:09.840881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997823+0000","last_change":"2024-02-21T07:42:02.966173+0000","last_active":"2024-02-21T07:42:07.997823+0000","last_peered":"2024-02-21T07:42:07.997823+0000","last_clean":"2024-02-21T07:42:07.997823+0000","last_became_active":"2024-02-21T07:42:02.964280+0000","last_became_peered":"2024-02-21T07:42:02.964280+0000","last_unstale":"2024-02-21T07:42:07.997823+0000","last_undegraded":"2024-02-21T07:42:07.997823+0000","last_fullsized":"2024-02-21T07:42:07.997823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113001+0000","last_change":"2024-02-21T07:42:02.975012+0000","last_active":"2024-02-21T07:42:08.113001+0000","last_peered":"2024-02-21T07:42:08.113001+0000","last_clean":"2024-02-21T07:42:08.113001+0000","last_became_active":"2024-02-21T07:42:02.974682+0000","last_became_peered":"2024-02-21T07:42:02.974682+0000","last_unstale":"2024-02-21T07:42:08.113001+0000","last_undegraded":"2024-02-21T07:42:08.113001+0000","last_fullsized":"2024-02-21T07:42:08.113001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996451+0000","last_change":"2024-02-21T07:42:02.966976+0000","last_active":"2024-02-21T07:42:07.996451+0000","last_peered":"2024-02-21T07:42:07.996451+0000","last_clean":"2024-02-21T07:42:07.996451+0000","last_became_active":"2024-02-21T07:42:02.966422+0000","last_became_peered":"2024-02-21T07:42:02.966422+0000","last_unstale":"2024-02-21T07:42:07.996451+0000","last_undegraded":"2024-02-21T07:42:07.996451+0000","last_fullsized":"2024-02-21T07:42:07.996451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186750+0000","last_change":"2024-02-21T07:42:02.957398+0000","last_active":"2024-02-21T07:42:08.186750+0000","last_peered":"2024-02-21T07:42:08.186750+0000","last_clean":"2024-02-21T07:42:08.186750+0000","last_became_active":"2024-02-21T07:42:02.957115+0000","last_became_peered":"2024-02-21T07:42:02.957115+0000","last_unstale":"2024-02-21T07:42:08.186750+0000","last_undegraded":"2024-02-21T07:42:08.186750+0000","last_fullsized":"2024-02-21T07:42:08.186750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992415+0000","last_change":"2024-02-21T07:42:02.956114+0000","last_active":"2024-02-21T07:42:07.992415+0000","last_peered":"2024-02-21T07:42:07.992415+0000","last_clean":"2024-02-21T07:42:07.992415+0000","last_became_active":"2024-02-21T07:42:02.955476+0000","last_became_peered":"2024-02-21T07:42:02.955476+0000","last_unstale":"2024-02-21T07:42:07.992415+0000","last_undegraded":"2024-02-21T07:42:07.992415+0000","last_fullsized":"2024-02-21T07:42:07.992415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192545+0000","last_change":"2024-02-21T07:42:02.955604+0000","last_active":"2024-02-21T07:42:09.192545+0000","last_peered":"2024-02-21T07:42:09.192545+0000","last_clean":"2024-02-21T07:42:09.192545+0000","last_became_active":"2024-02-21T07:42:02.955327+0000","last_became_peered":"2024-02-21T07:42:02.955327+0000","last_unstale":"2024-02-21T07:42:09.192545+0000","last_undegraded":"2024-02-21T07:42:09.192545+0000","last_fullsized":"2024-02-21T07:42:09.192545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840939+0000","last_change":"2024-02-21T07:42:02.967092+0000","last_active":"2024-02-21T07:42:09.840939+0000","last_peered":"2024-02-21T07:42:09.840939+0000","last_clean":"2024-02-21T07:42:09.840939+0000","last_became_active":"2024-02-21T07:42:02.966845+0000","last_became_peered":"2024-02-21T07:42:02.966845+0000","last_unstale":"2024-02-21T07:42:09.840939+0000","last_undegraded":"2024-02-21T07:42:09.840939+0000","last_fullsized":"2024-02-21T07:42:09.840939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417187+0000","last_change":"2024-02-21T07:42:02.973535+0000","last_active":"2024-02-21T07:42:10.417187+0000","last_peered":"2024-02-21T07:42:10.417187+0000","last_clean":"2024-02-21T07:42:10.417187+0000","last_became_active":"2024-02-21T07:42:02.973202+0000","last_became_peered":"2024-02-21T07:42:02.973202+0000","last_unstale":"2024-02-21T07:42:10.417187+0000","last_undegraded":"2024-02-21T07:42:10.417187+0000","last_fullsized":"2024-02-21T07:42:10.417187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192968+0000","last_change":"2024-02-21T07:42:02.954398+0000","last_active":"2024-02-21T07:42:09.192968+0000","last_peered":"2024-02-21T07:42:09.192968+0000","last_clean":"2024-02-21T07:42:09.192968+0000","last_became_active":"2024-02-21T07:42:02.954099+0000","last_became_peered":"2024-02-21T07:42:02.954099+0000","last_unstale":"2024-02-21T07:42:09.192968+0000","last_undegraded":"2024-02-21T07:42:09.192968+0000","last_fullsized":"2024-02-21T07:42:09.192968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186572+0000","last_change":"2024-02-21T07:42:02.958214+0000","last_active":"2024-02-21T07:42:08.186572+0000","last_peered":"2024-02-21T07:42:08.186572+0000","last_clean":"2024-02-21T07:42:08.186572+0000","last_became_active":"2024-02-21T07:42:02.957885+0000","last_became_peered":"2024-02-21T07:42:02.957885+0000","last_unstale":"2024-02-21T07:42:08.186572+0000","last_undegraded":"2024-02-21T07:42:08.186572+0000","last_fullsized":"2024-02-21T07:42:08.186572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292117+0000","last_change":"2024-02-21T07:42:02.980607+0000","last_active":"2024-02-21T07:42:08.292117+0000","last_peered":"2024-02-21T07:42:08.292117+0000","last_clean":"2024-02-21T07:42:08.292117+0000","last_became_active":"2024-02-21T07:42:02.980239+0000","last_became_peered":"2024-02-21T07:42:02.980239+0000","last_unstale":"2024-02-21T07:42:08.292117+0000","last_undegraded":"2024-02-21T07:42:08.292117+0000","last_fullsized":"2024-02-21T07:42:08.292117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.291998+0000","last_change":"2024-02-21T07:42:02.972536+0000","last_active":"2024-02-21T07:42:08.291998+0000","last_peered":"2024-02-21T07:42:08.291998+0000","last_clean":"2024-02-21T07:42:08.291998+0000","last_became_active":"2024-02-21T07:42:02.972216+0000","last_became_peered":"2024-02-21T07:42:02.972216+0000","last_unstale":"2024-02-21T07:42:08.291998+0000","last_undegraded":"2024-02-21T07:42:08.291998+0000","last_fullsized":"2024-02-21T07:42:08.291998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992288+0000","last_change":"2024-02-21T07:42:02.958082+0000","last_active":"2024-02-21T07:42:07.992288+0000","last_peered":"2024-02-21T07:42:07.992288+0000","last_clean":"2024-02-21T07:42:07.992288+0000","last_became_active":"2024-02-21T07:42:02.957711+0000","last_became_peered":"2024-02-21T07:42:02.957711+0000","last_unstale":"2024-02-21T07:42:07.992288+0000","last_undegraded":"2024-02-21T07:42:07.992288+0000","last_fullsized":"2024-02-21T07:42:07.992288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157664+0000","last_change":"2024-02-21T07:42:02.957799+0000","last_active":"2024-02-21T07:42:10.157664+0000","last_peered":"2024-02-21T07:42:10.157664+0000","last_clean":"2024-02-21T07:42:10.157664+0000","last_became_active":"2024-02-21T07:42:02.957510+0000","last_became_peered":"2024-02-21T07:42:02.957510+0000","last_unstale":"2024-02-21T07:42:10.157664+0000","last_undegraded":"2024-02-21T07:42:10.157664+0000","last_fullsized":"2024-02-21T07:42:10.157664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125190+0000","last_change":"2024-02-21T07:42:02.962565+0000","last_active":"2024-02-21T07:42:10.125190+0000","last_peered":"2024-02-21T07:42:10.125190+0000","last_clean":"2024-02-21T07:42:10.125190+0000","last_became_active":"2024-02-21T07:42:02.962298+0000","last_became_peered":"2024-02-21T07:42:02.962298+0000","last_unstale":"2024-02-21T07:42:10.125190+0000","last_undegraded":"2024-02-21T07:42:10.125190+0000","last_fullsized":"2024-02-21T07:42:10.125190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413913+0000","last_change":"2024-02-21T07:42:02.961018+0000","last_active":"2024-02-21T07:42:10.413913+0000","last_peered":"2024-02-21T07:42:10.413913+0000","last_clean":"2024-02-21T07:42:10.413913+0000","last_became_active":"2024-02-21T07:42:02.960634+0000","last_became_peered":"2024-02-21T07:42:02.960634+0000","last_unstale":"2024-02-21T07:42:10.413913+0000","last_undegraded":"2024-02-21T07:42:10.413913+0000","last_fullsized":"2024-02-21T07:42:10.413913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.187102+0000","last_change":"2024-02-21T07:42:02.959426+0000","last_active":"2024-02-21T07:42:08.187102+0000","last_peered":"2024-02-21T07:42:08.187102+0000","last_clean":"2024-02-21T07:42:08.187102+0000","last_became_active":"2024-02-21T07:42:02.959021+0000","last_became_peered":"2024-02-21T07:42:02.959021+0000","last_unstale":"2024-02-21T07:42:08.187102+0000","last_undegraded":"2024-02-21T07:42:08.187102+0000","last_fullsized":"2024-02-21T07:42:08.187102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995727+0000","last_change":"2024-02-21T07:42:02.971151+0000","last_active":"2024-02-21T07:42:07.995727+0000","last_peered":"2024-02-21T07:42:07.995727+0000","last_clean":"2024-02-21T07:42:07.995727+0000","last_became_active":"2024-02-21T07:42:02.967323+0000","last_became_peered":"2024-02-21T07:42:02.967323+0000","last_unstale":"2024-02-21T07:42:07.995727+0000","last_undegraded":"2024-02-21T07:42:07.995727+0000","last_fullsized":"2024-02-21T07:42:07.995727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124824+0000","last_change":"2024-02-21T07:42:02.974767+0000","last_active":"2024-02-21T07:42:10.124824+0000","last_peered":"2024-02-21T07:42:10.124824+0000","last_clean":"2024-02-21T07:42:10.124824+0000","last_became_active":"2024-02-21T07:42:02.974292+0000","last_became_peered":"2024-02-21T07:42:02.974292+0000","last_unstale":"2024-02-21T07:42:10.124824+0000","last_undegraded":"2024-02-21T07:42:10.124824+0000","last_fullsized":"2024-02-21T07:42:10.124824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413730+0000","last_change":"2024-02-21T07:42:02.968079+0000","last_active":"2024-02-21T07:42:10.413730+0000","last_peered":"2024-02-21T07:42:10.413730+0000","last_clean":"2024-02-21T07:42:10.413730+0000","last_became_active":"2024-02-21T07:42:02.967767+0000","last_became_peered":"2024-02-21T07:42:02.967767+0000","last_unstale":"2024-02-21T07:42:10.413730+0000","last_undegraded":"2024-02-21T07:42:10.413730+0000","last_fullsized":"2024-02-21T07:42:10.413730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993396+0000","last_change":"2024-02-21T07:42:02.978031+0000","last_active":"2024-02-21T07:42:07.993396+0000","last_peered":"2024-02-21T07:42:07.993396+0000","last_clean":"2024-02-21T07:42:07.993396+0000","last_became_active":"2024-02-21T07:42:02.977704+0000","last_became_peered":"2024-02-21T07:42:02.977704+0000","last_unstale":"2024-02-21T07:42:07.993396+0000","last_undegraded":"2024-02-21T07:42:07.993396+0000","last_fullsized":"2024-02-21T07:42:07.993396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157552+0000","last_change":"2024-02-21T07:42:02.959959+0000","last_active":"2024-02-21T07:42:10.157552+0000","last_peered":"2024-02-21T07:42:10.157552+0000","last_clean":"2024-02-21T07:42:10.157552+0000","last_became_active":"2024-02-21T07:42:02.959655+0000","last_became_peered":"2024-02-21T07:42:02.959655+0000","last_unstale":"2024-02-21T07:42:10.157552+0000","last_undegraded":"2024-02-21T07:42:10.157552+0000","last_fullsized":"2024-02-21T07:42:10.157552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292334+0000","last_change":"2024-02-21T07:42:02.975851+0000","last_active":"2024-02-21T07:42:08.292334+0000","last_peered":"2024-02-21T07:42:08.292334+0000","last_clean":"2024-02-21T07:42:08.292334+0000","last_became_active":"2024-02-21T07:42:02.973848+0000","last_became_peered":"2024-02-21T07:42:02.973848+0000","last_unstale":"2024-02-21T07:42:08.292334+0000","last_undegraded":"2024-02-21T07:42:08.292334+0000","last_fullsized":"2024-02-21T07:42:08.292334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292889+0000","last_change":"2024-02-21T07:42:02.981681+0000","last_active":"2024-02-21T07:42:08.292889+0000","last_peered":"2024-02-21T07:42:08.292889+0000","last_clean":"2024-02-21T07:42:08.292889+0000","last_became_active":"2024-02-21T07:42:02.981324+0000","last_became_peered":"2024-02-21T07:42:02.981324+0000","last_unstale":"2024-02-21T07:42:08.292889+0000","last_undegraded":"2024-02-21T07:42:08.292889+0000","last_fullsized":"2024-02-21T07:42:08.292889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192896+0000","last_change":"2024-02-21T07:42:02.954466+0000","last_active":"2024-02-21T07:42:09.192896+0000","last_peered":"2024-02-21T07:42:09.192896+0000","last_clean":"2024-02-21T07:42:09.192896+0000","last_became_active":"2024-02-21T07:42:02.954168+0000","last_became_peered":"2024-02-21T07:42:02.954168+0000","last_unstale":"2024-02-21T07:42:09.192896+0000","last_undegraded":"2024-02-21T07:42:09.192896+0000","last_fullsized":"2024-02-21T07:42:09.192896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6046,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":12092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444042,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":141169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":10,"up_from":17,"seq":73014444042,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":145115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":9,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":141841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]}]},{"osd":8,"up_from":17,"seq":73014444041,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":141191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":7,"up_from":17,"seq":73014444042,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":732119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]}]},{"osd":6,"up_from":17,"seq":73014444042,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":141169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.696}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9710000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1600000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0289999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1040000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444042,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":937984,"data_stored":733013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":141169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]},{"osd":3,"up_from":17,"seq":73014444042,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":141259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":141203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":1,"up_from":17,"seq":73014444042,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":145011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":0,"up_from":17,"seq":73014444043,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":319488,"data_stored":141259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6120000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7589999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.423}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":44,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:42:36.091 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:42:36.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.323+0000 7f6ce6400640 1 Processor -- start 2024-02-21T07:42:36.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.323+0000 7f6ce6400640 1 -- start start 2024-02-21T07:42:36.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.325+0000 7f6ce6400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6ce0183fa0 0x7f6ce00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.325+0000 7f6ce6400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6ce00f6310 0x7f6ce0188270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.325+0000 7f6ce6400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce0187740 con 0x7f6ce01887b0 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.325+0000 7f6ce6400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce00ce230 con 0x7f6ce0183fa0 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.325+0000 7f6ce6400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ce006dcd0 con 0x7f6ce00f6310 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.325+0000 7f6cdf400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6ce0183fa0 0x7f6ce00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.325+0000 7f6cdf400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6ce0183fa0 0x7f6ce00cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39884/0 (socket says 172.21.15.69:39884) 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.325+0000 7f6cdf400640 1 -- 172.21.15.69:0/2799363557 learned_addr learned my addr 172.21.15.69:0/2799363557 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.326+0000 7f6cdea00640 1 --2- 172.21.15.69:0/2799363557 >> v2:172.21.15.184:3300/0 conn(0x7f6ce00f6310 0x7f6ce0188270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.326+0000 7f6cdf400640 1 -- 172.21.15.69:0/2799363557 >> v2:172.21.15.184:3300/0 conn(0x7f6ce00f6310 msgr2=0x7f6ce0188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.326+0000 7f6cdf400640 1 --2- 172.21.15.69:0/2799363557 >> v2:172.21.15.184:3300/0 conn(0x7f6ce00f6310 0x7f6ce0188270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.326+0000 7f6cdf400640 1 -- 172.21.15.69:0/2799363557 >> v1:172.21.15.184:6789/0 conn(0x7f6ce01887b0 legacy=0x7f6ce0189d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.326+0000 7f6cdf400640 1 -- 172.21.15.69:0/2799363557 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce0184380 con 0x7f6ce0183fa0 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.327+0000 7f6cdf400640 1 --2- 172.21.15.69:0/2799363557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce0183fa0 0x7f6ce00cd090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0162ab0 tx=0x7f6cd002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6354af6e8c41ef93 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.327+0000 7f6cde000640 1 -- 172.21.15.69:0/2799363557 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00317e0 con 0x7f6ce0183fa0 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.327+0000 7f6cde000640 1 -- 172.21.15.69:0/2799363557 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd0031940 con 0x7f6ce0183fa0 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.327+0000 7f6cde000640 1 -- 172.21.15.69:0/2799363557 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0031cd0 con 0x7f6ce0183fa0 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.328+0000 7f6ce6400640 1 -- 172.21.15.69:0/2799363557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce0183fa0 msgr2=0x7f6ce00cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.328+0000 7f6ce6400640 1 --2- 172.21.15.69:0/2799363557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce0183fa0 0x7f6ce00cd090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0162ab0 tx=0x7f6cd002b880 comp rx=0 tx=0).stop 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.328+0000 7f6ce6400640 1 -- 172.21.15.69:0/2799363557 shutdown_connections 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.328+0000 7f6ce6400640 1 --2- 172.21.15.69:0/2799363557 >> v2:172.21.15.184:3300/0 conn(0x7f6ce00f6310 0x7f6ce0188270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.328+0000 7f6ce6400640 1 --2- 172.21.15.69:0/2799363557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce0183fa0 0x7f6ce00cd090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.328+0000 7f6ce6400640 1 -- 172.21.15.69:0/2799363557 >> 172.21.15.69:0/2799363557 conn(0x7f6ce00f69c0 msgr2=0x7f6ce00f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.328+0000 7f6ce6400640 1 -- 172.21.15.69:0/2799363557 shutdown_connections 2024-02-21T07:42:36.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.328+0000 7f6ce6400640 1 -- 172.21.15.69:0/2799363557 wait complete. 2024-02-21T07:42:36.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.330+0000 7f6ce6400640 1 Processor -- start 2024-02-21T07:42:36.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.330+0000 7f6ce6400640 1 -- start start 2024-02-21T07:42:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.331+0000 7f6ce6400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce00f6310 0x7f6ce016a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.331+0000 7f6ce6400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ce0183fa0 0x7f6ce0182d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.331+0000 7f6ce6400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ce01887b0 0x7f6ce01832d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.331+0000 7f6ce6400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce016ab50 con 0x7f6ce00f6310 2024-02-21T07:42:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.331+0000 7f6ce6400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce017fd10 con 0x7f6ce0183fa0 2024-02-21T07:42:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.331+0000 7f6ce6400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce017ee20 con 0x7f6ce01887b0 2024-02-21T07:42:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdf400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce00f6310 0x7f6ce016a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdf400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce00f6310 0x7f6ce016a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39888/0 (socket says 172.21.15.69:39888) 2024-02-21T07:42:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdf400640 1 -- 172.21.15.69:0/2527355881 learned_addr learned my addr 172.21.15.69:0/2527355881 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:36.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdfe00640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ce01887b0 0x7f6ce01832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdf400640 1 -- 172.21.15.69:0/2527355881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ce01887b0 msgr2=0x7f6ce01832d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdea00640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ce0183fa0 0x7f6ce0182d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdf400640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ce01887b0 0x7f6ce01832d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdf400640 1 -- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ce0183fa0 msgr2=0x7f6ce0182d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdf400640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ce0183fa0 0x7f6ce0182d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdf400640 1 -- 172.21.15.69:0/2527355881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd00094d0 con 0x7f6ce00f6310 2024-02-21T07:42:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdfe00640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ce01887b0 0x7f6ce01832d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdea00640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ce0183fa0 0x7f6ce0182d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.332+0000 7f6cdf400640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce00f6310 0x7f6ce016a610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6cd002b8c0 tx=0x7f6cd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.333+0000 7f6cd7400640 1 -- 172.21.15.69:0/2527355881 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0032880 con 0x7f6ce00f6310 2024-02-21T07:42:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.333+0000 7f6cd7400640 1 -- 172.21.15.69:0/2527355881 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd0032a00 con 0x7f6ce00f6310 2024-02-21T07:42:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.333+0000 7f6cd7400640 1 -- 172.21.15.69:0/2527355881 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd0032db0 con 0x7f6ce00f6310 2024-02-21T07:42:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.333+0000 7f6ce6400640 1 -- 172.21.15.69:0/2527355881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce017f100 con 0x7f6ce00f6310 2024-02-21T07:42:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.333+0000 7f6ce6400640 1 -- 172.21.15.69:0/2527355881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce017f6c0 con 0x7f6ce00f6310 2024-02-21T07:42:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.334+0000 7f6ce6400640 1 -- 172.21.15.69:0/2527355881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce0069d50 con 0x7f6ce00f6310 2024-02-21T07:42:36.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.336+0000 7f6cd7400640 1 -- 172.21.15.69:0/2527355881 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f6cd00453f0 con 0x7f6ce00f6310 2024-02-21T07:42:36.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.337+0000 7f6cd7400640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cc009f130 0x7f6cc00a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.337+0000 7f6cd7400640 1 -- 172.21.15.69:0/2527355881 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f6cd00ebea0 con 0x7f6ce00f6310 2024-02-21T07:42:36.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.337+0000 7f6cdea00640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cc009f130 0x7f6cc00a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.338+0000 7f6cdea00640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cc009f130 0x7f6cc00a15f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009a20 tx=0x7f6ccc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:36.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.341+0000 7f6cd7400640 1 -- 172.21.15.69:0/2527355881 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6cd007f8c0 con 0x7f6ce00f6310 2024-02-21T07:42:36.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.540+0000 7f6ce6400640 1 -- 172.21.15.69:0/2527355881 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ce00cd990 con 0x7f6cc009f130 2024-02-21T07:42:36.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.550+0000 7f6cd7400640 1 -- 172.21.15.69:0/2527355881 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368273 (secure 0 0 0) 0x7f6ccc004030 con 0x7f6cc009f130 2024-02-21T07:42:36.561 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:36.563 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-02-21T07:42:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 -- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cc009f130 msgr2=0x7f6cc00a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cc009f130 0x7f6cc00a15f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009a20 tx=0x7f6ccc008040 comp rx=0 tx=0).stop 2024-02-21T07:42:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 -- 172.21.15.69:0/2527355881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce00f6310 msgr2=0x7f6ce016a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce00f6310 0x7f6ce016a610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6cd002b8c0 tx=0x7f6cd00046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 -- 172.21.15.69:0/2527355881 shutdown_connections 2024-02-21T07:42:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cc009f130 0x7f6cc00a15f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6ce01887b0 0x7f6ce01832d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6ce0183fa0 0x7f6ce0182d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 --2- 172.21.15.69:0/2527355881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ce00f6310 0x7f6ce016a610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 -- 172.21.15.69:0/2527355881 >> 172.21.15.69:0/2527355881 conn(0x7f6ce00f69c0 msgr2=0x7f6ce0179020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:36.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 -- 172.21.15.69:0/2527355881 shutdown_connections 2024-02-21T07:42:36.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.556+0000 7f6ce6400640 1 -- 172.21.15.69:0/2527355881 wait complete. 2024-02-21T07:42:36.589 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-02-21T07:42:36.450213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":638684,"num_objects":102,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":201,"num_read_kb":202,"num_write":412,"num_write_kb":3053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":339,"ondisk_log_size":339,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":329408,"kb_used_data":5216,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132132672,"statfs":{"total":1159641169920,"available":1159303856128,"internally_reserved":0,"allocated":5341184,"data_stored":3003696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":331855161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43817,"num_objects":78,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":75,"num_read_kb":93,"num_write":184,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003192"},"pg_stats":[{"pgid":"2.1f","version":"29'13","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:34.348748+0000","last_change":"2024-02-21T07:42:01.938302+0000","last_active":"2024-02-21T07:42:34.348748+0000","last_peered":"2024-02-21T07:42:34.348748+0000","last_clean":"2024-02-21T07:42:34.348748+0000","last_became_active":"2024-02-21T07:42:01.935737+0000","last_became_peered":"2024-02-21T07:42:01.935737+0000","last_unstale":"2024-02-21T07:42:34.348748+0000","last_undegraded":"2024-02-21T07:42:34.348748+0000","last_fullsized":"2024-02-21T07:42:34.348748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997031+0000","last_change":"2024-02-21T07:42:02.963926+0000","last_active":"2024-02-21T07:42:07.997031+0000","last_peered":"2024-02-21T07:42:07.997031+0000","last_clean":"2024-02-21T07:42:07.997031+0000","last_became_active":"2024-02-21T07:42:02.963585+0000","last_became_peered":"2024-02-21T07:42:02.963585+0000","last_unstale":"2024-02-21T07:42:07.997031+0000","last_undegraded":"2024-02-21T07:42:07.997031+0000","last_fullsized":"2024-02-21T07:42:07.997031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840648+0000","last_change":"2024-02-21T07:42:07.017236+0000","last_active":"2024-02-21T07:42:09.840648+0000","last_peered":"2024-02-21T07:42:09.840648+0000","last_clean":"2024-02-21T07:42:09.840648+0000","last_became_active":"2024-02-21T07:42:07.016750+0000","last_became_peered":"2024-02-21T07:42:07.016750+0000","last_unstale":"2024-02-21T07:42:09.840648+0000","last_undegraded":"2024-02-21T07:42:09.840648+0000","last_fullsized":"2024-02-21T07:42:09.840648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997651+0000","last_change":"2024-02-21T07:42:01.947176+0000","last_active":"2024-02-21T07:42:07.997651+0000","last_peered":"2024-02-21T07:42:07.997651+0000","last_clean":"2024-02-21T07:42:07.997651+0000","last_became_active":"2024-02-21T07:42:01.946831+0000","last_became_peered":"2024-02-21T07:42:01.946831+0000","last_unstale":"2024-02-21T07:42:07.997651+0000","last_undegraded":"2024-02-21T07:42:07.997651+0000","last_fullsized":"2024-02-21T07:42:07.997651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293106+0000","last_change":"2024-02-21T07:42:02.970038+0000","last_active":"2024-02-21T07:42:08.293106+0000","last_peered":"2024-02-21T07:42:08.293106+0000","last_clean":"2024-02-21T07:42:08.293106+0000","last_became_active":"2024-02-21T07:42:02.969433+0000","last_became_peered":"2024-02-21T07:42:02.969433+0000","last_unstale":"2024-02-21T07:42:08.293106+0000","last_undegraded":"2024-02-21T07:42:08.293106+0000","last_fullsized":"2024-02-21T07:42:08.293106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157309+0000","last_change":"2024-02-21T07:42:07.009585+0000","last_active":"2024-02-21T07:42:10.157309+0000","last_peered":"2024-02-21T07:42:10.157309+0000","last_clean":"2024-02-21T07:42:10.157309+0000","last_became_active":"2024-02-21T07:42:07.009264+0000","last_became_peered":"2024-02-21T07:42:07.009264+0000","last_unstale":"2024-02-21T07:42:10.157309+0000","last_undegraded":"2024-02-21T07:42:10.157309+0000","last_fullsized":"2024-02-21T07:42:10.157309+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'12","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.316614+0000","last_change":"2024-02-21T07:42:01.930474+0000","last_active":"2024-02-21T07:42:32.316614+0000","last_peered":"2024-02-21T07:42:32.316614+0000","last_clean":"2024-02-21T07:42:32.316614+0000","last_became_active":"2024-02-21T07:42:01.930173+0000","last_became_peered":"2024-02-21T07:42:01.930173+0000","last_unstale":"2024-02-21T07:42:32.316614+0000","last_undegraded":"2024-02-21T07:42:32.316614+0000","last_fullsized":"2024-02-21T07:42:32.316614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:42.554637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186921+0000","last_change":"2024-02-21T07:42:02.955640+0000","last_active":"2024-02-21T07:42:08.186921+0000","last_peered":"2024-02-21T07:42:08.186921+0000","last_clean":"2024-02-21T07:42:08.186921+0000","last_became_active":"2024-02-21T07:42:02.955341+0000","last_became_peered":"2024-02-21T07:42:02.955341+0000","last_unstale":"2024-02-21T07:42:08.186921+0000","last_undegraded":"2024-02-21T07:42:08.186921+0000","last_fullsized":"2024-02-21T07:42:08.186921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157595+0000","last_change":"2024-02-21T07:42:07.013240+0000","last_active":"2024-02-21T07:42:10.157595+0000","last_peered":"2024-02-21T07:42:10.157595+0000","last_clean":"2024-02-21T07:42:10.157595+0000","last_became_active":"2024-02-21T07:42:07.012852+0000","last_became_peered":"2024-02-21T07:42:07.012852+0000","last_unstale":"2024-02-21T07:42:10.157595+0000","last_undegraded":"2024-02-21T07:42:10.157595+0000","last_fullsized":"2024-02-21T07:42:10.157595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.316459+0000","last_change":"2024-02-21T07:42:01.933225+0000","last_active":"2024-02-21T07:42:32.316459+0000","last_peered":"2024-02-21T07:42:32.316459+0000","last_clean":"2024-02-21T07:42:32.316459+0000","last_became_active":"2024-02-21T07:42:01.932908+0000","last_became_peered":"2024-02-21T07:42:01.932908+0000","last_unstale":"2024-02-21T07:42:32.316459+0000","last_undegraded":"2024-02-21T07:42:32.316459+0000","last_fullsized":"2024-02-21T07:42:32.316459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113448+0000","last_change":"2024-02-21T07:42:02.965143+0000","last_active":"2024-02-21T07:42:08.113448+0000","last_peered":"2024-02-21T07:42:08.113448+0000","last_clean":"2024-02-21T07:42:08.113448+0000","last_became_active":"2024-02-21T07:42:02.964614+0000","last_became_peered":"2024-02-21T07:42:02.964614+0000","last_unstale":"2024-02-21T07:42:08.113448+0000","last_undegraded":"2024-02-21T07:42:08.113448+0000","last_fullsized":"2024-02-21T07:42:08.113448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157408+0000","last_change":"2024-02-21T07:42:07.017243+0000","last_active":"2024-02-21T07:42:10.157408+0000","last_peered":"2024-02-21T07:42:10.157408+0000","last_clean":"2024-02-21T07:42:10.157408+0000","last_became_active":"2024-02-21T07:42:07.016898+0000","last_became_peered":"2024-02-21T07:42:07.016898+0000","last_unstale":"2024-02-21T07:42:10.157408+0000","last_undegraded":"2024-02-21T07:42:10.157408+0000","last_fullsized":"2024-02-21T07:42:10.157408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124848+0000","last_change":"2024-02-21T07:42:02.961021+0000","last_active":"2024-02-21T07:42:10.124848+0000","last_peered":"2024-02-21T07:42:10.124848+0000","last_clean":"2024-02-21T07:42:10.124848+0000","last_became_active":"2024-02-21T07:42:02.960723+0000","last_became_peered":"2024-02-21T07:42:02.960723+0000","last_unstale":"2024-02-21T07:42:10.124848+0000","last_undegraded":"2024-02-21T07:42:10.124848+0000","last_fullsized":"2024-02-21T07:42:10.124848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.107460+0000","last_change":"2024-02-21T07:42:01.928055+0000","last_active":"2024-02-21T07:42:30.107460+0000","last_peered":"2024-02-21T07:42:30.107460+0000","last_clean":"2024-02-21T07:42:30.107460+0000","last_became_active":"2024-02-21T07:42:01.927733+0000","last_became_peered":"2024-02-21T07:42:01.927733+0000","last_unstale":"2024-02-21T07:42:30.107460+0000","last_undegraded":"2024-02-21T07:42:30.107460+0000","last_fullsized":"2024-02-21T07:42:30.107460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157702+0000","last_change":"2024-02-21T07:42:07.124695+0000","last_active":"2024-02-21T07:42:10.157702+0000","last_peered":"2024-02-21T07:42:10.157702+0000","last_clean":"2024-02-21T07:42:10.157702+0000","last_became_active":"2024-02-21T07:42:07.123973+0000","last_became_peered":"2024-02-21T07:42:07.123973+0000","last_unstale":"2024-02-21T07:42:10.157702+0000","last_undegraded":"2024-02-21T07:42:10.157702+0000","last_fullsized":"2024-02-21T07:42:10.157702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996795+0000","last_change":"2024-02-21T07:42:02.982537+0000","last_active":"2024-02-21T07:42:07.996795+0000","last_peered":"2024-02-21T07:42:07.996795+0000","last_clean":"2024-02-21T07:42:07.996795+0000","last_became_active":"2024-02-21T07:42:02.982222+0000","last_became_peered":"2024-02-21T07:42:02.982222+0000","last_unstale":"2024-02-21T07:42:07.996795+0000","last_undegraded":"2024-02-21T07:42:07.996795+0000","last_fullsized":"2024-02-21T07:42:07.996795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.127468+0000","last_change":"2024-02-21T07:42:01.942392+0000","last_active":"2024-02-21T07:42:32.127468+0000","last_peered":"2024-02-21T07:42:32.127468+0000","last_clean":"2024-02-21T07:42:32.127468+0000","last_became_active":"2024-02-21T07:42:01.942152+0000","last_became_peered":"2024-02-21T07:42:01.942152+0000","last_unstale":"2024-02-21T07:42:32.127468+0000","last_undegraded":"2024-02-21T07:42:32.127468+0000","last_fullsized":"2024-02-21T07:42:32.127468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.491378+0000","last_change":"2024-02-21T07:42:07.015054+0000","last_active":"2024-02-21T07:42:10.491378+0000","last_peered":"2024-02-21T07:42:10.491378+0000","last_clean":"2024-02-21T07:42:10.491378+0000","last_became_active":"2024-02-21T07:42:07.014713+0000","last_became_peered":"2024-02-21T07:42:07.014713+0000","last_unstale":"2024-02-21T07:42:10.491378+0000","last_undegraded":"2024-02-21T07:42:10.491378+0000","last_fullsized":"2024-02-21T07:42:10.491378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192537+0000","last_change":"2024-02-21T07:42:02.970973+0000","last_active":"2024-02-21T07:42:09.192537+0000","last_peered":"2024-02-21T07:42:09.192537+0000","last_clean":"2024-02-21T07:42:09.192537+0000","last_became_active":"2024-02-21T07:42:02.970644+0000","last_became_peered":"2024-02-21T07:42:02.970644+0000","last_unstale":"2024-02-21T07:42:09.192537+0000","last_undegraded":"2024-02-21T07:42:09.192537+0000","last_fullsized":"2024-02-21T07:42:09.192537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'7","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.318173+0000","last_change":"2024-02-21T07:42:01.947758+0000","last_active":"2024-02-21T07:42:32.318173+0000","last_peered":"2024-02-21T07:42:32.318173+0000","last_clean":"2024-02-21T07:42:32.318173+0000","last_became_active":"2024-02-21T07:42:01.947407+0000","last_became_peered":"2024-02-21T07:42:01.947407+0000","last_unstale":"2024-02-21T07:42:32.318173+0000","last_undegraded":"2024-02-21T07:42:32.318173+0000","last_fullsized":"2024-02-21T07:42:32.318173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417671+0000","last_change":"2024-02-21T07:42:07.023243+0000","last_active":"2024-02-21T07:42:10.417671+0000","last_peered":"2024-02-21T07:42:10.417671+0000","last_clean":"2024-02-21T07:42:10.417671+0000","last_became_active":"2024-02-21T07:42:07.022308+0000","last_became_peered":"2024-02-21T07:42:07.022308+0000","last_unstale":"2024-02-21T07:42:10.417671+0000","last_undegraded":"2024-02-21T07:42:10.417671+0000","last_fullsized":"2024-02-21T07:42:10.417671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:24.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993327+0000","last_change":"2024-02-21T07:42:02.963456+0000","last_active":"2024-02-21T07:42:07.993327+0000","last_peered":"2024-02-21T07:42:07.993327+0000","last_clean":"2024-02-21T07:42:07.993327+0000","last_became_active":"2024-02-21T07:42:02.963049+0000","last_became_peered":"2024-02-21T07:42:02.963049+0000","last_unstale":"2024-02-21T07:42:07.993327+0000","last_undegraded":"2024-02-21T07:42:07.993327+0000","last_fullsized":"2024-02-21T07:42:07.993327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.106442+0000","last_change":"2024-02-21T07:42:01.930737+0000","last_active":"2024-02-21T07:42:30.106442+0000","last_peered":"2024-02-21T07:42:30.106442+0000","last_clean":"2024-02-21T07:42:30.106442+0000","last_became_active":"2024-02-21T07:42:01.930465+0000","last_became_peered":"2024-02-21T07:42:01.930465+0000","last_unstale":"2024-02-21T07:42:30.106442+0000","last_undegraded":"2024-02-21T07:42:30.106442+0000","last_fullsized":"2024-02-21T07:42:30.106442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:08:11.073826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157596+0000","last_change":"2024-02-21T07:42:07.124659+0000","last_active":"2024-02-21T07:42:10.157596+0000","last_peered":"2024-02-21T07:42:10.157596+0000","last_clean":"2024-02-21T07:42:10.157596+0000","last_became_active":"2024-02-21T07:42:07.124217+0000","last_became_peered":"2024-02-21T07:42:07.124217+0000","last_unstale":"2024-02-21T07:42:10.157596+0000","last_undegraded":"2024-02-21T07:42:10.157596+0000","last_fullsized":"2024-02-21T07:42:10.157596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293041+0000","last_change":"2024-02-21T07:42:02.980306+0000","last_active":"2024-02-21T07:42:08.293041+0000","last_peered":"2024-02-21T07:42:08.293041+0000","last_clean":"2024-02-21T07:42:08.293041+0000","last_became_active":"2024-02-21T07:42:02.978879+0000","last_became_peered":"2024-02-21T07:42:02.978879+0000","last_unstale":"2024-02-21T07:42:08.293041+0000","last_undegraded":"2024-02-21T07:42:08.293041+0000","last_fullsized":"2024-02-21T07:42:08.293041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.310890+0000","last_change":"2024-02-21T07:42:01.931986+0000","last_active":"2024-02-21T07:42:32.310890+0000","last_peered":"2024-02-21T07:42:32.310890+0000","last_clean":"2024-02-21T07:42:32.310890+0000","last_became_active":"2024-02-21T07:42:01.931671+0000","last_became_peered":"2024-02-21T07:42:01.931671+0000","last_unstale":"2024-02-21T07:42:32.310890+0000","last_undegraded":"2024-02-21T07:42:32.310890+0000","last_fullsized":"2024-02-21T07:42:32.310890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840491+0000","last_change":"2024-02-21T07:42:06.999795+0000","last_active":"2024-02-21T07:42:09.840491+0000","last_peered":"2024-02-21T07:42:09.840491+0000","last_clean":"2024-02-21T07:42:09.840491+0000","last_became_active":"2024-02-21T07:42:06.999315+0000","last_became_peered":"2024-02-21T07:42:06.999315+0000","last_unstale":"2024-02-21T07:42:09.840491+0000","last_undegraded":"2024-02-21T07:42:09.840491+0000","last_fullsized":"2024-02-21T07:42:09.840491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997838+0000","last_change":"2024-02-21T07:42:02.968914+0000","last_active":"2024-02-21T07:42:07.997838+0000","last_peered":"2024-02-21T07:42:07.997838+0000","last_clean":"2024-02-21T07:42:07.997838+0000","last_became_active":"2024-02-21T07:42:02.961877+0000","last_became_peered":"2024-02-21T07:42:02.961877+0000","last_unstale":"2024-02-21T07:42:07.997838+0000","last_undegraded":"2024-02-21T07:42:07.997838+0000","last_fullsized":"2024-02-21T07:42:07.997838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'10","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:33.975480+0000","last_change":"2024-02-21T07:42:01.937837+0000","last_active":"2024-02-21T07:42:33.975480+0000","last_peered":"2024-02-21T07:42:33.975480+0000","last_clean":"2024-02-21T07:42:33.975480+0000","last_became_active":"2024-02-21T07:42:01.937536+0000","last_became_peered":"2024-02-21T07:42:01.937536+0000","last_unstale":"2024-02-21T07:42:33.975480+0000","last_undegraded":"2024-02-21T07:42:33.975480+0000","last_fullsized":"2024-02-21T07:42:33.975480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995749+0000","last_change":"2024-02-21T07:42:07.125588+0000","last_active":"2024-02-21T07:42:07.995749+0000","last_peered":"2024-02-21T07:42:07.995749+0000","last_clean":"2024-02-21T07:42:07.995749+0000","last_became_active":"2024-02-21T07:42:07.124044+0000","last_became_peered":"2024-02-21T07:42:07.124044+0000","last_unstale":"2024-02-21T07:42:07.995749+0000","last_undegraded":"2024-02-21T07:42:07.995749+0000","last_fullsized":"2024-02-21T07:42:07.995749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992717+0000","last_change":"2024-02-21T07:42:02.961820+0000","last_active":"2024-02-21T07:42:07.992717+0000","last_peered":"2024-02-21T07:42:07.992717+0000","last_clean":"2024-02-21T07:42:07.992717+0000","last_became_active":"2024-02-21T07:42:02.961478+0000","last_became_peered":"2024-02-21T07:42:02.961478+0000","last_unstale":"2024-02-21T07:42:07.992717+0000","last_undegraded":"2024-02-21T07:42:07.992717+0000","last_fullsized":"2024-02-21T07:42:07.992717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.302240+0000","last_change":"2024-02-21T07:42:01.947736+0000","last_active":"2024-02-21T07:42:32.302240+0000","last_peered":"2024-02-21T07:42:32.302240+0000","last_clean":"2024-02-21T07:42:32.302240+0000","last_became_active":"2024-02-21T07:42:01.947443+0000","last_became_peered":"2024-02-21T07:42:01.947443+0000","last_unstale":"2024-02-21T07:42:32.302240+0000","last_undegraded":"2024-02-21T07:42:32.302240+0000","last_fullsized":"2024-02-21T07:42:32.302240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:17.915214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192630+0000","last_change":"2024-02-21T07:42:07.008819+0000","last_active":"2024-02-21T07:42:09.192630+0000","last_peered":"2024-02-21T07:42:09.192630+0000","last_clean":"2024-02-21T07:42:09.192630+0000","last_became_active":"2024-02-21T07:42:07.008423+0000","last_became_peered":"2024-02-21T07:42:07.008423+0000","last_unstale":"2024-02-21T07:42:09.192630+0000","last_undegraded":"2024-02-21T07:42:09.192630+0000","last_fullsized":"2024-02-21T07:42:09.192630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413836+0000","last_change":"2024-02-21T07:42:02.975343+0000","last_active":"2024-02-21T07:42:10.413836+0000","last_peered":"2024-02-21T07:42:10.413836+0000","last_clean":"2024-02-21T07:42:10.413836+0000","last_became_active":"2024-02-21T07:42:02.975041+0000","last_became_peered":"2024-02-21T07:42:02.975041+0000","last_unstale":"2024-02-21T07:42:10.413836+0000","last_undegraded":"2024-02-21T07:42:10.413836+0000","last_fullsized":"2024-02-21T07:42:10.413836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416266+0000","last_change":"2024-02-21T07:42:01.935020+0000","last_active":"2024-02-21T07:42:10.416266+0000","last_peered":"2024-02-21T07:42:10.416266+0000","last_clean":"2024-02-21T07:42:10.416266+0000","last_became_active":"2024-02-21T07:42:01.934752+0000","last_became_peered":"2024-02-21T07:42:01.934752+0000","last_unstale":"2024-02-21T07:42:10.416266+0000","last_undegraded":"2024-02-21T07:42:10.416266+0000","last_fullsized":"2024-02-21T07:42:10.416266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993582+0000","last_change":"2024-02-21T07:42:07.124477+0000","last_active":"2024-02-21T07:42:07.993582+0000","last_peered":"2024-02-21T07:42:07.993582+0000","last_clean":"2024-02-21T07:42:07.993582+0000","last_became_active":"2024-02-21T07:42:07.123915+0000","last_became_peered":"2024-02-21T07:42:07.123915+0000","last_unstale":"2024-02-21T07:42:07.993582+0000","last_undegraded":"2024-02-21T07:42:07.993582+0000","last_fullsized":"2024-02-21T07:42:07.993582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413746+0000","last_change":"2024-02-21T07:42:02.964531+0000","last_active":"2024-02-21T07:42:10.413746+0000","last_peered":"2024-02-21T07:42:10.413746+0000","last_clean":"2024-02-21T07:42:10.413746+0000","last_became_active":"2024-02-21T07:42:02.964185+0000","last_became_peered":"2024-02-21T07:42:02.964185+0000","last_unstale":"2024-02-21T07:42:10.413746+0000","last_undegraded":"2024-02-21T07:42:10.413746+0000","last_fullsized":"2024-02-21T07:42:10.413746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:34.349576+0000","last_change":"2024-02-21T07:42:01.934093+0000","last_active":"2024-02-21T07:42:34.349576+0000","last_peered":"2024-02-21T07:42:34.349576+0000","last_clean":"2024-02-21T07:42:34.349576+0000","last_became_active":"2024-02-21T07:42:01.933841+0000","last_became_peered":"2024-02-21T07:42:01.933841+0000","last_unstale":"2024-02-21T07:42:34.349576+0000","last_undegraded":"2024-02-21T07:42:34.349576+0000","last_fullsized":"2024-02-21T07:42:34.349576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992564+0000","last_change":"2024-02-21T07:42:07.018134+0000","last_active":"2024-02-21T07:42:07.992564+0000","last_peered":"2024-02-21T07:42:07.992564+0000","last_clean":"2024-02-21T07:42:07.992564+0000","last_became_active":"2024-02-21T07:42:07.017670+0000","last_became_peered":"2024-02-21T07:42:07.017670+0000","last_unstale":"2024-02-21T07:42:07.992564+0000","last_undegraded":"2024-02-21T07:42:07.992564+0000","last_fullsized":"2024-02-21T07:42:07.992564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113034+0000","last_change":"2024-02-21T07:42:02.962279+0000","last_active":"2024-02-21T07:42:08.113034+0000","last_peered":"2024-02-21T07:42:08.113034+0000","last_clean":"2024-02-21T07:42:08.113034+0000","last_became_active":"2024-02-21T07:42:02.961965+0000","last_became_peered":"2024-02-21T07:42:02.961965+0000","last_unstale":"2024-02-21T07:42:08.113034+0000","last_undegraded":"2024-02-21T07:42:08.113034+0000","last_fullsized":"2024-02-21T07:42:08.113034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:34.310921+0000","last_change":"2024-02-21T07:42:01.948478+0000","last_active":"2024-02-21T07:42:34.310921+0000","last_peered":"2024-02-21T07:42:34.310921+0000","last_clean":"2024-02-21T07:42:34.310921+0000","last_became_active":"2024-02-21T07:42:01.948184+0000","last_became_peered":"2024-02-21T07:42:01.948184+0000","last_unstale":"2024-02-21T07:42:34.310921+0000","last_undegraded":"2024-02-21T07:42:34.310921+0000","last_fullsized":"2024-02-21T07:42:34.310921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993308+0000","last_change":"2024-02-21T07:42:07.124759+0000","last_active":"2024-02-21T07:42:07.993308+0000","last_peered":"2024-02-21T07:42:07.993308+0000","last_clean":"2024-02-21T07:42:07.993308+0000","last_became_active":"2024-02-21T07:42:07.124275+0000","last_became_peered":"2024-02-21T07:42:07.124275+0000","last_unstale":"2024-02-21T07:42:07.993308+0000","last_undegraded":"2024-02-21T07:42:07.993308+0000","last_fullsized":"2024-02-21T07:42:07.993308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.991454+0000","last_change":"2024-02-21T07:42:02.961213+0000","last_active":"2024-02-21T07:42:07.991454+0000","last_peered":"2024-02-21T07:42:07.991454+0000","last_clean":"2024-02-21T07:42:07.991454+0000","last_became_active":"2024-02-21T07:42:02.960477+0000","last_became_peered":"2024-02-21T07:42:02.960477+0000","last_unstale":"2024-02-21T07:42:07.991454+0000","last_undegraded":"2024-02-21T07:42:07.991454+0000","last_fullsized":"2024-02-21T07:42:07.991454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:31.115599+0000","last_change":"2024-02-21T07:42:01.928302+0000","last_active":"2024-02-21T07:42:31.115599+0000","last_peered":"2024-02-21T07:42:31.115599+0000","last_clean":"2024-02-21T07:42:31.115599+0000","last_became_active":"2024-02-21T07:42:01.927234+0000","last_became_peered":"2024-02-21T07:42:01.927234+0000","last_unstale":"2024-02-21T07:42:31.115599+0000","last_undegraded":"2024-02-21T07:42:31.115599+0000","last_fullsized":"2024-02-21T07:42:31.115599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113596+0000","last_change":"2024-02-21T07:42:07.124715+0000","last_active":"2024-02-21T07:42:08.113596+0000","last_peered":"2024-02-21T07:42:08.113596+0000","last_clean":"2024-02-21T07:42:08.113596+0000","last_became_active":"2024-02-21T07:42:07.124248+0000","last_became_peered":"2024-02-21T07:42:07.124248+0000","last_unstale":"2024-02-21T07:42:08.113596+0000","last_undegraded":"2024-02-21T07:42:08.113596+0000","last_fullsized":"2024-02-21T07:42:08.113596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:17:21.721728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996414+0000","last_change":"2024-02-21T07:42:02.971762+0000","last_active":"2024-02-21T07:42:07.996414+0000","last_peered":"2024-02-21T07:42:07.996414+0000","last_clean":"2024-02-21T07:42:07.996414+0000","last_became_active":"2024-02-21T07:42:02.970032+0000","last_became_peered":"2024-02-21T07:42:02.970032+0000","last_unstale":"2024-02-21T07:42:07.996414+0000","last_undegraded":"2024-02-21T07:42:07.996414+0000","last_fullsized":"2024-02-21T07:42:07.996414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'6","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.311057+0000","last_change":"2024-02-21T07:42:01.932968+0000","last_active":"2024-02-21T07:42:32.311057+0000","last_peered":"2024-02-21T07:42:32.311057+0000","last_clean":"2024-02-21T07:42:32.311057+0000","last_became_active":"2024-02-21T07:42:01.932620+0000","last_became_peered":"2024-02-21T07:42:01.932620+0000","last_unstale":"2024-02-21T07:42:32.311057+0000","last_undegraded":"2024-02-21T07:42:32.311057+0000","last_fullsized":"2024-02-21T07:42:32.311057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124899+0000","last_change":"2024-02-21T07:41:57.883808+0000","last_active":"2024-02-21T07:42:10.124899+0000","last_peered":"2024-02-21T07:42:10.124899+0000","last_clean":"2024-02-21T07:42:10.124899+0000","last_became_active":"2024-02-21T07:41:57.883530+0000","last_became_peered":"2024-02-21T07:41:57.883530+0000","last_unstale":"2024-02-21T07:42:10.124899+0000","last_undegraded":"2024-02-21T07:42:10.124899+0000","last_fullsized":"2024-02-21T07:42:10.124899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_clean_scrub_stamp":"2024-02-21T07:41:56.862963+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:09:51.756066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.492525+0000","last_change":"2024-02-21T07:42:07.011954+0000","last_active":"2024-02-21T07:42:10.492525+0000","last_peered":"2024-02-21T07:42:10.492525+0000","last_clean":"2024-02-21T07:42:10.492525+0000","last_became_active":"2024-02-21T07:42:07.011654+0000","last_became_peered":"2024-02-21T07:42:07.011654+0000","last_unstale":"2024-02-21T07:42:10.492525+0000","last_undegraded":"2024-02-21T07:42:10.492525+0000","last_fullsized":"2024-02-21T07:42:10.492525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125300+0000","last_change":"2024-02-21T07:42:02.956569+0000","last_active":"2024-02-21T07:42:10.125300+0000","last_peered":"2024-02-21T07:42:10.125300+0000","last_clean":"2024-02-21T07:42:10.125300+0000","last_became_active":"2024-02-21T07:42:02.956232+0000","last_became_peered":"2024-02-21T07:42:02.956232+0000","last_unstale":"2024-02-21T07:42:10.125300+0000","last_undegraded":"2024-02-21T07:42:10.125300+0000","last_fullsized":"2024-02-21T07:42:10.125300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:34.309249+0000","last_change":"2024-02-21T07:42:01.926736+0000","last_active":"2024-02-21T07:42:34.309249+0000","last_peered":"2024-02-21T07:42:34.309249+0000","last_clean":"2024-02-21T07:42:34.309249+0000","last_became_active":"2024-02-21T07:42:01.926454+0000","last_became_peered":"2024-02-21T07:42:01.926454+0000","last_unstale":"2024-02-21T07:42:34.309249+0000","last_undegraded":"2024-02-21T07:42:34.309249+0000","last_fullsized":"2024-02-21T07:42:34.309249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186824+0000","last_change":"2024-02-21T07:42:07.003371+0000","last_active":"2024-02-21T07:42:08.186824+0000","last_peered":"2024-02-21T07:42:08.186824+0000","last_clean":"2024-02-21T07:42:08.186824+0000","last_became_active":"2024-02-21T07:42:07.002940+0000","last_became_peered":"2024-02-21T07:42:07.002940+0000","last_unstale":"2024-02-21T07:42:08.186824+0000","last_undegraded":"2024-02-21T07:42:08.186824+0000","last_fullsized":"2024-02-21T07:42:08.186824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:17.859796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125133+0000","last_change":"2024-02-21T07:42:02.976255+0000","last_active":"2024-02-21T07:42:10.125133+0000","last_peered":"2024-02-21T07:42:10.125133+0000","last_clean":"2024-02-21T07:42:10.125133+0000","last_became_active":"2024-02-21T07:42:02.975927+0000","last_became_peered":"2024-02-21T07:42:02.975927+0000","last_unstale":"2024-02-21T07:42:10.125133+0000","last_undegraded":"2024-02-21T07:42:10.125133+0000","last_fullsized":"2024-02-21T07:42:10.125133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.302904+0000","last_change":"2024-02-21T07:42:01.932488+0000","last_active":"2024-02-21T07:42:32.302904+0000","last_peered":"2024-02-21T07:42:32.302904+0000","last_clean":"2024-02-21T07:42:32.302904+0000","last_became_active":"2024-02-21T07:42:01.932131+0000","last_became_peered":"2024-02-21T07:42:01.932131+0000","last_unstale":"2024-02-21T07:42:32.302904+0000","last_undegraded":"2024-02-21T07:42:32.302904+0000","last_fullsized":"2024-02-21T07:42:32.302904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292501+0000","last_change":"2024-02-21T07:42:07.017329+0000","last_active":"2024-02-21T07:42:08.292501+0000","last_peered":"2024-02-21T07:42:08.292501+0000","last_clean":"2024-02-21T07:42:08.292501+0000","last_became_active":"2024-02-21T07:42:07.016916+0000","last_became_peered":"2024-02-21T07:42:07.016916+0000","last_unstale":"2024-02-21T07:42:08.292501+0000","last_undegraded":"2024-02-21T07:42:08.292501+0000","last_fullsized":"2024-02-21T07:42:08.292501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125268+0000","last_change":"2024-02-21T07:42:02.959157+0000","last_active":"2024-02-21T07:42:10.125268+0000","last_peered":"2024-02-21T07:42:10.125268+0000","last_clean":"2024-02-21T07:42:10.125268+0000","last_became_active":"2024-02-21T07:42:02.958593+0000","last_became_peered":"2024-02-21T07:42:02.958593+0000","last_unstale":"2024-02-21T07:42:10.125268+0000","last_undegraded":"2024-02-21T07:42:10.125268+0000","last_fullsized":"2024-02-21T07:42:10.125268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:55.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.315527+0000","last_change":"2024-02-21T07:42:01.949434+0000","last_active":"2024-02-21T07:42:32.315527+0000","last_peered":"2024-02-21T07:42:32.315527+0000","last_clean":"2024-02-21T07:42:32.315527+0000","last_became_active":"2024-02-21T07:42:01.948805+0000","last_became_peered":"2024-02-21T07:42:01.948805+0000","last_unstale":"2024-02-21T07:42:32.315527+0000","last_undegraded":"2024-02-21T07:42:32.315527+0000","last_fullsized":"2024-02-21T07:42:32.315527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.112966+0000","last_change":"2024-02-21T07:42:07.003190+0000","last_active":"2024-02-21T07:42:08.112966+0000","last_peered":"2024-02-21T07:42:08.112966+0000","last_clean":"2024-02-21T07:42:08.112966+0000","last_became_active":"2024-02-21T07:42:07.002780+0000","last_became_peered":"2024-02-21T07:42:07.002780+0000","last_unstale":"2024-02-21T07:42:08.112966+0000","last_undegraded":"2024-02-21T07:42:08.112966+0000","last_fullsized":"2024-02-21T07:42:08.112966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192778+0000","last_change":"2024-02-21T07:42:02.959569+0000","last_active":"2024-02-21T07:42:09.192778+0000","last_peered":"2024-02-21T07:42:09.192778+0000","last_clean":"2024-02-21T07:42:09.192778+0000","last_became_active":"2024-02-21T07:42:02.959146+0000","last_became_peered":"2024-02-21T07:42:02.959146+0000","last_unstale":"2024-02-21T07:42:09.192778+0000","last_undegraded":"2024-02-21T07:42:09.192778+0000","last_fullsized":"2024-02-21T07:42:09.192778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.112889+0000","last_change":"2024-02-21T07:42:01.926878+0000","last_active":"2024-02-21T07:42:32.112889+0000","last_peered":"2024-02-21T07:42:32.112889+0000","last_clean":"2024-02-21T07:42:32.112889+0000","last_became_active":"2024-02-21T07:42:01.926212+0000","last_became_peered":"2024-02-21T07:42:01.926212+0000","last_unstale":"2024-02-21T07:42:32.112889+0000","last_undegraded":"2024-02-21T07:42:32.112889+0000","last_fullsized":"2024-02-21T07:42:32.112889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113080+0000","last_change":"2024-02-21T07:42:07.017443+0000","last_active":"2024-02-21T07:42:08.113080+0000","last_peered":"2024-02-21T07:42:08.113080+0000","last_clean":"2024-02-21T07:42:08.113080+0000","last_became_active":"2024-02-21T07:42:07.016918+0000","last_became_peered":"2024-02-21T07:42:07.016918+0000","last_unstale":"2024-02-21T07:42:08.113080+0000","last_undegraded":"2024-02-21T07:42:08.113080+0000","last_fullsized":"2024-02-21T07:42:08.113080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:49:35.717727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113122+0000","last_change":"2024-02-21T07:42:02.965178+0000","last_active":"2024-02-21T07:42:08.113122+0000","last_peered":"2024-02-21T07:42:08.113122+0000","last_clean":"2024-02-21T07:42:08.113122+0000","last_became_active":"2024-02-21T07:42:02.964846+0000","last_became_peered":"2024-02-21T07:42:02.964846+0000","last_unstale":"2024-02-21T07:42:08.113122+0000","last_undegraded":"2024-02-21T07:42:08.113122+0000","last_fullsized":"2024-02-21T07:42:08.113122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'17","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.301994+0000","last_change":"2024-02-21T07:42:01.946183+0000","last_active":"2024-02-21T07:42:32.301994+0000","last_peered":"2024-02-21T07:42:32.301994+0000","last_clean":"2024-02-21T07:42:32.301994+0000","last_became_active":"2024-02-21T07:42:01.945960+0000","last_became_peered":"2024-02-21T07:42:01.945960+0000","last_unstale":"2024-02-21T07:42:32.301994+0000","last_undegraded":"2024-02-21T07:42:32.301994+0000","last_fullsized":"2024-02-21T07:42:32.301994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993395+0000","last_change":"2024-02-21T07:42:07.021166+0000","last_active":"2024-02-21T07:42:07.993395+0000","last_peered":"2024-02-21T07:42:07.993395+0000","last_clean":"2024-02-21T07:42:07.993395+0000","last_became_active":"2024-02-21T07:42:07.017128+0000","last_became_peered":"2024-02-21T07:42:07.017128+0000","last_unstale":"2024-02-21T07:42:07.993395+0000","last_undegraded":"2024-02-21T07:42:07.993395+0000","last_fullsized":"2024-02-21T07:42:07.993395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124773+0000","last_change":"2024-02-21T07:42:02.960144+0000","last_active":"2024-02-21T07:42:10.124773+0000","last_peered":"2024-02-21T07:42:10.124773+0000","last_clean":"2024-02-21T07:42:10.124773+0000","last_became_active":"2024-02-21T07:42:02.959714+0000","last_became_peered":"2024-02-21T07:42:02.959714+0000","last_unstale":"2024-02-21T07:42:10.124773+0000","last_undegraded":"2024-02-21T07:42:10.124773+0000","last_fullsized":"2024-02-21T07:42:10.124773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:34.311599+0000","last_change":"2024-02-21T07:42:01.930429+0000","last_active":"2024-02-21T07:42:34.311599+0000","last_peered":"2024-02-21T07:42:34.311599+0000","last_clean":"2024-02-21T07:42:34.311599+0000","last_became_active":"2024-02-21T07:42:01.930076+0000","last_became_peered":"2024-02-21T07:42:01.930076+0000","last_unstale":"2024-02-21T07:42:34.311599+0000","last_undegraded":"2024-02-21T07:42:34.311599+0000","last_fullsized":"2024-02-21T07:42:34.311599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417833+0000","last_change":"2024-02-21T07:42:07.025234+0000","last_active":"2024-02-21T07:42:10.417833+0000","last_peered":"2024-02-21T07:42:10.417833+0000","last_clean":"2024-02-21T07:42:10.417833+0000","last_became_active":"2024-02-21T07:42:07.024452+0000","last_became_peered":"2024-02-21T07:42:07.024452+0000","last_unstale":"2024-02-21T07:42:10.417833+0000","last_undegraded":"2024-02-21T07:42:10.417833+0000","last_fullsized":"2024-02-21T07:42:10.417833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124980+0000","last_change":"2024-02-21T07:42:02.958015+0000","last_active":"2024-02-21T07:42:10.124980+0000","last_peered":"2024-02-21T07:42:10.124980+0000","last_clean":"2024-02-21T07:42:10.124980+0000","last_became_active":"2024-02-21T07:42:02.956436+0000","last_became_peered":"2024-02-21T07:42:02.956436+0000","last_unstale":"2024-02-21T07:42:10.124980+0000","last_undegraded":"2024-02-21T07:42:10.124980+0000","last_fullsized":"2024-02-21T07:42:10.124980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:39.265082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.312216+0000","last_change":"2024-02-21T07:42:01.943079+0000","last_active":"2024-02-21T07:42:32.312216+0000","last_peered":"2024-02-21T07:42:32.312216+0000","last_clean":"2024-02-21T07:42:32.312216+0000","last_became_active":"2024-02-21T07:42:01.942831+0000","last_became_peered":"2024-02-21T07:42:01.942831+0000","last_unstale":"2024-02-21T07:42:32.312216+0000","last_undegraded":"2024-02-21T07:42:32.312216+0000","last_fullsized":"2024-02-21T07:42:32.312216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192731+0000","last_change":"2024-02-21T07:42:07.015228+0000","last_active":"2024-02-21T07:42:09.192731+0000","last_peered":"2024-02-21T07:42:09.192731+0000","last_clean":"2024-02-21T07:42:09.192731+0000","last_became_active":"2024-02-21T07:42:07.014798+0000","last_became_peered":"2024-02-21T07:42:07.014798+0000","last_unstale":"2024-02-21T07:42:09.192731+0000","last_undegraded":"2024-02-21T07:42:09.192731+0000","last_fullsized":"2024-02-21T07:42:09.192731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.991844+0000","last_change":"2024-02-21T07:42:02.965287+0000","last_active":"2024-02-21T07:42:07.991844+0000","last_peered":"2024-02-21T07:42:07.991844+0000","last_clean":"2024-02-21T07:42:07.991844+0000","last_became_active":"2024-02-21T07:42:02.960780+0000","last_became_peered":"2024-02-21T07:42:02.960780+0000","last_unstale":"2024-02-21T07:42:07.991844+0000","last_undegraded":"2024-02-21T07:42:07.991844+0000","last_fullsized":"2024-02-21T07:42:07.991844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.317068+0000","last_change":"2024-02-21T07:42:01.932401+0000","last_active":"2024-02-21T07:42:32.317068+0000","last_peered":"2024-02-21T07:42:32.317068+0000","last_clean":"2024-02-21T07:42:32.317068+0000","last_became_active":"2024-02-21T07:42:01.932108+0000","last_became_peered":"2024-02-21T07:42:01.932108+0000","last_unstale":"2024-02-21T07:42:32.317068+0000","last_undegraded":"2024-02-21T07:42:32.317068+0000","last_fullsized":"2024-02-21T07:42:32.317068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113526+0000","last_change":"2024-02-21T07:42:07.018725+0000","last_active":"2024-02-21T07:42:08.113526+0000","last_peered":"2024-02-21T07:42:08.113526+0000","last_clean":"2024-02-21T07:42:08.113526+0000","last_became_active":"2024-02-21T07:42:07.018322+0000","last_became_peered":"2024-02-21T07:42:07.018322+0000","last_unstale":"2024-02-21T07:42:08.113526+0000","last_undegraded":"2024-02-21T07:42:08.113526+0000","last_fullsized":"2024-02-21T07:42:08.113526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:04:05.896966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993773+0000","last_change":"2024-02-21T07:42:02.963384+0000","last_active":"2024-02-21T07:42:07.993773+0000","last_peered":"2024-02-21T07:42:07.993773+0000","last_clean":"2024-02-21T07:42:07.993773+0000","last_became_active":"2024-02-21T07:42:02.963098+0000","last_became_peered":"2024-02-21T07:42:02.963098+0000","last_unstale":"2024-02-21T07:42:07.993773+0000","last_undegraded":"2024-02-21T07:42:07.993773+0000","last_fullsized":"2024-02-21T07:42:07.993773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"29'25","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:35.316784+0000","last_change":"2024-02-21T07:42:01.936472+0000","last_active":"2024-02-21T07:42:35.316784+0000","last_peered":"2024-02-21T07:42:35.316784+0000","last_clean":"2024-02-21T07:42:35.316784+0000","last_became_active":"2024-02-21T07:42:01.936181+0000","last_became_peered":"2024-02-21T07:42:01.936181+0000","last_unstale":"2024-02-21T07:42:35.316784+0000","last_undegraded":"2024-02-21T07:42:35.316784+0000","last_fullsized":"2024-02-21T07:42:35.316784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40475,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":45,"num_write":27,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416924+0000","last_change":"2024-02-21T07:42:07.013938+0000","last_active":"2024-02-21T07:42:10.416924+0000","last_peered":"2024-02-21T07:42:10.416924+0000","last_clean":"2024-02-21T07:42:10.416924+0000","last_became_active":"2024-02-21T07:42:07.013409+0000","last_became_peered":"2024-02-21T07:42:07.013409+0000","last_unstale":"2024-02-21T07:42:10.416924+0000","last_undegraded":"2024-02-21T07:42:10.416924+0000","last_fullsized":"2024-02-21T07:42:10.416924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:52:00.302670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186924+0000","last_change":"2024-02-21T07:42:02.960084+0000","last_active":"2024-02-21T07:42:08.186924+0000","last_peered":"2024-02-21T07:42:08.186924+0000","last_clean":"2024-02-21T07:42:08.186924+0000","last_became_active":"2024-02-21T07:42:02.959610+0000","last_became_peered":"2024-02-21T07:42:02.959610+0000","last_unstale":"2024-02-21T07:42:08.186924+0000","last_undegraded":"2024-02-21T07:42:08.186924+0000","last_fullsized":"2024-02-21T07:42:08.186924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.127720+0000","last_change":"2024-02-21T07:42:01.946668+0000","last_active":"2024-02-21T07:42:32.127720+0000","last_peered":"2024-02-21T07:42:32.127720+0000","last_clean":"2024-02-21T07:42:32.127720+0000","last_became_active":"2024-02-21T07:42:01.946454+0000","last_became_peered":"2024-02-21T07:42:01.946454+0000","last_unstale":"2024-02-21T07:42:32.127720+0000","last_undegraded":"2024-02-21T07:42:32.127720+0000","last_fullsized":"2024-02-21T07:42:32.127720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157319+0000","last_change":"2024-02-21T07:42:07.013560+0000","last_active":"2024-02-21T07:42:10.157319+0000","last_peered":"2024-02-21T07:42:10.157319+0000","last_clean":"2024-02-21T07:42:10.157319+0000","last_became_active":"2024-02-21T07:42:07.012952+0000","last_became_peered":"2024-02-21T07:42:07.012952+0000","last_unstale":"2024-02-21T07:42:10.157319+0000","last_undegraded":"2024-02-21T07:42:10.157319+0000","last_fullsized":"2024-02-21T07:42:10.157319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293193+0000","last_change":"2024-02-21T07:42:02.969725+0000","last_active":"2024-02-21T07:42:08.293193+0000","last_peered":"2024-02-21T07:42:08.293193+0000","last_clean":"2024-02-21T07:42:08.293193+0000","last_became_active":"2024-02-21T07:42:02.969125+0000","last_became_peered":"2024-02-21T07:42:02.969125+0000","last_unstale":"2024-02-21T07:42:08.293193+0000","last_undegraded":"2024-02-21T07:42:08.293193+0000","last_fullsized":"2024-02-21T07:42:08.293193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.316300+0000","last_change":"2024-02-21T07:42:01.931035+0000","last_active":"2024-02-21T07:42:32.316300+0000","last_peered":"2024-02-21T07:42:32.316300+0000","last_clean":"2024-02-21T07:42:32.316300+0000","last_became_active":"2024-02-21T07:42:01.930665+0000","last_became_peered":"2024-02-21T07:42:01.930665+0000","last_unstale":"2024-02-21T07:42:32.316300+0000","last_undegraded":"2024-02-21T07:42:32.316300+0000","last_fullsized":"2024-02-21T07:42:32.316300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416501+0000","last_change":"2024-02-21T07:42:07.022730+0000","last_active":"2024-02-21T07:42:10.416501+0000","last_peered":"2024-02-21T07:42:10.416501+0000","last_clean":"2024-02-21T07:42:10.416501+0000","last_became_active":"2024-02-21T07:42:07.022349+0000","last_became_peered":"2024-02-21T07:42:07.022349+0000","last_unstale":"2024-02-21T07:42:10.416501+0000","last_undegraded":"2024-02-21T07:42:10.416501+0000","last_fullsized":"2024-02-21T07:42:10.416501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:17.859796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.187028+0000","last_change":"2024-02-21T07:42:02.956416+0000","last_active":"2024-02-21T07:42:08.187028+0000","last_peered":"2024-02-21T07:42:08.187028+0000","last_clean":"2024-02-21T07:42:08.187028+0000","last_became_active":"2024-02-21T07:42:02.956098+0000","last_became_peered":"2024-02-21T07:42:02.956098+0000","last_unstale":"2024-02-21T07:42:08.187028+0000","last_undegraded":"2024-02-21T07:42:08.187028+0000","last_fullsized":"2024-02-21T07:42:08.187028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:35.309923+0000","last_change":"2024-02-21T07:42:01.937810+0000","last_active":"2024-02-21T07:42:35.309923+0000","last_peered":"2024-02-21T07:42:35.309923+0000","last_clean":"2024-02-21T07:42:35.309923+0000","last_became_active":"2024-02-21T07:42:01.937555+0000","last_became_peered":"2024-02-21T07:42:01.937555+0000","last_unstale":"2024-02-21T07:42:35.309923+0000","last_undegraded":"2024-02-21T07:42:35.309923+0000","last_fullsized":"2024-02-21T07:42:35.309923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996295+0000","last_change":"2024-02-21T07:42:07.013284+0000","last_active":"2024-02-21T07:42:07.996295+0000","last_peered":"2024-02-21T07:42:07.996295+0000","last_clean":"2024-02-21T07:42:07.996295+0000","last_became_active":"2024-02-21T07:42:07.012412+0000","last_became_peered":"2024-02-21T07:42:07.012412+0000","last_unstale":"2024-02-21T07:42:07.996295+0000","last_undegraded":"2024-02-21T07:42:07.996295+0000","last_fullsized":"2024-02-21T07:42:07.996295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292443+0000","last_change":"2024-02-21T07:42:07.016945+0000","last_active":"2024-02-21T07:42:08.292443+0000","last_peered":"2024-02-21T07:42:08.292443+0000","last_clean":"2024-02-21T07:42:08.292443+0000","last_became_active":"2024-02-21T07:42:07.016572+0000","last_became_peered":"2024-02-21T07:42:07.016572+0000","last_unstale":"2024-02-21T07:42:08.292443+0000","last_undegraded":"2024-02-21T07:42:08.292443+0000","last_fullsized":"2024-02-21T07:42:08.292443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416578+0000","last_change":"2024-02-21T07:42:02.977972+0000","last_active":"2024-02-21T07:42:10.416578+0000","last_peered":"2024-02-21T07:42:10.416578+0000","last_clean":"2024-02-21T07:42:10.416578+0000","last_became_active":"2024-02-21T07:42:02.977632+0000","last_became_peered":"2024-02-21T07:42:02.977632+0000","last_unstale":"2024-02-21T07:42:10.416578+0000","last_undegraded":"2024-02-21T07:42:10.416578+0000","last_fullsized":"2024-02-21T07:42:10.416578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.304904+0000","last_change":"2024-02-21T07:42:01.930402+0000","last_active":"2024-02-21T07:42:32.304904+0000","last_peered":"2024-02-21T07:42:32.304904+0000","last_clean":"2024-02-21T07:42:32.304904+0000","last_became_active":"2024-02-21T07:42:01.930084+0000","last_became_peered":"2024-02-21T07:42:01.930084+0000","last_unstale":"2024-02-21T07:42:32.304904+0000","last_undegraded":"2024-02-21T07:42:32.304904+0000","last_fullsized":"2024-02-21T07:42:32.304904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192889+0000","last_change":"2024-02-21T07:42:07.016859+0000","last_active":"2024-02-21T07:42:09.192889+0000","last_peered":"2024-02-21T07:42:09.192889+0000","last_clean":"2024-02-21T07:42:09.192889+0000","last_became_active":"2024-02-21T07:42:07.016372+0000","last_became_peered":"2024-02-21T07:42:07.016372+0000","last_unstale":"2024-02-21T07:42:09.192889+0000","last_undegraded":"2024-02-21T07:42:09.192889+0000","last_fullsized":"2024-02-21T07:42:09.192889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995924+0000","last_change":"2024-02-21T07:42:02.948576+0000","last_active":"2024-02-21T07:42:07.995924+0000","last_peered":"2024-02-21T07:42:07.995924+0000","last_clean":"2024-02-21T07:42:07.995924+0000","last_became_active":"2024-02-21T07:42:02.947666+0000","last_became_peered":"2024-02-21T07:42:02.947666+0000","last_unstale":"2024-02-21T07:42:07.995924+0000","last_undegraded":"2024-02-21T07:42:07.995924+0000","last_fullsized":"2024-02-21T07:42:07.995924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:31.120967+0000","last_change":"2024-02-21T07:42:01.929126+0000","last_active":"2024-02-21T07:42:31.120967+0000","last_peered":"2024-02-21T07:42:31.120967+0000","last_clean":"2024-02-21T07:42:31.120967+0000","last_became_active":"2024-02-21T07:42:01.928667+0000","last_became_peered":"2024-02-21T07:42:01.928667+0000","last_unstale":"2024-02-21T07:42:31.120967+0000","last_undegraded":"2024-02-21T07:42:31.120967+0000","last_fullsized":"2024-02-21T07:42:31.120967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.128601+0000","last_change":"2024-02-21T07:42:01.933903+0000","last_active":"2024-02-21T07:42:32.128601+0000","last_peered":"2024-02-21T07:42:32.128601+0000","last_clean":"2024-02-21T07:42:32.128601+0000","last_became_active":"2024-02-21T07:42:01.933578+0000","last_became_peered":"2024-02-21T07:42:01.933578+0000","last_unstale":"2024-02-21T07:42:32.128601+0000","last_undegraded":"2024-02-21T07:42:32.128601+0000","last_fullsized":"2024-02-21T07:42:32.128601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113230+0000","last_change":"2024-02-21T07:42:02.964660+0000","last_active":"2024-02-21T07:42:08.113230+0000","last_peered":"2024-02-21T07:42:08.113230+0000","last_clean":"2024-02-21T07:42:08.113230+0000","last_became_active":"2024-02-21T07:42:02.964389+0000","last_became_peered":"2024-02-21T07:42:02.964389+0000","last_unstale":"2024-02-21T07:42:08.113230+0000","last_undegraded":"2024-02-21T07:42:08.113230+0000","last_fullsized":"2024-02-21T07:42:08.113230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840629+0000","last_change":"2024-02-21T07:42:07.015720+0000","last_active":"2024-02-21T07:42:09.840629+0000","last_peered":"2024-02-21T07:42:09.840629+0000","last_clean":"2024-02-21T07:42:09.840629+0000","last_became_active":"2024-02-21T07:42:07.015315+0000","last_became_peered":"2024-02-21T07:42:07.015315+0000","last_unstale":"2024-02-21T07:42:09.840629+0000","last_undegraded":"2024-02-21T07:42:09.840629+0000","last_fullsized":"2024-02-21T07:42:09.840629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:34.309141+0000","last_change":"2024-02-21T07:42:01.927978+0000","last_active":"2024-02-21T07:42:34.309141+0000","last_peered":"2024-02-21T07:42:34.309141+0000","last_clean":"2024-02-21T07:42:34.309141+0000","last_became_active":"2024-02-21T07:42:01.927661+0000","last_became_peered":"2024-02-21T07:42:01.927661+0000","last_unstale":"2024-02-21T07:42:34.309141+0000","last_undegraded":"2024-02-21T07:42:34.309141+0000","last_fullsized":"2024-02-21T07:42:34.309141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993701+0000","last_change":"2024-02-21T07:42:02.971175+0000","last_active":"2024-02-21T07:42:07.993701+0000","last_peered":"2024-02-21T07:42:07.993701+0000","last_clean":"2024-02-21T07:42:07.993701+0000","last_became_active":"2024-02-21T07:42:02.970886+0000","last_became_peered":"2024-02-21T07:42:02.970886+0000","last_unstale":"2024-02-21T07:42:07.993701+0000","last_undegraded":"2024-02-21T07:42:07.993701+0000","last_fullsized":"2024-02-21T07:42:07.993701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840892+0000","last_change":"2024-02-21T07:42:07.003267+0000","last_active":"2024-02-21T07:42:09.840892+0000","last_peered":"2024-02-21T07:42:09.840892+0000","last_clean":"2024-02-21T07:42:09.840892+0000","last_became_active":"2024-02-21T07:42:07.002824+0000","last_became_peered":"2024-02-21T07:42:07.002824+0000","last_unstale":"2024-02-21T07:42:09.840892+0000","last_undegraded":"2024-02-21T07:42:09.840892+0000","last_fullsized":"2024-02-21T07:42:09.840892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192386+0000","last_change":"2024-02-21T07:42:02.960884+0000","last_active":"2024-02-21T07:42:09.192386+0000","last_peered":"2024-02-21T07:42:09.192386+0000","last_clean":"2024-02-21T07:42:09.192386+0000","last_became_active":"2024-02-21T07:42:02.960515+0000","last_became_peered":"2024-02-21T07:42:02.960515+0000","last_unstale":"2024-02-21T07:42:09.192386+0000","last_undegraded":"2024-02-21T07:42:09.192386+0000","last_fullsized":"2024-02-21T07:42:09.192386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840732+0000","last_change":"2024-02-21T07:42:02.960807+0000","last_active":"2024-02-21T07:42:09.840732+0000","last_peered":"2024-02-21T07:42:09.840732+0000","last_clean":"2024-02-21T07:42:09.840732+0000","last_became_active":"2024-02-21T07:42:02.960478+0000","last_became_peered":"2024-02-21T07:42:02.960478+0000","last_unstale":"2024-02-21T07:42:09.840732+0000","last_undegraded":"2024-02-21T07:42:09.840732+0000","last_fullsized":"2024-02-21T07:42:09.840732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840455+0000","last_change":"2024-02-21T07:42:02.966666+0000","last_active":"2024-02-21T07:42:09.840455+0000","last_peered":"2024-02-21T07:42:09.840455+0000","last_clean":"2024-02-21T07:42:09.840455+0000","last_became_active":"2024-02-21T07:42:02.966350+0000","last_became_peered":"2024-02-21T07:42:02.966350+0000","last_unstale":"2024-02-21T07:42:09.840455+0000","last_undegraded":"2024-02-21T07:42:09.840455+0000","last_fullsized":"2024-02-21T07:42:09.840455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292232+0000","last_change":"2024-02-21T07:42:02.973149+0000","last_active":"2024-02-21T07:42:08.292232+0000","last_peered":"2024-02-21T07:42:08.292232+0000","last_clean":"2024-02-21T07:42:08.292232+0000","last_became_active":"2024-02-21T07:42:02.972869+0000","last_became_peered":"2024-02-21T07:42:02.972869+0000","last_unstale":"2024-02-21T07:42:08.292232+0000","last_undegraded":"2024-02-21T07:42:08.292232+0000","last_fullsized":"2024-02-21T07:42:08.292232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992632+0000","last_change":"2024-02-21T07:42:02.957623+0000","last_active":"2024-02-21T07:42:07.992632+0000","last_peered":"2024-02-21T07:42:07.992632+0000","last_clean":"2024-02-21T07:42:07.992632+0000","last_became_active":"2024-02-21T07:42:02.956527+0000","last_became_peered":"2024-02-21T07:42:02.956527+0000","last_unstale":"2024-02-21T07:42:07.992632+0000","last_undegraded":"2024-02-21T07:42:07.992632+0000","last_fullsized":"2024-02-21T07:42:07.992632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192705+0000","last_change":"2024-02-21T07:42:02.961369+0000","last_active":"2024-02-21T07:42:09.192705+0000","last_peered":"2024-02-21T07:42:09.192705+0000","last_clean":"2024-02-21T07:42:09.192705+0000","last_became_active":"2024-02-21T07:42:02.961075+0000","last_became_peered":"2024-02-21T07:42:02.961075+0000","last_unstale":"2024-02-21T07:42:09.192705+0000","last_undegraded":"2024-02-21T07:42:09.192705+0000","last_fullsized":"2024-02-21T07:42:09.192705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840881+0000","last_change":"2024-02-21T07:42:02.960461+0000","last_active":"2024-02-21T07:42:09.840881+0000","last_peered":"2024-02-21T07:42:09.840881+0000","last_clean":"2024-02-21T07:42:09.840881+0000","last_became_active":"2024-02-21T07:42:02.960168+0000","last_became_peered":"2024-02-21T07:42:02.960168+0000","last_unstale":"2024-02-21T07:42:09.840881+0000","last_undegraded":"2024-02-21T07:42:09.840881+0000","last_fullsized":"2024-02-21T07:42:09.840881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997823+0000","last_change":"2024-02-21T07:42:02.966173+0000","last_active":"2024-02-21T07:42:07.997823+0000","last_peered":"2024-02-21T07:42:07.997823+0000","last_clean":"2024-02-21T07:42:07.997823+0000","last_became_active":"2024-02-21T07:42:02.964280+0000","last_became_peered":"2024-02-21T07:42:02.964280+0000","last_unstale":"2024-02-21T07:42:07.997823+0000","last_undegraded":"2024-02-21T07:42:07.997823+0000","last_fullsized":"2024-02-21T07:42:07.997823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113001+0000","last_change":"2024-02-21T07:42:02.975012+0000","last_active":"2024-02-21T07:42:08.113001+0000","last_peered":"2024-02-21T07:42:08.113001+0000","last_clean":"2024-02-21T07:42:08.113001+0000","last_became_active":"2024-02-21T07:42:02.974682+0000","last_became_peered":"2024-02-21T07:42:02.974682+0000","last_unstale":"2024-02-21T07:42:08.113001+0000","last_undegraded":"2024-02-21T07:42:08.113001+0000","last_fullsized":"2024-02-21T07:42:08.113001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996451+0000","last_change":"2024-02-21T07:42:02.966976+0000","last_active":"2024-02-21T07:42:07.996451+0000","last_peered":"2024-02-21T07:42:07.996451+0000","last_clean":"2024-02-21T07:42:07.996451+0000","last_became_active":"2024-02-21T07:42:02.966422+0000","last_became_peered":"2024-02-21T07:42:02.966422+0000","last_unstale":"2024-02-21T07:42:07.996451+0000","last_undegraded":"2024-02-21T07:42:07.996451+0000","last_fullsized":"2024-02-21T07:42:07.996451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186750+0000","last_change":"2024-02-21T07:42:02.957398+0000","last_active":"2024-02-21T07:42:08.186750+0000","last_peered":"2024-02-21T07:42:08.186750+0000","last_clean":"2024-02-21T07:42:08.186750+0000","last_became_active":"2024-02-21T07:42:02.957115+0000","last_became_peered":"2024-02-21T07:42:02.957115+0000","last_unstale":"2024-02-21T07:42:08.186750+0000","last_undegraded":"2024-02-21T07:42:08.186750+0000","last_fullsized":"2024-02-21T07:42:08.186750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992415+0000","last_change":"2024-02-21T07:42:02.956114+0000","last_active":"2024-02-21T07:42:07.992415+0000","last_peered":"2024-02-21T07:42:07.992415+0000","last_clean":"2024-02-21T07:42:07.992415+0000","last_became_active":"2024-02-21T07:42:02.955476+0000","last_became_peered":"2024-02-21T07:42:02.955476+0000","last_unstale":"2024-02-21T07:42:07.992415+0000","last_undegraded":"2024-02-21T07:42:07.992415+0000","last_fullsized":"2024-02-21T07:42:07.992415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192545+0000","last_change":"2024-02-21T07:42:02.955604+0000","last_active":"2024-02-21T07:42:09.192545+0000","last_peered":"2024-02-21T07:42:09.192545+0000","last_clean":"2024-02-21T07:42:09.192545+0000","last_became_active":"2024-02-21T07:42:02.955327+0000","last_became_peered":"2024-02-21T07:42:02.955327+0000","last_unstale":"2024-02-21T07:42:09.192545+0000","last_undegraded":"2024-02-21T07:42:09.192545+0000","last_fullsized":"2024-02-21T07:42:09.192545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840939+0000","last_change":"2024-02-21T07:42:02.967092+0000","last_active":"2024-02-21T07:42:09.840939+0000","last_peered":"2024-02-21T07:42:09.840939+0000","last_clean":"2024-02-21T07:42:09.840939+0000","last_became_active":"2024-02-21T07:42:02.966845+0000","last_became_peered":"2024-02-21T07:42:02.966845+0000","last_unstale":"2024-02-21T07:42:09.840939+0000","last_undegraded":"2024-02-21T07:42:09.840939+0000","last_fullsized":"2024-02-21T07:42:09.840939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417187+0000","last_change":"2024-02-21T07:42:02.973535+0000","last_active":"2024-02-21T07:42:10.417187+0000","last_peered":"2024-02-21T07:42:10.417187+0000","last_clean":"2024-02-21T07:42:10.417187+0000","last_became_active":"2024-02-21T07:42:02.973202+0000","last_became_peered":"2024-02-21T07:42:02.973202+0000","last_unstale":"2024-02-21T07:42:10.417187+0000","last_undegraded":"2024-02-21T07:42:10.417187+0000","last_fullsized":"2024-02-21T07:42:10.417187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192968+0000","last_change":"2024-02-21T07:42:02.954398+0000","last_active":"2024-02-21T07:42:09.192968+0000","last_peered":"2024-02-21T07:42:09.192968+0000","last_clean":"2024-02-21T07:42:09.192968+0000","last_became_active":"2024-02-21T07:42:02.954099+0000","last_became_peered":"2024-02-21T07:42:02.954099+0000","last_unstale":"2024-02-21T07:42:09.192968+0000","last_undegraded":"2024-02-21T07:42:09.192968+0000","last_fullsized":"2024-02-21T07:42:09.192968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186572+0000","last_change":"2024-02-21T07:42:02.958214+0000","last_active":"2024-02-21T07:42:08.186572+0000","last_peered":"2024-02-21T07:42:08.186572+0000","last_clean":"2024-02-21T07:42:08.186572+0000","last_became_active":"2024-02-21T07:42:02.957885+0000","last_became_peered":"2024-02-21T07:42:02.957885+0000","last_unstale":"2024-02-21T07:42:08.186572+0000","last_undegraded":"2024-02-21T07:42:08.186572+0000","last_fullsized":"2024-02-21T07:42:08.186572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292117+0000","last_change":"2024-02-21T07:42:02.980607+0000","last_active":"2024-02-21T07:42:08.292117+0000","last_peered":"2024-02-21T07:42:08.292117+0000","last_clean":"2024-02-21T07:42:08.292117+0000","last_became_active":"2024-02-21T07:42:02.980239+0000","last_became_peered":"2024-02-21T07:42:02.980239+0000","last_unstale":"2024-02-21T07:42:08.292117+0000","last_undegraded":"2024-02-21T07:42:08.292117+0000","last_fullsized":"2024-02-21T07:42:08.292117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.291998+0000","last_change":"2024-02-21T07:42:02.972536+0000","last_active":"2024-02-21T07:42:08.291998+0000","last_peered":"2024-02-21T07:42:08.291998+0000","last_clean":"2024-02-21T07:42:08.291998+0000","last_became_active":"2024-02-21T07:42:02.972216+0000","last_became_peered":"2024-02-21T07:42:02.972216+0000","last_unstale":"2024-02-21T07:42:08.291998+0000","last_undegraded":"2024-02-21T07:42:08.291998+0000","last_fullsized":"2024-02-21T07:42:08.291998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992288+0000","last_change":"2024-02-21T07:42:02.958082+0000","last_active":"2024-02-21T07:42:07.992288+0000","last_peered":"2024-02-21T07:42:07.992288+0000","last_clean":"2024-02-21T07:42:07.992288+0000","last_became_active":"2024-02-21T07:42:02.957711+0000","last_became_peered":"2024-02-21T07:42:02.957711+0000","last_unstale":"2024-02-21T07:42:07.992288+0000","last_undegraded":"2024-02-21T07:42:07.992288+0000","last_fullsized":"2024-02-21T07:42:07.992288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157664+0000","last_change":"2024-02-21T07:42:02.957799+0000","last_active":"2024-02-21T07:42:10.157664+0000","last_peered":"2024-02-21T07:42:10.157664+0000","last_clean":"2024-02-21T07:42:10.157664+0000","last_became_active":"2024-02-21T07:42:02.957510+0000","last_became_peered":"2024-02-21T07:42:02.957510+0000","last_unstale":"2024-02-21T07:42:10.157664+0000","last_undegraded":"2024-02-21T07:42:10.157664+0000","last_fullsized":"2024-02-21T07:42:10.157664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125190+0000","last_change":"2024-02-21T07:42:02.962565+0000","last_active":"2024-02-21T07:42:10.125190+0000","last_peered":"2024-02-21T07:42:10.125190+0000","last_clean":"2024-02-21T07:42:10.125190+0000","last_became_active":"2024-02-21T07:42:02.962298+0000","last_became_peered":"2024-02-21T07:42:02.962298+0000","last_unstale":"2024-02-21T07:42:10.125190+0000","last_undegraded":"2024-02-21T07:42:10.125190+0000","last_fullsized":"2024-02-21T07:42:10.125190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413913+0000","last_change":"2024-02-21T07:42:02.961018+0000","last_active":"2024-02-21T07:42:10.413913+0000","last_peered":"2024-02-21T07:42:10.413913+0000","last_clean":"2024-02-21T07:42:10.413913+0000","last_became_active":"2024-02-21T07:42:02.960634+0000","last_became_peered":"2024-02-21T07:42:02.960634+0000","last_unstale":"2024-02-21T07:42:10.413913+0000","last_undegraded":"2024-02-21T07:42:10.413913+0000","last_fullsized":"2024-02-21T07:42:10.413913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.187102+0000","last_change":"2024-02-21T07:42:02.959426+0000","last_active":"2024-02-21T07:42:08.187102+0000","last_peered":"2024-02-21T07:42:08.187102+0000","last_clean":"2024-02-21T07:42:08.187102+0000","last_became_active":"2024-02-21T07:42:02.959021+0000","last_became_peered":"2024-02-21T07:42:02.959021+0000","last_unstale":"2024-02-21T07:42:08.187102+0000","last_undegraded":"2024-02-21T07:42:08.187102+0000","last_fullsized":"2024-02-21T07:42:08.187102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995727+0000","last_change":"2024-02-21T07:42:02.971151+0000","last_active":"2024-02-21T07:42:07.995727+0000","last_peered":"2024-02-21T07:42:07.995727+0000","last_clean":"2024-02-21T07:42:07.995727+0000","last_became_active":"2024-02-21T07:42:02.967323+0000","last_became_peered":"2024-02-21T07:42:02.967323+0000","last_unstale":"2024-02-21T07:42:07.995727+0000","last_undegraded":"2024-02-21T07:42:07.995727+0000","last_fullsized":"2024-02-21T07:42:07.995727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124824+0000","last_change":"2024-02-21T07:42:02.974767+0000","last_active":"2024-02-21T07:42:10.124824+0000","last_peered":"2024-02-21T07:42:10.124824+0000","last_clean":"2024-02-21T07:42:10.124824+0000","last_became_active":"2024-02-21T07:42:02.974292+0000","last_became_peered":"2024-02-21T07:42:02.974292+0000","last_unstale":"2024-02-21T07:42:10.124824+0000","last_undegraded":"2024-02-21T07:42:10.124824+0000","last_fullsized":"2024-02-21T07:42:10.124824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413730+0000","last_change":"2024-02-21T07:42:02.968079+0000","last_active":"2024-02-21T07:42:10.413730+0000","last_peered":"2024-02-21T07:42:10.413730+0000","last_clean":"2024-02-21T07:42:10.413730+0000","last_became_active":"2024-02-21T07:42:02.967767+0000","last_became_peered":"2024-02-21T07:42:02.967767+0000","last_unstale":"2024-02-21T07:42:10.413730+0000","last_undegraded":"2024-02-21T07:42:10.413730+0000","last_fullsized":"2024-02-21T07:42:10.413730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993396+0000","last_change":"2024-02-21T07:42:02.978031+0000","last_active":"2024-02-21T07:42:07.993396+0000","last_peered":"2024-02-21T07:42:07.993396+0000","last_clean":"2024-02-21T07:42:07.993396+0000","last_became_active":"2024-02-21T07:42:02.977704+0000","last_became_peered":"2024-02-21T07:42:02.977704+0000","last_unstale":"2024-02-21T07:42:07.993396+0000","last_undegraded":"2024-02-21T07:42:07.993396+0000","last_fullsized":"2024-02-21T07:42:07.993396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157552+0000","last_change":"2024-02-21T07:42:02.959959+0000","last_active":"2024-02-21T07:42:10.157552+0000","last_peered":"2024-02-21T07:42:10.157552+0000","last_clean":"2024-02-21T07:42:10.157552+0000","last_became_active":"2024-02-21T07:42:02.959655+0000","last_became_peered":"2024-02-21T07:42:02.959655+0000","last_unstale":"2024-02-21T07:42:10.157552+0000","last_undegraded":"2024-02-21T07:42:10.157552+0000","last_fullsized":"2024-02-21T07:42:10.157552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292334+0000","last_change":"2024-02-21T07:42:02.975851+0000","last_active":"2024-02-21T07:42:08.292334+0000","last_peered":"2024-02-21T07:42:08.292334+0000","last_clean":"2024-02-21T07:42:08.292334+0000","last_became_active":"2024-02-21T07:42:02.973848+0000","last_became_peered":"2024-02-21T07:42:02.973848+0000","last_unstale":"2024-02-21T07:42:08.292334+0000","last_undegraded":"2024-02-21T07:42:08.292334+0000","last_fullsized":"2024-02-21T07:42:08.292334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292889+0000","last_change":"2024-02-21T07:42:02.981681+0000","last_active":"2024-02-21T07:42:08.292889+0000","last_peered":"2024-02-21T07:42:08.292889+0000","last_clean":"2024-02-21T07:42:08.292889+0000","last_became_active":"2024-02-21T07:42:02.981324+0000","last_became_peered":"2024-02-21T07:42:02.981324+0000","last_unstale":"2024-02-21T07:42:08.292889+0000","last_undegraded":"2024-02-21T07:42:08.292889+0000","last_fullsized":"2024-02-21T07:42:08.292889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192896+0000","last_change":"2024-02-21T07:42:02.954466+0000","last_active":"2024-02-21T07:42:09.192896+0000","last_peered":"2024-02-21T07:42:09.192896+0000","last_clean":"2024-02-21T07:42:09.192896+0000","last_became_active":"2024-02-21T07:42:02.954168+0000","last_became_peered":"2024-02-21T07:42:02.954168+0000","last_unstale":"2024-02-21T07:42:09.192896+0000","last_undegraded":"2024-02-21T07:42:09.192896+0000","last_fullsized":"2024-02-21T07:42:09.192896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":48082,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":75,"num_read_kb":93,"num_write":229,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":335872,"data_stored":96164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444043,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":146852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":10,"up_from":17,"seq":73014444043,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":182030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":9,"up_from":17,"seq":73014444043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":150123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6499999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.754}]}]},{"osd":8,"up_from":17,"seq":73014444042,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":146093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":7,"up_from":17,"seq":73014444043,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":933888,"data_stored":741972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":6,"up_from":17,"seq":73014444043,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":141869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.696}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9710000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1600000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0289999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1040000000000001}]}]},{"osd":5,"up_from":17,"seq":73014444043,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":954368,"data_stored":738266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":146338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":3,"up_from":17,"seq":73014444043,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":141461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7829999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8149999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":143819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444043,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":182808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":0,"up_from":17,"seq":73014444044,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":142065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":41639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":40861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:42:36.594 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-21T07:42:36.594 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-21T07:42:36.595 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-21T07:42:36.595 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-21T07:42:36.595 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-21T07:42:36.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.829+0000 7f388c200640 1 Processor -- start 2024-02-21T07:42:36.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.829+0000 7f388c200640 1 -- start start 2024-02-21T07:42:36.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.831+0000 7f388c200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f388406ee60 0x7f3884189420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f388c200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38840710d0 0x7f38840cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f388c200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38840ccc50 con 0x7f3884188930 2024-02-21T07:42:36.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f388c200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38840f7a10 con 0x7f388406ee60 2024-02-21T07:42:36.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f388c200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388406f420 con 0x7f38840710d0 2024-02-21T07:42:36.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f388a200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f38840710d0 0x7f38840cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f3889800640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3884188930 0x7f3884188d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:57104/0 (socket says 172.21.15.69:57104) 2024-02-21T07:42:36.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f3889800640 1 -- 172.21.15.69:0/2667848220 learned_addr learned my addr 172.21.15.69:0/2667848220 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:36.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f3888e00640 1 --2- 172.21.15.69:0/2667848220 >> v2:172.21.15.174:3300/0 conn(0x7f388406ee60 0x7f3884189420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f3883e00640 1 -- 172.21.15.69:0/2667848220 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159652849 0 0) 0x7f38840ccc50 con 0x7f3884188930 2024-02-21T07:42:36.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f3883e00640 1 -- 172.21.15.69:0/2667848220 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f386c003520 con 0x7f3884188930 2024-02-21T07:42:36.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f388a200640 1 -- 172.21.15.69:0/2667848220 >> v2:172.21.15.174:3300/0 conn(0x7f388406ee60 msgr2=0x7f3884189420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:36.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.832+0000 7f388a200640 1 --2- 172.21.15.69:0/2667848220 >> v2:172.21.15.174:3300/0 conn(0x7f388406ee60 0x7f3884189420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.833+0000 7f388a200640 1 -- 172.21.15.69:0/2667848220 >> v1:172.21.15.184:6789/0 conn(0x7f3884188930 legacy=0x7f3884188d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.833+0000 7f388a200640 1 -- 172.21.15.69:0/2667848220 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388406f700 con 0x7f38840710d0 2024-02-21T07:42:36.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.834+0000 7f388a200640 1 --2- 172.21.15.69:0/2667848220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38840710d0 0x7f38840cd0e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3884075140 tx=0x7f387c02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d55f0b1b5047243 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:36.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f3883e00640 1 -- 172.21.15.69:0/2667848220 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c02cbf0 con 0x7f38840710d0 2024-02-21T07:42:36.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f3883e00640 1 -- 172.21.15.69:0/2667848220 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387c02cd50 con 0x7f38840710d0 2024-02-21T07:42:36.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f3883e00640 1 -- 172.21.15.69:0/2667848220 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387c034640 con 0x7f38840710d0 2024-02-21T07:42:36.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f388c200640 1 -- 172.21.15.69:0/2667848220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38840710d0 msgr2=0x7f38840cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f388c200640 1 --2- 172.21.15.69:0/2667848220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38840710d0 0x7f38840cd0e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3884075140 tx=0x7f387c02be40 comp rx=0 tx=0).stop 2024-02-21T07:42:36.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f388c200640 1 -- 172.21.15.69:0/2667848220 shutdown_connections 2024-02-21T07:42:36.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f388c200640 1 --2- 172.21.15.69:0/2667848220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38840710d0 0x7f38840cd0e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f388c200640 1 --2- 172.21.15.69:0/2667848220 >> v2:172.21.15.174:3300/0 conn(0x7f388406ee60 0x7f3884189420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f388c200640 1 -- 172.21.15.69:0/2667848220 >> 172.21.15.69:0/2667848220 conn(0x7f38840f8b00 msgr2=0x7f38840f8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:36.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f388c200640 1 -- 172.21.15.69:0/2667848220 shutdown_connections 2024-02-21T07:42:36.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.835+0000 7f388c200640 1 -- 172.21.15.69:0/2667848220 wait complete. 2024-02-21T07:42:36.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.837+0000 7f388c200640 1 Processor -- start 2024-02-21T07:42:36.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.837+0000 7f388c200640 1 -- start start 2024-02-21T07:42:36.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f388c200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f388406ee60 0x7f388416bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f388c200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38840710d0 0x7f3884186c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f388c200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3884188930 0x7f3884187160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f388c200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38841876a0 con 0x7f388406ee60 2024-02-21T07:42:36.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f388c200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38841797a0 con 0x7f3884188930 2024-02-21T07:42:36.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f388c200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3884215b50 con 0x7f38840710d0 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f3889800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f388406ee60 0x7f388416bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f3888e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38840710d0 0x7f3884186c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f3889800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f388406ee60 0x7f388416bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39898/0 (socket says 172.21.15.69:39898) 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f3889800640 1 -- 172.21.15.69:0/2758427006 learned_addr learned my addr 172.21.15.69:0/2758427006 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f388a200640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3884188930 0x7f3884187160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f3888e00640 1 -- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3884188930 msgr2=0x7f3884187160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f3888e00640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3884188930 0x7f3884187160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f3888e00640 1 -- 172.21.15.69:0/2758427006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f388406ee60 msgr2=0x7f388416bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f3888e00640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f388406ee60 0x7f388416bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f3888e00640 1 -- 172.21.15.69:0/2758427006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c009a70 con 0x7f38840710d0 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.839+0000 7f388a200640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3884188930 0x7f3884187160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:36.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.840+0000 7f3888e00640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38840710d0 0x7f3884186c20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f387000e870 tx=0x7f387000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:36.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.840+0000 7f3881600640 1 -- 172.21.15.69:0/2758427006 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387000ee60 con 0x7f38840710d0 2024-02-21T07:42:36.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.840+0000 7f3881600640 1 -- 172.21.15.69:0/2758427006 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387000c940 con 0x7f38840710d0 2024-02-21T07:42:36.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.840+0000 7f3881600640 1 -- 172.21.15.69:0/2758427006 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387000ccd0 con 0x7f38840710d0 2024-02-21T07:42:36.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.840+0000 7f388c200640 1 -- 172.21.15.69:0/2758427006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38841799f0 con 0x7f38840710d0 2024-02-21T07:42:36.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.840+0000 7f388c200640 1 -- 172.21.15.69:0/2758427006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3884179fb0 con 0x7f38840710d0 2024-02-21T07:42:36.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.841+0000 7f388c200640 1 -- 172.21.15.69:0/2758427006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3884090420 con 0x7f38840710d0 2024-02-21T07:42:36.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.843+0000 7f3881600640 1 -- 172.21.15.69:0/2758427006 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f3870013470 con 0x7f38840710d0 2024-02-21T07:42:36.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.844+0000 7f3881600640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f386409f160 0x7f38640a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:36.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.845+0000 7f3881600640 1 -- 172.21.15.69:0/2758427006 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f38700ca340 con 0x7f38840710d0 2024-02-21T07:42:36.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.845+0000 7f3889800640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f386409f160 0x7f38640a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:36.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.846+0000 7f3889800640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f386409f160 0x7f38640a1620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3878005880 tx=0x7f3878009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:36.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:36.847+0000 7f3881600640 1 -- 172.21.15.69:0/2758427006 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3870094050 con 0x7f38840710d0 2024-02-21T07:42:37.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.088+0000 7f388c200640 1 -- 172.21.15.69:0/2758427006 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3884069d50 con 0x7f38840710d0 2024-02-21T07:42:37.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.093+0000 7f3881600640 1 -- 172.21.15.69:0/2758427006 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+257057 (secure 0 0 0) 0x7f3870021090 con 0x7f38840710d0 2024-02-21T07:42:37.103 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:37.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 -- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f386409f160 msgr2=0x7f38640a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f386409f160 0x7f38640a1620 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3878005880 tx=0x7f3878009040 comp rx=0 tx=0).stop 2024-02-21T07:42:37.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 -- 172.21.15.69:0/2758427006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38840710d0 msgr2=0x7f3884186c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38840710d0 0x7f3884186c20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f387000e870 tx=0x7f387000ed30 comp rx=0 tx=0).stop 2024-02-21T07:42:37.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 -- 172.21.15.69:0/2758427006 shutdown_connections 2024-02-21T07:42:37.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f386409f160 0x7f38640a1620 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3884188930 0x7f3884187160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38840710d0 0x7f3884186c20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 --2- 172.21.15.69:0/2758427006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f388406ee60 0x7f388416bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 -- 172.21.15.69:0/2758427006 >> 172.21.15.69:0/2758427006 conn(0x7f38840f8b00 msgr2=0x7f38840708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:37.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 -- 172.21.15.69:0/2758427006 shutdown_connections 2024-02-21T07:42:37.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.099+0000 7f388c200640 1 -- 172.21.15.69:0/2758427006 wait complete. 2024-02-21T07:42:37.123 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":6,"flags":0,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6800","nonce":1264070995},{"type":"v1","addr":"172.21.15.174:6801","nonce":1264070995}]},"active_addr":"172.21.15.174:6801/1264070995","active_change":"2024-02-21T07:41:46.430557+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4114,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":2784281539}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":1405780024}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":3466401943}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":945127065}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.174:0","nonce":349493210}]}]} 2024-02-21T07:42:37.127 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-21T07:42:37.128 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-21T07:42:37.128 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:37.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.352+0000 7f9c51800640 1 Processor -- start 2024-02-21T07:42:37.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.352+0000 7f9c51800640 1 -- start start 2024-02-21T07:42:37.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.354+0000 7f9c51800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9c4c0f9780 0x7f9c4c190270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.354+0000 7f9c51800640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c0f9e90 con 0x7f9c4c185da0 2024-02-21T07:42:37.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.354+0000 7f9c51800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c1869a0 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.354+0000 7f9c51800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c187620 con 0x7f9c4c0f9780 2024-02-21T07:42:37.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.354+0000 7f9c4aa00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9c4c185da0 0x7f9c4c0cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:43612/0 (socket says 172.21.15.69:43612) 2024-02-21T07:42:37.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.354+0000 7f9c4aa00640 1 -- 172.21.15.69:0/2865813167 learned_addr learned my addr 172.21.15.69:0/2865813167 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:37.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.354+0000 7f9c4b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9c4c0f9780 0x7f9c4c190270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.355+0000 7f9c49600640 1 -- 172.21.15.69:0/2865813167 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792454992 0 0) 0x7f9c4c0f9e90 con 0x7f9c4c185da0 2024-02-21T07:42:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.355+0000 7f9c49600640 1 -- 172.21.15.69:0/2865813167 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c30003520 con 0x7f9c4c185da0 2024-02-21T07:42:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.355+0000 7f9c4b400640 1 -- 172.21.15.69:0/2865813167 >> v1:172.21.15.184:6789/0 conn(0x7f9c4c0f8bc0 legacy=0x7f9c4c0f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.355+0000 7f9c49600640 1 -- 172.21.15.69:0/2865813167 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531624981 0 0) 0x7f9c4c1869a0 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.355+0000 7f9c4b400640 1 -- 172.21.15.69:0/2865813167 >> v1:172.21.15.174:6789/0 conn(0x7f9c4c185da0 legacy=0x7f9c4c0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.355+0000 7f9c4b400640 1 -- 172.21.15.69:0/2865813167 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c186c80 con 0x7f9c4c0f9780 2024-02-21T07:42:37.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.356+0000 7f9c4b400640 1 --2- 172.21.15.69:0/2865813167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f9780 0x7f9c4c190270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009d90 tx=0x7f9c4402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f167a79dd2f7be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:37.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.356+0000 7f9c49600640 1 -- 172.21.15.69:0/2865813167 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4402cbd0 con 0x7f9c4c0f9780 2024-02-21T07:42:37.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.356+0000 7f9c49600640 1 -- 172.21.15.69:0/2865813167 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4402cd30 con 0x7f9c4c0f9780 2024-02-21T07:42:37.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.356+0000 7f9c49600640 1 -- 172.21.15.69:0/2865813167 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4402cea0 con 0x7f9c4c0f9780 2024-02-21T07:42:37.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.357+0000 7f9c51800640 1 -- 172.21.15.69:0/2865813167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f9780 msgr2=0x7f9c4c190270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.357+0000 7f9c51800640 1 --2- 172.21.15.69:0/2865813167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f9780 0x7f9c4c190270 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009d90 tx=0x7f9c4402be20 comp rx=0 tx=0).stop 2024-02-21T07:42:37.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.357+0000 7f9c51800640 1 -- 172.21.15.69:0/2865813167 shutdown_connections 2024-02-21T07:42:37.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.357+0000 7f9c51800640 1 --2- 172.21.15.69:0/2865813167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f9780 0x7f9c4c190270 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.357+0000 7f9c51800640 1 -- 172.21.15.69:0/2865813167 >> 172.21.15.69:0/2865813167 conn(0x7f9c4c071b80 msgr2=0x7f9c4c0668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:37.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.357+0000 7f9c51800640 1 -- 172.21.15.69:0/2865813167 shutdown_connections 2024-02-21T07:42:37.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.357+0000 7f9c51800640 1 -- 172.21.15.69:0/2865813167 wait complete. 2024-02-21T07:42:37.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.359+0000 7f9c51800640 1 Processor -- start 2024-02-21T07:42:37.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.359+0000 7f9c51800640 1 -- start start 2024-02-21T07:42:37.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c51800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f8bc0 0x7f9c4c2225e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c51800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c4c0f9780 0x7f9c4c171d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c51800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c4c185da0 0x7f9c4c220e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c51800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c21fae0 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c51800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c21fdc0 con 0x7f9c4c185da0 2024-02-21T07:42:37.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c51800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c2200a0 con 0x7f9c4c0f9780 2024-02-21T07:42:37.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c4aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f8bc0 0x7f9c4c2225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c4b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c4c185da0 0x7f9c4c220e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c4aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f8bc0 0x7f9c4c2225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39912/0 (socket says 172.21.15.69:39912) 2024-02-21T07:42:37.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c4aa00640 1 -- 172.21.15.69:0/4145719330 learned_addr learned my addr 172.21.15.69:0/4145719330 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:37.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.360+0000 7f9c4a000640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c4c0f9780 0x7f9c4c171d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c4aa00640 1 -- 172.21.15.69:0/4145719330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c4c0f9780 msgr2=0x7f9c4c171d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c4aa00640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c4c0f9780 0x7f9c4c171d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c4aa00640 1 -- 172.21.15.69:0/4145719330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c4c185da0 msgr2=0x7f9c4c220e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c4aa00640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c4c185da0 0x7f9c4c220e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c4aa00640 1 -- 172.21.15.69:0/4145719330 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c44009a70 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c4b400640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c4c185da0 0x7f9c4c220e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:37.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c4aa00640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f8bc0 0x7f9c4c2225e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00c410 tx=0x7f9c3c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:37.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c42a00640 1 -- 172.21.15.69:0/4145719330 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c005ce0 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c42a00640 1 -- 172.21.15.69:0/4145719330 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c005e40 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c51800640 1 -- 172.21.15.69:0/4145719330 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c220380 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c42a00640 1 -- 172.21.15.69:0/4145719330 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c0072f0 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.361+0000 7f9c51800640 1 -- 172.21.15.69:0/4145719330 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c220940 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.363+0000 7f9c51800640 1 -- 172.21.15.69:0/4145719330 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c069d50 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.364+0000 7f9c42a00640 1 -- 172.21.15.69:0/4145719330 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f9c3c007450 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.365+0000 7f9c42a00640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9c2c09f160 0x7f9c2c0a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.366+0000 7f9c42a00640 1 -- 172.21.15.69:0/4145719330 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f9c3c0c9060 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.366+0000 7f9c4a000640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9c2c09f160 0x7f9c2c0a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.366+0000 7f9c4a000640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9c2c09f160 0x7f9c2c0a1620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c1783b0 tx=0x7f9c38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:37.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.370+0000 7f9c42a00640 1 -- 172.21.15.69:0/4145719330 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c3c096ad0 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.570+0000 7f9c51800640 1 -- 172.21.15.69:0/4145719330 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c4c174820 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.573+0000 7f9c42a00640 1 -- 172.21.15.69:0/4145719330 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7f9c3c096660 con 0x7f9c4c0f8bc0 2024-02-21T07:42:37.580 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:37.580 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:37.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.576+0000 7f9c51800640 1 -- 172.21.15.69:0/4145719330 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9c2c09f160 msgr2=0x7f9c2c0a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.576+0000 7f9c51800640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9c2c09f160 0x7f9c2c0a1620 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c1783b0 tx=0x7f9c38009040 comp rx=0 tx=0).stop 2024-02-21T07:42:37.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.576+0000 7f9c51800640 1 -- 172.21.15.69:0/4145719330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f8bc0 msgr2=0x7f9c4c2225e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.576+0000 7f9c51800640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f8bc0 0x7f9c4c2225e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00c410 tx=0x7f9c3c00c8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.576+0000 7f9c51800640 1 -- 172.21.15.69:0/4145719330 shutdown_connections 2024-02-21T07:42:37.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.576+0000 7f9c51800640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9c2c09f160 0x7f9c2c0a1620 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.576+0000 7f9c51800640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9c4c185da0 0x7f9c4c220e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.576+0000 7f9c51800640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9c4c0f9780 0x7f9c4c171d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.576+0000 7f9c51800640 1 --2- 172.21.15.69:0/4145719330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c4c0f8bc0 0x7f9c4c2225e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.576+0000 7f9c51800640 1 -- 172.21.15.69:0/4145719330 >> 172.21.15.69:0/4145719330 conn(0x7f9c4c071b80 msgr2=0x7f9c4c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:37.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.577+0000 7f9c51800640 1 -- 172.21.15.69:0/4145719330 shutdown_connections 2024-02-21T07:42:37.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.577+0000 7f9c51800640 1 -- 172.21.15.69:0/4145719330 wait complete. 2024-02-21T07:42:37.599 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-21T07:42:37.599 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:37.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.791+0000 7fa14ca00640 1 Processor -- start 2024-02-21T07:42:37.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.791+0000 7fa14ca00640 1 -- start start 2024-02-21T07:42:37.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.793+0000 7fa14ca00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa1480d65e0 0x7fa1480fe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.793+0000 7fa14ca00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1481897f0 con 0x7fa1480fd740 2024-02-21T07:42:37.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.793+0000 7fa14ca00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1480fdbd0 con 0x7fa14815dad0 2024-02-21T07:42:37.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.793+0000 7fa14ca00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1480fc3c0 con 0x7fa1480d65e0 2024-02-21T07:42:37.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.793+0000 7fa145e00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa1480fd740 0x7fa1480fe050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47746/0 (socket says 172.21.15.69:47746) 2024-02-21T07:42:37.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.793+0000 7fa145e00640 1 -- 172.21.15.69:0/3699455323 learned_addr learned my addr 172.21.15.69:0/3699455323 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:37.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa147200640 1 --2- 172.21.15.69:0/3699455323 >> v2:172.21.15.174:3300/0 conn(0x7fa1480d65e0 0x7fa1480fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269214286 0 0) 0x7fa1481897f0 con 0x7fa1480fd740 2024-02-21T07:42:37.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa12c003520 con 0x7fa1480fd740 2024-02-21T07:42:37.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292830357 0 0) 0x7fa1480fdbd0 con 0x7fa14815dad0 2024-02-21T07:42:37.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1481897f0 con 0x7fa14815dad0 2024-02-21T07:42:37.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3657495648 0 0) 0x7fa12c003520 con 0x7fa1480fd740 2024-02-21T07:42:37.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 >> v2:172.21.15.174:3300/0 conn(0x7fa1480d65e0 msgr2=0x7fa1480fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 --2- 172.21.15.69:0/3699455323 >> v2:172.21.15.174:3300/0 conn(0x7fa1480d65e0 0x7fa1480fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 >> v1:172.21.15.184:6789/0 conn(0x7fa14815dad0 legacy=0x7fa148189d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480fc6a0 con 0x7fa1480fd740 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7fa134001670 con 0x7fa1480fd740 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 >> v1:172.21.15.69:6789/0 conn(0x7fa1480fd740 legacy=0x7fa1480fe050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.794+0000 7fa145400640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c003b50 0x7fa12c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa145400640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa12c0047c0 0x7fa12c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa145400640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa12c005240 0x7fa12c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480fc3c0 con 0x7fa12c0047c0 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c00c180 con 0x7fa12c005240 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c00c340 con 0x7fa12c003b50 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa146800640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c003b50 0x7fa12c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa145e00640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa12c0047c0 0x7fa12c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa147200640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa12c005240 0x7fa12c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa147200640 1 -- 172.21.15.69:0/3699455323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c003b50 msgr2=0x7fa12c003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:37.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa147200640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c003b50 0x7fa12c003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa147200640 1 -- 172.21.15.69:0/3699455323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa12c0047c0 msgr2=0x7fa12c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:37.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa147200640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa12c0047c0 0x7fa12c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa147200640 1 -- 172.21.15.69:0/3699455323 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c003520 con 0x7fa12c005240 2024-02-21T07:42:37.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa146800640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c003b50 0x7fa12c003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:37.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.795+0000 7fa145e00640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa12c0047c0 0x7fa12c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:37.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.796+0000 7fa147200640 1 -- 172.21.15.69:0/3699455323 reap_dead start 2024-02-21T07:42:37.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.796+0000 7fa147200640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa12c005240 0x7fa12c00b980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa140009fc0 tx=0x7fa12c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe36eb1896319720 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:37.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.797+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14002cc30 con 0x7fa12c005240 2024-02-21T07:42:37.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.797+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14000f040 con 0x7fa12c005240 2024-02-21T07:42:37.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.797+0000 7fa145400640 1 -- 172.21.15.69:0/3699455323 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140003990 con 0x7fa12c005240 2024-02-21T07:42:37.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.797+0000 7fa14ca00640 1 -- 172.21.15.69:0/3699455323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa12c005240 msgr2=0x7fa12c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.797+0000 7fa14ca00640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa12c005240 0x7fa12c00b980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa140009fc0 tx=0x7fa12c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.797+0000 7fa14ca00640 1 -- 172.21.15.69:0/3699455323 shutdown_connections 2024-02-21T07:42:37.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.797+0000 7fa14ca00640 1 --2- 172.21.15.69:0/3699455323 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa12c005240 0x7fa12c00b980 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.797+0000 7fa14ca00640 1 -- 172.21.15.69:0/3699455323 >> 172.21.15.69:0/3699455323 conn(0x7fa1480d2c90 msgr2=0x7fa1480d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:37.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.797+0000 7fa14ca00640 1 -- 172.21.15.69:0/3699455323 shutdown_connections 2024-02-21T07:42:37.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.797+0000 7fa14ca00640 1 -- 172.21.15.69:0/3699455323 wait complete. 2024-02-21T07:42:37.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.800+0000 7fa14ca00640 1 Processor -- start 2024-02-21T07:42:37.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.800+0000 7fa14ca00640 1 -- start start 2024-02-21T07:42:37.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.801+0000 7fa14ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c005240 0x7fa148222660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.801+0000 7fa14ca00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa148181850 0x7fa1481545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.801+0000 7fa14ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa148154b00 0x7fa1480d1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.801+0000 7fa14ca00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa148157200 con 0x7fa148154b00 2024-02-21T07:42:37.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.801+0000 7fa14ca00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1481574e0 con 0x7fa148181850 2024-02-21T07:42:37.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.801+0000 7fa14ca00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480d0a20 con 0x7fa12c005240 2024-02-21T07:42:37.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa147200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa148154b00 0x7fa1480d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa145e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa148181850 0x7fa1481545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa145e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa148181850 0x7fa1481545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:51028/0 (socket says 172.21.15.69:51028) 2024-02-21T07:42:37.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa146800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c005240 0x7fa148222660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa145e00640 1 -- 172.21.15.69:0/2082816856 learned_addr learned my addr 172.21.15.69:0/2082816856 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:37.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa146800640 1 -- 172.21.15.69:0/2082816856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa148181850 msgr2=0x7fa1481545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa146800640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa148181850 0x7fa1481545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa146800640 1 -- 172.21.15.69:0/2082816856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa148154b00 msgr2=0x7fa1480d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:37.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa146800640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa148154b00 0x7fa1480d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:37.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa146800640 1 -- 172.21.15.69:0/2082816856 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480d0d00 con 0x7fa12c005240 2024-02-21T07:42:37.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa145e00640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa148181850 0x7fa1481545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:37.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa147200640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa148154b00 0x7fa1480d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:37.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.802+0000 7fa146800640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c005240 0x7fa148222660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa13800f6f0 tx=0x7fa13800faf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:37.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.803+0000 7fa13ea00640 1 -- 172.21.15.69:0/2082816856 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1380053a0 con 0x7fa12c005240 2024-02-21T07:42:37.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.803+0000 7fa13ea00640 1 -- 172.21.15.69:0/2082816856 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1380035f0 con 0x7fa12c005240 2024-02-21T07:42:37.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.803+0000 7fa13ea00640 1 -- 172.21.15.69:0/2082816856 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138003980 con 0x7fa12c005240 2024-02-21T07:42:37.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.803+0000 7fa14ca00640 1 -- 172.21.15.69:0/2082816856 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1480d0fe0 con 0x7fa12c005240 2024-02-21T07:42:37.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.803+0000 7fa14ca00640 1 -- 172.21.15.69:0/2082816856 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1480d1c20 con 0x7fa12c005240 2024-02-21T07:42:37.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.804+0000 7fa14ca00640 1 -- 172.21.15.69:0/2082816856 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14806cba0 con 0x7fa12c005240 2024-02-21T07:42:37.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.807+0000 7fa13ea00640 1 -- 172.21.15.69:0/2082816856 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fa138003ae0 con 0x7fa12c005240 2024-02-21T07:42:37.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.808+0000 7fa13ea00640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa12809f160 0x7fa1280a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:37.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.808+0000 7fa13ea00640 1 -- 172.21.15.69:0/2082816856 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa1380c9b70 con 0x7fa12c005240 2024-02-21T07:42:37.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.809+0000 7fa145e00640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa12809f160 0x7fa1280a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.809+0000 7fa145e00640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa12809f160 0x7fa1280a1620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa1480d0820 tx=0x7fa134001e00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:37.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:37.813+0000 7fa13ea00640 1 -- 172.21.15.69:0/2082816856 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa138093880 con 0x7fa12c005240 2024-02-21T07:42:38.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.007+0000 7fa14ca00640 1 -- 172.21.15.69:0/2082816856 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1480d0880 con 0x7fa12c005240 2024-02-21T07:42:38.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.009+0000 7fa13ea00640 1 -- 172.21.15.69:0/2082816856 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7fa1480d0880 con 0x7fa12c005240 2024-02-21T07:42:38.016 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:38.016 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 -- 172.21.15.69:0/2082816856 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa12809f160 msgr2=0x7fa1280a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa12809f160 0x7fa1280a1620 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa1480d0820 tx=0x7fa134001e00 comp rx=0 tx=0).stop 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 -- 172.21.15.69:0/2082816856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c005240 msgr2=0x7fa148222660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c005240 0x7fa148222660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa13800f6f0 tx=0x7fa13800faf0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 -- 172.21.15.69:0/2082816856 shutdown_connections 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa12809f160 0x7fa1280a1620 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa148154b00 0x7fa1480d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa148181850 0x7fa1481545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 --2- 172.21.15.69:0/2082816856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa12c005240 0x7fa148222660 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 -- 172.21.15.69:0/2082816856 >> 172.21.15.69:0/2082816856 conn(0x7fa1480d2c90 msgr2=0x7fa148189980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 -- 172.21.15.69:0/2082816856 shutdown_connections 2024-02-21T07:42:38.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.012+0000 7fa14ca00640 1 -- 172.21.15.69:0/2082816856 wait complete. 2024-02-21T07:42:38.035 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-21T07:42:38.036 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-21T07:42:38.036 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-21T07:42:38.036 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-21T07:42:38.037 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-21T07:42:38.037 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-21T07:42:38.038 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-21T07:42:38.038 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-21T07:42:38.038 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-02-21T07:42:38.039 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-02-21T07:42:38.039 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-02-21T07:42:38.040 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-02-21T07:42:38.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.436+0000 7f6cd7800640 1 Processor -- start 2024-02-21T07:42:38.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.436+0000 7f6cd7800640 1 -- start start 2024-02-21T07:42:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.439+0000 7f6cd7800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6cd0182bb0 0x7f6cd008ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.439+0000 7f6cd7800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6cd008f160 0x7f6cd008f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.439+0000 7f377ae00640 1 Processor -- start 2024-02-21T07:42:38.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.439+0000 7f6cd7800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd0189f40 con 0x7f6cd01827d0 2024-02-21T07:42:38.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.439+0000 7f6cd7800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd018b080 con 0x7f6cd0182bb0 2024-02-21T07:42:38.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.439+0000 7f6cd7800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd018a190 con 0x7f6cd008f160 2024-02-21T07:42:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.439+0000 7f377ae00640 1 -- start start 2024-02-21T07:42:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.439+0000 7f6cd5800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6cd008f160 0x7f6cd008f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.441+0000 7f6ccfe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6cd0182bb0 0x7f6cd008ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.441+0000 7f6cd4e00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f6cd01827d0 0x7f6cd018b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:57130/0 (socket says 172.21.15.69:57130) 2024-02-21T07:42:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.441+0000 7f6cd4e00640 1 -- 172.21.15.69:0/771023879 learned_addr learned my addr 172.21.15.69:0/771023879 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:38.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.441+0000 7f51cd800640 1 Processor -- start 2024-02-21T07:42:38.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.441+0000 7f51cd800640 1 -- start start 2024-02-21T07:42:38.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.443+0000 7f6cd5800640 1 -- 172.21.15.69:0/771023879 >> v2:172.21.15.174:3300/0 conn(0x7f6cd0182bb0 msgr2=0x7f6cd008ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.443+0000 7f6cd5800640 1 --2- 172.21.15.69:0/771023879 >> v2:172.21.15.174:3300/0 conn(0x7f6cd0182bb0 0x7f6cd008ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.443+0000 7f6cd5800640 1 -- 172.21.15.69:0/771023879 >> v1:172.21.15.184:6789/0 conn(0x7f6cd01827d0 legacy=0x7f6cd018b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.443+0000 7f6cd5800640 1 -- 172.21.15.69:0/771023879 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd018a470 con 0x7f6cd008f160 2024-02-21T07:42:38.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.442+0000 7f377ae00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f37740cab70 0x7f37740cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.442+0000 7f377ae00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377406e970 con 0x7f3774184680 2024-02-21T07:42:38.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.442+0000 7f377ae00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377406eba0 con 0x7f3774180900 2024-02-21T07:42:38.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.442+0000 7f377ae00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377406fb00 con 0x7f37740cab70 2024-02-21T07:42:38.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.443+0000 7f3779a00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3774180900 0x7f377406e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:57140/0 (socket says 172.21.15.69:57140) 2024-02-21T07:42:38.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.443+0000 7f3779a00640 1 -- 172.21.15.69:0/2096306433 learned_addr learned my addr 172.21.15.69:0/2096306433 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:38.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.443+0000 7f377a400640 1 --2- 172.21.15.69:0/2096306433 >> v2:172.21.15.184:3300/0 conn(0x7f37740cab70 0x7f37740cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.444+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691758134 0 0) 0x7f377406eba0 con 0x7f3774180900 2024-02-21T07:42:38.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.444+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f375c003520 con 0x7f3774180900 2024-02-21T07:42:38.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.444+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522996590 0 0) 0x7f377406e970 con 0x7f3774184680 2024-02-21T07:42:38.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.444+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f375c003840 con 0x7f3774184680 2024-02-21T07:42:38.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 87072910 0 0) 0x7f375c003840 con 0x7f3774184680 2024-02-21T07:42:38.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 >> v2:172.21.15.184:3300/0 conn(0x7f37740cab70 msgr2=0x7f37740cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 --2- 172.21.15.69:0/2096306433 >> v2:172.21.15.184:3300/0 conn(0x7f37740cab70 0x7f37740cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 >> v1:172.21.15.184:6789/0 conn(0x7f3774180900 legacy=0x7f377406e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377406ee80 con 0x7f3774184680 2024-02-21T07:42:38.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f376c0019d0 con 0x7f3774184680 2024-02-21T07:42:38.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 >> v1:172.21.15.69:6789/0 conn(0x7f3774184680 legacy=0x7f3774184b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 0x7f375c004150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f375c004810 0x7f375c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.447+0000 7f51cd800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f51c8180900 0x7f51c806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375c0053a0 0x7f375c00ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377406fb00 con 0x7f375c003d10 2024-02-21T07:42:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c00c2e0 con 0x7f375c004810 2024-02-21T07:42:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.445+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c00c4a0 con 0x7f375c0053a0 2024-02-21T07:42:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.446+0000 7f377a400640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375c0053a0 0x7f375c00ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.447+0000 7f3779a00640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 0x7f375c004150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.447+0000 7f3779000640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f375c004810 0x7f375c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.448+0000 7f51c7e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f51c8180900 0x7f51c806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.449+0000 7f51c7400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f51c8184680 0x7f51c8184b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:43616/0 (socket says 172.21.15.69:43616) 2024-02-21T07:42:38.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.449+0000 7f51c7e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f51c8180900 0x7f51c806e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:60936/0 (socket says 172.21.15.69:60936) 2024-02-21T07:42:38.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.449+0000 7f51c7400640 1 -- 172.21.15.69:0/3598053437 learned_addr learned my addr 172.21.15.69:0/3598053437 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.448+0000 7f3779a00640 1 -- 172.21.15.69:0/2096306433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375c0053a0 msgr2=0x7f375c00ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.448+0000 7f3779a00640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f375c0053a0 0x7f375c00ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.448+0000 7f3779a00640 1 -- 172.21.15.69:0/2096306433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f375c004810 msgr2=0x7f375c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.448+0000 7f3779a00640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f375c004810 0x7f375c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.448+0000 7f3779a00640 1 -- 172.21.15.69:0/2096306433 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377406ee80 con 0x7f375c003d10 2024-02-21T07:42:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.448+0000 7f3779000640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f375c004810 0x7f375c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.448+0000 7f377a400640 1 -- 172.21.15.69:0/2096306433 reap_dead start 2024-02-21T07:42:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.452+0000 7f51cd800640 1 -- 172.21.15.69:0/3598053437 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c806eba0 con 0x7f51c8184680 2024-02-21T07:42:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.452+0000 7f51cd800640 1 -- 172.21.15.69:0/3598053437 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c806ee80 con 0x7f51c80f81f0 2024-02-21T07:42:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.452+0000 7f51cd800640 1 -- 172.21.15.69:0/3598053437 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c806fb00 con 0x7f51c8180900 2024-02-21T07:42:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.453+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663828605 0 0) 0x7f51c806eba0 con 0x7f51c8184680 2024-02-21T07:42:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.453+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ac003520 con 0x7f51c8184680 2024-02-21T07:42:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.453+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694263197 0 0) 0x7f51c806ee80 con 0x7f51c80f81f0 2024-02-21T07:42:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.453+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c806eba0 con 0x7f51c80f81f0 2024-02-21T07:42:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.451+0000 7f6cd5800640 1 --2- 172.21.15.69:0/771023879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd008f160 0x7f6cd008f5d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00fe240 tx=0x7f6cc802be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e49e1d70feefcb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.451+0000 7f6ccf400640 1 -- 172.21.15.69:0/771023879 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc802cc20 con 0x7f6cd008f160 2024-02-21T07:42:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.451+0000 7f6ccf400640 1 -- 172.21.15.69:0/771023879 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc802cd80 con 0x7f6cd008f160 2024-02-21T07:42:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.451+0000 7f6ccf400640 1 -- 172.21.15.69:0/771023879 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8034660 con 0x7f6cd008f160 2024-02-21T07:42:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.452+0000 7f6cd7800640 1 -- 172.21.15.69:0/771023879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd008f160 msgr2=0x7f6cd008f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.452+0000 7f6cd7800640 1 --2- 172.21.15.69:0/771023879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd008f160 0x7f6cd008f5d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00fe240 tx=0x7f6cc802be70 comp rx=0 tx=0).stop 2024-02-21T07:42:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.453+0000 7f6cd7800640 1 -- 172.21.15.69:0/771023879 shutdown_connections 2024-02-21T07:42:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.453+0000 7f6cd7800640 1 --2- 172.21.15.69:0/771023879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd008f160 0x7f6cd008f5d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.453+0000 7f6cd7800640 1 --2- 172.21.15.69:0/771023879 >> v2:172.21.15.174:3300/0 conn(0x7f6cd0182bb0 0x7f6cd008ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.453+0000 7f6cd7800640 1 -- 172.21.15.69:0/771023879 >> 172.21.15.69:0/771023879 conn(0x7f6cd00d28c0 msgr2=0x7f6cd00d2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.453+0000 7f6cd7800640 1 -- 172.21.15.69:0/771023879 shutdown_connections 2024-02-21T07:42:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.453+0000 7f6cd7800640 1 -- 172.21.15.69:0/771023879 wait complete. 2024-02-21T07:42:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1719582225 0 0) 0x7f51ac003520 con 0x7f51c8184680 2024-02-21T07:42:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 >> v2:172.21.15.184:3300/0 conn(0x7f51c8180900 msgr2=0x7f51c806e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f51c6a00640 1 --2- 172.21.15.69:0/3598053437 >> v2:172.21.15.184:3300/0 conn(0x7f51c8180900 0x7f51c806e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 >> v1:172.21.15.184:6789/0 conn(0x7f51c80f81f0 legacy=0x7f51c80f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c806f160 con 0x7f51c8184680 2024-02-21T07:42:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.457+0000 7efe07800640 1 Processor -- start 2024-02-21T07:42:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.458+0000 7efe07800640 1 -- start start 2024-02-21T07:42:38.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f51b40015a0 con 0x7f51c8184680 2024-02-21T07:42:38.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 >> v1:172.21.15.174:6789/0 conn(0x7f51c8184680 legacy=0x7f51c8184b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f51c6a00640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac003bd0 0x7f51ac003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f51c6a00640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac0047c0 0x7f51ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f51c6a00640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0052f0 0x7f51ac00ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.455+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c0001530 con 0x7f51ac003bd0 2024-02-21T07:42:38.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.455+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c806fb00 con 0x7f51ac0047c0 2024-02-21T07:42:38.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.455+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ac00c310 con 0x7f51ac0052f0 2024-02-21T07:42:38.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.455+0000 7f51c7e00640 1 --2- 172.21.15.69:0/3598053437 >> v2:172.21.15.184:3300/0 conn(0x7f51c8180900 0x7f51c806e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:38.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.456+0000 7f51cce00640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0052f0 0x7f51ac00ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.456+0000 7f51c7400640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac0047c0 0x7f51ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.457+0000 7f51cce00640 1 -- 172.21.15.69:0/3598053437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac0047c0 msgr2=0x7f51ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.457+0000 7f51cce00640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac0047c0 0x7f51ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.457+0000 7f51cce00640 1 -- 172.21.15.69:0/3598053437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac003bd0 msgr2=0x7f51ac003fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:38.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.461+0000 7f51c7e00640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac003bd0 0x7f51ac003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.461+0000 7f51cce00640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac003bd0 0x7f51ac003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.461+0000 7f51cce00640 1 -- 172.21.15.69:0/3598053437 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac003520 con 0x7f51ac0052f0 2024-02-21T07:42:38.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.460+0000 7f6cd7800640 1 Processor -- start 2024-02-21T07:42:38.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.463+0000 7f6cd7800640 1 -- start start 2024-02-21T07:42:38.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.464+0000 7efe07800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efe001840b0 0x7efe000f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.464+0000 7efe07800640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe00184490 con 0x7efe000cd090 2024-02-21T07:42:38.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.462+0000 7f51c7e00640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51ac003bd0 0x7f51ac003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:38.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.450+0000 7f3779a00640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 0x7f375c004150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3760001b90 tx=0x7f375c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b27cb0476a28a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.451+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760005ad0 con 0x7f375c003d10 2024-02-21T07:42:38.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.451+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3760005c30 con 0x7f375c003d10 2024-02-21T07:42:38.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.452+0000 7f377ae00640 1 -- 172.21.15.69:0/2096306433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 msgr2=0x7f375c004150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.452+0000 7f3773e00640 1 -- 172.21.15.69:0/2096306433 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760005ad0 con 0x7f375c003d10 2024-02-21T07:42:38.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.452+0000 7f377ae00640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 0x7f375c004150 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3760001b90 tx=0x7f375c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f377ae00640 1 -- 172.21.15.69:0/2096306433 shutdown_connections 2024-02-21T07:42:38.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f377ae00640 1 --2- 172.21.15.69:0/2096306433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 0x7f375c004150 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.454+0000 7f377ae00640 1 -- 172.21.15.69:0/2096306433 >> 172.21.15.69:0/2096306433 conn(0x7f37740ce290 msgr2=0x7f37740ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.455+0000 7f377ae00640 1 -- 172.21.15.69:0/2096306433 shutdown_connections 2024-02-21T07:42:38.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.455+0000 7f377ae00640 1 -- 172.21.15.69:0/2096306433 wait complete. 2024-02-21T07:42:38.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.463+0000 7f377ae00640 1 Processor -- start 2024-02-21T07:42:38.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.465+0000 7f377ae00640 1 -- start start 2024-02-21T07:42:38.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.464+0000 7efe04e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efe001840b0 0x7efe000f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.465+0000 7efdffe00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7efe000cd090 0x7efe00188270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:43626/0 (socket says 172.21.15.69:43626) 2024-02-21T07:42:38.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.463+0000 7f51cce00640 1 -- 172.21.15.69:0/3598053437 reap_dead start 2024-02-21T07:42:38.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.465+0000 7efdffe00640 1 -- 172.21.15.69:0/2336226653 learned_addr learned my addr 172.21.15.69:0/2336226653 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:38.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.466+0000 7efe07800640 1 -- 172.21.15.69:0/2336226653 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe001877d0 con 0x7efe00188980 2024-02-21T07:42:38.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.466+0000 7f51cce00640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0052f0 0x7f51ac00ba00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51c0012a80 tx=0x7f51ac0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c374f7b55a97a62 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.467+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0003b70 con 0x7f51ac0052f0 2024-02-21T07:42:38.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.467+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0003cf0 con 0x7f51ac0052f0 2024-02-21T07:42:38.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.467+0000 7f51c6a00640 1 -- 172.21.15.69:0/3598053437 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0012310 con 0x7f51ac0052f0 2024-02-21T07:42:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.466+0000 7efe07800640 1 -- 172.21.15.69:0/2336226653 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000cd650 con 0x7efe001840b0 2024-02-21T07:42:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.468+0000 7efdff400640 1 -- 172.21.15.69:0/2336226653 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178846569 0 0) 0x7efdf4001110 con 0x7efe000cd090 2024-02-21T07:42:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.468+0000 7efdff400640 1 -- 172.21.15.69:0/2336226653 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde8003520 con 0x7efe000cd090 2024-02-21T07:42:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.468+0000 7efdff400640 1 -- 172.21.15.69:0/2336226653 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557590415 0 0) 0x7efe001877d0 con 0x7efe00188980 2024-02-21T07:42:38.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.468+0000 7f51cd800640 1 -- 172.21.15.69:0/3598053437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0052f0 msgr2=0x7f51ac00ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.468+0000 7efdff400640 1 -- 172.21.15.69:0/2336226653 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf4001110 con 0x7efe00188980 2024-02-21T07:42:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.469+0000 7f51cd800640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0052f0 0x7f51ac00ba00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51c0012a80 tx=0x7f51ac0057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.469+0000 7efe04e00640 1 -- 172.21.15.69:0/2336226653 >> v1:172.21.15.184:6789/0 conn(0x7efe00188980 legacy=0x7efe0006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.469+0000 7efe04e00640 1 -- 172.21.15.69:0/2336226653 >> v1:172.21.15.174:6789/0 conn(0x7efe000cd090 legacy=0x7efe00188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.469+0000 7efe04e00640 1 -- 172.21.15.69:0/2336226653 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000cd930 con 0x7efe001840b0 2024-02-21T07:42:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.470+0000 7f51cd800640 1 -- 172.21.15.69:0/3598053437 shutdown_connections 2024-02-21T07:42:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.470+0000 7f51cd800640 1 --2- 172.21.15.69:0/3598053437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51ac0052f0 0x7f51ac00ba00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.470+0000 7f51cd800640 1 -- 172.21.15.69:0/3598053437 >> 172.21.15.69:0/3598053437 conn(0x7f51c80ce290 msgr2=0x7f51c80ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.470+0000 7f51cd800640 1 -- 172.21.15.69:0/3598053437 shutdown_connections 2024-02-21T07:42:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.470+0000 7f51cd800640 1 -- 172.21.15.69:0/3598053437 wait complete. 2024-02-21T07:42:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.469+0000 7f7bb6e00640 1 Processor -- start 2024-02-21T07:42:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.469+0000 7f7bb6e00640 1 -- start start 2024-02-21T07:42:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.467+0000 7f377ae00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 0x7f3774239c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.467+0000 7f377ae00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f377423cd20 0x7f377423d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.467+0000 7f377ae00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f377417eb50 0x7f377417efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.467+0000 7f377ae00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377423d6e0 con 0x7f375c003d10 2024-02-21T07:42:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.467+0000 7f377ae00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740f9a90 con 0x7f377423cd20 2024-02-21T07:42:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.467+0000 7f377ae00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740f8ba0 con 0x7f377417eb50 2024-02-21T07:42:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.472+0000 7f1f2f000640 1 Processor -- start 2024-02-21T07:42:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.472+0000 7f1f2f000640 1 -- start start 2024-02-21T07:42:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.472+0000 7f6cd7800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd008f160 0x7f6cd0172480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.472+0000 7f6cd7800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd01827d0 0x7f6cd017a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.472+0000 7f6cd7800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd0182bb0 0x7f6cd017aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.473+0000 7f3779a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 0x7f3774239c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.473+0000 7efe04e00640 1 --2- 172.21.15.69:0/2336226653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe001840b0 0x7efe000f62c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efdec0097a0 tx=0x7efdec02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d67bbae350802c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.473+0000 7f3779a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 0x7f3774239c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39966/0 (socket says 172.21.15.69:39966) 2024-02-21T07:42:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.474+0000 7f6cd5800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd0182bb0 0x7f6cd017aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.474+0000 7f6cd5800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd0182bb0 0x7f6cd017aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:51072/0 (socket says 172.21.15.69:51072) 2024-02-21T07:42:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.474+0000 7f6cd5800640 1 -- 172.21.15.69:0/1148696122 learned_addr learned my addr 172.21.15.69:0/1148696122 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.474+0000 7f6ccfe00640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd01827d0 0x7f6cd017a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.474+0000 7f3779a00640 1 -- 172.21.15.69:0/462299960 learned_addr learned my addr 172.21.15.69:0/462299960 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.475+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd015a930 con 0x7f6cd01827d0 2024-02-21T07:42:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.475+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd015ab80 con 0x7f6cd0182bb0 2024-02-21T07:42:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.475+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd015ae60 con 0x7f6cd008f160 2024-02-21T07:42:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.475+0000 7f6cd4e00640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd008f160 0x7f6cd0172480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.474+0000 7f3779000640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f377423cd20 0x7f377423d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.475+0000 7f1f2f000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1f28181940 0x7f1f280f4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.475+0000 7f1f2f000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1f28182fd0 0x7f1f28184bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.475+0000 7f377a400640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f377417eb50 0x7f377417efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.476+0000 7f1f2f000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f280f6100 con 0x7f1f28181d20 2024-02-21T07:42:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.476+0000 7f1f2f000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f280f5210 con 0x7f1f28182fd0 2024-02-21T07:42:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.476+0000 7f7bb6e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7bb018a430 0x7f7bb00f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.476+0000 7f1f2f000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f280f54f0 con 0x7f1f28181940 2024-02-21T07:42:38.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7efdff400640 1 -- 172.21.15.69:0/2336226653 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec02e070 con 0x7efe001840b0 2024-02-21T07:42:38.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7f1f27e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1f28181940 0x7f1f280f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7efdff400640 1 -- 172.21.15.69:0/2336226653 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec0315a0 con 0x7efe001840b0 2024-02-21T07:42:38.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7efdff400640 1 -- 172.21.15.69:0/2336226653 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec031930 con 0x7efe001840b0 2024-02-21T07:42:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7f1f27e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1f28181940 0x7f1f280f4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:60986/0 (socket says 172.21.15.69:60986) 2024-02-21T07:42:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7f1f27e00640 1 -- 172.21.15.69:0/3744695581 learned_addr learned my addr 172.21.15.69:0/3744695581 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.476+0000 7f6cd4e00640 1 -- 172.21.15.69:0/1148696122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd0182bb0 msgr2=0x7f6cd017aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.476+0000 7f6cd4e00640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6cd0182bb0 0x7f6cd017aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7f3779000640 1 -- 172.21.15.69:0/462299960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f377417eb50 msgr2=0x7f377417efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7f3779000640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f377417eb50 0x7f377417efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7f3779000640 1 -- 172.21.15.69:0/462299960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 msgr2=0x7f3774239c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7f3779000640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f375c003d10 0x7f3774239c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7f3779000640 1 -- 172.21.15.69:0/462299960 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37740f8e80 con 0x7f377423cd20 2024-02-21T07:42:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f51cd800640 1 Processor -- start 2024-02-21T07:42:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.477+0000 7f7bb6e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7bb006ecb0 0x7f7bb018abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f7bb6e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7bb018b0f0 0x7f7bb006cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f7bb6e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb00f4f50 con 0x7f7bb006ecb0 2024-02-21T07:42:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f7bb6e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb00f5230 con 0x7f7bb018b0f0 2024-02-21T07:42:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f7bb6e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb00f5510 con 0x7f7bb018a430 2024-02-21T07:42:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.478+0000 7f3779000640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f377423cd20 0x7f377423d1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f376c00db30 tx=0x7f376c001aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f3771600640 1 -- 172.21.15.69:0/462299960 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c003d80 con 0x7f377423cd20 2024-02-21T07:42:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f3771600640 1 -- 172.21.15.69:0/462299960 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c016020 con 0x7f377423cd20 2024-02-21T07:42:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f3771600640 1 -- 172.21.15.69:0/462299960 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c00ba50 con 0x7f377423cd20 2024-02-21T07:42:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.478+0000 7f1f27e00640 1 -- 172.21.15.69:0/3744695581 >> v2:172.21.15.69:3300/0 conn(0x7f1f28182fd0 msgr2=0x7f1f28184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.478+0000 7f1f2d000640 1 --2- 172.21.15.69:0/3744695581 >> v2:172.21.15.69:3300/0 conn(0x7f1f28182fd0 0x7f1f28184bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.478+0000 7f1f27e00640 1 --2- 172.21.15.69:0/3744695581 >> v2:172.21.15.69:3300/0 conn(0x7f1f28182fd0 0x7f1f28184bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.478+0000 7f1f27e00640 1 -- 172.21.15.69:0/3744695581 >> v1:172.21.15.69:6789/0 conn(0x7f1f28181d20 legacy=0x7f1f281828c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.479+0000 7f1f27e00640 1 -- 172.21.15.69:0/3744695581 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f280f57d0 con 0x7f1f28181940 2024-02-21T07:42:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.479+0000 7f1f2d000640 1 --2- 172.21.15.69:0/3744695581 >> v2:172.21.15.69:3300/0 conn(0x7f1f28182fd0 0x7f1f28184bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.476+0000 7f6cd4e00640 1 -- 172.21.15.69:0/1148696122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd01827d0 msgr2=0x7f6cd017a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f7bb5a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7bb018a430 0x7f7bb00f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f7bb5a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7bb018a430 0x7f7bb00f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:60996/0 (socket says 172.21.15.69:60996) 2024-02-21T07:42:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f7bb5a00640 1 -- 172.21.15.69:0/859048059 learned_addr learned my addr 172.21.15.69:0/859048059 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f1f27e00640 1 --2- 172.21.15.69:0/3744695581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f28181940 0x7f1f280f4970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f280748e0 tx=0x7f1f1402b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22e40f7349d4f754 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.476+0000 7f6cd4e00640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd01827d0 0x7f6cd017a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.481+0000 7f1f26a00640 1 -- 172.21.15.69:0/3744695581 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f140317e0 con 0x7f1f28181940 2024-02-21T07:42:38.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.481+0000 7f1f26a00640 1 -- 172.21.15.69:0/3744695581 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f14031940 con 0x7f1f28181940 2024-02-21T07:42:38.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.482+0000 7efe07800640 1 -- 172.21.15.69:0/2336226653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe001840b0 msgr2=0x7efe000f62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.482+0000 7efe07800640 1 --2- 172.21.15.69:0/2336226653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe001840b0 0x7efe000f62c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efdec0097a0 tx=0x7efdec02b840 comp rx=0 tx=0).stop 2024-02-21T07:42:38.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.481+0000 7f1f26a00640 1 -- 172.21.15.69:0/3744695581 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14031cd0 con 0x7f1f28181940 2024-02-21T07:42:38.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.482+0000 7f1f2f000640 1 -- 172.21.15.69:0/3744695581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f28181940 msgr2=0x7f1f280f4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.482+0000 7f1f2f000640 1 --2- 172.21.15.69:0/3744695581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f28181940 0x7f1f280f4970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f280748e0 tx=0x7f1f1402b880 comp rx=0 tx=0).stop 2024-02-21T07:42:38.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.483+0000 7f377ae00640 1 -- 172.21.15.69:0/462299960 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37740f9160 con 0x7f377423cd20 2024-02-21T07:42:38.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.483+0000 7f377ae00640 1 -- 172.21.15.69:0/462299960 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37740f9720 con 0x7f377423cd20 2024-02-21T07:42:38.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.483+0000 7f1f2f000640 1 -- 172.21.15.69:0/3744695581 shutdown_connections 2024-02-21T07:42:38.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.483+0000 7f1f2f000640 1 --2- 172.21.15.69:0/3744695581 >> v2:172.21.15.69:3300/0 conn(0x7f1f28182fd0 0x7f1f28184bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.483+0000 7f1f2f000640 1 --2- 172.21.15.69:0/3744695581 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f28181940 0x7f1f280f4970 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.483+0000 7f1f2f000640 1 -- 172.21.15.69:0/3744695581 >> 172.21.15.69:0/3744695581 conn(0x7f1f280f69c0 msgr2=0x7f1f280f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.476+0000 7f6cd4e00640 1 -- 172.21.15.69:0/1148696122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8009a70 con 0x7f6cd008f160 2024-02-21T07:42:38.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.480+0000 7f51cd800640 1 -- start start 2024-02-21T07:42:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.478+0000 7f6cd4e00640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd008f160 0x7f6cd0172480 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400c440 tx=0x7f6cc4001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.478+0000 7f6cccc00640 1 -- 172.21.15.69:0/1148696122 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4005ce0 con 0x7f6cd008f160 2024-02-21T07:42:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.481+0000 7f7bb6400640 1 --2- 172.21.15.69:0/859048059 >> v2:172.21.15.174:3300/0 conn(0x7f7bb018b0f0 0x7f7bb006cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.481+0000 7f7bb5000640 1 --2- 172.21.15.69:0/859048059 >> v2:172.21.15.69:3300/0 conn(0x7f7bb006ecb0 0x7f7bb018abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.478+0000 7f6cccc00640 1 -- 172.21.15.69:0/1148696122 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc4005e40 con 0x7f6cd008f160 2024-02-21T07:42:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.478+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd015b140 con 0x7f6cd008f160 2024-02-21T07:42:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.479+0000 7f6cccc00640 1 -- 172.21.15.69:0/1148696122 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc40072d0 con 0x7f6cd008f160 2024-02-21T07:42:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.484+0000 7f7bb5a00640 1 -- 172.21.15.69:0/859048059 >> v2:172.21.15.174:3300/0 conn(0x7f7bb018b0f0 msgr2=0x7f7bb006cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.479+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd015b700 con 0x7f6cd008f160 2024-02-21T07:42:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.484+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6cd018ad10 con 0x7f6cd008f160 2024-02-21T07:42:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7efe07800640 1 -- 172.21.15.69:0/2336226653 shutdown_connections 2024-02-21T07:42:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7efe07800640 1 --2- 172.21.15.69:0/2336226653 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe001840b0 0x7efe000f62c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7efe07800640 1 -- 172.21.15.69:0/2336226653 >> 172.21.15.69:0/2336226653 conn(0x7efe000f69c0 msgr2=0x7efe000f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7efe07800640 1 -- 172.21.15.69:0/2336226653 shutdown_connections 2024-02-21T07:42:38.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.484+0000 7f7bb5a00640 1 --2- 172.21.15.69:0/859048059 >> v2:172.21.15.174:3300/0 conn(0x7f7bb018b0f0 0x7f7bb006cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.484+0000 7f7bb5a00640 1 -- 172.21.15.69:0/859048059 >> v2:172.21.15.69:3300/0 conn(0x7f7bb006ecb0 msgr2=0x7f7bb018abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7f7bb5a00640 1 --2- 172.21.15.69:0/859048059 >> v2:172.21.15.69:3300/0 conn(0x7f7bb006ecb0 0x7f7bb018abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.484+0000 7f1f2f000640 1 -- 172.21.15.69:0/3744695581 shutdown_connections 2024-02-21T07:42:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7f1f2f000640 1 -- 172.21.15.69:0/3744695581 wait complete. 2024-02-21T07:42:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7f51cd800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac0052f0 0x7f51c81681b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.486+0000 7f51cd800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c821a530 0x7f51c821a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.486+0000 7f51cd800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51c821c050 0x7f51c821c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.486+0000 7f51cd800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c821b600 con 0x7f51c821c050 2024-02-21T07:42:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.486+0000 7f51cd800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c817f930 con 0x7f51ac0052f0 2024-02-21T07:42:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.486+0000 7f51cd800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c817fc10 con 0x7f51c821a530 2024-02-21T07:42:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.487+0000 7f51cce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51c821c050 0x7f51c821c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.486+0000 7f577ec00640 1 Processor -- start 2024-02-21T07:42:38.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.486+0000 7f577ec00640 1 -- start start 2024-02-21T07:42:38.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7f7bb5a00640 1 -- 172.21.15.69:0/859048059 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb00f57f0 con 0x7f7bb018a430 2024-02-21T07:42:38.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7f3766a00640 1 -- 172.21.15.69:0/462299960 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3748001030 con 0x7f377423cd20 2024-02-21T07:42:38.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.487+0000 7f51c7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c821a530 0x7f51c821a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.488+0000 7f51c7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c821a530 0x7f51c821a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:32768/0 (socket says 172.21.15.69:32768) 2024-02-21T07:42:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.488+0000 7f51c7400640 1 -- 172.21.15.69:0/440775002 learned_addr learned my addr 172.21.15.69:0/440775002 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.487+0000 7f51cce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51c821c050 0x7f51c821c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40000/0 (socket says 172.21.15.69:40000) 2024-02-21T07:42:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.488+0000 7f1760600640 1 Processor -- start 2024-02-21T07:42:38.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.486+0000 7f51c7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac0052f0 0x7f51c81681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.488+0000 7f1760600640 1 -- start start 2024-02-21T07:42:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.489+0000 7f1f2f000640 1 Processor -- start 2024-02-21T07:42:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7f7bb6400640 1 --2- 172.21.15.69:0/859048059 >> v2:172.21.15.174:3300/0 conn(0x7f7bb018b0f0 0x7f7bb006cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:38.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7f7bb5000640 1 --2- 172.21.15.69:0/859048059 >> v2:172.21.15.69:3300/0 conn(0x7f7bb006ecb0 0x7f7bb018abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.489+0000 7f1f2f000640 1 -- start start 2024-02-21T07:42:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.489+0000 7f51cce00640 1 -- 172.21.15.69:0/440775002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c821a530 msgr2=0x7f51c821a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.489+0000 7f51cce00640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51c821a530 0x7f51c821a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.489+0000 7f51cce00640 1 -- 172.21.15.69:0/440775002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac0052f0 msgr2=0x7f51c81681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.489+0000 7f51cce00640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f51ac0052f0 0x7f51c81681b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.489+0000 7f51cce00640 1 -- 172.21.15.69:0/440775002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c817fef0 con 0x7f51c821c050 2024-02-21T07:42:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.490+0000 7f577ec00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5778185da0 0x7f57780cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.490+0000 7f577ec00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57780f9bd0 con 0x7f577818c600 2024-02-21T07:42:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.490+0000 7f577ec00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57780f9e90 con 0x7f57780cf1f0 2024-02-21T07:42:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.490+0000 7f577ec00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5778187620 con 0x7f5778185da0 2024-02-21T07:42:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.490+0000 7f5777e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5778185da0 0x7f57780cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.491+0000 7f5777e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5778185da0 0x7f57780cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:32776/0 (socket says 172.21.15.69:32776) 2024-02-21T07:42:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.491+0000 7f5777e00640 1 -- 172.21.15.69:0/3192705271 learned_addr learned my addr 172.21.15.69:0/3192705271 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.488+0000 7f6cccc00640 1 -- 172.21.15.69:0/1148696122 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f6cc4007430 con 0x7f6cd008f160 2024-02-21T07:42:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.485+0000 7efe07800640 1 -- 172.21.15.69:0/2336226653 wait complete. 2024-02-21T07:42:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.489+0000 7f7bb5a00640 1 --2- 172.21.15.69:0/859048059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb018a430 0x7f7bb00f62d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00f7920 tx=0x7f7b9c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a93b6bdfd36347e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.490+0000 7f7bafe00640 1 -- 172.21.15.69:0/859048059 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c02e070 con 0x7f7bb018a430 2024-02-21T07:42:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.490+0000 7f7bafe00640 1 -- 172.21.15.69:0/859048059 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c0315a0 con 0x7f7bb018a430 2024-02-21T07:42:38.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.490+0000 7f7bafe00640 1 -- 172.21.15.69:0/859048059 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c031970 con 0x7f7bb018a430 2024-02-21T07:42:38.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.491+0000 7f5776a00640 1 -- 172.21.15.69:0/3192705271 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956241651 0 0) 0x7f57780f9e90 con 0x7f57780cf1f0 2024-02-21T07:42:38.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.491+0000 7f5776a00640 1 -- 172.21.15.69:0/3192705271 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f575c003520 con 0x7f57780cf1f0 2024-02-21T07:42:38.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.491+0000 7f7bb6e00640 1 -- 172.21.15.69:0/859048059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb018a430 msgr2=0x7f7bb00f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.491+0000 7f7bb6e00640 1 --2- 172.21.15.69:0/859048059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb018a430 0x7f7bb00f62d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00f7920 tx=0x7f7b9c02b840 comp rx=0 tx=0).stop 2024-02-21T07:42:38.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.491+0000 7f5777e00640 1 -- 172.21.15.69:0/3192705271 >> v1:172.21.15.184:6789/0 conn(0x7f57780cf1f0 legacy=0x7f577818bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.491+0000 7f5777e00640 1 -- 172.21.15.69:0/3192705271 >> v1:172.21.15.69:6789/0 conn(0x7f577818c600 legacy=0x7f577818f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.491+0000 7f5777e00640 1 -- 172.21.15.69:0/3192705271 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57781869a0 con 0x7f5778185da0 2024-02-21T07:42:38.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f1f2f000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f28181940 0x7f1f2821d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f51cce00640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51c821c050 0x7f51c821c4d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f51c808e180 tx=0x7f51c0001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f7bb6e00640 1 -- 172.21.15.69:0/859048059 shutdown_connections 2024-02-21T07:42:38.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f7bb6e00640 1 --2- 172.21.15.69:0/859048059 >> v2:172.21.15.174:3300/0 conn(0x7f7bb018b0f0 0x7f7bb006cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f7bb6e00640 1 --2- 172.21.15.69:0/859048059 >> v2:172.21.15.69:3300/0 conn(0x7f7bb006ecb0 0x7f7bb018abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f7bb6e00640 1 --2- 172.21.15.69:0/859048059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb018a430 0x7f7bb00f62d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f7bb6e00640 1 -- 172.21.15.69:0/859048059 >> 172.21.15.69:0/859048059 conn(0x7f7bb00f6840 msgr2=0x7f7bb00f6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f7bb6e00640 1 -- 172.21.15.69:0/859048059 shutdown_connections 2024-02-21T07:42:38.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f1f2f000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f28181d20 0x7f1f2821ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f1f27e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f28181940 0x7f1f2821d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f1f27e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f28181940 0x7f1f2821d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:51104/0 (socket says 172.21.15.69:51104) 2024-02-21T07:42:38.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f1f27e00640 1 -- 172.21.15.69:0/1953259425 learned_addr learned my addr 172.21.15.69:0/1953259425 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f1f2f000640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f28182fd0 0x7f1f2816a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2821bf60 con 0x7f1f28181d20 2024-02-21T07:42:38.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.492+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2821d070 con 0x7f1f28181940 2024-02-21T07:42:38.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.493+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2821c180 con 0x7f1f28182fd0 2024-02-21T07:42:38.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.493+0000 7f51bfe00640 1 -- 172.21.15.69:0/440775002 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0006d10 con 0x7f51c821c050 2024-02-21T07:42:38.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.493+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c821b850 con 0x7f51c821c050 2024-02-21T07:42:38.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.493+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c81686f0 con 0x7f51c821c050 2024-02-21T07:42:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.493+0000 7f7bb6e00640 1 -- 172.21.15.69:0/859048059 wait complete. 2024-02-21T07:42:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.493+0000 7f1f2d000640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f28182fd0 0x7f1f2816a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.493+0000 7f1f27400640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f28181d20 0x7f1f2821ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1f27e00640 1 -- 172.21.15.69:0/1953259425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f28182fd0 msgr2=0x7f1f2816a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1f27e00640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f28182fd0 0x7f1f2816a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1f27e00640 1 -- 172.21.15.69:0/1953259425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f28181d20 msgr2=0x7f1f2821ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1f27e00640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f28181d20 0x7f1f2821ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1f27e00640 1 -- 172.21.15.69:0/1953259425 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f140094d0 con 0x7f1f28181940 2024-02-21T07:42:38.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1f27400640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f28181d20 0x7f1f2821ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:38.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1f2d000640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1f28182fd0 0x7f1f2816a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:38.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1760600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1750054a90 0x7f1750107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1760600640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1750108410 0x7f1750079290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1760600640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175007a250 con 0x7f1750106f70 2024-02-21T07:42:38.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1760600640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175007aaf0 con 0x7f1750054a90 2024-02-21T07:42:38.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f1760600640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1750107ab0 con 0x7f1750108410 2024-02-21T07:42:38.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.495+0000 7f1f27e00640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f28181940 0x7f1f2821d500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1f14000c00 tx=0x7f1f140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f51bfe00640 1 -- 172.21.15.69:0/440775002 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0003b80 con 0x7f51c821c050 2024-02-21T07:42:38.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.494+0000 7f51bfe00640 1 -- 172.21.15.69:0/440775002 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0006d10 con 0x7f51c821c050 2024-02-21T07:42:38.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.495+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51a0001030 con 0x7f51c821c050 2024-02-21T07:42:38.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.495+0000 7efe07800640 1 Processor -- start 2024-02-21T07:42:38.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.495+0000 7f175dc00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f1750106f70 0x7f1750054380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:57164/0 (socket says 172.21.15.69:57164) 2024-02-21T07:42:38.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.495+0000 7f175dc00640 1 -- 172.21.15.69:0/1002481351 learned_addr learned my addr 172.21.15.69:0/1002481351 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:38.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.495+0000 7efe07800640 1 -- start start 2024-02-21T07:42:38.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.496+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165101240 0 0) 0x7f175007a250 con 0x7f1750106f70 2024-02-21T07:42:38.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.496+0000 7f5777e00640 1 --2- 172.21.15.69:0/3192705271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5778185da0 0x7f57780cecb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5768009870 tx=0x7f576802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97cbcf71ac13b434 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.497+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1740003520 con 0x7f1750106f70 2024-02-21T07:42:38.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.497+0000 7f5776a00640 1 -- 172.21.15.69:0/3192705271 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768031800 con 0x7f5778185da0 2024-02-21T07:42:38.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.497+0000 7f5776a00640 1 -- 172.21.15.69:0/3192705271 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768031960 con 0x7f5778185da0 2024-02-21T07:42:38.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.498+0000 7f577ec00640 1 -- 172.21.15.69:0/3192705271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5778185da0 msgr2=0x7f57780cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.498+0000 7f5776a00640 1 -- 172.21.15.69:0/3192705271 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768031800 con 0x7f5778185da0 2024-02-21T07:42:38.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.498+0000 7f577ec00640 1 --2- 172.21.15.69:0/3192705271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5778185da0 0x7f57780cecb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5768009870 tx=0x7f576802b8a0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.498+0000 7efe07800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe000cd090 0x7efe00223180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.498+0000 7efe07800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe001840b0 0x7efe00173210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.498+0000 7efe07800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe00188980 0x7efe00173750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.497+0000 7f7bb6e00640 1 Processor -- start 2024-02-21T07:42:38.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.498+0000 7f7bb6e00640 1 -- start start 2024-02-21T07:42:38.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.498+0000 7f3771600640 1 -- 172.21.15.69:0/462299960 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f376c00bbb0 con 0x7f377423cd20 2024-02-21T07:42:38.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7efe04e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe000cd090 0x7efe00223180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7efe04e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe000cd090 0x7efe00223180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:32792/0 (socket says 172.21.15.69:32792) 2024-02-21T07:42:38.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7efe04e00640 1 -- 172.21.15.69:0/2897982903 learned_addr learned my addr 172.21.15.69:0/2897982903 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe001749b0 con 0x7efe001840b0 2024-02-21T07:42:38.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7efe05800640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe00188980 0x7efe00173750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7efdffe00640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe001840b0 0x7efe00173210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe00173e30 con 0x7efe00188980 2024-02-21T07:42:38.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f7bb6e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb006ecb0 0x7f7bb0177f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f66a6e00640 1 Processor -- start 2024-02-21T07:42:38.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe00174110 con 0x7efe000cd090 2024-02-21T07:42:38.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f7bb6e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb018a430 0x7f7bb01784a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f7bb6e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb018b0f0 0x7f7bb0221660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f7bb6e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb02211d0 con 0x7f7bb006ecb0 2024-02-21T07:42:38.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f7bb6e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0225b70 con 0x7f7bb018b0f0 2024-02-21T07:42:38.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f7bb6e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0225890 con 0x7f7bb018a430 2024-02-21T07:42:38.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f7bb5a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb006ecb0 0x7f7bb0177f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f66a6e00640 1 -- start start 2024-02-21T07:42:38.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f7bb5a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb006ecb0 0x7f7bb0177f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40042/0 (socket says 172.21.15.69:40042) 2024-02-21T07:42:38.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f7bb5a00640 1 -- 172.21.15.69:0/145240947 learned_addr learned my addr 172.21.15.69:0/145240947 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7f577ec00640 1 -- 172.21.15.69:0/3192705271 shutdown_connections 2024-02-21T07:42:38.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7f577ec00640 1 --2- 172.21.15.69:0/3192705271 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5778185da0 0x7f57780cecb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7f6cccc00640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cb00a7ac0 0x7f6cb00a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7f577ec00640 1 -- 172.21.15.69:0/3192705271 >> 172.21.15.69:0/3192705271 conn(0x7f5778071b80 msgr2=0x7f57780668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7efe04e00640 1 -- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe00188980 msgr2=0x7efe00173750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7f577ec00640 1 -- 172.21.15.69:0/3192705271 shutdown_connections 2024-02-21T07:42:38.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7f6cccc00640 1 -- 172.21.15.69:0/1148696122 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f6cc40c97f0 con 0x7f6cd008f160 2024-02-21T07:42:38.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7efe04e00640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe00188980 0x7efe00173750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7efe04e00640 1 -- 172.21.15.69:0/2897982903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe001840b0 msgr2=0x7efe00173210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7efe04e00640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe001840b0 0x7efe00173210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7efe04e00640 1 -- 172.21.15.69:0/2897982903 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec009400 con 0x7efe000cd090 2024-02-21T07:42:38.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.500+0000 7efdffe00640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe001840b0 0x7efe00173210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:38.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7efe04e00640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe000cd090 0x7efe00223180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efdec0098c0 tx=0x7efdec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7f6cccc00640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.184:6824/825193265,v1:172.21.15.184:6825/825193265] conn(0x7f6cb00b2450 0x7f6cb00b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7f6cccc00640 1 -- 172.21.15.69:0/1148696122 --> [v2:172.21.15.184:6824/825193265,v1:172.21.15.184:6825/825193265] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6cb00b4f60 con 0x7f6cb00b2450 2024-02-21T07:42:38.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.502+0000 7f6cccc00640 1 -- 172.21.15.69:0/1148696122 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cc40cbe10 con 0x7f6cd008f160 2024-02-21T07:42:38.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7efdfcc00640 1 -- 172.21.15.69:0/2897982903 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec032840 con 0x7efe000cd090 2024-02-21T07:42:38.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7efdfcc00640 1 -- 172.21.15.69:0/2897982903 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdec0329c0 con 0x7efe000cd090 2024-02-21T07:42:38.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7efdfcc00640 1 -- 172.21.15.69:0/2897982903 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdec032d70 con 0x7efe000cd090 2024-02-21T07:42:38.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.502+0000 7f6cd5800640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.184:6824/825193265,v1:172.21.15.184:6825/825193265] conn(0x7f6cb00b2450 0x7f6cb00b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.502+0000 7f51bfe00640 1 -- 172.21.15.69:0/440775002 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f51c0005070 con 0x7f51c821c050 2024-02-21T07:42:38.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.502+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe001743f0 con 0x7efe000cd090 2024-02-21T07:42:38.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.502+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0016fe30 con 0x7efe000cd090 2024-02-21T07:42:38.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.503+0000 7f66a6e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f66a006eb60 0x7f66a006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.504+0000 7f66a6e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a017ed70 con 0x7f66a01866e0 2024-02-21T07:42:38.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.504+0000 7f66a6e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a0071820 con 0x7f66a00f7360 2024-02-21T07:42:38.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.504+0000 7f66a6e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a0071b00 con 0x7f66a006eb60 2024-02-21T07:42:38.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.504+0000 7f66a5a00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f66a00f7360 0x7f66a006da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:57172/0 (socket says 172.21.15.69:57172) 2024-02-21T07:42:38.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.504+0000 7f66a5a00640 1 -- 172.21.15.69:0/3254684449 learned_addr learned my addr 172.21.15.69:0/3254684449 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:38.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.501+0000 7f577ec00640 1 -- 172.21.15.69:0/3192705271 wait complete. 2024-02-21T07:42:38.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.504+0000 7f577ec00640 1 Processor -- start 2024-02-21T07:42:38.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.505+0000 7f51bfe00640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f51a809f240 0x7f51a80a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3157545307 0 0) 0x7f1740003520 con 0x7f1750106f70 2024-02-21T07:42:38.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 >> v2:172.21.15.184:3300/0 conn(0x7f1750108410 msgr2=0x7f1750079290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:42:38.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 --2- 172.21.15.69:0/1002481351 >> v2:172.21.15.184:3300/0 conn(0x7f1750108410 0x7f1750079290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 >> v2:172.21.15.69:3300/0 conn(0x7f1750054a90 msgr2=0x7f1750107ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 --2- 172.21.15.69:0/1002481351 >> v2:172.21.15.69:3300/0 conn(0x7f1750054a90 0x7f1750107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175010a590 con 0x7f1750106f70 2024-02-21T07:42:38.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f1748001670 con 0x7f1750106f70 2024-02-21T07:42:38.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 >> v1:172.21.15.184:6789/0 conn(0x7f1750106f70 legacy=0x7f1750054380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17400039c0 0x7f1740003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17400047c0 0x7f1740004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1740009970 0x7f174000be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175007aaf0 con 0x7f17400039c0 2024-02-21T07:42:38.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750107ab0 con 0x7f17400047c0 2024-02-21T07:42:38.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.499+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174000c3c0 con 0x7f1740009970 2024-02-21T07:42:38.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.505+0000 7f51bfe00640 1 -- 172.21.15.69:0/440775002 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f51c00f3950 con 0x7f51c821c050 2024-02-21T07:42:38.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.505+0000 7f6cd5800640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.184:6824/825193265,v1:172.21.15.184:6825/825193265] conn(0x7f6cb00b2450 0x7f6cb00b4890 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.504+0000 7f3771600640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f375409f230 0x7f37540a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.505+0000 7f3771600640 1 -- 172.21.15.69:0/462299960 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f376c017030 con 0x7f377423cd20 2024-02-21T07:42:38.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.505+0000 7f3771600640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:6818/807358556,v1:172.21.15.174:6819/807358556] conn(0x7f37540a9bc0 0x7f37540ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.505+0000 7f3771600640 1 -- 172.21.15.69:0/462299960 --> [v2:172.21.15.174:6818/807358556,v1:172.21.15.174:6819/807358556] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37540ac6d0 con 0x7f37540a9bc0 2024-02-21T07:42:38.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.505+0000 7f3771600640 1 -- 172.21.15.69:0/462299960 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f376c0cadf0 con 0x7f377423cd20 2024-02-21T07:42:38.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f377a400640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:6818/807358556,v1:172.21.15.174:6819/807358556] conn(0x7f37540a9bc0 0x7f37540ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f7bb5000640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb018a430 0x7f7bb01784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f51bfe00640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.69:6807/4247950924,v1:172.21.15.69:6809/4247950924] conn(0x7f51a80a9be0 0x7f51a80ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f7bb6400640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb018b0f0 0x7f7bb0221660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f66a6400640 1 --2- 172.21.15.69:0/3254684449 >> v2:172.21.15.184:3300/0 conn(0x7f66a006eb60 0x7f66a006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f7bb6400640 1 -- 172.21.15.69:0/145240947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb018a430 msgr2=0x7f7bb01784a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f51bfe00640 1 -- 172.21.15.69:0/440775002 --> [v2:172.21.15.69:6807/4247950924,v1:172.21.15.69:6809/4247950924] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51a80ac6f0 con 0x7f51a80a9be0 2024-02-21T07:42:38.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.505+0000 7f577ec00640 1 -- start start 2024-02-21T07:42:38.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f6cccc00640 1 -- 172.21.15.69:0/1148696122 <== osd.2 v2:172.21.15.184:6824/825193265 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6cb00b4f60 con 0x7f6cb00b2450 2024-02-21T07:42:38.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f51bfe00640 1 -- 172.21.15.69:0/440775002 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51c00f3d00 con 0x7f51c821c050 2024-02-21T07:42:38.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f377a400640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:6818/807358556,v1:172.21.15.174:6819/807358556] conn(0x7f37540a9bc0 0x7f37540ac000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f7bb6400640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb018a430 0x7f7bb01784a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f7bb6400640 1 -- 172.21.15.69:0/145240947 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb006ecb0 msgr2=0x7f7bb0177f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f7bb6400640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7bb006ecb0 0x7f7bb0177f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.506+0000 7f7bb6400640 1 -- 172.21.15.69:0/145240947 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0094d0 con 0x7f7bb018b0f0 2024-02-21T07:42:38.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f1f1fe00640 1 -- 172.21.15.69:0/1953259425 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f1403dab0 con 0x7f1f28181940 2024-02-21T07:42:38.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f7bb5000640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bb018a430 0x7f7bb01784a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:38.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128410714 0 0) 0x7f66a0071820 con 0x7f66a00f7360 2024-02-21T07:42:38.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.504+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efddc001030 con 0x7efe000cd090 2024-02-21T07:42:38.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f7bb6400640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb018b0f0 0x7f7bb0221660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800cce0 tx=0x7f7ba800a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6688003520 con 0x7f66a00f7360 2024-02-21T07:42:38.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763685198 0 0) 0x7f6694001040 con 0x7f66a01866e0 2024-02-21T07:42:38.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66a0071820 con 0x7f66a01866e0 2024-02-21T07:42:38.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f3779a00640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f375409f230 0x7f37540a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f3771600640 1 -- 172.21.15.69:0/462299960 <== osd.7 v2:172.21.15.174:6818/807358556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f37540ac6d0 con 0x7f37540a9bc0 2024-02-21T07:42:38.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f577ec00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57780cf1f0 0x7f5778175190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2821c460 con 0x7f1f28181940 2024-02-21T07:42:38.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2821ca20 con 0x7f1f28181940 2024-02-21T07:42:38.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f1f1fe00640 1 -- 172.21.15.69:0/1953259425 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f1403dc10 con 0x7f1f28181940 2024-02-21T07:42:38.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f1f1fe00640 1 -- 172.21.15.69:0/1953259425 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f14032470 con 0x7f1f28181940 2024-02-21T07:42:38.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f577ec00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5778185da0 0x7f577821e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f51c7e00640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f51a809f240 0x7f51a80a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2537183799 0 0) 0x7f6688003520 con 0x7f66a00f7360 2024-02-21T07:42:38.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 >> v2:172.21.15.184:3300/0 conn(0x7f66a006eb60 msgr2=0x7f66a006efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 --2- 172.21.15.69:0/3254684449 >> v2:172.21.15.184:3300/0 conn(0x7f66a006eb60 0x7f66a006efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 >> v1:172.21.15.69:6789/0 conn(0x7f66a01866e0 legacy=0x7f66a0186b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a0071de0 con 0x7f66a00f7360 2024-02-21T07:42:38.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f668c001670 con 0x7f66a00f7360 2024-02-21T07:42:38.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f6ccfe00640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cb00a7ac0 0x7f6cb00a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.502+0000 7f175e600640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1740009970 0x7f174000be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.502+0000 7f175d200640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17400047c0 0x7f1740004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f5777400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5778185da0 0x7f577821e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f5777400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5778185da0 0x7f577821e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40066/0 (socket says 172.21.15.69:40066) 2024-02-21T07:42:38.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f5777400640 1 -- 172.21.15.69:0/3031565414 learned_addr learned my addr 172.21.15.69:0/3031565414 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f577ec00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f577818c600 0x7f577821c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5778187dc0 con 0x7f5778185da0 2024-02-21T07:42:38.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57781880a0 con 0x7f577818c600 2024-02-21T07:42:38.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 >> v1:172.21.15.184:6789/0 conn(0x7f66a00f7360 legacy=0x7f66a006da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6688003b50 0x7f6688003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66880047c0 0x7f6688004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6688005180 0x7f668800ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0071b00 con 0x7f6688005180 2024-02-21T07:42:38.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880104d0 con 0x7f6688003b50 2024-02-21T07:42:38.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.508+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668800bb80 con 0x7f66880047c0 2024-02-21T07:42:38.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5778188380 con 0x7f57780cf1f0 2024-02-21T07:42:38.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7f577cc00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f577818c600 0x7f577821c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7f3779a00640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f375409f230 0x7f37540a16f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3760000c00 tx=0x7f3760039040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7f66a5a00640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6688003b50 0x7f6688003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7f66a6400640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6688005180 0x7f668800ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7f51c7400640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.69:6807/4247950924,v1:172.21.15.69:6809/4247950924] conn(0x7f51a80a9be0 0x7f51a80ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.510+0000 7f51c7e00640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f51a809f240 0x7f51a80a1700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f51b8006fd0 tx=0x7f51b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7f5777e00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57780cf1f0 0x7f5778175190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.510+0000 7f577cc00640 1 -- 172.21.15.69:0/3031565414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57780cf1f0 msgr2=0x7f5778175190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.510+0000 7f577cc00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57780cf1f0 0x7f5778175190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.510+0000 7f577cc00640 1 -- 172.21.15.69:0/3031565414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5778185da0 msgr2=0x7f577821e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.510+0000 7f577cc00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5778185da0 0x7f577821e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7f66a5000640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66880047c0 0x7f6688004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.510+0000 7f577cc00640 1 -- 172.21.15.69:0/3031565414 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680094d0 con 0x7f577818c600 2024-02-21T07:42:38.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.510+0000 7f6ccfe00640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cb00a7ac0 0x7f6cb00a9f80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6cd017d990 tx=0x7f6cbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.509+0000 7efdfcc00640 1 -- 172.21.15.69:0/2897982903 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7efdec005990 con 0x7efe000cd090 2024-02-21T07:42:38.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.511+0000 7f577cc00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f577818c600 0x7f577821c000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f577000c780 tx=0x7f577000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7f175d200640 1 -- 172.21.15.69:0/1002481351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1740009970 msgr2=0x7f174000be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7f175d200640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1740009970 0x7f174000be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7f175d200640 1 -- 172.21.15.69:0/1002481351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17400039c0 msgr2=0x7f1740003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.511+0000 7f66a5a00640 1 -- 172.21.15.69:0/3254684449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66880047c0 msgr2=0x7f6688004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.511+0000 7f51c7400640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.69:6807/4247950924,v1:172.21.15.69:6809/4247950924] conn(0x7f51a80a9be0 0x7f51a80ac020 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7efdfcc00640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efde009f280 0x7efde00a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.511+0000 7f66a5a00640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66880047c0 0x7f6688004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.511+0000 7f66a5a00640 1 -- 172.21.15.69:0/3254684449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6688005180 msgr2=0x7f668800ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.511+0000 7f66a5a00640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6688005180 0x7f668800ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f51bfe00640 1 -- 172.21.15.69:0/440775002 <== osd.0 v2:172.21.15.69:6807/4247950924 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f51a80ac6f0 con 0x7f51a80a9be0 2024-02-21T07:42:38.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7f576fe00640 1 -- 172.21.15.69:0/3031565414 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770003d80 con 0x7f577818c600 2024-02-21T07:42:38.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f576fe00640 1 -- 172.21.15.69:0/3031565414 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577000ce30 con 0x7f577818c600 2024-02-21T07:42:38.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f576fe00640 1 -- 172.21.15.69:0/3031565414 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700052b0 con 0x7f577818c600 2024-02-21T07:42:38.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5778188660 con 0x7f577818c600 2024-02-21T07:42:38.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5778188c20 con 0x7f577818c600 2024-02-21T07:42:38.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.507+0000 7f175dc00640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17400039c0 0x7f1740003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f175d200640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17400039c0 0x7f1740003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f175d200640 1 -- 172.21.15.69:0/1002481351 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740003520 con 0x7f17400047c0 2024-02-21T07:42:38.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f175dc00640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17400039c0 0x7f1740003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:38.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f175e600640 1 -- 172.21.15.69:0/1002481351 reap_dead start 2024-02-21T07:42:38.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7efdfcc00640 1 -- 172.21.15.69:0/2897982903 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7efdec0ec030 con 0x7efe000cd090 2024-02-21T07:42:38.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7efdfcc00640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:6826/1000763984,v1:172.21.15.174:6827/1000763984] conn(0x7efde00a9c20 0x7efde00ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7efdffe00640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efde009f280 0x7efde00a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7efdfcc00640 1 -- 172.21.15.69:0/2897982903 --> [v2:172.21.15.174:6826/1000763984,v1:172.21.15.174:6827/1000763984] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efde00ac730 con 0x7efde00a9c20 2024-02-21T07:42:38.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7efdfcc00640 1 -- 172.21.15.69:0/2897982903 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdec0ec3e0 con 0x7efe000cd090 2024-02-21T07:42:38.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.511+0000 7f66a5a00640 1 -- 172.21.15.69:0/3254684449 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a0071de0 con 0x7f6688003b50 2024-02-21T07:42:38.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f66a6400640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6688005180 0x7f668800ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:38.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f66a6400640 1 -- 172.21.15.69:0/3254684449 reap_dead start 2024-02-21T07:42:38.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7f7bad600640 1 -- 172.21.15.69:0/145240947 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8003b90 con 0x7f7bb018b0f0 2024-02-21T07:42:38.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7f7bad600640 1 -- 172.21.15.69:0/145240947 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba8003cf0 con 0x7f7bb018b0f0 2024-02-21T07:42:38.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7f7bad600640 1 -- 172.21.15.69:0/145240947 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8004260 con 0x7f7bb018b0f0 2024-02-21T07:42:38.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb02208a0 con 0x7f7bb018b0f0 2024-02-21T07:42:38.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb0220e60 con 0x7f7bb018b0f0 2024-02-21T07:42:38.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7fa979800640 1 Processor -- start 2024-02-21T07:42:38.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.514+0000 7fa979800640 1 -- start start 2024-02-21T07:42:38.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.513+0000 7efe05800640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:6826/1000763984,v1:172.21.15.174:6827/1000763984] conn(0x7efde00a9c20 0x7efde00ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.514+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5778187240 con 0x7f577818c600 2024-02-21T07:42:38.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.515+0000 7f175d200640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17400047c0 0x7f1740004c40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1758073740 tx=0x7f17400057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bac4a9d39fc3600d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.515+0000 7efdffe00640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efde009f280 0x7efde00a1740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe000cb6a0 tx=0x7efdf4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.515+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17580a7820 con 0x7f17400047c0 2024-02-21T07:42:38.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.515+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17580a79a0 con 0x7f17400047c0 2024-02-21T07:42:38.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.515+0000 7f1757e00640 1 -- 172.21.15.69:0/1002481351 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17580a7e10 con 0x7f17400047c0 2024-02-21T07:42:38.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.515+0000 7efe05800640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:6826/1000763984,v1:172.21.15.174:6827/1000763984] conn(0x7efde00a9c20 0x7efde00ac060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.516+0000 7f66a5a00640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6688003b50 0x7f6688003f50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f668c00c370 tx=0x7f66880057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92886042a4b03c92 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.517+0000 7f1760600640 1 -- 172.21.15.69:0/1002481351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17400047c0 msgr2=0x7f1740004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.517+0000 7f1760600640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17400047c0 0x7f1740004c40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1758073740 tx=0x7f17400057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.517+0000 7efdfcc00640 1 -- 172.21.15.69:0/2897982903 <== osd.4 v2:172.21.15.174:6826/1000763984 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efde00ac730 con 0x7efde00a9c20 2024-02-21T07:42:38.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.516+0000 7fa979800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa974182bb0 0x7fa97408ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.516+0000 7fa979800640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa974189f40 con 0x7fa9741827d0 2024-02-21T07:42:38.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.516+0000 7fa979800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97418b080 con 0x7fa97408f160 2024-02-21T07:42:38.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.516+0000 7fa979800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97418a190 con 0x7fa974182bb0 2024-02-21T07:42:38.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.516+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c02cb50 con 0x7f6688003b50 2024-02-21T07:42:38.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.516+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668c02ccd0 con 0x7f6688003b50 2024-02-21T07:42:38.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.516+0000 7f669fe00640 1 -- 172.21.15.69:0/3254684449 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668c005b10 con 0x7f6688003b50 2024-02-21T07:42:38.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.512+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f00001030 con 0x7f1f28181940 2024-02-21T07:42:38.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f1760600640 1 -- 172.21.15.69:0/1002481351 shutdown_connections 2024-02-21T07:42:38.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f1760600640 1 --2- 172.21.15.69:0/1002481351 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17400047c0 0x7f1740004c40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f1760600640 1 -- 172.21.15.69:0/1002481351 >> 172.21.15.69:0/1002481351 conn(0x7f1750052de0 msgr2=0x7f17500531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.517+0000 7fa972000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa974182bb0 0x7fa97408ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.517+0000 7fa972000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa974182bb0 0x7fa97408ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:32834/0 (socket says 172.21.15.69:32834) 2024-02-21T07:42:38.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.517+0000 7fa972000640 1 -- 172.21.15.69:0/2462654924 learned_addr learned my addr 172.21.15.69:0/2462654924 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.517+0000 7fa972000640 1 -- 172.21.15.69:0/2462654924 >> v1:172.21.15.184:6789/0 conn(0x7fa97408f160 legacy=0x7fa97408f5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:38.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.517+0000 7fa972000640 1 -- 172.21.15.69:0/2462654924 >> v1:172.21.15.69:6789/0 conn(0x7fa9741827d0 legacy=0x7fa97418b510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:38.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f66a6e00640 1 -- 172.21.15.69:0/3254684449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6688003b50 msgr2=0x7f6688003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f1760600640 1 -- 172.21.15.69:0/1002481351 shutdown_connections 2024-02-21T07:42:38.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f66a6e00640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6688003b50 0x7f6688003f50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f668c00c370 tx=0x7f66880057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.517+0000 7f1f1fe00640 1 -- 172.21.15.69:0/1953259425 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1f1403d0d0 con 0x7f1f28181940 2024-02-21T07:42:38.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f66a6e00640 1 -- 172.21.15.69:0/3254684449 shutdown_connections 2024-02-21T07:42:38.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f66a6e00640 1 --2- 172.21.15.69:0/3254684449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6688003b50 0x7f6688003f50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f66a6e00640 1 -- 172.21.15.69:0/3254684449 >> 172.21.15.69:0/3254684449 conn(0x7f66a00f6840 msgr2=0x7f66a00f6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f66a6e00640 1 -- 172.21.15.69:0/3254684449 shutdown_connections 2024-02-21T07:42:38.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.519+0000 7fa972000640 1 -- 172.21.15.69:0/2462654924 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97418a470 con 0x7fa974182bb0 2024-02-21T07:42:38.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f66a6e00640 1 -- 172.21.15.69:0/3254684449 wait complete. 2024-02-21T07:42:38.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.521+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7bb018a810 con 0x7f7bb018b0f0 2024-02-21T07:42:38.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.521+0000 7fa972000640 1 --2- 172.21.15.69:0/2462654924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa974182bb0 0x7fa97408ec20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009e50 tx=0x7fa96c02be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379a96642da6eb3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.518+0000 7f1760600640 1 -- 172.21.15.69:0/1002481351 wait complete. 2024-02-21T07:42:38.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.521+0000 7f576fe00640 1 -- 172.21.15.69:0/3031565414 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5770005410 con 0x7f577818c600 2024-02-21T07:42:38.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.521+0000 7f1760600640 1 Processor -- start 2024-02-21T07:42:38.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.521+0000 7f1760600640 1 -- start start 2024-02-21T07:42:38.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.521+0000 7fa971600640 1 -- 172.21.15.69:0/2462654924 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c02c9f0 con 0x7fa974182bb0 2024-02-21T07:42:38.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.521+0000 7fa971600640 1 -- 172.21.15.69:0/2462654924 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c02cb50 con 0x7fa974182bb0 2024-02-21T07:42:38.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.521+0000 7fa971600640 1 -- 172.21.15.69:0/2462654924 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0343f0 con 0x7fa974182bb0 2024-02-21T07:42:38.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.522+0000 7f66a6e00640 1 Processor -- start 2024-02-21T07:42:38.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.521+0000 7f1f1fe00640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1f080a35f0 0x7f1f080a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.523+0000 7f66a6e00640 1 -- start start 2024-02-21T07:42:38.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.523+0000 7f1760600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17400047c0 0x7f17500dad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.523+0000 7f1760600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17500db2c0 0x7f17500ff470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.524+0000 7f1760600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17500ff9b0 0x7f17500e2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.524+0000 7fa979800640 1 -- 172.21.15.69:0/2462654924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa974182bb0 msgr2=0x7fa97408ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.523+0000 7f1f1fe00640 1 -- 172.21.15.69:0/1953259425 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f1f140eb750 con 0x7f1f28181940 2024-02-21T07:42:38.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.524+0000 7f576fe00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f575809f280 0x7f57580a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.524+0000 7f576fe00640 1 -- 172.21.15.69:0/3031565414 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f57700c95c0 con 0x7f577818c600 2024-02-21T07:42:38.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.524+0000 7fa979800640 1 --2- 172.21.15.69:0/2462654924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa974182bb0 0x7fa97408ec20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009e50 tx=0x7fa96c02be50 comp rx=0 tx=0).stop 2024-02-21T07:42:38.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.524+0000 7f5777e00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f575809f280 0x7f57580a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.524+0000 7f175dc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17400047c0 0x7f17500dad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.524+0000 7f175dc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17400047c0 0x7f17500dad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:32842/0 (socket says 172.21.15.69:32842) 2024-02-21T07:42:38.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.524+0000 7f175d200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17500db2c0 0x7f17500ff470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f576fe00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:6808/3466097956,v1:172.21.15.174:6810/3466097956] conn(0x7f57580a9c20 0x7f57580ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f576fe00640 1 -- 172.21.15.69:0/3031565414 --> [v2:172.21.15.174:6808/3466097956,v1:172.21.15.174:6810/3466097956] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57580ac730 con 0x7f57580a9c20 2024-02-21T07:42:38.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f576fe00640 1 -- 172.21.15.69:0/3031565414 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57700c9970 con 0x7f577818c600 2024-02-21T07:42:38.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f175d200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17500db2c0 0x7f17500ff470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40082/0 (socket says 172.21.15.69:40082) 2024-02-21T07:42:38.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.524+0000 7f1f27400640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1f080a35f0 0x7f1f080a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f175dc00640 1 -- 172.21.15.69:0/1515385918 learned_addr learned my addr 172.21.15.69:0/1515385918 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f1760600640 1 -- 172.21.15.69:0/1515385918 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17500e2390 con 0x7f17500db2c0 2024-02-21T07:42:38.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f175e600640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17500ff9b0 0x7f17500e2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f1760600640 1 -- 172.21.15.69:0/1515385918 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750050a00 con 0x7f17500ff9b0 2024-02-21T07:42:38.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f7bad600640 1 -- 172.21.15.69:0/145240947 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f7ba800b040 con 0x7f7bb018b0f0 2024-02-21T07:42:38.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f66a6e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6688003b50 0x7f66a0159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f1760600640 1 -- 172.21.15.69:0/1515385918 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17501a0cc0 con 0x7f17400047c0 2024-02-21T07:42:38.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f66a6e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66a015a1d0 0x7f66a021e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f5777e00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f575809f280 0x7f57580a1740 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5768036000 tx=0x7f576803c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f66a6e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a021e690 0x7f66a017c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f66a5a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6688003b50 0x7f66a0159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f66a6e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a017bf50 con 0x7f66a015a1d0 2024-02-21T07:42:38.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f66a6e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a021cb10 con 0x7f66a021e690 2024-02-21T07:42:38.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f5777400640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:6808/3466097956,v1:172.21.15.174:6810/3466097956] conn(0x7f57580a9c20 0x7f57580ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7fa979800640 1 -- 172.21.15.69:0/2462654924 shutdown_connections 2024-02-21T07:42:38.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7fa979800640 1 --2- 172.21.15.69:0/2462654924 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa974182bb0 0x7fa97408ec20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7fa979800640 1 -- 172.21.15.69:0/2462654924 >> 172.21.15.69:0/2462654924 conn(0x7fa9740d28c0 msgr2=0x7fa9740d2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f66a6e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a021cdf0 con 0x7f6688003b50 2024-02-21T07:42:38.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f66a5000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66a015a1d0 0x7f66a021e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.525+0000 7f1f1fe00640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:6802/1736166221,v1:172.21.15.174:6803/1736166221] conn(0x7f1f080adf90 0x7f1f080b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f1f1fe00640 1 -- 172.21.15.69:0/1953259425 --> [v2:172.21.15.174:6802/1736166221,v1:172.21.15.174:6803/1736166221] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f080b0aa0 con 0x7f1f080adf90 2024-02-21T07:42:38.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f66a5000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66a015a1d0 0x7f66a021e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40090/0 (socket says 172.21.15.69:40090) 2024-02-21T07:42:38.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f1f1fe00640 1 -- 172.21.15.69:0/1953259425 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f140edd70 con 0x7f1f28181940 2024-02-21T07:42:38.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f66a6400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a021e690 0x7f66a017c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f66a6400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a021e690 0x7f66a017c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:51164/0 (socket says 172.21.15.69:51164) 2024-02-21T07:42:38.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.526+0000 7f66a6400640 1 -- 172.21.15.69:0/3141754025 learned_addr learned my addr 172.21.15.69:0/3141754025 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.527+0000 7f175e600640 1 -- 172.21.15.69:0/1515385918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17400047c0 msgr2=0x7f17500dad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.527+0000 7f175e600640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17400047c0 0x7f17500dad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.527+0000 7f175e600640 1 -- 172.21.15.69:0/1515385918 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17500db2c0 msgr2=0x7f17500ff470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.527+0000 7f175e600640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17500db2c0 0x7f17500ff470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.527+0000 7f175e600640 1 -- 172.21.15.69:0/1515385918 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17501a0fa0 con 0x7f17500ff9b0 2024-02-21T07:42:38.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.527+0000 7f66a6400640 1 -- 172.21.15.69:0/3141754025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6688003b50 msgr2=0x7f66a0159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.527+0000 7f1f2d000640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:6802/1736166221,v1:172.21.15.174:6803/1736166221] conn(0x7f1f080adf90 0x7f1f080b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.527+0000 7f175d200640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17500db2c0 0x7f17500ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:38.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f66a6400640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6688003b50 0x7f66a0159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f5edbc00640 1 Processor -- start 2024-02-21T07:42:38.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7fa979800640 1 -- 172.21.15.69:0/2462654924 shutdown_connections 2024-02-21T07:42:38.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.527+0000 7f175dc00640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17400047c0 0x7f17500dad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:38.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f175e600640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17500ff9b0 0x7f17500e2820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f175007b2f0 tx=0x7f174c00e900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f66a6400640 1 -- 172.21.15.69:0/3141754025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66a015a1d0 msgr2=0x7f66a021e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f66a6400640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66a015a1d0 0x7f66a021e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f5edbc00640 1 -- start start 2024-02-21T07:42:38.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f66a6400640 1 -- 172.21.15.69:0/3141754025 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a021d0d0 con 0x7f66a021e690 2024-02-21T07:42:38.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f66a5000640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66a015a1d0 0x7f66a021e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:38.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7fa979800640 1 -- 172.21.15.69:0/2462654924 wait complete. 2024-02-21T07:42:38.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f1755600640 1 -- 172.21.15.69:0/1515385918 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c013680 con 0x7f17500ff9b0 2024-02-21T07:42:38.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f66a5a00640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6688003b50 0x7f66a0159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:38.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.528+0000 7f1f27400640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1f080a35f0 0x7f1f080a5ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1f18006fd0 tx=0x7f1f18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.529+0000 7f1f2d000640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:6802/1736166221,v1:172.21.15.174:6803/1736166221] conn(0x7f1f080adf90 0x7f1f080b03d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.529+0000 7f66a6400640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a021e690 0x7f66a017c3e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f66a008e050 tx=0x7f6698010630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.529+0000 7f1755600640 1 -- 172.21.15.69:0/1515385918 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c0137e0 con 0x7f17500ff9b0 2024-02-21T07:42:38.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.529+0000 7f7bad600640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7b9009f200 0x7f7b900a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.529+0000 7f1760600640 1 -- 172.21.15.69:0/1515385918 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17501a1280 con 0x7f17500ff9b0 2024-02-21T07:42:38.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.529+0000 7f1760600640 1 -- 172.21.15.69:0/1515385918 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17501a1840 con 0x7f17500ff9b0 2024-02-21T07:42:38.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.529+0000 7f7bad600640 1 -- 172.21.15.69:0/145240947 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f7ba80ca720 con 0x7f7bb018b0f0 2024-02-21T07:42:38.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.529+0000 7f7bb5a00640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7b9009f200 0x7f7b900a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.530+0000 7f1f1fe00640 1 -- 172.21.15.69:0/1953259425 <== osd.10 v2:172.21.15.174:6802/1736166221 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1f080b0aa0 con 0x7f1f080adf90 2024-02-21T07:42:38.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.530+0000 7f5777400640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:6808/3466097956,v1:172.21.15.174:6810/3466097956] conn(0x7f57580a9c20 0x7f57580ac060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.531+0000 7f1755600640 1 -- 172.21.15.69:0/1515385918 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c013b90 con 0x7f17500ff9b0 2024-02-21T07:42:38.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.530+0000 7f7bad600640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.184:6816/2071034595,v1:172.21.15.184:6817/2071034595] conn(0x7f7b900a9b90 0x7f7b900abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.530+0000 7f7bad600640 1 -- 172.21.15.69:0/145240947 --> [v2:172.21.15.184:6816/2071034595,v1:172.21.15.184:6817/2071034595] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b900ac6a0 con 0x7f7b900a9b90 2024-02-21T07:42:38.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.530+0000 7f7bad600640 1 -- 172.21.15.69:0/145240947 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ba80cab30 con 0x7f7bb018b0f0 2024-02-21T07:42:38.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.531+0000 7f669d600640 1 -- 172.21.15.69:0/3141754025 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698009e20 con 0x7f66a021e690 2024-02-21T07:42:38.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.531+0000 7f669d600640 1 -- 172.21.15.69:0/3141754025 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698010e40 con 0x7f66a021e690 2024-02-21T07:42:38.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.531+0000 7f669d600640 1 -- 172.21.15.69:0/3141754025 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698003bd0 con 0x7f66a021e690 2024-02-21T07:42:38.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.531+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a021d3b0 con 0x7f66a021e690 2024-02-21T07:42:38.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.531+0000 7f1746a00640 1 -- 172.21.15.69:0/1515385918 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1734001030 con 0x7f17500ff9b0 2024-02-21T07:42:38.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.531+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a017c920 con 0x7f66a021e690 2024-02-21T07:42:38.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.531+0000 7f7bb5a00640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7b9009f200 0x7f7b900a16c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0069200 tx=0x7f7b9c03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.531+0000 7f7bb5000640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.184:6816/2071034595,v1:172.21.15.184:6817/2071034595] conn(0x7f7b900a9b90 0x7f7b900abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.532+0000 7f576fe00640 1 -- 172.21.15.69:0/3031565414 <== osd.1 v2:172.21.15.174:6808/3466097956 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f57580ac730 con 0x7f57580a9c20 2024-02-21T07:42:38.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.532+0000 7f5edbc00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ecc105650 0x7f5ecc10ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.532+0000 7f5edbc00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5ecc10bf80 0x7f5ecc109370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.532+0000 7f5edbc00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5ecc1098b0 0x7f5ecc076770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.532+0000 7f5edbc00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc10aff0 con 0x7f5ecc10bf80 2024-02-21T07:42:38.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.532+0000 7f5edbc00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc10c400 con 0x7f5ecc105650 2024-02-21T07:42:38.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.532+0000 7f5edbc00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ecc10a090 con 0x7f5ecc1098b0 2024-02-21T07:42:38.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.533+0000 7f7bb5000640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.184:6816/2071034595,v1:172.21.15.184:6817/2071034595] conn(0x7f7b900a9b90 0x7f7b900abfd0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.534+0000 7fa979800640 1 Processor -- start 2024-02-21T07:42:38.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.534+0000 7fa979800640 1 -- start start 2024-02-21T07:42:38.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.533+0000 7f5ed9200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ecc105650 0x7f5ecc10ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.533+0000 7f5ed9200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5ecc105650 0x7f5ecc10ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:51168/0 (socket says 172.21.15.69:51168) 2024-02-21T07:42:38.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.533+0000 7f5ed9200640 1 -- 172.21.15.69:0/3022375627 learned_addr learned my addr 172.21.15.69:0/3022375627 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.533+0000 7f5ed3e00640 1 --2- 172.21.15.69:0/3022375627 >> v2:172.21.15.69:3300/0 conn(0x7f5ecc10bf80 0x7f5ecc109370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.534+0000 7f5ed3e00640 1 -- 172.21.15.69:0/3022375627 >> v2:172.21.15.184:3300/0 conn(0x7f5ecc1098b0 msgr2=0x7f5ecc076770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:42:38.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.534+0000 7f5ed3e00640 1 --2- 172.21.15.69:0/3022375627 >> v2:172.21.15.184:3300/0 conn(0x7f5ecc1098b0 0x7f5ecc076770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.534+0000 7f5ed3e00640 1 -- 172.21.15.69:0/3022375627 >> v2:172.21.15.174:3300/0 conn(0x7f5ecc105650 msgr2=0x7f5ecc10ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.534+0000 7f5ed3e00640 1 --2- 172.21.15.69:0/3022375627 >> v2:172.21.15.174:3300/0 conn(0x7f5ecc105650 0x7f5ecc10ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.534+0000 7f5ed3e00640 1 -- 172.21.15.69:0/3022375627 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc10a370 con 0x7f5ecc10bf80 2024-02-21T07:42:38.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.537+0000 7f5ed3e00640 1 --2- 172.21.15.69:0/3022375627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ecc10bf80 0x7f5ecc109370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc053f00 tx=0x7f5ec002b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97ce807e8daebf3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.534+0000 7f7bad600640 1 -- 172.21.15.69:0/145240947 <== osd.5 v2:172.21.15.184:6816/2071034595 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7b900ac6a0 con 0x7f7b900a9b90 2024-02-21T07:42:38.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.538+0000 7f5ed3400640 1 -- 172.21.15.69:0/3022375627 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0033620 con 0x7f5ecc10bf80 2024-02-21T07:42:38.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.538+0000 7f5ed3400640 1 -- 172.21.15.69:0/3022375627 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec0033780 con 0x7f5ecc10bf80 2024-02-21T07:42:38.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.538+0000 7f5ed3400640 1 -- 172.21.15.69:0/3022375627 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0033b10 con 0x7f5ecc10bf80 2024-02-21T07:42:38.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.539+0000 7f1755600640 1 -- 172.21.15.69:0/1515385918 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f174c013cf0 con 0x7f17500ff9b0 2024-02-21T07:42:38.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.540+0000 7f5edbc00640 1 -- 172.21.15.69:0/3022375627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ecc10bf80 msgr2=0x7f5ecc109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.540+0000 7f5edbc00640 1 --2- 172.21.15.69:0/3022375627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ecc10bf80 0x7f5ecc109370 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc053f00 tx=0x7f5ec002b7d0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.538+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f667c001030 con 0x7f66a021e690 2024-02-21T07:42:38.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.539+0000 7f669d600640 1 -- 172.21.15.69:0/3141754025 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f6698014440 con 0x7f66a021e690 2024-02-21T07:42:38.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.541+0000 7f669d600640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f668009f1b0 0x7f66800a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.541+0000 7f669d600640 1 -- 172.21.15.69:0/3141754025 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f66980c9b20 con 0x7f66a021e690 2024-02-21T07:42:38.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.537+0000 7fa979800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa97408f160 0x7fa9740cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.538+0000 7fa979800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9741827d0 0x7fa9740fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.538+0000 7fa979800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa974182bb0 0x7fa9740fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.540+0000 7fa979800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97417b3f0 con 0x7fa97408f160 2024-02-21T07:42:38.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.540+0000 7fa979800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97417b6d0 con 0x7fa974182bb0 2024-02-21T07:42:38.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.540+0000 7fa979800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97417b9b0 con 0x7fa9741827d0 2024-02-21T07:42:38.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.541+0000 7fa973400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa974182bb0 0x7fa9740fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.541+0000 7fa973400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa974182bb0 0x7fa9740fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:51178/0 (socket says 172.21.15.69:51178) 2024-02-21T07:42:38.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.541+0000 7fa973400640 1 -- 172.21.15.69:0/2644160485 learned_addr learned my addr 172.21.15.69:0/2644160485 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.541+0000 7fa972a00640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa97408f160 0x7fa9740cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.541+0000 7fa972000640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9741827d0 0x7fa9740fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.542+0000 7f669d600640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.184:6800/2169979443,v1:172.21.15.184:6801/2169979443] conn(0x7f66800a9ad0 0x7f66800abf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.542+0000 7f669d600640 1 -- 172.21.15.69:0/3141754025 --> [v2:172.21.15.184:6800/2169979443,v1:172.21.15.184:6801/2169979443] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66800ac5e0 con 0x7f66800a9ad0 2024-02-21T07:42:38.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.542+0000 7f669d600640 1 -- 172.21.15.69:0/3141754025 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6698093720 con 0x7f66a021e690 2024-02-21T07:42:38.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.542+0000 7fa972a00640 1 -- 172.21.15.69:0/2644160485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9741827d0 msgr2=0x7fa9740fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.542+0000 7fa972a00640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9741827d0 0x7fa9740fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.542+0000 7fa972a00640 1 -- 172.21.15.69:0/2644160485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa974182bb0 msgr2=0x7fa9740fc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.542+0000 7fa972a00640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa974182bb0 0x7fa9740fc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.542+0000 7fa972a00640 1 -- 172.21.15.69:0/2644160485 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c009b30 con 0x7fa97408f160 2024-02-21T07:42:38.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.542+0000 7f1755600640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f173c09f200 0x7f173c0a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.542+0000 7f1755600640 1 -- 172.21.15.69:0/1515385918 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f174c0ca3d0 con 0x7f17500ff9b0 2024-02-21T07:42:38.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.543+0000 7f1755600640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.69:6822/3267685751,v1:172.21.15.69:6825/3267685751] conn(0x7f173c0a9ba0 0x7f173c0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.543+0000 7f1755600640 1 -- 172.21.15.69:0/1515385918 --> [v2:172.21.15.69:6822/3267685751,v1:172.21.15.69:6825/3267685751] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f173c0ac6b0 con 0x7f173c0a9ba0 2024-02-21T07:42:38.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.543+0000 7f1755600640 1 -- 172.21.15.69:0/1515385918 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f174c0ca7e0 con 0x7f17500ff9b0 2024-02-21T07:42:38.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.543+0000 7fa972a00640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa97408f160 0x7fa9740cf6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c780 tx=0x7fa96000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.543+0000 7fa96aa00640 1 -- 172.21.15.69:0/2644160485 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000a640 con 0x7fa97408f160 2024-02-21T07:42:38.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.543+0000 7fa96aa00640 1 -- 172.21.15.69:0/2644160485 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96000a7c0 con 0x7fa97408f160 2024-02-21T07:42:38.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.543+0000 7fa96aa00640 1 -- 172.21.15.69:0/2644160485 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000ab70 con 0x7fa97408f160 2024-02-21T07:42:38.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.544+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97417bc90 con 0x7fa97408f160 2024-02-21T07:42:38.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.544+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97417c250 con 0x7fa97408f160 2024-02-21T07:42:38.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.545+0000 7f5edbc00640 1 -- 172.21.15.69:0/3022375627 shutdown_connections 2024-02-21T07:42:38.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.545+0000 7f5edbc00640 1 --2- 172.21.15.69:0/3022375627 >> v2:172.21.15.184:3300/0 conn(0x7f5ecc1098b0 0x7f5ecc076770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.545+0000 7f5edbc00640 1 --2- 172.21.15.69:0/3022375627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ecc10bf80 0x7f5ecc109370 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.545+0000 7f5edbc00640 1 --2- 172.21.15.69:0/3022375627 >> v2:172.21.15.174:3300/0 conn(0x7f5ecc105650 0x7f5ecc10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.545+0000 7f5edbc00640 1 -- 172.21.15.69:0/3022375627 >> 172.21.15.69:0/3022375627 conn(0x7f5ecc052de0 msgr2=0x7f5ecc0531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.545+0000 7f5edbc00640 1 -- 172.21.15.69:0/3022375627 shutdown_connections 2024-02-21T07:42:38.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.545+0000 7f175d200640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.69:6822/3267685751,v1:172.21.15.69:6825/3267685751] conn(0x7f173c0a9ba0 0x7f173c0abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.547+0000 7f66a5000640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.184:6800/2169979443,v1:172.21.15.184:6801/2169979443] conn(0x7f66800a9ad0 0x7f66800abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.547+0000 7f66a5a00640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f668009f1b0 0x7f66800a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.547+0000 7f175dc00640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f173c09f200 0x7f173c0a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.547+0000 7f66a5000640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.184:6800/2169979443,v1:172.21.15.184:6801/2169979443] conn(0x7f66800a9ad0 0x7f66800abf10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.547+0000 7f3766a00640 1 -- 172.21.15.69:0/462299960 --> [v2:172.21.15.174:6818/807358556,v1:172.21.15.174:6819/807358556] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3748002d30 con 0x7f37540a9bc0 2024-02-21T07:42:38.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.547+0000 7f175dc00640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f173c09f200 0x7f173c0a16c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1748000fd0 tx=0x7f1748001640 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.548+0000 7f3771600640 1 -- 172.21.15.69:0/462299960 <== osd.7 v2:172.21.15.174:6818/807358556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3748002d30 con 0x7f37540a9bc0 2024-02-21T07:42:38.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.545+0000 7f5edbc00640 1 -- 172.21.15.69:0/3022375627 wait complete. 2024-02-21T07:42:38.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.548+0000 7f5edbc00640 1 Processor -- start 2024-02-21T07:42:38.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.548+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa97418ad10 con 0x7fa97408f160 2024-02-21T07:42:38.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.549+0000 7f5edbc00640 1 -- start start 2024-02-21T07:42:38.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.550+0000 7f3766a00640 1 -- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:6818/807358556,v1:172.21.15.174:6819/807358556] conn(0x7f37540a9bc0 msgr2=0x7f37540ac000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.550+0000 7f3766a00640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:6818/807358556,v1:172.21.15.174:6819/807358556] conn(0x7f37540a9bc0 0x7f37540ac000 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.549+0000 7f175d200640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.69:6822/3267685751,v1:172.21.15.69:6825/3267685751] conn(0x7f173c0a9ba0 0x7f173c0abfe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f669d600640 1 -- 172.21.15.69:0/3141754025 <== osd.8 v2:172.21.15.184:6800/2169979443 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f66800ac5e0 con 0x7f66800a9ad0 2024-02-21T07:42:38.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.551+0000 7f5edbc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ecc105650 0x7f5ecc1014a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.551+0000 7f5edbc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ecc1098b0 0x7f5ecc0e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.551+0000 7f5edbc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ecc10bf80 0x7f5ecc073d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f5edbc00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0746c0 con 0x7f5ecc105650 2024-02-21T07:42:38.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f5ed3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ecc1098b0 0x7f5ecc0e2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f5ed3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ecc1098b0 0x7f5ecc0e2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:51190/0 (socket says 172.21.15.69:51190) 2024-02-21T07:42:38.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f5ed3e00640 1 -- 172.21.15.69:0/4032324345 learned_addr learned my addr 172.21.15.69:0/4032324345 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f5ed9200640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ecc105650 0x7f5ecc1014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc0749a0 con 0x7f5ecc1098b0 2024-02-21T07:42:38.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f66a5a00640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f668009f1b0 0x7f66800a1670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f668c034000 tx=0x7f668c007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ecc074c80 con 0x7f5ecc10bf80 2024-02-21T07:42:38.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f3766a00640 1 -- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f375409f230 msgr2=0x7f37540a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f3766a00640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f375409f230 0x7f37540a16f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3760000c00 tx=0x7f3760039040 comp rx=0 tx=0).stop 2024-02-21T07:42:38.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f3766a00640 1 -- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f377423cd20 msgr2=0x7f377423d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f3766a00640 1 --2- 172.21.15.69:0/462299960 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f377423cd20 0x7f377423d1a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f376c00db30 tx=0x7f376c001aa0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f377a400640 1 -- 172.21.15.69:0/462299960 reap_dead start 2024-02-21T07:42:38.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f3766a00640 1 -- 172.21.15.69:0/462299960 shutdown_connections 2024-02-21T07:42:38.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f3766a00640 1 -- 172.21.15.69:0/462299960 >> 172.21.15.69:0/462299960 conn(0x7f37740ce290 msgr2=0x7f37740f51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f1755600640 1 -- 172.21.15.69:0/1515385918 <== osd.3 v2:172.21.15.69:6822/3267685751 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f173c0ac6b0 con 0x7f173c0a9ba0 2024-02-21T07:42:38.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.553+0000 7f5ed9200640 1 -- 172.21.15.69:0/4032324345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ecc10bf80 msgr2=0x7f5ecc073d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.553+0000 7f3766a00640 1 -- 172.21.15.69:0/462299960 shutdown_connections 2024-02-21T07:42:38.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.552+0000 7f5ed9c00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ecc10bf80 0x7f5ecc073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.553+0000 7f3766a00640 1 -- 172.21.15.69:0/462299960 wait complete. 2024-02-21T07:42:38.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.553+0000 7f5ed9200640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ecc10bf80 0x7f5ecc073d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.553+0000 7f5ed9200640 1 -- 172.21.15.69:0/4032324345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ecc1098b0 msgr2=0x7f5ecc0e2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.553+0000 7f5ed9200640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ecc1098b0 0x7f5ecc0e2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.553+0000 7f5ed9200640 1 -- 172.21.15.69:0/4032324345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec0009400 con 0x7f5ecc105650 2024-02-21T07:42:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.553+0000 7f5ed3e00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5ecc1098b0 0x7f5ecc0e2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.554+0000 7f5ed9200640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ecc105650 0x7f5ecc1014a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4050150 tx=0x7f5ed406bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.554+0000 7f5ed9c00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5ecc10bf80 0x7f5ecc073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.555+0000 7f5ed0c00640 1 -- 172.21.15.69:0/4032324345 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4068a90 con 0x7f5ecc105650 2024-02-21T07:42:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.555+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ecc074f60 con 0x7f5ecc105650 2024-02-21T07:42:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.555+0000 7f5ed0c00640 1 -- 172.21.15.69:0/4032324345 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4068bf0 con 0x7f5ecc105650 2024-02-21T07:42:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.557+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ecc0e2f90 con 0x7f5ecc105650 2024-02-21T07:42:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.559+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ecc10ac10 con 0x7f5ecc105650 2024-02-21T07:42:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.559+0000 7fa96aa00640 1 -- 172.21.15.69:0/2644160485 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fa96000acd0 con 0x7fa97408f160 2024-02-21T07:42:38.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.561+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 --> [v2:172.21.15.174:6826/1000763984,v1:172.21.15.174:6827/1000763984] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efddc002d30 con 0x7efde00a9c20 2024-02-21T07:42:38.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.561+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 --> [v2:172.21.15.184:6824/825193265,v1:172.21.15.184:6825/825193265] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6cd018aa30 con 0x7f6cb00b2450 2024-02-21T07:42:38.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7f6cccc00640 1 -- 172.21.15.69:0/1148696122 <== osd.2 v2:172.21.15.184:6824/825193265 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6cc80098f0 con 0x7f6cb00b2450 2024-02-21T07:42:38.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7efdfcc00640 1 -- 172.21.15.69:0/2897982903 <== osd.4 v2:172.21.15.174:6826/1000763984 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efddc002d30 con 0x7efde00a9c20 2024-02-21T07:42:38.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7f5ed0c00640 1 -- 172.21.15.69:0/4032324345 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4068a90 con 0x7f5ecc105650 2024-02-21T07:42:38.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:6826/1000763984,v1:172.21.15.174:6827/1000763984] conn(0x7efde00a9c20 msgr2=0x7efde00ac060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7efe07800640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:6826/1000763984,v1:172.21.15.174:6827/1000763984] conn(0x7efde00a9c20 0x7efde00ac060 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 >> [v2:172.21.15.184:6824/825193265,v1:172.21.15.184:6825/825193265] conn(0x7f6cb00b2450 msgr2=0x7f6cb00b4890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7f6cd7800640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.184:6824/825193265,v1:172.21.15.184:6825/825193265] conn(0x7f6cb00b2450 0x7f6cb00b4890 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cb00a7ac0 msgr2=0x7f6cb00a9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7f6cd7800640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6cb00a7ac0 0x7f6cb00a9f80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6cd017d990 tx=0x7f6cbc008040 comp rx=0 tx=0).stop 2024-02-21T07:42:38.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd008f160 msgr2=0x7f6cd0172480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7f6cd7800640 1 --2- 172.21.15.69:0/1148696122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6cd008f160 0x7f6cd0172480 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400c440 tx=0x7f6cc4001e70 comp rx=0 tx=0).stop 2024-02-21T07:42:38.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7f6cd5800640 1 -- 172.21.15.69:0/1148696122 reap_dead start 2024-02-21T07:42:38.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efde009f280 msgr2=0x7efde00a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7efe07800640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efde009f280 0x7efde00a1740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe000cb6a0 tx=0x7efdf4009040 comp rx=0 tx=0).stop 2024-02-21T07:42:38.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 shutdown_connections 2024-02-21T07:42:38.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 >> 172.21.15.69:0/1148696122 conn(0x7f6cd00d28c0 msgr2=0x7f6cd00d1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe000cd090 msgr2=0x7efe00223180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7efe07800640 1 --2- 172.21.15.69:0/2897982903 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe000cd090 0x7efe00223180 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efdec0098c0 tx=0x7efdec0046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7efe05800640 1 -- 172.21.15.69:0/2897982903 reap_dead start 2024-02-21T07:42:38.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 shutdown_connections 2024-02-21T07:42:38.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 >> 172.21.15.69:0/2897982903 conn(0x7efe000f69c0 msgr2=0x7efe00179ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.563+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 shutdown_connections 2024-02-21T07:42:38.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.564+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 --> [v2:172.21.15.69:6807/4247950924,v1:172.21.15.69:6809/4247950924] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51a0002d30 con 0x7f51a80a9be0 2024-02-21T07:42:38.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.564+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 shutdown_connections 2024-02-21T07:42:38.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.564+0000 7f6cd7800640 1 -- 172.21.15.69:0/1148696122 wait complete. 2024-02-21T07:42:38.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.565+0000 7efe07800640 1 -- 172.21.15.69:0/2897982903 wait complete. 2024-02-21T07:42:38.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.565+0000 7f51bfe00640 1 -- 172.21.15.69:0/440775002 <== osd.0 v2:172.21.15.69:6807/4247950924 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f51a0002d30 con 0x7f51a80a9be0 2024-02-21T07:42:38.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.561+0000 7fa96aa00640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa95409f2b0 0x7fa9540a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7fa96aa00640 1 -- 172.21.15.69:0/2644160485 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa9600c9b40 con 0x7fa97408f160 2024-02-21T07:42:38.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.562+0000 7fa96aa00640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.69:6800/1788647795,v1:172.21.15.69:6801/1788647795] conn(0x7fa9540a9bd0 0x7fa9540ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.565+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 >> [v2:172.21.15.69:6807/4247950924,v1:172.21.15.69:6809/4247950924] conn(0x7f51a80a9be0 msgr2=0x7f51a80ac020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.565+0000 7f51cd800640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.69:6807/4247950924,v1:172.21.15.69:6809/4247950924] conn(0x7f51a80a9be0 0x7f51a80ac020 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.565+0000 7fa972000640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa95409f2b0 0x7fa9540a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.566+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f51a809f240 msgr2=0x7f51a80a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.566+0000 7f51cd800640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f51a809f240 0x7f51a80a1700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f51b8006fd0 tx=0x7f51b8008040 comp rx=0 tx=0).stop 2024-02-21T07:42:38.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.566+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51c821c050 msgr2=0x7f51c821c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.566+0000 7f51cd800640 1 --2- 172.21.15.69:0/440775002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51c821c050 0x7f51c821c4d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f51c808e180 tx=0x7f51c0001a50 comp rx=0 tx=0).stop 2024-02-21T07:42:38.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.566+0000 7f51cce00640 1 -- 172.21.15.69:0/440775002 reap_dead start 2024-02-21T07:42:38.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.566+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 shutdown_connections 2024-02-21T07:42:38.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.566+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 >> 172.21.15.69:0/440775002 conn(0x7f51c80ce290 msgr2=0x7f51c80f5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.566+0000 7fa972000640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa95409f2b0 0x7fa9540a1770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa96c035000 tx=0x7fa96c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.567+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 shutdown_connections 2024-02-21T07:42:38.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.567+0000 7f51cd800640 1 -- 172.21.15.69:0/440775002 wait complete. 2024-02-21T07:42:38.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.567+0000 7fa96aa00640 1 -- 172.21.15.69:0/2644160485 --> [v2:172.21.15.69:6800/1788647795,v1:172.21.15.69:6801/1788647795] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9540ac6e0 con 0x7fa9540a9bd0 2024-02-21T07:42:38.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.567+0000 7fa96aa00640 1 -- 172.21.15.69:0/2644160485 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9600938e0 con 0x7fa97408f160 2024-02-21T07:42:38.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.567+0000 7fa973400640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.69:6800/1788647795,v1:172.21.15.69:6801/1788647795] conn(0x7fa9540a9bd0 0x7fa9540ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.568+0000 7fa973400640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.69:6800/1788647795,v1:172.21.15.69:6801/1788647795] conn(0x7fa9540a9bd0 0x7fa9540ac010 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.568+0000 7f5ed0c00640 1 -- 172.21.15.69:0/4032324345 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5ed4092070 con 0x7f5ecc105650 2024-02-21T07:42:38.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.570+0000 7fa96aa00640 1 -- 172.21.15.69:0/2644160485 <== osd.6 v2:172.21.15.69:6800/1788647795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa9540ac6e0 con 0x7fa9540a9bd0 2024-02-21T07:42:38.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.570+0000 7f5ed0c00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5eb409f190 0x7f5eb40a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.571+0000 7f5ed3e00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5eb409f190 0x7f5eb40a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.572+0000 7f5ed0c00640 1 -- 172.21.15.69:0/4032324345 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f5ed4144ec0 con 0x7f5ecc105650 2024-02-21T07:42:38.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.572+0000 7f5ed3e00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5eb409f190 0x7f5eb40a1650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc07e860 tx=0x7f5ec0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.572+0000 7f5ed0c00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.69:6814/776969315,v1:172.21.15.69:6816/776969315] conn(0x7f5eb40a9b30 0x7f5eb40abf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.573+0000 7f5ed9c00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.69:6814/776969315,v1:172.21.15.69:6816/776969315] conn(0x7f5eb40a9b30 0x7f5eb40abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.573+0000 7f5ed0c00640 1 -- 172.21.15.69:0/4032324345 --> [v2:172.21.15.69:6814/776969315,v1:172.21.15.69:6816/776969315] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5eb40ac640 con 0x7f5eb40a9b30 2024-02-21T07:42:38.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.573+0000 7f5ed0c00640 1 -- 172.21.15.69:0/4032324345 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ed4145270 con 0x7f5ecc105650 2024-02-21T07:42:38.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.574+0000 7f5ed9c00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.69:6814/776969315,v1:172.21.15.69:6816/776969315] conn(0x7f5eb40a9b30 0x7f5eb40abf70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.575+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 --> [v2:172.21.15.174:6808/3466097956,v1:172.21.15.174:6810/3466097956] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5778186f60 con 0x7f57580a9c20 2024-02-21T07:42:38.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.576+0000 7f5ed0c00640 1 -- 172.21.15.69:0/4032324345 <== osd.9 v2:172.21.15.69:6814/776969315 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5eb40ac640 con 0x7f5eb40a9b30 2024-02-21T07:42:38.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.579+0000 7f576fe00640 1 -- 172.21.15.69:0/3031565414 <== osd.1 v2:172.21.15.174:6808/3466097956 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5764001510 con 0x7f57580a9c20 2024-02-21T07:42:38.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.581+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:6808/3466097956,v1:172.21.15.174:6810/3466097956] conn(0x7f57580a9c20 msgr2=0x7f57580ac060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.581+0000 7f577ec00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:6808/3466097956,v1:172.21.15.174:6810/3466097956] conn(0x7f57580a9c20 0x7f57580ac060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.581+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f575809f280 msgr2=0x7f57580a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.581+0000 7f577ec00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f575809f280 0x7f57580a1740 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5768036000 tx=0x7f576803c040 comp rx=0 tx=0).stop 2024-02-21T07:42:38.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.582+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f577818c600 msgr2=0x7f577821c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.582+0000 7f577ec00640 1 --2- 172.21.15.69:0/3031565414 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f577818c600 0x7f577821c000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f577000c780 tx=0x7f577000cc40 comp rx=0 tx=0).stop 2024-02-21T07:42:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.582+0000 7f577cc00640 1 -- 172.21.15.69:0/3031565414 reap_dead start 2024-02-21T07:42:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.582+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 shutdown_connections 2024-02-21T07:42:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.582+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 >> 172.21.15.69:0/3031565414 conn(0x7f5778071b80 msgr2=0x7f5778068a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.582+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 shutdown_connections 2024-02-21T07:42:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.583+0000 7f577ec00640 1 -- 172.21.15.69:0/3031565414 wait complete. 2024-02-21T07:42:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.584+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 --> [v2:172.21.15.184:6816/2071034595,v1:172.21.15.184:6817/2071034595] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7bb00f5db0 con 0x7f7b900a9b90 2024-02-21T07:42:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.585+0000 7f7bad600640 1 -- 172.21.15.69:0/145240947 <== osd.5 v2:172.21.15.184:6816/2071034595 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ba400a6c0 con 0x7f7b900a9b90 2024-02-21T07:42:38.631 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:38.632 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-21T07:42:38.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.587+0000 7f9a2e400640 1 Processor -- start 2024-02-21T07:42:38.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.587+0000 7f9a2e400640 1 -- start start 2024-02-21T07:42:38.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.590+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 >> [v2:172.21.15.184:6816/2071034595,v1:172.21.15.184:6817/2071034595] conn(0x7f7b900a9b90 msgr2=0x7f7b900abfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.590+0000 7f7bb6e00640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.184:6816/2071034595,v1:172.21.15.184:6817/2071034595] conn(0x7f7b900a9b90 0x7f7b900abfd0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.590+0000 7f9a2e400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9a20106fa0 0x7f9a200543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.590+0000 7f9a2e400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9a200548f0 0x7f9a20107f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.590+0000 7f9a2e400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a20108b50 con 0x7f9a20054d80 2024-02-21T07:42:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.590+0000 7f9a2e400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2007ab20 con 0x7f9a200548f0 2024-02-21T07:42:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.590+0000 7f9a2e400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a20107ae0 con 0x7f9a20106fa0 2024-02-21T07:42:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.590+0000 7f9a26a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9a200548f0 0x7f9a20107f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.590+0000 7f9a26a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9a200548f0 0x7f9a20107f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:51194/0 (socket says 172.21.15.69:51194) 2024-02-21T07:42:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.590+0000 7f9a26a00640 1 -- 172.21.15.69:0/284357018 learned_addr learned my addr 172.21.15.69:0/284357018 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f9a27400640 1 --2- 172.21.15.69:0/284357018 >> v2:172.21.15.184:3300/0 conn(0x7f9a20106fa0 0x7f9a200543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f9a26a00640 1 -- 172.21.15.69:0/284357018 >> v2:172.21.15.184:3300/0 conn(0x7f9a20106fa0 msgr2=0x7f9a200543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:38.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f9a26a00640 1 --2- 172.21.15.69:0/284357018 >> v2:172.21.15.184:3300/0 conn(0x7f9a20106fa0 0x7f9a200543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7b9009f200 msgr2=0x7f7b900a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f7bb6e00640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7b9009f200 0x7f7b900a16c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0069200 tx=0x7f7b9c03d040 comp rx=0 tx=0).stop 2024-02-21T07:42:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb018b0f0 msgr2=0x7f7bb0221660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f7bb6e00640 1 --2- 172.21.15.69:0/145240947 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7bb018b0f0 0x7f7bb0221660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800cce0 tx=0x7f7ba800a650 comp rx=0 tx=0).stop 2024-02-21T07:42:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f7bb6400640 1 -- 172.21.15.69:0/145240947 reap_dead start 2024-02-21T07:42:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 shutdown_connections 2024-02-21T07:42:38.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 >> 172.21.15.69:0/145240947 conn(0x7f7bb00f6840 msgr2=0x7f7bb006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f9a26a00640 1 -- 172.21.15.69:0/284357018 >> v1:172.21.15.174:6789/0 conn(0x7f9a20054d80 legacy=0x7f9a20108440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.591+0000 7f9a26a00640 1 -- 172.21.15.69:0/284357018 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2010a5c0 con 0x7f9a200548f0 2024-02-21T07:42:38.636 INFO:teuthology.orchestra.run.smithi069.stdout:73014444045 2024-02-21T07:42:38.637 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:38.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.594+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 shutdown_connections 2024-02-21T07:42:38.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.594+0000 7f7bb6e00640 1 -- 172.21.15.69:0/145240947 wait complete. 2024-02-21T07:42:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.594+0000 7f9a26a00640 1 --2- 172.21.15.69:0/284357018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a200548f0 0x7f9a20107f00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9a20012b60 tx=0x7f9a1402c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=406d12586feb9e1e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.594+0000 7f9a26000640 1 -- 172.21.15.69:0/284357018 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14031870 con 0x7f9a200548f0 2024-02-21T07:42:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.594+0000 7f9a26000640 1 -- 172.21.15.69:0/284357018 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a140319d0 con 0x7f9a200548f0 2024-02-21T07:42:38.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.594+0000 7f9a26000640 1 -- 172.21.15.69:0/284357018 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14031da0 con 0x7f9a200548f0 2024-02-21T07:42:38.639 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-21T07:42:38.639 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-21T07:42:38.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.596+0000 7f1746a00640 1 -- 172.21.15.69:0/1515385918 --> [v2:172.21.15.69:6822/3267685751,v1:172.21.15.69:6825/3267685751] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1734002cb0 con 0x7f173c0a9ba0 2024-02-21T07:42:38.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.596+0000 7f9a2e400640 1 -- 172.21.15.69:0/284357018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a200548f0 msgr2=0x7f9a20107f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.596+0000 7f9a2e400640 1 --2- 172.21.15.69:0/284357018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a200548f0 0x7f9a20107f00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9a20012b60 tx=0x7f9a1402c9b0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.597+0000 7f9a2e400640 1 -- 172.21.15.69:0/284357018 shutdown_connections 2024-02-21T07:42:38.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.597+0000 7f9a2e400640 1 --2- 172.21.15.69:0/284357018 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a200548f0 0x7f9a20107f00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.597+0000 7f9a2e400640 1 --2- 172.21.15.69:0/284357018 >> v2:172.21.15.184:3300/0 conn(0x7f9a20106fa0 0x7f9a200543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.597+0000 7f9a2e400640 1 -- 172.21.15.69:0/284357018 >> 172.21.15.69:0/284357018 conn(0x7f9a20052e10 msgr2=0x7f9a20053220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.597+0000 7f1755600640 1 -- 172.21.15.69:0/1515385918 <== osd.3 v2:172.21.15.69:6822/3267685751 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1734002cb0 con 0x7f173c0a9ba0 2024-02-21T07:42:38.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.598+0000 7f9a2e400640 1 -- 172.21.15.69:0/284357018 shutdown_connections 2024-02-21T07:42:38.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.598+0000 7f1746a00640 1 -- 172.21.15.69:0/1515385918 >> [v2:172.21.15.69:6822/3267685751,v1:172.21.15.69:6825/3267685751] conn(0x7f173c0a9ba0 msgr2=0x7f173c0abfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.598+0000 7f1746a00640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.69:6822/3267685751,v1:172.21.15.69:6825/3267685751] conn(0x7f173c0a9ba0 0x7f173c0abfe0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.599+0000 7f1746a00640 1 -- 172.21.15.69:0/1515385918 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f173c09f200 msgr2=0x7f173c0a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.599+0000 7f1746a00640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f173c09f200 0x7f173c0a16c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1748000fd0 tx=0x7f1748001640 comp rx=0 tx=0).stop 2024-02-21T07:42:38.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.599+0000 7f1746a00640 1 -- 172.21.15.69:0/1515385918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17500ff9b0 msgr2=0x7f17500e2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.599+0000 7f1746a00640 1 --2- 172.21.15.69:0/1515385918 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f17500ff9b0 0x7f17500e2820 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f175007b2f0 tx=0x7f174c00e900 comp rx=0 tx=0).stop 2024-02-21T07:42:38.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.599+0000 7f175e600640 1 -- 172.21.15.69:0/1515385918 reap_dead start 2024-02-21T07:42:38.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.599+0000 7f1746a00640 1 -- 172.21.15.69:0/1515385918 shutdown_connections 2024-02-21T07:42:38.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.599+0000 7f1746a00640 1 -- 172.21.15.69:0/1515385918 >> 172.21.15.69:0/1515385918 conn(0x7f1750052de0 msgr2=0x7f17500556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.599+0000 7f1746a00640 1 -- 172.21.15.69:0/1515385918 shutdown_connections 2024-02-21T07:42:38.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.599+0000 7f1746a00640 1 -- 172.21.15.69:0/1515385918 wait complete. 2024-02-21T07:42:38.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.598+0000 7f9a2e400640 1 -- 172.21.15.69:0/284357018 wait complete. 2024-02-21T07:42:38.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.602+0000 7f9a2e400640 1 Processor -- start 2024-02-21T07:42:38.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.602+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 --> [v2:172.21.15.174:6802/1736166221,v1:172.21.15.174:6803/1736166221] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f00002d30 con 0x7f1f080adf90 2024-02-21T07:42:38.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.602+0000 7f9a2e400640 1 -- start start 2024-02-21T07:42:38.644 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:38.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.605+0000 7f9a2e400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a200548f0 0x7f9a200f9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.645 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-21T07:42:38.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.605+0000 7f1f1fe00640 1 -- 172.21.15.69:0/1953259425 <== osd.10 v2:172.21.15.174:6802/1736166221 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1f00002d30 con 0x7f1f080adf90 2024-02-21T07:42:38.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f9a2e400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a20054d80 0x7f9a201a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 --> [v2:172.21.15.69:6800/1788647795,v1:172.21.15.69:6801/1788647795] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa97418aa30 con 0x7fa9540a9bd0 2024-02-21T07:42:38.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f9a2e400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a20106fa0 0x7f9a201a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:6802/1736166221,v1:172.21.15.174:6803/1736166221] conn(0x7f1f080adf90 msgr2=0x7f1f080b03d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f1f2f000640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:6802/1736166221,v1:172.21.15.174:6803/1736166221] conn(0x7f1f080adf90 0x7f1f080b03d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f9a2e400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20109270 con 0x7f9a200548f0 2024-02-21T07:42:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1f080a35f0 msgr2=0x7f1f080a5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f1f2f000640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1f080a35f0 0x7f1f080a5ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1f18006fd0 tx=0x7f1f18008040 comp rx=0 tx=0).stop 2024-02-21T07:42:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f28181940 msgr2=0x7f1f2821d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f1f2f000640 1 --2- 172.21.15.69:0/1953259425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1f28181940 0x7f1f2821d500 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1f14000c00 tx=0x7f1f140046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.607+0000 7fa96aa00640 1 -- 172.21.15.69:0/2644160485 <== osd.6 v2:172.21.15.69:6800/1788647795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa964009600 con 0x7fa9540a9bd0 2024-02-21T07:42:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.607+0000 7f1f2d000640 1 -- 172.21.15.69:0/1953259425 reap_dead start 2024-02-21T07:42:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.607+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 shutdown_connections 2024-02-21T07:42:38.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.607+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 >> 172.21.15.69:0/1953259425 conn(0x7f1f280f69c0 msgr2=0x7f1f280f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f9a27400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a200548f0 0x7f9a200f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f9a27e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a20106fa0 0x7f9a201a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.607+0000 7f9a27e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a20106fa0 0x7f9a201a0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:51202/0 (socket says 172.21.15.69:51202) 2024-02-21T07:42:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.607+0000 7f9a27e00640 1 -- 172.21.15.69:0/915434168 learned_addr learned my addr 172.21.15.69:0/915434168 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f9a26a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a20054d80 0x7f9a201a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.606+0000 7f9a2e400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20109550 con 0x7f9a20106fa0 2024-02-21T07:42:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.607+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20109830 con 0x7f9a20054d80 2024-02-21T07:42:38.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 --> [v2:172.21.15.184:6800/2169979443,v1:172.21.15.184:6801/2169979443] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f667c002d30 con 0x7f66800a9ad0 2024-02-21T07:42:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 >> [v2:172.21.15.69:6800/1788647795,v1:172.21.15.69:6801/1788647795] conn(0x7fa9540a9bd0 msgr2=0x7fa9540ac010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7fa979800640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.69:6800/1788647795,v1:172.21.15.69:6801/1788647795] conn(0x7fa9540a9bd0 0x7fa9540ac010 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.607+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 shutdown_connections 2024-02-21T07:42:38.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.607+0000 7f1f2f000640 1 -- 172.21.15.69:0/1953259425 wait complete. 2024-02-21T07:42:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa95409f2b0 msgr2=0x7fa9540a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7fa979800640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa95409f2b0 0x7fa9540a1770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa96c035000 tx=0x7fa96c030000 comp rx=0 tx=0).stop 2024-02-21T07:42:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa97408f160 msgr2=0x7fa9740cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7f9a27e00640 1 -- 172.21.15.69:0/915434168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a20054d80 msgr2=0x7f9a201a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7fa979800640 1 --2- 172.21.15.69:0/2644160485 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa97408f160 0x7fa9740cf6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c780 tx=0x7fa96000cc40 comp rx=0 tx=0).stop 2024-02-21T07:42:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7f669d600640 1 -- 172.21.15.69:0/3141754025 <== osd.8 v2:172.21.15.184:6800/2169979443 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f667c002d30 con 0x7f66800a9ad0 2024-02-21T07:42:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.609+0000 7fa973400640 1 -- 172.21.15.69:0/2644160485 reap_dead start 2024-02-21T07:42:38.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7f9a27e00640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a20054d80 0x7f9a201a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7f9a27e00640 1 -- 172.21.15.69:0/915434168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a200548f0 msgr2=0x7f9a200f9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7f9a27e00640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9a200548f0 0x7f9a200f9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.608+0000 7f9a27e00640 1 -- 172.21.15.69:0/915434168 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140094d0 con 0x7f9a20106fa0 2024-02-21T07:42:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.609+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 shutdown_connections 2024-02-21T07:42:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.609+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 >> 172.21.15.69:0/2644160485 conn(0x7fa9740d28c0 msgr2=0x7fa97417ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.609+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 shutdown_connections 2024-02-21T07:42:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.609+0000 7fa979800640 1 -- 172.21.15.69:0/2644160485 wait complete. 2024-02-21T07:42:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.610+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 >> [v2:172.21.15.184:6800/2169979443,v1:172.21.15.184:6801/2169979443] conn(0x7f66800a9ad0 msgr2=0x7f66800abf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.610+0000 7f66a6e00640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.184:6800/2169979443,v1:172.21.15.184:6801/2169979443] conn(0x7f66800a9ad0 0x7f66800abf10 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.609+0000 7f9a27e00640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a20106fa0 0x7f9a201a0880 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00c3c0 tx=0x7f9a1c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.609+0000 7f9a1b400640 1 -- 172.21.15.69:0/915434168 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0052d0 con 0x7f9a20106fa0 2024-02-21T07:42:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.610+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a20109b10 con 0x7f9a20106fa0 2024-02-21T07:42:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.610+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2010a0d0 con 0x7f9a20106fa0 2024-02-21T07:42:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.610+0000 7f9a1b400640 1 -- 172.21.15.69:0/915434168 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c005430 con 0x7f9a20106fa0 2024-02-21T07:42:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.610+0000 7f9a1b400640 1 -- 172.21.15.69:0/915434168 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c0052d0 con 0x7f9a20106fa0 2024-02-21T07:42:38.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.610+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f668009f1b0 msgr2=0x7f66800a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.611+0000 7f66a6e00640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f668009f1b0 0x7f66800a1670 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f668c034000 tx=0x7f668c007000 comp rx=0 tx=0).stop 2024-02-21T07:42:38.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.611+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a021e690 msgr2=0x7f66a017c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.611+0000 7f66a6e00640 1 --2- 172.21.15.69:0/3141754025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66a021e690 0x7f66a017c3e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f66a008e050 tx=0x7f6698010630 comp rx=0 tx=0).stop 2024-02-21T07:42:38.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.611+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a04001030 con 0x7f9a20106fa0 2024-02-21T07:42:38.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.611+0000 7f66a6400640 1 -- 172.21.15.69:0/3141754025 reap_dead start 2024-02-21T07:42:38.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.611+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 shutdown_connections 2024-02-21T07:42:38.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.612+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 >> 172.21.15.69:0/3141754025 conn(0x7f66a00f6840 msgr2=0x7f66a01723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.612+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 shutdown_connections 2024-02-21T07:42:38.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.612+0000 7f66a6e00640 1 -- 172.21.15.69:0/3141754025 wait complete. 2024-02-21T07:42:38.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.614+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 --> [v2:172.21.15.69:6814/776969315,v1:172.21.15.69:6816/776969315] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ecc10a930 con 0x7f5eb40a9b30 2024-02-21T07:42:38.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.615+0000 7f5ed0c00640 1 -- 172.21.15.69:0/4032324345 <== osd.9 v2:172.21.15.69:6814/776969315 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ec800a9e0 con 0x7f5eb40a9b30 2024-02-21T07:42:38.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.616+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 >> [v2:172.21.15.69:6814/776969315,v1:172.21.15.69:6816/776969315] conn(0x7f5eb40a9b30 msgr2=0x7f5eb40abf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.616+0000 7f5edbc00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.69:6814/776969315,v1:172.21.15.69:6816/776969315] conn(0x7f5eb40a9b30 0x7f5eb40abf70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.616+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5eb409f190 msgr2=0x7f5eb40a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.616+0000 7f5edbc00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5eb409f190 0x7f5eb40a1650 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc07e860 tx=0x7f5ec0008030 comp rx=0 tx=0).stop 2024-02-21T07:42:38.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.616+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ecc105650 msgr2=0x7f5ecc1014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.616+0000 7f5edbc00640 1 --2- 172.21.15.69:0/4032324345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5ecc105650 0x7f5ecc1014a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4050150 tx=0x7f5ed406bf00 comp rx=0 tx=0).stop 2024-02-21T07:42:38.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.617+0000 7f5ed9c00640 1 -- 172.21.15.69:0/4032324345 reap_dead start 2024-02-21T07:42:38.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.617+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 shutdown_connections 2024-02-21T07:42:38.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.617+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 >> 172.21.15.69:0/4032324345 conn(0x7f5ecc052de0 msgr2=0x7f5ecc004b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.617+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 shutdown_connections 2024-02-21T07:42:38.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.617+0000 7f9a1b400640 1 -- 172.21.15.69:0/915434168 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f9a1c007020 con 0x7f9a20106fa0 2024-02-21T07:42:38.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.617+0000 7f5edbc00640 1 -- 172.21.15.69:0/4032324345 wait complete. 2024-02-21T07:42:38.662 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:38.662 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-21T07:42:38.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.619+0000 7f9a1b400640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9a0809f210 0x7f9a080a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.619+0000 7f9a1b400640 1 -- 172.21.15.69:0/915434168 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f9a1c0c8dd0 con 0x7f9a20106fa0 2024-02-21T07:42:38.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.620+0000 7f9a1b400640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.184:6808/1731856636,v1:172.21.15.184:6809/1731856636] conn(0x7f9a080a9bb0 0x7f9a080abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:38.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.620+0000 7f9a1b400640 1 -- 172.21.15.69:0/915434168 --> [v2:172.21.15.184:6808/1731856636,v1:172.21.15.184:6809/1731856636] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a080ac6c0 con 0x7f9a080a9bb0 2024-02-21T07:42:38.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.620+0000 7f9a1b400640 1 -- 172.21.15.69:0/915434168 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a1c0c9180 con 0x7f9a20106fa0 2024-02-21T07:42:38.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.620+0000 7f9a27400640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9a0809f210 0x7f9a080a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.621+0000 7f9a26a00640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.184:6808/1731856636,v1:172.21.15.184:6809/1731856636] conn(0x7f9a080a9bb0 0x7f9a080abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:38.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.623+0000 7f9a26a00640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.184:6808/1731856636,v1:172.21.15.184:6809/1731856636] conn(0x7f9a080a9bb0 0x7f9a080abff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.664 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:38.665 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-21T07:42:38.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.623+0000 7f9a27400640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9a0809f210 0x7f9a080a16d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a2802d330 tx=0x7f9a2806d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:38.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.624+0000 7f9a1b400640 1 -- 172.21.15.69:0/915434168 <== osd.11 v2:172.21.15.184:6808/1731856636 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9a080ac6c0 con 0x7f9a080a9bb0 2024-02-21T07:42:38.666 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:38.667 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-21T07:42:38.667 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:38.668 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-02-21T07:42:38.669 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:38.669 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-02-21T07:42:38.670 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:38.670 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-21T07:42:38.671 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:38.672 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-02-21T07:42:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.643+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 --> [v2:172.21.15.184:6808/1731856636,v1:172.21.15.184:6809/1731856636] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a04002d30 con 0x7f9a080a9bb0 2024-02-21T07:42:38.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.643+0000 7f9a1b400640 1 -- 172.21.15.69:0/915434168 <== osd.11 v2:172.21.15.184:6808/1731856636 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a04002d30 con 0x7f9a080a9bb0 2024-02-21T07:42:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 >> [v2:172.21.15.184:6808/1731856636,v1:172.21.15.184:6809/1731856636] conn(0x7f9a080a9bb0 msgr2=0x7f9a080abff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a2e400640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.184:6808/1731856636,v1:172.21.15.184:6809/1731856636] conn(0x7f9a080a9bb0 0x7f9a080abff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9a0809f210 msgr2=0x7f9a080a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a2e400640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9a0809f210 0x7f9a080a16d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9a2802d330 tx=0x7f9a2806d040 comp rx=0 tx=0).stop 2024-02-21T07:42:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a20106fa0 msgr2=0x7f9a201a0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a2e400640 1 --2- 172.21.15.69:0/915434168 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9a20106fa0 0x7f9a201a0880 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00c3c0 tx=0x7f9a1c00c880 comp rx=0 tx=0).stop 2024-02-21T07:42:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a27e00640 1 -- 172.21.15.69:0/915434168 reap_dead start 2024-02-21T07:42:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 shutdown_connections 2024-02-21T07:42:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 >> 172.21.15.69:0/915434168 conn(0x7f9a20052e10 msgr2=0x7f9a200531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 shutdown_connections 2024-02-21T07:42:38.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:38.644+0000 7f9a2e400640 1 -- 172.21.15.69:0/915434168 wait complete. 2024-02-21T07:42:38.675 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:38.676 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-02-21T07:42:39.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.068+0000 7fcd03c00640 1 Processor -- start 2024-02-21T07:42:39.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.068+0000 7fcd03c00640 1 -- start start 2024-02-21T07:42:39.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.074+0000 7fcd03c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fccfc0f8bc0 0x7fccfc0f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.074+0000 7f3294400640 1 Processor -- start 2024-02-21T07:42:39.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.074+0000 7fcd01200640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fccfc185da0 0x7fccfc0cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:48754/0 (socket says 172.21.15.69:48754) 2024-02-21T07:42:39.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.074+0000 7f3294400640 1 -- start start 2024-02-21T07:42:39.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.075+0000 7fcd03c00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc0f9e90 con 0x7fccfc0f95b0 2024-02-21T07:42:39.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.075+0000 7fcd03c00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc1869a0 con 0x7fccfc185da0 2024-02-21T07:42:39.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.075+0000 7fcd03c00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccfc187620 con 0x7fccfc0f8bc0 2024-02-21T07:42:39.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.075+0000 7fcd01200640 1 -- 172.21.15.69:0/1437961352 learned_addr learned my addr 172.21.15.69:0/1437961352 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:39.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.076+0000 7fccfbe00640 1 --2- 172.21.15.69:0/1437961352 >> v2:172.21.15.69:3300/0 conn(0x7fccfc0f8bc0 0x7fccfc0f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.077+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889255652 0 0) 0x7fccfc1869a0 con 0x7fccfc185da0 2024-02-21T07:42:39.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.077+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce0003520 con 0x7fccfc185da0 2024-02-21T07:42:39.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.077+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965258192 0 0) 0x7fccfc0f9e90 con 0x7fccfc0f95b0 2024-02-21T07:42:39.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.077+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccfc1869a0 con 0x7fccfc0f95b0 2024-02-21T07:42:39.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.077+0000 7f3294400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3284110db0 0x7f32840792c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1267533207 0 0) 0x7fcce0003520 con 0x7fccfc185da0 2024-02-21T07:42:39.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 >> v2:172.21.15.69:3300/0 conn(0x7fccfc0f8bc0 msgr2=0x7fccfc0f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7f3294400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328410bf30 con 0x7f3284112630 2024-02-21T07:42:39.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7f3294400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328410f970 con 0x7f328410bb50 2024-02-21T07:42:39.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7f3294400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328407a1f0 con 0x7f3284110db0 2024-02-21T07:42:39.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 --2- 172.21.15.69:0/1437961352 >> v2:172.21.15.69:3300/0 conn(0x7fccfc0f8bc0 0x7fccfc0f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 >> v1:172.21.15.174:6789/0 conn(0x7fccfc0f95b0 legacy=0x7fccfc18f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7f3291a00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f328410bb50 0x7f3284111f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:48760/0 (socket says 172.21.15.69:48760) 2024-02-21T07:42:39.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7f3291a00640 1 -- 172.21.15.69:0/6658535 learned_addr learned my addr 172.21.15.69:0/6658535 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:39.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.079+0000 7f3292400640 1 --2- 172.21.15.69:0/6658535 >> v2:172.21.15.69:3300/0 conn(0x7f3284110db0 0x7f32840792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc186c80 con 0x7fccfc185da0 2024-02-21T07:42:39.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7fccec001670 con 0x7fccfc185da0 2024-02-21T07:42:39.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 >> v1:172.21.15.184:6789/0 conn(0x7fccfc185da0 legacy=0x7fccfc0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.080+0000 7f328be00640 1 -- 172.21.15.69:0/6658535 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164954822 0 0) 0x7f328410f970 con 0x7f328410bb50 2024-02-21T07:42:39.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.080+0000 7f328be00640 1 -- 172.21.15.69:0/6658535 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3274003520 con 0x7f328410bb50 2024-02-21T07:42:39.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.080+0000 7f328be00640 1 -- 172.21.15.69:0/6658535 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419651793 0 0) 0x7f328410bf30 con 0x7f3284112630 2024-02-21T07:42:39.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.080+0000 7f328be00640 1 -- 172.21.15.69:0/6658535 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32740048a0 con 0x7f3284112630 2024-02-21T07:42:39.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcce0004bb0 0x7fcce0004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0003760 0x7fcce0003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcce0004270 0x7fcce000ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf4001460 con 0x7fcce0004bb0 2024-02-21T07:42:39.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc187620 con 0x7fcce0004270 2024-02-21T07:42:39.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.078+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce000c310 con 0x7fcce0003760 2024-02-21T07:42:39.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.080+0000 7fccfbe00640 1 --2- 172.21.15.69:0/1437961352 >> v2:172.21.15.69:3300/0 conn(0x7fccfc0f8bc0 0x7fccfc0f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:39.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.081+0000 7f3292400640 1 -- 172.21.15.69:0/6658535 >> v1:172.21.15.184:6789/0 conn(0x7f328410bb50 legacy=0x7f3284111f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.081+0000 7f328be00640 1 -- 172.21.15.69:0/6658535 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2848432560 0 0) 0x7f32740048a0 con 0x7f3284112630 2024-02-21T07:42:39.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.081+0000 7f3292400640 1 -- 172.21.15.69:0/6658535 >> v1:172.21.15.174:6789/0 conn(0x7f3284112630 legacy=0x7f32841106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.082+0000 7f3292400640 1 -- 172.21.15.69:0/6658535 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328407a4d0 con 0x7f3284110db0 2024-02-21T07:42:39.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.081+0000 7fcd01c00640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcce0004270 0x7fcce000ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.082+0000 7fccfbe00640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0003760 0x7fcce0003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.082+0000 7fcd01200640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcce0004bb0 0x7fcce0004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.083+0000 7fcd01c00640 1 -- 172.21.15.69:0/1437961352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0003760 msgr2=0x7fcce0003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.083+0000 7fcd01c00640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0003760 0x7fcce0003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.083+0000 7fcd01c00640 1 -- 172.21.15.69:0/1437961352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcce0004bb0 msgr2=0x7fcce0004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.083+0000 7fcd01c00640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcce0004bb0 0x7fcce0004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.083+0000 7fcd01c00640 1 -- 172.21.15.69:0/1437961352 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc186c80 con 0x7fcce0004270 2024-02-21T07:42:39.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.086+0000 7fc88f800640 1 Processor -- start 2024-02-21T07:42:39.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.087+0000 7fc88f800640 1 -- start start 2024-02-21T07:42:39.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.087+0000 7fcd01c00640 1 -- 172.21.15.69:0/1437961352 reap_dead start 2024-02-21T07:42:39.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.088+0000 7fcd01c00640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcce0004270 0x7fcce000ba00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c1e0 tx=0x7fcce00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=221608b120d1bc6d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.089+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4003b70 con 0x7fcce0004270 2024-02-21T07:42:39.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.087+0000 7f3292400640 1 --2- 172.21.15.69:0/6658535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3284110db0 0x7f32840792c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f327c0097a0 tx=0x7f327c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e65c095daf6ce31 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.089+0000 7f328be00640 1 -- 172.21.15.69:0/6658535 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280001650 con 0x7f3284110db0 2024-02-21T07:42:39.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.089+0000 7f328be00640 1 -- 172.21.15.69:0/6658535 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c02e050 con 0x7f3284110db0 2024-02-21T07:42:39.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.089+0000 7f328be00640 1 -- 172.21.15.69:0/6658535 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c030730 con 0x7f3284110db0 2024-02-21T07:42:39.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.089+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4003cf0 con 0x7fcce0004270 2024-02-21T07:42:39.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.089+0000 7fccfb400640 1 -- 172.21.15.69:0/1437961352 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf402ca50 con 0x7fcce0004270 2024-02-21T07:42:39.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.090+0000 7f3294400640 1 -- 172.21.15.69:0/6658535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3284110db0 msgr2=0x7f32840792c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.090+0000 7f3294400640 1 --2- 172.21.15.69:0/6658535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3284110db0 0x7f32840792c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f327c0097a0 tx=0x7f327c02b710 comp rx=0 tx=0).stop 2024-02-21T07:42:39.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.090+0000 7fcd03c00640 1 -- 172.21.15.69:0/1437961352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcce0004270 msgr2=0x7fcce000ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.090+0000 7fcd03c00640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcce0004270 0x7fcce000ba00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c1e0 tx=0x7fcce00057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7fcd03c00640 1 -- 172.21.15.69:0/1437961352 shutdown_connections 2024-02-21T07:42:39.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7fcd03c00640 1 --2- 172.21.15.69:0/1437961352 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcce0004270 0x7fcce000ba00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7f3294400640 1 -- 172.21.15.69:0/6658535 shutdown_connections 2024-02-21T07:42:39.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7f3294400640 1 --2- 172.21.15.69:0/6658535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3284110db0 0x7f32840792c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7f3294400640 1 -- 172.21.15.69:0/6658535 >> 172.21.15.69:0/6658535 conn(0x7f3284052e10 msgr2=0x7f3284053220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7fcd03c00640 1 -- 172.21.15.69:0/1437961352 >> 172.21.15.69:0/1437961352 conn(0x7fccfc071b80 msgr2=0x7fccfc0668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7f5b99800640 1 Processor -- start 2024-02-21T07:42:39.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7fcd03c00640 1 -- 172.21.15.69:0/1437961352 shutdown_connections 2024-02-21T07:42:39.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7f3294400640 1 -- 172.21.15.69:0/6658535 shutdown_connections 2024-02-21T07:42:39.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7f3294400640 1 -- 172.21.15.69:0/6658535 wait complete. 2024-02-21T07:42:39.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7fcd03c00640 1 -- 172.21.15.69:0/1437961352 wait complete. 2024-02-21T07:42:39.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.092+0000 7fa9e1a00640 1 Processor -- start 2024-02-21T07:42:39.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.092+0000 7f2897600640 1 Processor -- start 2024-02-21T07:42:39.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.092+0000 7f2897600640 1 -- start start 2024-02-21T07:42:39.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.091+0000 7f5b99800640 1 -- start start 2024-02-21T07:42:39.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.095+0000 7f5b99800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5b940f61f0 0x7f5b94186d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.095+0000 7fc88f800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc888182240 0x7fc888182810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.095+0000 7f5b99800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5b941872d0 0x7f5b940f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.095+0000 7f5b99800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9417faf0 con 0x7f5b9417f710 2024-02-21T07:42:39.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.095+0000 7f5b98e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5b941872d0 0x7f5b940f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7f5b98e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5b941872d0 0x7f5b940f68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34242/0 (socket says 172.21.15.69:34242) 2024-02-21T07:42:39.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7fc88ce00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc888182240 0x7fc888182810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7fc88ce00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc888182240 0x7fc888182810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42074/0 (socket says 172.21.15.69:42074) 2024-02-21T07:42:39.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7fc88ce00640 1 -- 172.21.15.69:0/3603066880 learned_addr learned my addr 172.21.15.69:0/3603066880 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7f5b98e00640 1 -- 172.21.15.69:0/121082773 learned_addr learned my addr 172.21.15.69:0/121082773 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.093+0000 7fa9e1a00640 1 -- start start 2024-02-21T07:42:39.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.095+0000 7fa9e1a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa9dc181d20 0x7fa9dc1828c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.095+0000 7fa9e1a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa9dc1821b0 0x7fa9dc182e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.095+0000 7fa9e1a00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc0f6100 con 0x7fa9dc181940 2024-02-21T07:42:39.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.095+0000 7fa9e1a00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0f5210 con 0x7fa9dc1821b0 2024-02-21T07:42:39.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.095+0000 7fa9e1a00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0f54f0 con 0x7fa9dc181d20 2024-02-21T07:42:39.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7fa9da000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa9dc181d20 0x7fa9dc1828c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7fa9daa00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fa9dc181940 0x7fa9dc0f4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:48780/0 (socket says 172.21.15.69:48780) 2024-02-21T07:42:39.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7fa9daa00640 1 -- 172.21.15.69:0/2813586588 learned_addr learned my addr 172.21.15.69:0/2813586588 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:39.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7fc88f800640 1 --2- 172.21.15.69:0/3603066880 >> v2:172.21.15.184:3300/0 conn(0x7fc888188a50 0x7fc8880d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7f5b99800640 1 -- 172.21.15.69:0/121082773 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b940f66a0 con 0x7f5b940f61f0 2024-02-21T07:42:39.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7fa9da000640 1 -- 172.21.15.69:0/2813586588 >> v2:172.21.15.174:3300/0 conn(0x7fa9dc1821b0 msgr2=0x7fa9dc182e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:42:39.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7f5b99800640 1 -- 172.21.15.69:0/121082773 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b94189ab0 con 0x7f5b941872d0 2024-02-21T07:42:39.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7fa9da000640 1 --2- 172.21.15.69:0/2813586588 >> v2:172.21.15.174:3300/0 conn(0x7fa9dc1821b0 0x7fa9dc182e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.096+0000 7fa9da000640 1 -- 172.21.15.69:0/2813586588 >> v1:172.21.15.184:6789/0 conn(0x7fa9dc181940 legacy=0x7fa9dc0f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.097+0000 7fa9da000640 1 -- 172.21.15.69:0/2813586588 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc0f57d0 con 0x7fa9dc181d20 2024-02-21T07:42:39.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.097+0000 7fcd03c00640 1 Processor -- start 2024-02-21T07:42:39.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.094+0000 7f3294400640 1 Processor -- start 2024-02-21T07:42:39.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.097+0000 7fcd03c00640 1 -- start start 2024-02-21T07:42:39.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.097+0000 7f5b93400640 1 --2- 172.21.15.69:0/121082773 >> v2:172.21.15.174:3300/0 conn(0x7f5b940f61f0 0x7f5b94186d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.097+0000 7f5b98e00640 1 -- 172.21.15.69:0/121082773 >> v2:172.21.15.174:3300/0 conn(0x7f5b940f61f0 msgr2=0x7f5b94186d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.097+0000 7f5b98e00640 1 --2- 172.21.15.69:0/121082773 >> v2:172.21.15.174:3300/0 conn(0x7f5b940f61f0 0x7f5b94186d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.098+0000 7f5b98e00640 1 -- 172.21.15.69:0/121082773 >> v1:172.21.15.184:6789/0 conn(0x7f5b9417f710 legacy=0x7f5b940f5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.098+0000 7f5b98e00640 1 -- 172.21.15.69:0/121082773 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b94188c50 con 0x7f5b941872d0 2024-02-21T07:42:39.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.097+0000 7f3294400640 1 -- start start 2024-02-21T07:42:39.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7fc88f800640 1 -- 172.21.15.69:0/3603066880 --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8880f59a0 con 0x7fc8880f5e30 2024-02-21T07:42:39.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7fc88f800640 1 -- 172.21.15.69:0/3603066880 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc888185880 con 0x7fc888182240 2024-02-21T07:42:39.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7fc88f800640 1 -- 172.21.15.69:0/3603066880 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8880d2620 con 0x7fc888188a50 2024-02-21T07:42:39.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.100+0000 7fc88d800640 1 --2- 172.21.15.69:0/3603066880 >> v2:172.21.15.184:3300/0 conn(0x7fc888188a50 0x7fc8880d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f3294400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f328410bb50 0x7f32840ea590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f3294400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3284110db0 0x7f3284051e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f3294400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3284112630 0x7f3284052340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f3294400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3284050a80 con 0x7f3284112630 2024-02-21T07:42:39.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f3294400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3284050d60 con 0x7f328410bb50 2024-02-21T07:42:39.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f3294400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3284051040 con 0x7f3284110db0 2024-02-21T07:42:39.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.100+0000 7f3291a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f328410bb50 0x7f32840ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.100+0000 7f3291000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3284110db0 0x7f3284051e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.100+0000 7f3291a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f328410bb50 0x7f32840ea590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42100/0 (socket says 172.21.15.69:42100) 2024-02-21T07:42:39.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.100+0000 7f3291a00640 1 -- 172.21.15.69:0/1419814662 learned_addr learned my addr 172.21.15.69:0/1419814662 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.100+0000 7fcd03c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0004270 0x7fccfc0d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.100+0000 7fc887400640 1 -- 172.21.15.69:0/3603066880 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872012229 0 0) 0x7fc8880f59a0 con 0x7fc8880f5e30 2024-02-21T07:42:39.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7fcd01200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0004270 0x7fccfc0d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.100+0000 7f3292400640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3284112630 0x7f3284052340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7fcd01200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0004270 0x7fccfc0d3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34280/0 (socket says 172.21.15.69:34280) 2024-02-21T07:42:39.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7fcd01200640 1 -- 172.21.15.69:0/2942711973 learned_addr learned my addr 172.21.15.69:0/2942711973 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7fcd03c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc0d2f90 0x7fccfc0d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7f3291000640 1 -- 172.21.15.69:0/1419814662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f328410bb50 msgr2=0x7f32840ea590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7f3291000640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f328410bb50 0x7f32840ea590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7f3291000640 1 -- 172.21.15.69:0/1419814662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3284112630 msgr2=0x7f3284052340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7fc887400640 1 -- 172.21.15.69:0/3603066880 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc870003520 con 0x7fc8880f5e30 2024-02-21T07:42:39.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7f3291000640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3284112630 0x7f3284052340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f2897600640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2890182090 0x7f28900cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f2897600640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f28900cdd70 0x7f2890187d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f2897600640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28900cc4b0 con 0x7f2890188280 2024-02-21T07:42:39.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f2897600640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2890182470 con 0x7f28900cdd70 2024-02-21T07:42:39.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.099+0000 7f2897600640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900cc790 con 0x7f2890182090 2024-02-21T07:42:39.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.100+0000 7f2896000640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2890188280 0x7f28900f7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:48790/0 (socket says 172.21.15.69:48790) 2024-02-21T07:42:39.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.100+0000 7f2896000640 1 -- 172.21.15.69:0/169384192 learned_addr learned my addr 172.21.15.69:0/169384192 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:39.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7f2894c00640 1 --2- 172.21.15.69:0/169384192 >> v2:172.21.15.184:3300/0 conn(0x7f2890182090 0x7f28900cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319124119 0 0) 0x7f28900cc4b0 con 0x7f2890188280 2024-02-21T07:42:39.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2878003520 con 0x7f2890188280 2024-02-21T07:42:39.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.102+0000 7f288fe00640 1 --2- 172.21.15.69:0/169384192 >> v2:172.21.15.174:3300/0 conn(0x7f28900cdd70 0x7f2890187d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.102+0000 7fccfbe00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc0d2f90 0x7fccfc0d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.102+0000 7fcd03c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccfc224340 0x7fccfc2247c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.101+0000 7f3291000640 1 -- 172.21.15.69:0/1419814662 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009400 con 0x7f3284110db0 2024-02-21T07:42:39.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.102+0000 7f3292400640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3284112630 0x7f3284052340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:39.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.102+0000 7f3291000640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3284110db0 0x7f3284051e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f328000c450 tx=0x7f328000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7fcd01c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccfc224340 0x7fccfc2247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0d5110 con 0x7fccfc224340 2024-02-21T07:42:39.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7fa9da000640 1 --2- 172.21.15.69:0/2813586588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 0x7fa9dc1828c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc08e4f0 tx=0x7fa9d402c060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c13ec58b7b3ed389 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f3289600640 1 -- 172.21.15.69:0/1419814662 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280005480 con 0x7f3284110db0 2024-02-21T07:42:39.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f3289600640 1 -- 172.21.15.69:0/1419814662 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800035f0 con 0x7f3284110db0 2024-02-21T07:42:39.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f3289600640 1 -- 172.21.15.69:0/1419814662 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800039c0 con 0x7f3284110db0 2024-02-21T07:42:39.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0d3fe0 con 0x7fccfc0d2f90 2024-02-21T07:42:39.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f3294400640 1 -- 172.21.15.69:0/1419814662 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3284051320 con 0x7f3284110db0 2024-02-21T07:42:39.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.104+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc0d42b0 con 0x7fcce0004270 2024-02-21T07:42:39.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3896471265 0 0) 0x7f2878003520 con 0x7f2890188280 2024-02-21T07:42:39.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 >> v2:172.21.15.184:3300/0 conn(0x7f2890182090 msgr2=0x7f28900cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f288f400640 1 --2- 172.21.15.69:0/169384192 >> v2:172.21.15.184:3300/0 conn(0x7f2890182090 0x7f28900cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 >> v2:172.21.15.174:3300/0 conn(0x7f28900cdd70 msgr2=0x7f2890187d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f288f400640 1 --2- 172.21.15.69:0/169384192 >> v2:172.21.15.174:3300/0 conn(0x7f28900cdd70 0x7f2890187d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900cca70 con 0x7f2890188280 2024-02-21T07:42:39.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f2888001a00 con 0x7f2890188280 2024-02-21T07:42:39.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f1b4b400640 1 Processor -- start 2024-02-21T07:42:39.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f1b4b400640 1 -- start start 2024-02-21T07:42:39.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.103+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 >> v1:172.21.15.184:6789/0 conn(0x7f2890188280 legacy=0x7f28900f7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.104+0000 7f288f400640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780039e0 0x7f2878003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.104+0000 7f288f400640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28780047c0 0x7f2878004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.104+0000 7f288f400640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2878005180 0x7f287800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.104+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900cc790 con 0x7f2878005180 2024-02-21T07:42:39.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.104+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287800c110 con 0x7f28780047c0 2024-02-21T07:42:39.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.104+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287800c2d0 con 0x7f28780039e0 2024-02-21T07:42:39.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.104+0000 7f3294400640 1 -- 172.21.15.69:0/1419814662 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32840518e0 con 0x7f3284110db0 2024-02-21T07:42:39.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.104+0000 7f5b98e00640 1 --2- 172.21.15.69:0/121082773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b941872d0 0x7f5b940f68b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5b940d37d0 tx=0x7f5b8c02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd5696894a1353c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.104+0000 7fa9d9600640 1 -- 172.21.15.69:0/2813586588 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d402ce10 con 0x7fa9dc181d20 2024-02-21T07:42:39.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.105+0000 7fa9d9600640 1 -- 172.21.15.69:0/2813586588 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4034440 con 0x7fa9dc181d20 2024-02-21T07:42:39.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fccfbe00640 1 -- 172.21.15.69:0/2942711973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0004270 msgr2=0x7fccfc0d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fccfbe00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0004270 0x7fccfc0d3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fccfbe00640 1 -- 172.21.15.69:0/2942711973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccfc224340 msgr2=0x7fccfc2247c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fccfbe00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccfc224340 0x7fccfc2247c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fccfbe00640 1 -- 172.21.15.69:0/2942711973 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc0d4590 con 0x7fccfc0d2f90 2024-02-21T07:42:39.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fcd01200640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0004270 0x7fccfc0d3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:39.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fcd01c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccfc224340 0x7fccfc2247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:39.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.107+0000 7fccfbe00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc0d2f90 0x7fccfc0d33f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcce8011560 tx=0x7fcce8011a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.102+0000 7fc88ce00640 1 -- 172.21.15.69:0/3603066880 >> v2:172.21.15.184:3300/0 conn(0x7fc888188a50 msgr2=0x7fc8880d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.102+0000 7fc88ce00640 1 --2- 172.21.15.69:0/3603066880 >> v2:172.21.15.184:3300/0 conn(0x7fc888188a50 0x7fc8880d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.102+0000 7fc88ce00640 1 -- 172.21.15.69:0/3603066880 >> v1:172.21.15.69:6789/0 conn(0x7fc8880f5e30 legacy=0x7fc888188340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.102+0000 7fc88ce00640 1 -- 172.21.15.69:0/3603066880 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880f4d90 con 0x7fc888182240 2024-02-21T07:42:39.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fc88d800640 1 --2- 172.21.15.69:0/3603066880 >> v2:172.21.15.184:3300/0 conn(0x7fc888188a50 0x7fc8880d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:39.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7f5b92a00640 1 -- 172.21.15.69:0/121082773 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c031770 con 0x7f5b941872d0 2024-02-21T07:42:39.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7f5b92a00640 1 -- 172.21.15.69:0/121082773 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0318d0 con 0x7f5b941872d0 2024-02-21T07:42:39.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7f5b92a00640 1 -- 172.21.15.69:0/121082773 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c031ca0 con 0x7f5b941872d0 2024-02-21T07:42:39.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fa9d9600640 1 -- 172.21.15.69:0/2813586588 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d402ce10 con 0x7fa9dc181d20 2024-02-21T07:42:39.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fa9e1a00640 1 -- 172.21.15.69:0/2813586588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 msgr2=0x7fa9dc1828c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.106+0000 7fa9e1a00640 1 --2- 172.21.15.69:0/2813586588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 0x7fa9dc1828c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc08e4f0 tx=0x7fa9d402c060 comp rx=0 tx=0).stop 2024-02-21T07:42:39.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.107+0000 7f2896000640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2878005180 0x7f287800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.107+0000 7fa9e1a00640 1 -- 172.21.15.69:0/2813586588 shutdown_connections 2024-02-21T07:42:39.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.107+0000 7f5b99800640 1 -- 172.21.15.69:0/121082773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b941872d0 msgr2=0x7f5b940f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.107+0000 7f5b99800640 1 --2- 172.21.15.69:0/121082773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b941872d0 0x7f5b940f68b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5b940d37d0 tx=0x7f5b8c02b810 comp rx=0 tx=0).stop 2024-02-21T07:42:39.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7f5b99800640 1 -- 172.21.15.69:0/121082773 shutdown_connections 2024-02-21T07:42:39.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7fc88ce00640 1 --2- 172.21.15.69:0/3603066880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc888182240 0x7fc888182810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8880f0e20 tx=0x7fc87402dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b9694f567e8fe3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.107+0000 7fa9e1a00640 1 --2- 172.21.15.69:0/2813586588 >> v2:172.21.15.174:3300/0 conn(0x7fa9dc1821b0 0x7fa9dc182e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7fa9e1a00640 1 --2- 172.21.15.69:0/2813586588 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 0x7fa9dc1828c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7fa9e1a00640 1 -- 172.21.15.69:0/2813586588 >> 172.21.15.69:0/2813586588 conn(0x7fa9dc0f69c0 msgr2=0x7fa9dc0f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.107+0000 7f2894c00640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780039e0 0x7f2878003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.107+0000 7f288fe00640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28780047c0 0x7f2878004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7f288fe00640 1 -- 172.21.15.69:0/169384192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780039e0 msgr2=0x7f2878003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7f288fe00640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780039e0 0x7f2878003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7f288fe00640 1 -- 172.21.15.69:0/169384192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2878005180 msgr2=0x7f287800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7f288fe00640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2878005180 0x7f287800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7f288fe00640 1 -- 172.21.15.69:0/169384192 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900cca70 con 0x7f28780047c0 2024-02-21T07:42:39.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7f5b99800640 1 --2- 172.21.15.69:0/121082773 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b941872d0 0x7f5b940f68b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7f5b99800640 1 --2- 172.21.15.69:0/121082773 >> v2:172.21.15.174:3300/0 conn(0x7f5b940f61f0 0x7f5b94186d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7f5b99800640 1 -- 172.21.15.69:0/121082773 >> 172.21.15.69:0/121082773 conn(0x7f5b940cf370 msgr2=0x7f5b940cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.108+0000 7f2896000640 1 -- 172.21.15.69:0/169384192 reap_dead start 2024-02-21T07:42:39.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.109+0000 7fccf8c00640 1 -- 172.21.15.69:0/2942711973 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800c070 con 0x7fccfc0d2f90 2024-02-21T07:42:39.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.109+0000 7f1b4b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1b44196090 0x7f1b44198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.109+0000 7f1b4b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1b44199420 0x7f1b440f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.109+0000 7fccf8c00640 1 -- 172.21.15.69:0/2942711973 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8004220 con 0x7fccfc0d2f90 2024-02-21T07:42:39.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.109+0000 7f1b3be00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1b44196090 0x7f1b44198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.110+0000 7f1b3be00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1b44196090 0x7f1b44198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34298/0 (socket says 172.21.15.69:34298) 2024-02-21T07:42:39.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.110+0000 7f5b99800640 1 -- 172.21.15.69:0/121082773 shutdown_connections 2024-02-21T07:42:39.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.110+0000 7fc887400640 1 -- 172.21.15.69:0/3603066880 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874008df0 con 0x7fc888182240 2024-02-21T07:42:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.110+0000 7f5b99800640 1 -- 172.21.15.69:0/121082773 wait complete. 2024-02-21T07:42:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.109+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc0d4870 con 0x7fccfc0d2f90 2024-02-21T07:42:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.110+0000 7fc887400640 1 -- 172.21.15.69:0/3603066880 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87400a0d0 con 0x7fc888182240 2024-02-21T07:42:39.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.109+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc0d4e30 con 0x7fccfc0d2f90 2024-02-21T07:42:39.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.110+0000 7fc887400640 1 -- 172.21.15.69:0/3603066880 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87400a4a0 con 0x7fc888182240 2024-02-21T07:42:39.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.111+0000 7f288fe00640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28780047c0 0x7f2878004c40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f287c00ba30 tx=0x7f28780057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8409046dc7e1a321 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.111+0000 7fccf8c00640 1 -- 172.21.15.69:0/2942711973 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8015670 con 0x7fccfc0d2f90 2024-02-21T07:42:39.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.111+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c033680 con 0x7f28780047c0 2024-02-21T07:42:39.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.107+0000 7f3294400640 1 -- 172.21.15.69:0/1419814662 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3284057350 con 0x7f3284110db0 2024-02-21T07:42:39.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.112+0000 7f288f400640 1 -- 172.21.15.69:0/169384192 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c0337e0 con 0x7f28780047c0 2024-02-21T07:42:39.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.112+0000 7f1b48a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1b441955a0 0x7f1b44195980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44578/0 (socket says 172.21.15.69:44578) 2024-02-21T07:42:39.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.112+0000 7fa9e1a00640 1 -- 172.21.15.69:0/2813586588 shutdown_connections 2024-02-21T07:42:39.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.112+0000 7fa9e1a00640 1 -- 172.21.15.69:0/2813586588 wait complete. 2024-02-21T07:42:39.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.113+0000 7f2897600640 1 -- 172.21.15.69:0/169384192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28780047c0 msgr2=0x7f2878004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.113+0000 7f2897600640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28780047c0 0x7f2878004c40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f287c00ba30 tx=0x7f28780057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.114+0000 7f5b99800640 1 Processor -- start 2024-02-21T07:42:39.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.114+0000 7f5b99800640 1 -- start start 2024-02-21T07:42:39.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.115+0000 7f2897600640 1 -- 172.21.15.69:0/169384192 shutdown_connections 2024-02-21T07:42:39.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.113+0000 7f1b49400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1b44199420 0x7f1b440f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.113+0000 7f1b49400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1b44199420 0x7f1b440f51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33722/0 (socket says 172.21.15.69:33722) 2024-02-21T07:42:39.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.113+0000 7f1b4b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b440f4d60 con 0x7f1b441955a0 2024-02-21T07:42:39.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.113+0000 7f1b4b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b44196510 con 0x7f1b44199420 2024-02-21T07:42:39.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.113+0000 7f1b4b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b440d2920 con 0x7f1b44196090 2024-02-21T07:42:39.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.112+0000 7f3289600640 1 -- 172.21.15.69:0/1419814662 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f3280003b20 con 0x7f3284110db0 2024-02-21T07:42:39.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.115+0000 7f2897600640 1 --2- 172.21.15.69:0/169384192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f28780047c0 0x7f2878004c40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.115+0000 7f2897600640 1 -- 172.21.15.69:0/169384192 >> 172.21.15.69:0/169384192 conn(0x7f28900f6870 msgr2=0x7f28900f6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.116+0000 7f2897600640 1 -- 172.21.15.69:0/169384192 shutdown_connections 2024-02-21T07:42:39.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.117+0000 7fa9e1a00640 1 Processor -- start 2024-02-21T07:42:39.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.117+0000 7fa9e1a00640 1 -- start start 2024-02-21T07:42:39.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.118+0000 7f2897600640 1 -- 172.21.15.69:0/169384192 wait complete. 2024-02-21T07:42:39.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.119+0000 7f5b99800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b940f61f0 0x7f5b9415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.119+0000 7f5b99800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b9417f710 0x7f5b94170ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.119+0000 7f3289600640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f327009f280 0x7f32700a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7fc88f800640 1 -- 172.21.15.69:0/3603066880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc888182240 msgr2=0x7fc888182810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7fc88f800640 1 --2- 172.21.15.69:0/3603066880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc888182240 0x7fc888182810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8880f0e20 tx=0x7fc87402dab0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7f3289600640 1 -- 172.21.15.69:0/1419814662 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f32800c9120 con 0x7f3284110db0 2024-02-21T07:42:39.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7f5b93400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b9417f710 0x7f5b94170ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7f5b93400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b9417f710 0x7f5b94170ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34308/0 (socket says 172.21.15.69:34308) 2024-02-21T07:42:39.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7f5b99800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941872d0 0x7f5b9417e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7f5b93400640 1 -- 172.21.15.69:0/319717049 learned_addr learned my addr 172.21.15.69:0/319717049 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7f6155200640 1 Processor -- start 2024-02-21T07:42:39.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7fc88f800640 1 -- 172.21.15.69:0/3603066880 shutdown_connections 2024-02-21T07:42:39.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7fc88f800640 1 --2- 172.21.15.69:0/3603066880 >> v2:172.21.15.184:3300/0 conn(0x7fc888188a50 0x7fc8880d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7f5b98e00640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941872d0 0x7f5b9417e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7fc88f800640 1 --2- 172.21.15.69:0/3603066880 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc888182240 0x7fc888182810 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7fc88f800640 1 -- 172.21.15.69:0/3603066880 >> 172.21.15.69:0/3603066880 conn(0x7fc8880f6a20 msgr2=0x7fc8880f6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7f3289600640 1 -- 172.21.15.69:0/1419814662 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f32800cb690 con 0x7f3284110db0 2024-02-21T07:42:39.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7f5b93e00640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b940f61f0 0x7f5b9415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.121+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9417d610 con 0x7f5b940f61f0 2024-02-21T07:42:39.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.121+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b94220c80 con 0x7f5b941872d0 2024-02-21T07:42:39.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.121+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b94171e40 con 0x7f5b9417f710 2024-02-21T07:42:39.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.121+0000 7fa9e1a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9dc181940 0x7fa9dc16f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.121+0000 7fa9e1a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 0x7fa9dc21b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.119+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd4005290 con 0x7fccfc0d2f90 2024-02-21T07:42:39.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7fc88f800640 1 -- 172.21.15.69:0/3603066880 shutdown_connections 2024-02-21T07:42:39.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.115+0000 7f1b3be00640 1 -- 172.21.15.69:0/1235254795 learned_addr learned my addr 172.21.15.69:0/1235254795 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.117+0000 7f1b49400640 1 -- 172.21.15.69:0/1235254795 >> v2:172.21.15.184:3300/0 conn(0x7f1b44196090 msgr2=0x7f1b44198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.117+0000 7f1b49400640 1 --2- 172.21.15.69:0/1235254795 >> v2:172.21.15.184:3300/0 conn(0x7f1b44196090 0x7f1b44198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.117+0000 7f1b49400640 1 -- 172.21.15.69:0/1235254795 >> v1:172.21.15.69:6789/0 conn(0x7f1b441955a0 legacy=0x7f1b44195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.117+0000 7f1b49400640 1 -- 172.21.15.69:0/1235254795 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4406dcd0 con 0x7f1b44199420 2024-02-21T07:42:39.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7f5b98e00640 1 -- 172.21.15.69:0/319717049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b9417f710 msgr2=0x7f5b94170ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7f5b98e00640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b9417f710 0x7f5b94170ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7f5b98e00640 1 -- 172.21.15.69:0/319717049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b940f61f0 msgr2=0x7f5b9415e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7f5b98e00640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b940f61f0 0x7f5b9415e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7f5b98e00640 1 -- 172.21.15.69:0/319717049 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c0094d0 con 0x7f5b941872d0 2024-02-21T07:42:39.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.121+0000 7fa9e1a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9dc1821b0 0x7fa9dc1662b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7fa9da000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 0x7fa9dc21b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7fa9da000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 0x7fa9dc21b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34314/0 (socket says 172.21.15.69:34314) 2024-02-21T07:42:39.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7fa9da000640 1 -- 172.21.15.69:0/177271013 learned_addr learned my addr 172.21.15.69:0/177271013 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.120+0000 7f6155200640 1 -- start start 2024-02-21T07:42:39.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7f5b93400640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b9417f710 0x7f5b94170ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:39.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.123+0000 7fc88f800640 1 -- 172.21.15.69:0/3603066880 wait complete. 2024-02-21T07:42:39.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.122+0000 7f5b93e00640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b940f61f0 0x7f5b9415e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:39.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.123+0000 7fccf8c00640 1 -- 172.21.15.69:0/2942711973 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fcce80157d0 con 0x7fccfc0d2f90 2024-02-21T07:42:39.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.123+0000 7fdcc3e00640 1 Processor -- start 2024-02-21T07:42:39.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.123+0000 7fdcc3e00640 1 -- start start 2024-02-21T07:42:39.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.123+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc16f990 con 0x7fa9dc1821b0 2024-02-21T07:42:39.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.123+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc16efc0 con 0x7fa9dc181940 2024-02-21T07:42:39.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.123+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc16e0d0 con 0x7fa9dc181d20 2024-02-21T07:42:39.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.123+0000 7fa9db400640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9dc1821b0 0x7fa9dc1662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.123+0000 7f6155200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f61500d22f0 0x7f61501828c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.124+0000 7f1b49400640 1 --2- 172.21.15.69:0/1235254795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b44199420 0x7f1b440f51f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b44193370 tx=0x7f1b3c02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a762a935e15270 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.124+0000 7f5b98e00640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941872d0 0x7f5b9417e040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c033000 tx=0x7f5b8c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.124+0000 7fa9daa00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9dc181940 0x7fa9dc16f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.126+0000 7fa9da000640 1 -- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9dc181940 msgr2=0x7fa9dc16f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.126+0000 7fa9da000640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9dc181940 0x7fa9dc16f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.126+0000 7fa9da000640 1 -- 172.21.15.69:0/177271013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9dc1821b0 msgr2=0x7fa9dc1662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.127+0000 7f1b43e00640 1 -- 172.21.15.69:0/1235254795 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c02cb70 con 0x7f1b44199420 2024-02-21T07:42:39.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.127+0000 7f1b43e00640 1 -- 172.21.15.69:0/1235254795 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c02ccd0 con 0x7f1b44199420 2024-02-21T07:42:39.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.127+0000 7fa9da000640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9dc1821b0 0x7fa9dc1662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.127+0000 7fa9da000640 1 -- 172.21.15.69:0/177271013 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4009400 con 0x7fa9dc181d20 2024-02-21T07:42:39.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.126+0000 7f614de00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f61500f74e0 0x7f61500f4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44580/0 (socket says 172.21.15.69:44580) 2024-02-21T07:42:39.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.126+0000 7f614de00640 1 -- 172.21.15.69:0/2856206590 learned_addr learned my addr 172.21.15.69:0/2856206590 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:39.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.123+0000 7f6155200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61500f6100 con 0x7f61500f74e0 2024-02-21T07:42:39.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.126+0000 7f6155200640 1 -- 172.21.15.69:0/2856206590 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6150183250 con 0x7f6150182e00 2024-02-21T07:42:39.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.126+0000 7f6155200640 1 -- 172.21.15.69:0/2856206590 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61500d2780 con 0x7f61500d22f0 2024-02-21T07:42:39.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.127+0000 7f614d400640 1 --2- 172.21.15.69:0/2856206590 >> v2:172.21.15.184:3300/0 conn(0x7f61500d22f0 0x7f61501828c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.127+0000 7fdcc3e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdcc418c540 0x7fdcc41878f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.127+0000 7fdcc3e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc418cd10 con 0x7fdcc4182840 2024-02-21T07:42:39.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.127+0000 7fdcc3e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc4186850 con 0x7fdcc4187e30 2024-02-21T07:42:39.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.127+0000 7fdcc3e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc4189850 con 0x7fdcc418c540 2024-02-21T07:42:39.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.128+0000 7f1b43e00640 1 -- 172.21.15.69:0/1235254795 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c034660 con 0x7f1b44199420 2024-02-21T07:42:39.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.127+0000 7fdcc2a00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fdcc4182840 0x7fdcc418be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60538/0 (socket says 172.21.15.69:60538) 2024-02-21T07:42:39.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7f5b8be00640 1 -- 172.21.15.69:0/319717049 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c045620 con 0x7f5b941872d0 2024-02-21T07:42:39.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7f5b8be00640 1 -- 172.21.15.69:0/319717049 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c045780 con 0x7f5b941872d0 2024-02-21T07:42:39.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7fa9daa00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9dc181940 0x7fa9dc16f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:39.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b941715a0 con 0x7f5b941872d0 2024-02-21T07:42:39.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7fa9db400640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9dc1821b0 0x7fa9dc1662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:39.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.128+0000 7f614ca00640 1 -- 172.21.15.69:0/2856206590 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141106484 0 0) 0x7f61500f6100 con 0x7f61500f74e0 2024-02-21T07:42:39.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7f2897600640 1 Processor -- start 2024-02-21T07:42:39.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.128+0000 7f614ca00640 1 -- 172.21.15.69:0/2856206590 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6134003520 con 0x7f61500f74e0 2024-02-21T07:42:39.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.128+0000 7f614d400640 1 -- 172.21.15.69:0/2856206590 >> v1:172.21.15.174:6789/0 conn(0x7f6150182e00 legacy=0x7f61501818b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.128+0000 7fdcc2000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdcc418c540 0x7fdcc41878f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.128+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419102330 0 0) 0x7fdcc4186850 con 0x7fdcc4187e30 2024-02-21T07:42:39.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.128+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdca8003520 con 0x7fdcc4187e30 2024-02-21T07:42:39.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.128+0000 7f614d400640 1 -- 172.21.15.69:0/2856206590 >> v1:172.21.15.69:6789/0 conn(0x7f61500f74e0 legacy=0x7f61500f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7f614d400640 1 -- 172.21.15.69:0/2856206590 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61500f5210 con 0x7f61500d22f0 2024-02-21T07:42:39.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7f1b4b400640 1 -- 172.21.15.69:0/1235254795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b44199420 msgr2=0x7f1b440f51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7f1b4b400640 1 --2- 172.21.15.69:0/1235254795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b44199420 0x7f1b440f51f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1b44193370 tx=0x7f1b3c02bdc0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2729574853 0 0) 0x7fdca8003520 con 0x7fdcc4187e30 2024-02-21T07:42:39.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 >> v2:172.21.15.174:3300/0 conn(0x7fdcc418c540 msgr2=0x7fdcc41878f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7fdcc1600640 1 --2- 172.21.15.69:0/1709362597 >> v2:172.21.15.174:3300/0 conn(0x7fdcc418c540 0x7fdcc41878f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 >> v1:172.21.15.174:6789/0 conn(0x7fdcc4182840 legacy=0x7fdcc418be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4186b30 con 0x7fdcc4187e30 2024-02-21T07:42:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7fdcb4001670 con 0x7fdcc4187e30 2024-02-21T07:42:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 >> v1:172.21.15.184:6789/0 conn(0x7fdcc4187e30 legacy=0x7fdcc40cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7fa9da000640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 0x7fa9dc21b650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4037040 tx=0x7fa9d40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7f3291a00640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f327009f280 0x7f32700a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7f2897600640 1 -- start start 2024-02-21T07:42:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.130+0000 7f1b4b400640 1 -- 172.21.15.69:0/1235254795 shutdown_connections 2024-02-21T07:42:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.130+0000 7f1b4b400640 1 --2- 172.21.15.69:0/1235254795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b44199420 0x7f1b440f51f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.128+0000 7fdcc2a00640 1 -- 172.21.15.69:0/1709362597 learned_addr learned my addr 172.21.15.69:0/1709362597 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.130+0000 7fdcc2a00640 1 --1- 172.21.15.69:0/1709362597 >> v1:172.21.15.174:6789/0 conn(0x7fdcc4182840 0x7fdcc418be30 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2024-02-21T07:42:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.130+0000 7f1b4b400640 1 --2- 172.21.15.69:0/1235254795 >> v2:172.21.15.184:3300/0 conn(0x7f1b44196090 0x7f1b44198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.130+0000 7f1b4b400640 1 -- 172.21.15.69:0/1235254795 >> 172.21.15.69:0/1235254795 conn(0x7f1b440f69c0 msgr2=0x7f1b440f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.130+0000 7fdcc1600640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdca80039c0 0x7fdca8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.130+0000 7fdcc1600640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdca80047c0 0x7fdca8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fdcc1600640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdca800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4189850 con 0x7fdca80047c0 2024-02-21T07:42:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca800c1a0 con 0x7fdca80039c0 2024-02-21T07:42:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca800c360 con 0x7fdca8005250 2024-02-21T07:42:39.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fccf8c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fccdc09f280 0x7fccdc0a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7f1b4b400640 1 -- 172.21.15.69:0/1235254795 shutdown_connections 2024-02-21T07:42:39.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7f1b4b400640 1 -- 172.21.15.69:0/1235254795 wait complete. 2024-02-21T07:42:39.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.129+0000 7f5b8be00640 1 -- 172.21.15.69:0/319717049 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c045620 con 0x7f5b941872d0 2024-02-21T07:42:39.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.132+0000 7fccf8c00640 1 -- 172.21.15.69:0/2942711973 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fcce80c99c0 con 0x7fccfc0d2f90 2024-02-21T07:42:39.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.132+0000 7fcd01200640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fccdc09f280 0x7fccdc0a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.132+0000 7fccf8c00640 1 -- 172.21.15.69:0/2942711973 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcce80968b0 con 0x7fccfc0d2f90 2024-02-21T07:42:39.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.132+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b94171b60 con 0x7f5b941872d0 2024-02-21T07:42:39.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.133+0000 7fcd01200640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fccdc09f280 0x7fccdc0a1740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fccec0010e0 tx=0x7fccec007f70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.133+0000 7f1d37e00640 1 Processor -- start 2024-02-21T07:42:39.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.134+0000 7f1d37e00640 1 -- start start 2024-02-21T07:42:39.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.130+0000 7fa9d2a00640 1 -- 172.21.15.69:0/177271013 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4004480 con 0x7fa9dc181d20 2024-02-21T07:42:39.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fa9d2a00640 1 -- 172.21.15.69:0/177271013 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4003820 con 0x7fa9dc181d20 2024-02-21T07:42:39.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fa9d2a00640 1 -- 172.21.15.69:0/177271013 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4003bd0 con 0x7fa9dc181d20 2024-02-21T07:42:39.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc0f6710 con 0x7fa9dc181d20 2024-02-21T07:42:39.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc16e690 con 0x7fa9dc181d20 2024-02-21T07:42:39.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fdcc2000640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdca80047c0 0x7fdca8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fdcc3400640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdca800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.131+0000 7fdcc2a00640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdca80039c0 0x7fdca8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.132+0000 7fdcc3400640 1 -- 172.21.15.69:0/1709362597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdca80039c0 msgr2=0x7fdca8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.132+0000 7fdcc3400640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdca80039c0 0x7fdca8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.132+0000 7fdcc3400640 1 -- 172.21.15.69:0/1709362597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdca80047c0 msgr2=0x7fdca8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.135+0000 7fdcc3400640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdca80047c0 0x7fdca8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.135+0000 7fdcc3400640 1 -- 172.21.15.69:0/1709362597 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4186b30 con 0x7fdca8005250 2024-02-21T07:42:39.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.135+0000 7f2897600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780047c0 0x7f2890185b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.135+0000 7f2897600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2890186080 0x7f28901768e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.135+0000 7fdcc2000640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdca80047c0 0x7fdca8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.135+0000 7fc88f800640 1 Processor -- start 2024-02-21T07:42:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.135+0000 7fc88f800640 1 -- start start 2024-02-21T07:42:39.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.136+0000 7f2894c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780047c0 0x7f2890185b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.136+0000 7f2894c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780047c0 0x7f2890185b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34334/0 (socket says 172.21.15.69:34334) 2024-02-21T07:42:39.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.136+0000 7fdcc3400640 1 -- 172.21.15.69:0/1709362597 reap_dead start 2024-02-21T07:42:39.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.137+0000 7f1d37e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d30006430 0x7f1d30007c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.137+0000 7f1d37e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1d300e5d40 0x7f1d30110c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.137+0000 7f288fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2890186080 0x7f28901768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.137+0000 7f288fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2890186080 0x7f28901768e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33758/0 (socket says 172.21.15.69:33758) 2024-02-21T07:42:39.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.137+0000 7f2894c00640 1 -- 172.21.15.69:0/987186908 learned_addr learned my addr 172.21.15.69:0/987186908 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.137+0000 7f2897600640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2890176e20 0x7f289017f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.137+0000 7f1d36000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1d30006430 0x7f1d30007c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.137+0000 7f1d37400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1d300e5d40 0x7f1d30110c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.137+0000 7f1d37e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d30008170 con 0x7f1d3010adb0 2024-02-21T07:42:39.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f1d37400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1d300e5d40 0x7f1d30110c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33774/0 (socket says 172.21.15.69:33774) 2024-02-21T07:42:39.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f1d37400640 1 -- 172.21.15.69:0/3456277938 learned_addr learned my addr 172.21.15.69:0/3456277938 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f1d37e00640 1 -- 172.21.15.69:0/3456277938 --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3010e670 con 0x7f1d300e5d40 2024-02-21T07:42:39.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f1d37e00640 1 -- 172.21.15.69:0/3456277938 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300068b0 con 0x7f1d30006430 2024-02-21T07:42:39.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28901865f0 con 0x7f2890186080 2024-02-21T07:42:39.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f3291a00640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f327009f280 0x7f32700a1740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f328c064900 tx=0x7f328c06d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f1b4b400640 1 Processor -- start 2024-02-21T07:42:39.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.137+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b94070280 con 0x7f5b941872d0 2024-02-21T07:42:39.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.133+0000 7f614d400640 1 --2- 172.21.15.69:0/2856206590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61500d22f0 0x7f61501828c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f614800dd90 tx=0x7f614802fc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f15954e47a51833 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28901868d0 con 0x7f2890176e20 2024-02-21T07:42:39.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f1d36000640 1 -- 172.21.15.69:0/3456277938 >> v2:172.21.15.69:3300/0 conn(0x7f1d300e5d40 msgr2=0x7f1d30110c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f1d36000640 1 --2- 172.21.15.69:0/3456277938 >> v2:172.21.15.69:3300/0 conn(0x7f1d300e5d40 0x7f1d30110c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f1d36000640 1 -- 172.21.15.69:0/3456277938 >> v1:172.21.15.174:6789/0 conn(0x7f1d3010adb0 legacy=0x7f1d3010eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.138+0000 7f1d36000640 1 -- 172.21.15.69:0/3456277938 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30006b90 con 0x7f1d30006430 2024-02-21T07:42:39.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7fdcc3400640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdca800b980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4014a20 tx=0x7fdca80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=857299b2b7c91986 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb403b600 con 0x7fdca8005250 2024-02-21T07:42:39.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb4037050 con 0x7fdca8005250 2024-02-21T07:42:39.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7fdcc1600640 1 -- 172.21.15.69:0/1709362597 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb403b9c0 con 0x7fdca8005250 2024-02-21T07:42:39.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7f614ca00640 1 -- 172.21.15.69:0/2856206590 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138001650 con 0x7f61500d22f0 2024-02-21T07:42:39.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7f614ca00640 1 -- 172.21.15.69:0/2856206590 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61480307a0 con 0x7f61500d22f0 2024-02-21T07:42:39.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7f614ca00640 1 -- 172.21.15.69:0/2856206590 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138001650 con 0x7f61500d22f0 2024-02-21T07:42:39.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2890186bb0 con 0x7f28780047c0 2024-02-21T07:42:39.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7f2896000640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2890176e20 0x7f289017f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7f1b4b400640 1 -- start start 2024-02-21T07:42:39.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.141+0000 7f1d36000640 1 --2- 172.21.15.69:0/3456277938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d30006430 0x7f1d30007c30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1d30012e10 tx=0x7f1d2802b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46bdde6b9bb49cbc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7f1d35600640 1 -- 172.21.15.69:0/3456277938 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28030710 con 0x7f1d30006430 2024-02-21T07:42:39.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.139+0000 7f5b8be00640 1 -- 172.21.15.69:0/319717049 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5b8c043070 con 0x7f5b941872d0 2024-02-21T07:42:39.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.141+0000 7fdcc3e00640 1 -- 172.21.15.69:0/1709362597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 msgr2=0x7fdca800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.141+0000 7fdcc3e00640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdca800b980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4014a20 tx=0x7fdca80057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.141+0000 7f6155200640 1 -- 172.21.15.69:0/2856206590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61500d22f0 msgr2=0x7f61501828c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.141+0000 7f6155200640 1 --2- 172.21.15.69:0/2856206590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61500d22f0 0x7f61501828c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f614800dd90 tx=0x7f614802fc70 comp rx=0 tx=0).stop 2024-02-21T07:42:39.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.140+0000 7f2896000640 1 -- 172.21.15.69:0/987186908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780047c0 msgr2=0x7f2890185b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.140+0000 7f2896000640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780047c0 0x7f2890185b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.140+0000 7f2896000640 1 -- 172.21.15.69:0/987186908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2890186080 msgr2=0x7f28901768e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.141+0000 7f2894c00640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780047c0 0x7f2890185b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:39.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.141+0000 7f2896000640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2890186080 0x7f28901768e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.141+0000 7f2896000640 1 -- 172.21.15.69:0/987186908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2890186e90 con 0x7f2890176e20 2024-02-21T07:42:39.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.141+0000 7f288fe00640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2890186080 0x7f28901768e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:39.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7f2896000640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2890176e20 0x7f289017f8b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f28900f9d80 tx=0x7f2888007420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7fdcc3e00640 1 -- 172.21.15.69:0/1709362597 shutdown_connections 2024-02-21T07:42:39.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7fdcc3e00640 1 --2- 172.21.15.69:0/1709362597 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdca800b980 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7fdcc3e00640 1 -- 172.21.15.69:0/1709362597 >> 172.21.15.69:0/1709362597 conn(0x7fdcc4071aa0 msgr2=0x7fdcc40668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7f288cc00640 1 -- 172.21.15.69:0/987186908 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800a840 con 0x7f2890176e20 2024-02-21T07:42:39.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7f5b8be00640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7409f190 0x7f5b740a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7fdcc3e00640 1 -- 172.21.15.69:0/1709362597 shutdown_connections 2024-02-21T07:42:39.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.143+0000 7f6155200640 1 -- 172.21.15.69:0/2856206590 shutdown_connections 2024-02-21T07:42:39.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.143+0000 7f6155200640 1 --2- 172.21.15.69:0/2856206590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f61500d22f0 0x7f61501828c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.143+0000 7f6155200640 1 -- 172.21.15.69:0/2856206590 >> 172.21.15.69:0/2856206590 conn(0x7f61500f69c0 msgr2=0x7f61500f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.143+0000 7fdcc3e00640 1 -- 172.21.15.69:0/1709362597 wait complete. 2024-02-21T07:42:39.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.143+0000 7f5b93e00640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7409f190 0x7f5b740a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.143+0000 7f5b8be00640 1 -- 172.21.15.69:0/319717049 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f5b8c0b9530 con 0x7f5b941872d0 2024-02-21T07:42:39.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7fc88f800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8880f5e30 0x7fc888223cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.144+0000 7fc88f800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc888182240 0x7fc8882231f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.144+0000 7fc88f800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc888188a50 0x7fc888215b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.144+0000 7fc88f800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888214af0 con 0x7fc888188a50 2024-02-21T07:42:39.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7f288cc00640 1 -- 172.21.15.69:0/987186908 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288800a9a0 con 0x7f2890176e20 2024-02-21T07:42:39.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.144+0000 7f5b93e00640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7409f190 0x7f5b740a1650 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b940cf340 tx=0x7f5b84009570 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.144+0000 7f1b4b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b441955a0 0x7f1b44234ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.142+0000 7f1d35600640 1 -- 172.21.15.69:0/3456277938 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2802e050 con 0x7f1d30006430 2024-02-21T07:42:39.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1d35600640 1 -- 172.21.15.69:0/3456277938 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28030a90 con 0x7f1d30006430 2024-02-21T07:42:39.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.144+0000 7fc88d800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc888188a50 0x7fc888215b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1b4b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b44196090 0x7f1b44184890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.144+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2890187170 con 0x7f2890176e20 2024-02-21T07:42:39.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.144+0000 7f288cc00640 1 -- 172.21.15.69:0/987186908 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288800ad50 con 0x7f2890176e20 2024-02-21T07:42:39.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1b48a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b441955a0 0x7f1b44234ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1b48a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b441955a0 0x7f1b44234ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42204/0 (socket says 172.21.15.69:42204) 2024-02-21T07:42:39.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7fc88d800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc888188a50 0x7fc888215b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33784/0 (socket says 172.21.15.69:33784) 2024-02-21T07:42:39.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7fc88f800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc888214dd0 con 0x7fc8880f5e30 2024-02-21T07:42:39.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7fc88f800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8882150b0 con 0x7fc888182240 2024-02-21T07:42:39.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7fc88d800640 1 -- 172.21.15.69:0/1568160926 learned_addr learned my addr 172.21.15.69:0/1568160926 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7fc887e00640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc888182240 0x7fc8882231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7fc88ce00640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8880f5e30 0x7fc888223cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7fc88d800640 1 -- 172.21.15.69:0/1568160926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc888182240 msgr2=0x7fc8882231f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7fc88d800640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc888182240 0x7fc8882231f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7fc88d800640 1 -- 172.21.15.69:0/1568160926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8880f5e30 msgr2=0x7fc888223cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7fc88d800640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8880f5e30 0x7fc888223cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7fc88d800640 1 -- 172.21.15.69:0/1568160926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc874007040 con 0x7fc888188a50 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1b48a00640 1 -- 172.21.15.69:0/3989432086 learned_addr learned my addr 172.21.15.69:0/3989432086 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1b4b400640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b44199420 0x7f1b441945e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b44193540 con 0x7f1b44196090 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b44193820 con 0x7f1b441955a0 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b44193b00 con 0x7f1b44199420 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7f1b49400640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b44199420 0x7f1b441945e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7f1b3be00640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b44196090 0x7f1b44184890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7f1b48a00640 1 -- 172.21.15.69:0/3989432086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b44199420 msgr2=0x7f1b441945e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7f1b48a00640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b44199420 0x7f1b441945e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7f1b48a00640 1 -- 172.21.15.69:0/3989432086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b44196090 msgr2=0x7f1b44184890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7f1b48a00640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b44196090 0x7f1b44184890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7f1b48a00640 1 -- 172.21.15.69:0/3989432086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c009a70 con 0x7f1b441955a0 2024-02-21T07:42:39.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7f1b49400640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b44199420 0x7f1b441945e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:39.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1d37e00640 1 -- 172.21.15.69:0/3456277938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d30006430 msgr2=0x7f1d30007c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1d37e00640 1 --2- 172.21.15.69:0/3456277938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d30006430 0x7f1d30007c30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1d30012e10 tx=0x7f1d2802b680 comp rx=0 tx=0).stop 2024-02-21T07:42:39.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1d37e00640 1 -- 172.21.15.69:0/3456277938 shutdown_connections 2024-02-21T07:42:39.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1d37e00640 1 --2- 172.21.15.69:0/3456277938 >> v2:172.21.15.69:3300/0 conn(0x7f1d300e5d40 0x7f1d30110c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1d37e00640 1 --2- 172.21.15.69:0/3456277938 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d30006430 0x7f1d30007c30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f1d37e00640 1 -- 172.21.15.69:0/3456277938 >> 172.21.15.69:0/3456277938 conn(0x7f1d30052de0 msgr2=0x7f1d300531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7f1d37e00640 1 -- 172.21.15.69:0/3456277938 shutdown_connections 2024-02-21T07:42:39.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7f1d37e00640 1 -- 172.21.15.69:0/3456277938 wait complete. 2024-02-21T07:42:39.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.146+0000 7fdcc3e00640 1 Processor -- start 2024-02-21T07:42:39.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7fdcc3e00640 1 -- start start 2024-02-21T07:42:39.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f6155200640 1 -- 172.21.15.69:0/2856206590 shutdown_connections 2024-02-21T07:42:39.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.148+0000 7f6155200640 1 -- 172.21.15.69:0/2856206590 wait complete. 2024-02-21T07:42:39.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.145+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2890187970 con 0x7f2890176e20 2024-02-21T07:42:39.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.149+0000 7fc88d800640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc888188a50 0x7fc888215b90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc880007fa0 tx=0x7fc88000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.148+0000 7f1b48a00640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b441955a0 0x7f1b44234ec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400b410 tx=0x7f1b3400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.141+0000 7fa9d2a00640 1 -- 172.21.15.69:0/177271013 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fa9d4003d30 con 0x7fa9dc181d20 2024-02-21T07:42:39.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.143+0000 7fa9d2a00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa9bc09f210 0x7fa9bc0a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.147+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b4005290 con 0x7fa9dc181d20 2024-02-21T07:42:39.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.148+0000 7fa9d2a00640 1 -- 172.21.15.69:0/177271013 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa9d40ba040 con 0x7fa9dc181d20 2024-02-21T07:42:39.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.149+0000 7fdcc3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdcc4167a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.149+0000 7fdcc3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcc40d3ca0 0x7fdcc40d4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.149+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2890069c10 con 0x7f2890176e20 2024-02-21T07:42:39.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.149+0000 7fdcc3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcc40d1550 0x7fdcc40d19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.149+0000 7f5b8be00640 1 -- 172.21.15.69:0/319717049 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b8c0b57d0 con 0x7f5b941872d0 2024-02-21T07:42:39.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.149+0000 7f1b3be00640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b44196090 0x7f1b44184890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:39.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.149+0000 7f1b41600640 1 -- 172.21.15.69:0/3989432086 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34011830 con 0x7f1b441955a0 2024-02-21T07:42:39.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.150+0000 7f1b41600640 1 -- 172.21.15.69:0/3989432086 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b34011990 con 0x7f1b441955a0 2024-02-21T07:42:39.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.150+0000 7f1b41600640 1 -- 172.21.15.69:0/3989432086 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34011dc0 con 0x7f1b441955a0 2024-02-21T07:42:39.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.150+0000 7fdcc3e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40d0de0 con 0x7fdcc40d1550 2024-02-21T07:42:39.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.150+0000 7fdcc3e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40d49c0 con 0x7fdcc40d3ca0 2024-02-21T07:42:39.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.150+0000 7fdcc3e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40d4ca0 con 0x7fdca8005250 2024-02-21T07:42:39.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.148+0000 7f1d37e00640 1 Processor -- start 2024-02-21T07:42:39.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.150+0000 7f1d37e00640 1 -- start start 2024-02-21T07:42:39.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.150+0000 7fdcc2a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdcc4167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.150+0000 7fdcc2a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdcc4167a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34356/0 (socket says 172.21.15.69:34356) 2024-02-21T07:42:39.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.150+0000 7fdcc2a00640 1 -- 172.21.15.69:0/1165364635 learned_addr learned my addr 172.21.15.69:0/1165364635 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.150+0000 7f6155200640 1 Processor -- start 2024-02-21T07:42:39.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.151+0000 7f6155200640 1 -- start start 2024-02-21T07:42:39.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.151+0000 7fa9daa00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa9bc09f210 0x7fa9bc0a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.151+0000 7fdcc3400640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcc40d1550 0x7fdcc40d19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.151+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b44193de0 con 0x7f1b441955a0 2024-02-21T07:42:39.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.152+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b44184dd0 con 0x7f1b441955a0 2024-02-21T07:42:39.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.152+0000 7fa9daa00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa9bc09f210 0x7fa9bc0a16d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800a830 tx=0x7fa9c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.153+0000 7fc884c00640 1 -- 172.21.15.69:0/1568160926 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880003b90 con 0x7fc888188a50 2024-02-21T07:42:39.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.153+0000 7fc884c00640 1 -- 172.21.15.69:0/1568160926 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88000f040 con 0x7fc888188a50 2024-02-21T07:42:39.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.153+0000 7fc884c00640 1 -- 172.21.15.69:0/1568160926 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880004020 con 0x7fc888188a50 2024-02-21T07:42:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.153+0000 7f1d37e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d30006430 0x7f1d300fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f1d37e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d300e5d40 0x7f1d30105630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f1d37e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d3010adb0 0x7f1d30105b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f1d37e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d301060b0 con 0x7f1d30006430 2024-02-21T07:42:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f1d37e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30106310 con 0x7f1d3010adb0 2024-02-21T07:42:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f1d37e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d301065f0 con 0x7f1d300e5d40 2024-02-21T07:42:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.153+0000 7f6155200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61500d22f0 0x7f615016fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.153+0000 7f6155200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500f74e0 0x7f6150170180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f6155200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6150182e00 0x7f61500cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f614de00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61500d22f0 0x7f615016fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f6155200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61500cbfe0 con 0x7f61500f74e0 2024-02-21T07:42:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f6155200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6150225260 con 0x7f61500d22f0 2024-02-21T07:42:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f6155200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6150225540 con 0x7f6150182e00 2024-02-21T07:42:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f614de00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61500d22f0 0x7f615016fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42232/0 (socket says 172.21.15.69:42232) 2024-02-21T07:42:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f614de00640 1 -- 172.21.15.69:0/244926228 learned_addr learned my addr 172.21.15.69:0/244926228 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f614e800640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6150182e00 0x7f61500cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f1d36a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d30006430 0x7f1d300fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f1d36a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d30006430 0x7f1d300fd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33798/0 (socket says 172.21.15.69:33798) 2024-02-21T07:42:39.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f1d36a00640 1 -- 172.21.15.69:0/1966351549 learned_addr learned my addr 172.21.15.69:0/1966351549 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.154+0000 7f1d37400640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d3010adb0 0x7f1d30105b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.155+0000 7f1d36a00640 1 -- 172.21.15.69:0/1966351549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d300e5d40 msgr2=0x7f1d30105630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:42:39.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.155+0000 7f1d36a00640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d300e5d40 0x7f1d30105630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.155+0000 7f1d36a00640 1 -- 172.21.15.69:0/1966351549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d3010adb0 msgr2=0x7f1d30105b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.155+0000 7f1d36a00640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d3010adb0 0x7f1d30105b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.155+0000 7f1d36a00640 1 -- 172.21.15.69:0/1966351549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28009400 con 0x7f1d30006430 2024-02-21T07:42:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.156+0000 7f1d36a00640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d30006430 0x7f1d300fd290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c540 tx=0x7f1d2400ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.155+0000 7f614d400640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500f74e0 0x7f6150170180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.156+0000 7f1d2ea00640 1 -- 172.21.15.69:0/1966351549 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d240052d0 con 0x7f1d30006430 2024-02-21T07:42:39.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.156+0000 7f1d2ea00640 1 -- 172.21.15.69:0/1966351549 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d24005430 con 0x7f1d30006430 2024-02-21T07:42:39.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.156+0000 7f1d2ea00640 1 -- 172.21.15.69:0/1966351549 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24012870 con 0x7f1d30006430 2024-02-21T07:42:39.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.157+0000 7fa9d2a00640 1 -- 172.21.15.69:0/177271013 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa9d40b62e0 con 0x7fa9dc181d20 2024-02-21T07:42:39.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.156+0000 7f1d37e00640 1 -- 172.21.15.69:0/1966351549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d301068d0 con 0x7f1d30006430 2024-02-21T07:42:39.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.157+0000 7f1d37e00640 1 -- 172.21.15.69:0/1966351549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d301a4ac0 con 0x7f1d30006430 2024-02-21T07:42:39.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.151+0000 7fdcc2a00640 1 -- 172.21.15.69:0/1165364635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcc40d3ca0 msgr2=0x7fdcc40d4120 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:42:39.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.151+0000 7fdcc2a00640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcc40d3ca0 0x7fdcc40d4120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.151+0000 7fdcc2a00640 1 -- 172.21.15.69:0/1165364635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcc40d1550 msgr2=0x7fdcc40d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.151+0000 7fdcc2a00640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcc40d1550 0x7fdcc40d19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.153+0000 7fc88f800640 1 -- 172.21.15.69:0/1568160926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc888215390 con 0x7fc888188a50 2024-02-21T07:42:39.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.151+0000 7fdcc2a00640 1 -- 172.21.15.69:0/1165364635 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40d4f80 con 0x7fdca8005250 2024-02-21T07:42:39.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.151+0000 7fdcc3400640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcc40d1550 0x7fdcc40d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:39.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.156+0000 7fc88f800640 1 -- 172.21.15.69:0/1568160926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88806c6b0 con 0x7fc888188a50 2024-02-21T07:42:39.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.158+0000 7fdcc2a00640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdcc4167a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007480 tx=0x7fdcbc007940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.158+0000 7fdcbaa00640 1 -- 172.21.15.69:0/1165364635 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc004cb0 con 0x7fdca8005250 2024-02-21T07:42:39.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.158+0000 7f614de00640 1 -- 172.21.15.69:0/244926228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6150182e00 msgr2=0x7f61500cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.158+0000 7f614de00640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6150182e00 0x7f61500cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.158+0000 7f614de00640 1 -- 172.21.15.69:0/244926228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500f74e0 msgr2=0x7f6150170180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.158+0000 7f614de00640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500f74e0 0x7f6150170180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.158+0000 7f614de00640 1 -- 172.21.15.69:0/244926228 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614800da70 con 0x7f61500d22f0 2024-02-21T07:42:39.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.160+0000 7f1d37e00640 1 -- 172.21.15.69:0/1966351549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d30009af0 con 0x7f1d30006430 2024-02-21T07:42:39.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.160+0000 7f614d400640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500f74e0 0x7f6150170180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.162+0000 7f614de00640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61500d22f0 0x7f615016fc40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f613800c780 tx=0x7f613800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.162+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b440ed800 con 0x7f1b441955a0 2024-02-21T07:42:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.161+0000 7fc88f800640 1 -- 172.21.15.69:0/1568160926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8882158b0 con 0x7fc888188a50 2024-02-21T07:42:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.163+0000 7fc884c00640 1 -- 172.21.15.69:0/1568160926 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc880004180 con 0x7fc888188a50 2024-02-21T07:42:39.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.162+0000 7f1d2ea00640 1 -- 172.21.15.69:0/1966351549 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1d240129d0 con 0x7f1d30006430 2024-02-21T07:42:39.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.164+0000 7f1d2ea00640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1d1809f200 0x7f1d180a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.164+0000 7f1d2ea00640 1 -- 172.21.15.69:0/1966351549 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f1d240c98a0 con 0x7f1d30006430 2024-02-21T07:42:39.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.165+0000 7f1d36000640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1d1809f200 0x7f1d180a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.165+0000 7fc884c00640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc86809f280 0x7fc8680a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.165+0000 7fc884c00640 1 -- 172.21.15.69:0/1568160926 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fc8800ca0c0 con 0x7fc888188a50 2024-02-21T07:42:39.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.166+0000 7f1b41600640 1 -- 172.21.15.69:0/3989432086 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1b3401a400 con 0x7f1b441955a0 2024-02-21T07:42:39.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.166+0000 7fc88ce00640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc86809f280 0x7fc8680a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.167+0000 7f1d36000640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1d1809f200 0x7f1d180a16c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d28034000 tx=0x7f1d28008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.162+0000 7fdcbaa00640 1 -- 172.21.15.69:0/1165364635 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00f9c0 con 0x7fdca8005250 2024-02-21T07:42:39.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.167+0000 7fdcc3e00640 1 -- 172.21.15.69:0/1165364635 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc40d5260 con 0x7fdca8005250 2024-02-21T07:42:39.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.167+0000 7fdcc3e00640 1 -- 172.21.15.69:0/1165364635 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc40d4660 con 0x7fdca8005250 2024-02-21T07:42:39.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.167+0000 7fdcbaa00640 1 -- 172.21.15.69:0/1165364635 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00fd50 con 0x7fdca8005250 2024-02-21T07:42:39.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.169+0000 7fc88ce00640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc86809f280 0x7fc8680a1740 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc874037000 tx=0x7fc87400a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.166+0000 7f288cc00640 1 -- 172.21.15.69:0/987186908 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f2888017460 con 0x7f2890176e20 2024-02-21T07:42:39.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.166+0000 7f6146000640 1 -- 172.21.15.69:0/244926228 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380074e0 con 0x7f61500d22f0 2024-02-21T07:42:39.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.166+0000 7f6146000640 1 -- 172.21.15.69:0/244926228 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613800ce90 con 0x7f61500d22f0 2024-02-21T07:42:39.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.166+0000 7f6146000640 1 -- 172.21.15.69:0/244926228 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6138004a20 con 0x7f61500d22f0 2024-02-21T07:42:39.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.167+0000 7f6155200640 1 -- 172.21.15.69:0/244926228 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6150225820 con 0x7f61500d22f0 2024-02-21T07:42:39.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.167+0000 7f6155200640 1 -- 172.21.15.69:0/244926228 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6150225de0 con 0x7f61500d22f0 2024-02-21T07:42:39.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.169+0000 7f613f400640 1 -- 172.21.15.69:0/244926228 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6120005290 con 0x7f61500d22f0 2024-02-21T07:42:39.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.170+0000 7f288cc00640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f287009f1e0 0x7f28700a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.168+0000 7f1b41600640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2009f1b0 0x7f1b200a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.169+0000 7f1b41600640 1 -- 172.21.15.69:0/3989432086 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f1b340c9dd0 con 0x7f1b441955a0 2024-02-21T07:42:39.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.169+0000 7f1b3be00640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2009f1b0 0x7f1b200a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.169+0000 7f1b3be00640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2009f1b0 0x7f1b200a1670 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0097a0 tx=0x7f1b2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.170+0000 7f288cc00640 1 -- 172.21.15.69:0/987186908 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f28880ca3c0 con 0x7f2890176e20 2024-02-21T07:42:39.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.170+0000 7f288cc00640 1 -- 172.21.15.69:0/987186908 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f28880ca840 con 0x7f2890176e20 2024-02-21T07:42:39.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.171+0000 7f2894c00640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f287009f1e0 0x7f28700a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.171+0000 7f1b41600640 1 -- 172.21.15.69:0/3989432086 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b340cd030 con 0x7f1b441955a0 2024-02-21T07:42:39.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.173+0000 7f1d2ea00640 1 -- 172.21.15.69:0/1966351549 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1d24093610 con 0x7f1d30006430 2024-02-21T07:42:39.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.173+0000 7f2894c00640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f287009f1e0 0x7f28700a16a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2884004650 tx=0x7f2884008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.177+0000 7fdcafe00640 1 -- 172.21.15.69:0/1165364635 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9c005290 con 0x7fdca8005250 2024-02-21T07:42:39.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.175+0000 7f6146000640 1 -- 172.21.15.69:0/244926228 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f613800a5e0 con 0x7f61500d22f0 2024-02-21T07:42:39.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.177+0000 7f6146000640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f612c09f200 0x7f612c0a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.184+0000 7f614d400640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f612c09f200 0x7f612c0a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.184+0000 7f6146000640 1 -- 172.21.15.69:0/244926228 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f61380c98b0 con 0x7f61500d22f0 2024-02-21T07:42:39.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.184+0000 7f614d400640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f612c09f200 0x7f612c0a16c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f614803a000 tx=0x7f6148034000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.185+0000 7f6146000640 1 -- 172.21.15.69:0/244926228 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6138097260 con 0x7f61500d22f0 2024-02-21T07:42:39.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.188+0000 7fc884c00640 1 -- 172.21.15.69:0/1568160926 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc8882158b0 con 0x7fc888188a50 2024-02-21T07:42:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.182+0000 7fdcbaa00640 1 -- 172.21.15.69:0/1165364635 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fdcbc01d460 con 0x7fdca8005250 2024-02-21T07:42:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.184+0000 7fdcbaa00640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdca409f280 0x7fdca40a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.184+0000 7fdcbaa00640 1 -- 172.21.15.69:0/1165364635 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fdcbc0c9ee0 con 0x7fdca8005250 2024-02-21T07:42:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.189+0000 7fdcc2000640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdca409f280 0x7fdca40a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.189+0000 7fdcbaa00640 1 -- 172.21.15.69:0/1165364635 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdcbc093bf0 con 0x7fdca8005250 2024-02-21T07:42:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.190+0000 7fdcc2000640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdca409f280 0x7fdca40a1740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40d2790 tx=0x7fdcb0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.213+0000 7f5b9be00640 1 Processor -- start 2024-02-21T07:42:39.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.213+0000 7f5b9be00640 1 -- start start 2024-02-21T07:42:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.216+0000 7f5b9be00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5b94186e60 0x7f5b9418c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.223+0000 7fbb59c00640 1 Processor -- start 2024-02-21T07:42:39.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.223+0000 7fbb59c00640 1 -- start start 2024-02-21T07:42:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.226+0000 7fbb59c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbb5417f110 0x7fbb540f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.227+0000 7fbb53e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbb5417f110 0x7fbb540f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.227+0000 7fbb53e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbb5417f110 0x7fbb540f92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33816/0 (socket says 172.21.15.69:33816) 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.228+0000 7f5b9be00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5b940cf2d0 0x7f5b9418c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.228+0000 7f5b9be00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b940fd1e0 con 0x7f5b941903b0 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.228+0000 7f5b9be00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b9418cbd0 con 0x7f5b94186e60 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.228+0000 7f5b9be00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b94187240 con 0x7f5b940cf2d0 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.228+0000 7f5b98a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5b940cf2d0 0x7f5b9418c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.228+0000 7f5b98a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f5b940cf2d0 0x7f5b9418c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34396/0 (socket says 172.21.15.69:34396) 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.228+0000 7f5b98a00640 1 -- 172.21.15.69:0/89162253 learned_addr learned my addr 172.21.15.69:0/89162253 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.228+0000 7f5b99400640 1 --2- 172.21.15.69:0/89162253 >> v2:172.21.15.69:3300/0 conn(0x7f5b94186e60 0x7f5b9418c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.228+0000 7f5b98a00640 1 -- 172.21.15.69:0/89162253 >> v2:172.21.15.69:3300/0 conn(0x7f5b94186e60 msgr2=0x7f5b9418c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.229+0000 7f5b98a00640 1 --2- 172.21.15.69:0/89162253 >> v2:172.21.15.69:3300/0 conn(0x7f5b94186e60 0x7f5b9418c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.229+0000 7f5b98a00640 1 -- 172.21.15.69:0/89162253 >> v1:172.21.15.69:6789/0 conn(0x7f5b941903b0 legacy=0x7f5b941907e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.229+0000 7f5b98a00640 1 -- 172.21.15.69:0/89162253 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9418ddd0 con 0x7f5b940cf2d0 2024-02-21T07:42:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.229+0000 7f5b99400640 1 --2- 172.21.15.69:0/89162253 >> v2:172.21.15.69:3300/0 conn(0x7f5b94186e60 0x7f5b9418c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:39.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.230+0000 7fbb53e00640 1 -- 172.21.15.69:0/739712436 learned_addr learned my addr 172.21.15.69:0/739712436 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.230+0000 7fbb59c00640 1 --2- 172.21.15.69:0/739712436 >> v2:172.21.15.174:3300/0 conn(0x7fbb5406ebf0 0x7fbb540f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.230+0000 7fbb59c00640 1 -- 172.21.15.69:0/739712436 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb541898b0 con 0x7fbb5417f4f0 2024-02-21T07:42:39.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.230+0000 7fbb59c00640 1 -- 172.21.15.69:0/739712436 --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb540f8eb0 con 0x7fbb5417f110 2024-02-21T07:42:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.230+0000 7fbb59c00640 1 -- 172.21.15.69:0/739712436 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb54071a00 con 0x7fbb5406ebf0 2024-02-21T07:42:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.231+0000 7fbb53e00640 1 -- 172.21.15.69:0/739712436 >> v2:172.21.15.174:3300/0 conn(0x7fbb5406ebf0 msgr2=0x7fbb540f9810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:42:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.231+0000 7fbb53e00640 1 --2- 172.21.15.69:0/739712436 >> v2:172.21.15.174:3300/0 conn(0x7fbb5406ebf0 0x7fbb540f9810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.231+0000 7fbb53e00640 1 -- 172.21.15.69:0/739712436 >> v1:172.21.15.184:6789/0 conn(0x7fbb5417f4f0 legacy=0x7fbb5406d010 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:42:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.231+0000 7fbb53e00640 1 -- 172.21.15.69:0/739712436 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540f8230 con 0x7fbb5417f110 2024-02-21T07:42:39.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.232+0000 7fbb53e00640 1 --2- 172.21.15.69:0/739712436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb5417f110 0x7fbb540f92d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb5406e6c0 tx=0x7fbb4402b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c70be53aa34eaa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.235+0000 7f5b98a00640 1 --2- 172.21.15.69:0/89162253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b940cf2d0 0x7f5b9418c690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5b940fba80 tx=0x7f5b8802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f715706164ce3e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.235+0000 7f5b93e00640 1 -- 172.21.15.69:0/89162253 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88031870 con 0x7f5b940cf2d0 2024-02-21T07:42:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.239+0000 7f5b93e00640 1 -- 172.21.15.69:0/89162253 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b880319d0 con 0x7f5b940cf2d0 2024-02-21T07:42:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.239+0000 7f5b93e00640 1 -- 172.21.15.69:0/89162253 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88031d60 con 0x7f5b940cf2d0 2024-02-21T07:42:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.240+0000 7f5b9be00640 1 -- 172.21.15.69:0/89162253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b940cf2d0 msgr2=0x7f5b9418c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.240+0000 7f5b9be00640 1 --2- 172.21.15.69:0/89162253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b940cf2d0 0x7f5b9418c690 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5b940fba80 tx=0x7f5b8802b910 comp rx=0 tx=0).stop 2024-02-21T07:42:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.238+0000 7fbb52a00640 1 -- 172.21.15.69:0/739712436 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44031770 con 0x7fbb5417f110 2024-02-21T07:42:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.238+0000 7fbb52a00640 1 -- 172.21.15.69:0/739712436 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb440318d0 con 0x7fbb5417f110 2024-02-21T07:42:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.238+0000 7fbb52a00640 1 -- 172.21.15.69:0/739712436 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44031c60 con 0x7fbb5417f110 2024-02-21T07:42:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.241+0000 7fbb59c00640 1 -- 172.21.15.69:0/739712436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb5417f110 msgr2=0x7fbb540f92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.241+0000 7fbb59c00640 1 --2- 172.21.15.69:0/739712436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb5417f110 0x7fbb540f92d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb5406e6c0 tx=0x7fbb4402b810 comp rx=0 tx=0).stop 2024-02-21T07:42:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.242+0000 7fbb59c00640 1 -- 172.21.15.69:0/739712436 shutdown_connections 2024-02-21T07:42:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.242+0000 7fbb59c00640 1 --2- 172.21.15.69:0/739712436 >> v2:172.21.15.174:3300/0 conn(0x7fbb5406ebf0 0x7fbb540f9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.242+0000 7fbb59c00640 1 --2- 172.21.15.69:0/739712436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb5417f110 0x7fbb540f92d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.242+0000 7fbb59c00640 1 -- 172.21.15.69:0/739712436 >> 172.21.15.69:0/739712436 conn(0x7fbb540f6840 msgr2=0x7fbb540f6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.242+0000 7fbb59c00640 1 -- 172.21.15.69:0/739712436 shutdown_connections 2024-02-21T07:42:39.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.242+0000 7fbb59c00640 1 -- 172.21.15.69:0/739712436 wait complete. 2024-02-21T07:42:39.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.242+0000 7f5b9be00640 1 -- 172.21.15.69:0/89162253 shutdown_connections 2024-02-21T07:42:39.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.242+0000 7f5b9be00640 1 --2- 172.21.15.69:0/89162253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b940cf2d0 0x7f5b9418c690 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.242+0000 7f5b9be00640 1 --2- 172.21.15.69:0/89162253 >> v2:172.21.15.69:3300/0 conn(0x7f5b94186e60 0x7f5b9418c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.242+0000 7f5b9be00640 1 -- 172.21.15.69:0/89162253 >> 172.21.15.69:0/89162253 conn(0x7f5b94071b80 msgr2=0x7f5b940668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.246+0000 7f5b9be00640 1 -- 172.21.15.69:0/89162253 shutdown_connections 2024-02-21T07:42:39.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.246+0000 7f5b9be00640 1 -- 172.21.15.69:0/89162253 wait complete. 2024-02-21T07:42:39.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.245+0000 7fbb59c00640 1 Processor -- start 2024-02-21T07:42:39.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.249+0000 7fbb59c00640 1 -- start start 2024-02-21T07:42:39.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.253+0000 7fbb59c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb5406ebf0 0x7fbb54229040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.253+0000 7f5b9be00640 1 Processor -- start 2024-02-21T07:42:39.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.253+0000 7f5b9be00640 1 -- start start 2024-02-21T07:42:39.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.253+0000 7fbb59c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb5417f110 0x7fbb540cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.254+0000 7fbb59c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5417f4f0 0x7fbb5422ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.256+0000 7fbb59c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5422ca30 con 0x7fbb5406ebf0 2024-02-21T07:42:39.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.256+0000 7fbb59200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5417f4f0 0x7fbb5422ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.256+0000 7fbb59200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5417f4f0 0x7fbb5422ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34400/0 (socket says 172.21.15.69:34400) 2024-02-21T07:42:39.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.256+0000 7fbb59200640 1 -- 172.21.15.69:0/2103244798 learned_addr learned my addr 172.21.15.69:0/2103244798 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.256+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5422cd10 con 0x7fbb5417f110 2024-02-21T07:42:39.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.256+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5422cff0 con 0x7fbb5417f4f0 2024-02-21T07:42:39.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.256+0000 7fbb53e00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb5406ebf0 0x7fbb54229040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.258+0000 7fbb53e00640 1 -- 172.21.15.69:0/2103244798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5417f4f0 msgr2=0x7fbb5422ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.258+0000 7fbb53e00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5417f4f0 0x7fbb5422ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.258+0000 7fbb53e00640 1 -- 172.21.15.69:0/2103244798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb5417f110 msgr2=0x7fbb540cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.258+0000 7fbb53400640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb5417f110 0x7fbb540cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.258+0000 7fbb53e00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb5417f110 0x7fbb540cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.258+0000 7fbb53e00640 1 -- 172.21.15.69:0/2103244798 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb440094d0 con 0x7fbb5406ebf0 2024-02-21T07:42:39.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.263+0000 7fbb53e00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb5406ebf0 0x7fbb54229040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb44033000 tx=0x7fbb440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.263+0000 7f5b9be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b940cf2d0 0x7f5b940f8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.263+0000 7fbb4be00640 1 -- 172.21.15.69:0/2103244798 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb440328c0 con 0x7fbb5406ebf0 2024-02-21T07:42:39.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.264+0000 7fbb4be00640 1 -- 172.21.15.69:0/2103244798 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44032a20 con 0x7fbb5406ebf0 2024-02-21T07:42:39.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.264+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5422d2d0 con 0x7fbb5406ebf0 2024-02-21T07:42:39.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.264+0000 7f5b9be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b94186e60 0x7f5b9416b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.264+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5422d890 con 0x7fbb5406ebf0 2024-02-21T07:42:39.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.264+0000 7fbb4be00640 1 -- 172.21.15.69:0/2103244798 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44032dd0 con 0x7fbb5406ebf0 2024-02-21T07:42:39.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.264+0000 7f5b9be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b941903b0 0x7f5b94175160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.265+0000 7f5b99400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b940cf2d0 0x7f5b940f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.265+0000 7f5b99400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b940cf2d0 0x7f5b940f8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42264/0 (socket says 172.21.15.69:42264) 2024-02-21T07:42:39.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.265+0000 7f5b99400640 1 -- 172.21.15.69:0/2994643241 learned_addr learned my addr 172.21.15.69:0/2994643241 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:39.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.265+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940d3de0 con 0x7f5b941903b0 2024-02-21T07:42:39.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.266+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5422dad0 con 0x7fbb5406ebf0 2024-02-21T07:42:39.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.265+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940d4340 con 0x7f5b940cf2d0 2024-02-21T07:42:39.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.265+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b940d16a0 con 0x7f5b94186e60 2024-02-21T07:42:39.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.266+0000 7f5b98a00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b94186e60 0x7f5b9416b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.267+0000 7f5b99e00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b941903b0 0x7f5b94175160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.267+0000 7f5b98a00640 1 -- 172.21.15.69:0/2994643241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b940cf2d0 msgr2=0x7f5b940f8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.267+0000 7f5b98a00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b940cf2d0 0x7f5b940f8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.267+0000 7f5b98a00640 1 -- 172.21.15.69:0/2994643241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b941903b0 msgr2=0x7f5b94175160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.270+0000 7f5b98a00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b941903b0 0x7f5b94175160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.270+0000 7f5b98a00640 1 -- 172.21.15.69:0/2994643241 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880094d0 con 0x7f5b94186e60 2024-02-21T07:42:39.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.270+0000 7f5b99e00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b941903b0 0x7f5b94175160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:39.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.270+0000 7f5b98a00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b94186e60 0x7f5b9416b980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5b94187380 tx=0x7f5b880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.271+0000 7fbb4be00640 1 -- 172.21.15.69:0/2103244798 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fbb4404e450 con 0x7fbb5406ebf0 2024-02-21T07:42:39.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.274+0000 7f5b91600640 1 -- 172.21.15.69:0/2994643241 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8803ad70 con 0x7f5b94186e60 2024-02-21T07:42:39.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.274+0000 7f5b91600640 1 -- 172.21.15.69:0/2994643241 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b880443f0 con 0x7f5b94186e60 2024-02-21T07:42:39.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.274+0000 7f5b91600640 1 -- 172.21.15.69:0/2994643241 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880447a0 con 0x7f5b94186e60 2024-02-21T07:42:39.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.274+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b940d1980 con 0x7f5b94186e60 2024-02-21T07:42:39.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.274+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b94174960 con 0x7f5b94186e60 2024-02-21T07:42:39.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.273+0000 7fbb4be00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbb3409f230 0x7fbb340a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.278+0000 7fbb4be00640 1 -- 172.21.15.69:0/2103244798 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fbb440b9da0 con 0x7fbb5406ebf0 2024-02-21T07:42:39.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.279+0000 7fbb53400640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbb3409f230 0x7fbb340a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.279+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b94069d50 con 0x7f5b94186e60 2024-02-21T07:42:39.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.283+0000 7fbb53400640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbb3409f230 0x7fbb340a16f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb54071900 tx=0x7fbb40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.293+0000 7f5b91600640 1 -- 172.21.15.69:0/2994643241 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5b88044900 con 0x7f5b94186e60 2024-02-21T07:42:39.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.295+0000 7fbb4be00640 1 -- 172.21.15.69:0/2103244798 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbb440b60d0 con 0x7fbb5406ebf0 2024-02-21T07:42:39.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.309+0000 7f5b91600640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7809f200 0x7f5b780a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:39.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.310+0000 7f5b91600640 1 -- 172.21.15.69:0/2994643241 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f5b8802d040 con 0x7f5b94186e60 2024-02-21T07:42:39.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.314+0000 7f5b99400640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7809f200 0x7f5b780a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:39.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.314+0000 7f5b91600640 1 -- 172.21.15.69:0/2994643241 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b880ec960 con 0x7f5b94186e60 2024-02-21T07:42:39.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.315+0000 7f5b99400640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7809f200 0x7f5b780a16c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400aab0 tx=0x7f5b84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:39.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.608+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5b94070280 con 0x7f5b941872d0 2024-02-21T07:42:39.621 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:39.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.613+0000 7f5b8be00640 1 -- 172.21.15.69:0/319717049 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b8c0b5970 con 0x7f5b941872d0 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.616+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7409f190 msgr2=0x7f5b740a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.616+0000 7f5b99800640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7409f190 0x7f5b740a1650 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b940cf340 tx=0x7f5b84009570 comp rx=0 tx=0).stop 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.616+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941872d0 msgr2=0x7f5b9417e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.616+0000 7f5b99800640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941872d0 0x7f5b9417e040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c033000 tx=0x7f5b8c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.616+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 shutdown_connections 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.616+0000 7f5b99800640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7409f190 0x7f5b740a1650 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.616+0000 7f5b99800640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b941872d0 0x7f5b9417e040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.616+0000 7f5b99800640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b9417f710 0x7f5b94170ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.617+0000 7f5b99800640 1 --2- 172.21.15.69:0/319717049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b940f61f0 0x7f5b9415e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.617+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 >> 172.21.15.69:0/319717049 conn(0x7f5b940cf370 msgr2=0x7f5b9406f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.617+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 shutdown_connections 2024-02-21T07:42:39.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.617+0000 7f5b99800640 1 -- 172.21.15.69:0/319717049 wait complete. 2024-02-21T07:42:39.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.655+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b44069d50 con 0x7f1b441955a0 2024-02-21T07:42:39.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.655+0000 7f1b41600640 1 -- 172.21.15.69:0/3989432086 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b34015020 con 0x7f1b441955a0 2024-02-21T07:42:39.662 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:39.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.661+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2009f1b0 msgr2=0x7f1b200a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.661+0000 7f1b4b400640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2009f1b0 0x7f1b200a1670 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0097a0 tx=0x7f1b2c008040 comp rx=0 tx=0).stop 2024-02-21T07:42:39.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.661+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b441955a0 msgr2=0x7f1b44234ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.661+0000 7f1b4b400640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b441955a0 0x7f1b44234ec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400b410 tx=0x7f1b3400b8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.662+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 shutdown_connections 2024-02-21T07:42:39.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.662+0000 7f1b4b400640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2009f1b0 0x7f1b200a1670 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.662+0000 7f1b4b400640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b44199420 0x7f1b441945e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.662+0000 7f1b4b400640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b44196090 0x7f1b44184890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.662+0000 7f1b4b400640 1 --2- 172.21.15.69:0/3989432086 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b441955a0 0x7f1b44234ec0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.662+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 >> 172.21.15.69:0/3989432086 conn(0x7f1b440f69c0 msgr2=0x7f1b44195980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.664+0000 7f1d37e00640 1 -- 172.21.15.69:0/1966351549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1d30005450 con 0x7f1d30006430 2024-02-21T07:42:39.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.665+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 shutdown_connections 2024-02-21T07:42:39.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.665+0000 7f1b4b400640 1 -- 172.21.15.69:0/3989432086 wait complete. 2024-02-21T07:42:39.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.665+0000 7f1d2ea00640 1 -- 172.21.15.69:0/1966351549 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d24095540 con 0x7f1d30006430 2024-02-21T07:42:39.671 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:39.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.668+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fa9b4005810 con 0x7fa9dc181d20 2024-02-21T07:42:39.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.668+0000 7fa9d2a00640 1 -- 172.21.15.69:0/177271013 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7fa9d4039090 con 0x7fa9dc181d20 2024-02-21T07:42:39.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.670+0000 7f1d37e00640 1 -- 172.21.15.69:0/1966351549 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1d1809f200 msgr2=0x7f1d180a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.670+0000 7f1d37e00640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1d1809f200 0x7f1d180a16c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d28034000 tx=0x7f1d28008030 comp rx=0 tx=0).stop 2024-02-21T07:42:39.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.670+0000 7f1d37e00640 1 -- 172.21.15.69:0/1966351549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d30006430 msgr2=0x7f1d300fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.670+0000 7f1d37e00640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d30006430 0x7f1d300fd290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400c540 tx=0x7f1d2400ca00 comp rx=0 tx=0).stop 2024-02-21T07:42:39.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.671+0000 7f1d37e00640 1 -- 172.21.15.69:0/1966351549 shutdown_connections 2024-02-21T07:42:39.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.671+0000 7f1d37e00640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1d1809f200 0x7f1d180a16c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.671+0000 7f1d37e00640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1d3010adb0 0x7f1d30105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.671+0000 7f1d37e00640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d300e5d40 0x7f1d30105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.671+0000 7f1d37e00640 1 --2- 172.21.15.69:0/1966351549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1d30006430 0x7f1d300fd290 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.671+0000 7f1d37e00640 1 -- 172.21.15.69:0/1966351549 >> 172.21.15.69:0/1966351549 conn(0x7f1d30052de0 msgr2=0x7f1d30056de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.671+0000 7f1d37e00640 1 -- 172.21.15.69:0/1966351549 shutdown_connections 2024-02-21T07:42:39.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.671+0000 7f1d37e00640 1 -- 172.21.15.69:0/1966351549 wait complete. 2024-02-21T07:42:39.680 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:39.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.675+0000 7f3294400640 1 -- 172.21.15.69:0/1419814662 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3284051180 con 0x7f3284110db0 2024-02-21T07:42:39.684 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:39.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.675+0000 7f3289600640 1 -- 172.21.15.69:0/1419814662 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3284051180 con 0x7f3284110db0 2024-02-21T07:42:39.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.681+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa9bc09f210 msgr2=0x7fa9bc0a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.681+0000 7fa9e1a00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa9bc09f210 0x7fa9bc0a16d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800a830 tx=0x7fa9c8008040 comp rx=0 tx=0).stop 2024-02-21T07:42:39.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.681+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 msgr2=0x7fa9dc21b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.681+0000 7fa9e1a00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 0x7fa9dc21b650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4037040 tx=0x7fa9d40046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.681+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 shutdown_connections 2024-02-21T07:42:39.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.681+0000 7fa9e1a00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa9bc09f210 0x7fa9bc0a16d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.681+0000 7fa9e1a00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9dc1821b0 0x7fa9dc1662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.681+0000 7fa9e1a00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9dc181d20 0x7fa9dc21b650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.681+0000 7fa9e1a00640 1 --2- 172.21.15.69:0/177271013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa9dc181940 0x7fa9dc16f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.681+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 >> 172.21.15.69:0/177271013 conn(0x7fa9dc0f69c0 msgr2=0x7fa9dc0f47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.684+0000 7f3294400640 1 -- 172.21.15.69:0/1419814662 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f327009f280 msgr2=0x7f32700a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.684+0000 7f3294400640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f327009f280 0x7f32700a1740 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f328c064900 tx=0x7f328c06d040 comp rx=0 tx=0).stop 2024-02-21T07:42:39.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.684+0000 7f3294400640 1 -- 172.21.15.69:0/1419814662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3284110db0 msgr2=0x7f3284051e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.684+0000 7f3294400640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3284110db0 0x7f3284051e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f328000c450 tx=0x7f328000c910 comp rx=0 tx=0).stop 2024-02-21T07:42:39.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.684+0000 7f3294400640 1 -- 172.21.15.69:0/1419814662 shutdown_connections 2024-02-21T07:42:39.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.684+0000 7f3294400640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f327009f280 0x7f32700a1740 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f328c064900 tx=0x7f328c06d040 comp rx=0 tx=0).stop 2024-02-21T07:42:39.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.684+0000 7f3294400640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3284112630 0x7f3284052340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.684+0000 7f3294400640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3284110db0 0x7f3284051e00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.684+0000 7f3294400640 1 --2- 172.21.15.69:0/1419814662 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f328410bb50 0x7f32840ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.684+0000 7f3294400640 1 -- 172.21.15.69:0/1419814662 >> 172.21.15.69:0/1419814662 conn(0x7f3284052e10 msgr2=0x7f3284004b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.685+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 shutdown_connections 2024-02-21T07:42:39.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.685+0000 7fa9e1a00640 1 -- 172.21.15.69:0/177271013 wait complete. 2024-02-21T07:42:39.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444043 for osd.7 2024-02-21T07:42:39.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.687+0000 7f3294400640 1 -- 172.21.15.69:0/1419814662 shutdown_connections 2024-02-21T07:42:39.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.687+0000 7f3294400640 1 -- 172.21.15.69:0/1419814662 wait complete. 2024-02-21T07:42:39.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444045 got 73014444044 for osd.0 2024-02-21T07:42:39.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444043 for osd.5 2024-02-21T07:42:39.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444043 for osd.2 2024-02-21T07:42:39.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444043 for osd.10 2024-02-21T07:42:39.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.766+0000 7fc88f800640 1 -- 172.21.15.69:0/1568160926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8882158b0 con 0x7fc888188a50 2024-02-21T07:42:39.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.767+0000 7fc884c00640 1 -- 172.21.15.69:0/1568160926 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8882158b0 con 0x7fc888188a50 2024-02-21T07:42:39.774 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:39.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.770+0000 7fc88f800640 1 -- 172.21.15.69:0/1568160926 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc86809f280 msgr2=0x7fc8680a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.770+0000 7fc88f800640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc86809f280 0x7fc8680a1740 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc874037000 tx=0x7fc87400a000 comp rx=0 tx=0).stop 2024-02-21T07:42:39.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.770+0000 7fc88f800640 1 -- 172.21.15.69:0/1568160926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc888188a50 msgr2=0x7fc888215b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.770+0000 7fc88f800640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc888188a50 0x7fc888215b90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc880007fa0 tx=0x7fc88000d560 comp rx=0 tx=0).stop 2024-02-21T07:42:39.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.771+0000 7fc88f800640 1 -- 172.21.15.69:0/1568160926 shutdown_connections 2024-02-21T07:42:39.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.771+0000 7fc88f800640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc86809f280 0x7fc8680a1740 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.771+0000 7fc88f800640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc888188a50 0x7fc888215b90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.771+0000 7fc88f800640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc888182240 0x7fc8882231f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.771+0000 7fc88f800640 1 --2- 172.21.15.69:0/1568160926 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8880f5e30 0x7fc888223cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.771+0000 7fc88f800640 1 -- 172.21.15.69:0/1568160926 >> 172.21.15.69:0/1568160926 conn(0x7fc8880f6a20 msgr2=0x7fc888187e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.772+0000 7fc88f800640 1 -- 172.21.15.69:0/1568160926 shutdown_connections 2024-02-21T07:42:39.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.772+0000 7fc88f800640 1 -- 172.21.15.69:0/1568160926 wait complete. 2024-02-21T07:42:39.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.797+0000 7f613f400640 1 -- 172.21.15.69:0/244926228 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f6120005810 con 0x7f61500d22f0 2024-02-21T07:42:39.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.798+0000 7f6146000640 1 -- 172.21.15.69:0/244926228 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6138018020 con 0x7f61500d22f0 2024-02-21T07:42:39.804 INFO:teuthology.orchestra.run.smithi069.stdout:73014444042 2024-02-21T07:42:39.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444043 for osd.1 2024-02-21T07:42:39.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.801+0000 7f613f400640 1 -- 172.21.15.69:0/244926228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f612c09f200 msgr2=0x7f612c0a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.801+0000 7f613f400640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f612c09f200 0x7f612c0a16c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f614803a000 tx=0x7f6148034000 comp rx=0 tx=0).stop 2024-02-21T07:42:39.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.801+0000 7f613f400640 1 -- 172.21.15.69:0/244926228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61500d22f0 msgr2=0x7f615016fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.801+0000 7f613f400640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61500d22f0 0x7f615016fc40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f613800c780 tx=0x7f613800cc40 comp rx=0 tx=0).stop 2024-02-21T07:42:39.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.801+0000 7f613f400640 1 -- 172.21.15.69:0/244926228 shutdown_connections 2024-02-21T07:42:39.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.801+0000 7f613f400640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f612c09f200 0x7f612c0a16c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.801+0000 7f613f400640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6150182e00 0x7f61500cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.801+0000 7f613f400640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500f74e0 0x7f6150170180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.801+0000 7f613f400640 1 --2- 172.21.15.69:0/244926228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f61500d22f0 0x7f615016fc40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.801+0000 7f613f400640 1 -- 172.21.15.69:0/244926228 >> 172.21.15.69:0/244926228 conn(0x7f61500f69c0 msgr2=0x7f6150180d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.802+0000 7f613f400640 1 -- 172.21.15.69:0/244926228 shutdown_connections 2024-02-21T07:42:39.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.802+0000 7f613f400640 1 -- 172.21.15.69:0/244926228 wait complete. 2024-02-21T07:42:39.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.806+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fccd4005810 con 0x7fccfc0d2f90 2024-02-21T07:42:39.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.807+0000 7fccf8c00640 1 -- 172.21.15.69:0/2942711973 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcce8096be0 con 0x7fccfc0d2f90 2024-02-21T07:42:39.813 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:39.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fccdc09f280 msgr2=0x7fccdc0a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fccdc09f280 0x7fccdc0a1740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fccec0010e0 tx=0x7fccec007f70 comp rx=0 tx=0).stop 2024-02-21T07:42:39.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc0d2f90 msgr2=0x7fccfc0d33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc0d2f90 0x7fccfc0d33f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcce8011560 tx=0x7fcce8011a20 comp rx=0 tx=0).stop 2024-02-21T07:42:39.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 shutdown_connections 2024-02-21T07:42:39.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fccdc09f280 0x7fccdc0a1740 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccfc224340 0x7fccfc2247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fccfc0d2f90 0x7fccfc0d33f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 --2- 172.21.15.69:0/2942711973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcce0004270 0x7fccfc0d3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 >> 172.21.15.69:0/2942711973 conn(0x7fccfc071b80 msgr2=0x7fccfc187a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 shutdown_connections 2024-02-21T07:42:39.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.811+0000 7fcd03c00640 1 -- 172.21.15.69:0/2942711973 wait complete. 2024-02-21T07:42:39.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444042 for osd.8 2024-02-21T07:42:39.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.826+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f5b940fb860 con 0x7f5b94186e60 2024-02-21T07:42:39.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.827+0000 7f5b91600640 1 -- 172.21.15.69:0/2994643241 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f5b88035070 con 0x7f5b94186e60 2024-02-21T07:42:39.832 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:39.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7809f200 msgr2=0x7f5b780a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7809f200 0x7f5b780a16c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5b8400aab0 tx=0x7f5b84008040 comp rx=0 tx=0).stop 2024-02-21T07:42:39.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b94186e60 msgr2=0x7f5b9416b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b94186e60 0x7f5b9416b980 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5b94187380 tx=0x7f5b880046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 shutdown_connections 2024-02-21T07:42:39.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b7809f200 0x7f5b780a16c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b941903b0 0x7f5b94175160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b94186e60 0x7f5b9416b980 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 --2- 172.21.15.69:0/2994643241 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b940cf2d0 0x7f5b940f8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 >> 172.21.15.69:0/2994643241 conn(0x7f5b94071b80 msgr2=0x7f5b941907e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.829+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 shutdown_connections 2024-02-21T07:42:39.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.830+0000 7f5b9be00640 1 -- 172.21.15.69:0/2994643241 wait complete. 2024-02-21T07:42:39.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444043 for osd.4 2024-02-21T07:42:39.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.839+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f289017b900 con 0x7f2890176e20 2024-02-21T07:42:39.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.840+0000 7f288cc00640 1 -- 172.21.15.69:0/987186908 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f288801c030 con 0x7f2890176e20 2024-02-21T07:42:39.846 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.842+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f287009f1e0 msgr2=0x7f28700a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.842+0000 7f2897600640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f287009f1e0 0x7f28700a16a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2884004650 tx=0x7f2884008040 comp rx=0 tx=0).stop 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.842+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2890176e20 msgr2=0x7f289017f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.842+0000 7f2897600640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2890176e20 0x7f289017f8b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f28900f9d80 tx=0x7f2888007420 comp rx=0 tx=0).stop 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.843+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 shutdown_connections 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.843+0000 7f2897600640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f287009f1e0 0x7f28700a16a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.843+0000 7f2897600640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2890176e20 0x7f289017f8b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.843+0000 7f2897600640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2890186080 0x7f28901768e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.843+0000 7f2897600640 1 --2- 172.21.15.69:0/987186908 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f28780047c0 0x7f2890185b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.843+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 >> 172.21.15.69:0/987186908 conn(0x7f28900f6870 msgr2=0x7f28900f7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.843+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 shutdown_connections 2024-02-21T07:42:39.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.843+0000 7f2897600640 1 -- 172.21.15.69:0/987186908 wait complete. 2024-02-21T07:42:39.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444043 for osd.11 2024-02-21T07:42:39.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444043 for osd.6 2024-02-21T07:42:39.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.862+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fbb5422d130 con 0x7fbb5406ebf0 2024-02-21T07:42:39.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.863+0000 7fbb4be00640 1 -- 172.21.15.69:0/2103244798 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb5422d130 con 0x7fbb5406ebf0 2024-02-21T07:42:39.869 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbb3409f230 msgr2=0x7fbb340a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbb3409f230 0x7fbb340a16f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb54071900 tx=0x7fbb40008040 comp rx=0 tx=0).stop 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb5406ebf0 msgr2=0x7fbb54229040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb5406ebf0 0x7fbb54229040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb44033000 tx=0x7fbb440046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 shutdown_connections 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbb3409f230 0x7fbb340a16f0 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbb54071900 tx=0x7fbb40008040 comp rx=0 tx=0).stop 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbb5417f4f0 0x7fbb5422ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbb5417f110 0x7fbb540cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 --2- 172.21.15.69:0/2103244798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb5406ebf0 0x7fbb54229040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 >> 172.21.15.69:0/2103244798 conn(0x7fbb540f6840 msgr2=0x7fbb540cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 shutdown_connections 2024-02-21T07:42:39.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.865+0000 7fbb59c00640 1 -- 172.21.15.69:0/2103244798 wait complete. 2024-02-21T07:42:39.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.876+0000 7fdcafe00640 1 -- 172.21.15.69:0/1165364635 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdc9c005810 con 0x7fdca8005250 2024-02-21T07:42:39.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.876+0000 7fdcbaa00640 1 -- 172.21.15.69:0/1165364635 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdcbc095b20 con 0x7fdca8005250 2024-02-21T07:42:39.882 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 -- 172.21.15.69:0/1165364635 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdca409f280 msgr2=0x7fdca40a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdca409f280 0x7fdca40a1740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40d2790 tx=0x7fdcb0008040 comp rx=0 tx=0).stop 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 -- 172.21.15.69:0/1165364635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 msgr2=0x7fdcc4167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdcc4167a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007480 tx=0x7fdcbc007940 comp rx=0 tx=0).stop 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 -- 172.21.15.69:0/1165364635 shutdown_connections 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdca409f280 0x7fdca40a1740 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdcc40d1550 0x7fdcc40d19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdcc40d3ca0 0x7fdcc40d4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 --2- 172.21.15.69:0/1165364635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdca8005250 0x7fdcc4167a30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 -- 172.21.15.69:0/1165364635 >> 172.21.15.69:0/1165364635 conn(0x7fdcc4071aa0 msgr2=0x7fdcc40cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 -- 172.21.15.69:0/1165364635 shutdown_connections 2024-02-21T07:42:39.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:39.879+0000 7fdcafe00640 1 -- 172.21.15.69:0/1165364635 wait complete. 2024-02-21T07:42:39.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444043 for osd.9 2024-02-21T07:42:39.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444043 for osd.3 2024-02-21T07:42:40.693 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-21T07:42:40.710 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-21T07:42:40.735 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-21T07:42:40.735 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-21T07:42:40.740 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-02-21T07:42:40.807 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-21T07:42:40.832 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-02-21T07:42:40.838 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-21T07:42:40.853 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-02-21T07:42:40.868 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-21T07:42:40.888 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-02-21T07:42:40.902 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-21T07:42:40.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.954+0000 7f6ebca00640 1 Processor -- start 2024-02-21T07:42:40.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.955+0000 7f6ebca00640 1 -- start start 2024-02-21T07:42:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.958+0000 7f6ebca00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6eb80701c0 0x7f6eb8070620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.958+0000 7f6ebca00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6eb81829d0 0x7f6eb8182e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.959+0000 7f6ebca00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb8070ee0 con 0x7f6eb817eb50 2024-02-21T07:42:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.959+0000 7f6ebca00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80711c0 con 0x7f6eb81829d0 2024-02-21T07:42:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.959+0000 7f6ebca00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80714a0 con 0x7f6eb80701c0 2024-02-21T07:42:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.959+0000 7f6eb7e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6eb81829d0 0x7f6eb8182e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.959+0000 7f6eb7e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6eb81829d0 0x7f6eb8182e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42268/0 (socket says 172.21.15.69:42268) 2024-02-21T07:42:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.959+0000 7f6eb7e00640 1 -- 172.21.15.69:0/1585368847 learned_addr learned my addr 172.21.15.69:0/1585368847 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.959+0000 7f6eb6a00640 1 --2- 172.21.15.69:0/1585368847 >> v2:172.21.15.184:3300/0 conn(0x7f6eb80701c0 0x7f6eb8070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:40.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.960+0000 7f6eb6000640 1 -- 172.21.15.69:0/1585368847 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829744341 0 0) 0x7f6eb8070ee0 con 0x7f6eb817eb50 2024-02-21T07:42:40.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.960+0000 7f6eb6000640 1 -- 172.21.15.69:0/1585368847 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e9c003520 con 0x7f6eb817eb50 2024-02-21T07:42:40.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.960+0000 7f6eb7e00640 1 -- 172.21.15.69:0/1585368847 >> v2:172.21.15.184:3300/0 conn(0x7f6eb80701c0 msgr2=0x7f6eb8070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:40.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.960+0000 7f6eb7e00640 1 --2- 172.21.15.69:0/1585368847 >> v2:172.21.15.184:3300/0 conn(0x7f6eb80701c0 0x7f6eb8070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:40.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.960+0000 7f6eb7e00640 1 -- 172.21.15.69:0/1585368847 >> v1:172.21.15.174:6789/0 conn(0x7f6eb817eb50 legacy=0x7f6eb80f5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:40.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.960+0000 7f6eb7e00640 1 -- 172.21.15.69:0/1585368847 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8071780 con 0x7f6eb81829d0 2024-02-21T07:42:40.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.962+0000 7f6eb7e00640 1 --2- 172.21.15.69:0/1585368847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6eb81829d0 0x7f6eb8182e40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6eb808e640 tx=0x7f6eb002bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d2f2c82137d408 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:40.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.963+0000 7f6eb6000640 1 -- 172.21.15.69:0/1585368847 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb002cac0 con 0x7f6eb81829d0 2024-02-21T07:42:40.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.963+0000 7f6eb6000640 1 -- 172.21.15.69:0/1585368847 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb002cc20 con 0x7f6eb81829d0 2024-02-21T07:42:40.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.963+0000 7f6eb6000640 1 -- 172.21.15.69:0/1585368847 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb002cac0 con 0x7f6eb81829d0 2024-02-21T07:42:40.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.964+0000 7f6ebca00640 1 -- 172.21.15.69:0/1585368847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6eb81829d0 msgr2=0x7f6eb8182e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:40.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.964+0000 7f6ebca00640 1 --2- 172.21.15.69:0/1585368847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6eb81829d0 0x7f6eb8182e40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6eb808e640 tx=0x7f6eb002bf20 comp rx=0 tx=0).stop 2024-02-21T07:42:40.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.967+0000 7f6ebca00640 1 -- 172.21.15.69:0/1585368847 shutdown_connections 2024-02-21T07:42:40.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.967+0000 7f6ebca00640 1 --2- 172.21.15.69:0/1585368847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6eb81829d0 0x7f6eb8182e40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:40.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.967+0000 7f6ebca00640 1 --2- 172.21.15.69:0/1585368847 >> v2:172.21.15.184:3300/0 conn(0x7f6eb80701c0 0x7f6eb8070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:40.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.967+0000 7f6ebca00640 1 -- 172.21.15.69:0/1585368847 >> 172.21.15.69:0/1585368847 conn(0x7f6eb80ce290 msgr2=0x7f6eb80ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:40.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.969+0000 7f6ebca00640 1 -- 172.21.15.69:0/1585368847 shutdown_connections 2024-02-21T07:42:40.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.969+0000 7f6ebca00640 1 -- 172.21.15.69:0/1585368847 wait complete. 2024-02-21T07:42:40.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.976+0000 7f6ebca00640 1 Processor -- start 2024-02-21T07:42:40.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.976+0000 7f6ebca00640 1 -- start start 2024-02-21T07:42:40.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.983+0000 7f6ebca00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6eb80701c0 0x7f6eb8168e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:40.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.983+0000 7f6ebca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb817eb50 0x7f6eb80f32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.983+0000 7f6ebca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81829d0 0x7f6eb80f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.984+0000 7f6ebca00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80f2e10 con 0x7f6eb817eb50 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.984+0000 7f6ebca00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80f2240 con 0x7f6eb80701c0 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.984+0000 7f6ebca00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80f24e0 con 0x7f6eb81829d0 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.984+0000 7f6eb7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81829d0 0x7f6eb80f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.984+0000 7f6eb7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81829d0 0x7f6eb80f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34426/0 (socket says 172.21.15.69:34426) 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.984+0000 7f6eb7e00640 1 -- 172.21.15.69:0/4035873654 learned_addr learned my addr 172.21.15.69:0/4035873654 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.984+0000 7f6eb6a00640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb817eb50 0x7f6eb80f32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.984+0000 7f6eb7e00640 1 -- 172.21.15.69:0/4035873654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6eb80701c0 msgr2=0x7f6eb8168e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.984+0000 7f6eb7e00640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6eb80701c0 0x7f6eb8168e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.985+0000 7f6eb7e00640 1 -- 172.21.15.69:0/4035873654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb817eb50 msgr2=0x7f6eb80f32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.985+0000 7f6eb7e00640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb817eb50 0x7f6eb80f32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.985+0000 7f6eb7e00640 1 -- 172.21.15.69:0/4035873654 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb0009b30 con 0x7f6eb81829d0 2024-02-21T07:42:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.986+0000 7f6eb7e00640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81829d0 0x7f6eb80f37e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0036040 tx=0x7f6eb0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:40.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.989+0000 7f6eaf400640 1 -- 172.21.15.69:0/4035873654 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00099b0 con 0x7f6eb81829d0 2024-02-21T07:42:40.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.989+0000 7f6eaf400640 1 -- 172.21.15.69:0/4035873654 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb0003e10 con 0x7f6eb81829d0 2024-02-21T07:42:40.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.989+0000 7f6eaf400640 1 -- 172.21.15.69:0/4035873654 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0004450 con 0x7f6eb81829d0 2024-02-21T07:42:40.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.990+0000 7f6ebca00640 1 -- 172.21.15.69:0/4035873654 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb80f27c0 con 0x7f6eb81829d0 2024-02-21T07:42:40.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.991+0000 7f6ebca00640 1 -- 172.21.15.69:0/4035873654 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb80f3d20 con 0x7f6eb81829d0 2024-02-21T07:42:41.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:40.998+0000 7f6eacc00640 1 -- 172.21.15.69:0/4035873654 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb8069c10 con 0x7f6eb81829d0 2024-02-21T07:42:41.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.000+0000 7f6eaf400640 1 -- 172.21.15.69:0/4035873654 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f6eb00045b0 con 0x7f6eb81829d0 2024-02-21T07:42:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.003+0000 7f6eaf400640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e9809f280 0x7f6e980a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.003+0000 7f6eaf400640 1 -- 172.21.15.69:0/4035873654 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f6eb00ec530 con 0x7f6eb81829d0 2024-02-21T07:42:41.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.006+0000 7f6eb7400640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e9809f280 0x7f6e980a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.007+0000 7f6eb7400640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e9809f280 0x7f6e980a1740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80cf230 tx=0x7f6ea8007840 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.007+0000 7f6eaf400640 1 -- 172.21.15.69:0/4035873654 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6eb00b62d0 con 0x7f6eb81829d0 2024-02-21T07:42:41.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.020+0000 7fc2c0400640 1 Processor -- start 2024-02-21T07:42:41.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.023+0000 7fe76be00640 1 Processor -- start 2024-02-21T07:42:41.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.023+0000 7fe76be00640 1 -- start start 2024-02-21T07:42:41.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.020+0000 7fc2c0400640 1 -- start start 2024-02-21T07:42:41.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.027+0000 7fe76be00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe7640cbf40 0x7fe7640cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.027+0000 7fc2c0400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc2b818a660 0x7fc2b80cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.027+0000 7fc2c0400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc2b818da00 0x7fc2b80f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.027+0000 7fc2c0400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b80cdc50 con 0x7fc2b80cd7f0 2024-02-21T07:42:41.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.027+0000 7fc2c0400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b818aa40 con 0x7fc2b818da00 2024-02-21T07:42:41.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.027+0000 7fc2c0400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b80f5b90 con 0x7fc2b818a660 2024-02-21T07:42:41.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.027+0000 7fe76be00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76406f450 con 0x7fe76418c480 2024-02-21T07:42:41.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.027+0000 7fe76be00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe764189ac0 con 0x7fe76418c0a0 2024-02-21T07:42:41.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.027+0000 7fe76be00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76418cff0 con 0x7fe7640cbf40 2024-02-21T07:42:41.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.028+0000 7fe769400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe76418c0a0 0x7fe76408e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60570/0 (socket says 172.21.15.69:60570) 2024-02-21T07:42:41.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.028+0000 7fe769400640 1 -- 172.21.15.69:0/3959992125 learned_addr learned my addr 172.21.15.69:0/3959992125 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:41.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.028+0000 7fc2bd000640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc2b80cd7f0 0x7fc2b818d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44602/0 (socket says 172.21.15.69:44602) 2024-02-21T07:42:41.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.028+0000 7fc2bd000640 1 -- 172.21.15.69:0/1034326133 learned_addr learned my addr 172.21.15.69:0/1034326133 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:41.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.029+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647651949 0 0) 0x7fe764189ac0 con 0x7fe76418c0a0 2024-02-21T07:42:41.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.029+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe74c003520 con 0x7fe76418c0a0 2024-02-21T07:42:41.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.029+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2892124372 0 0) 0x7fe74c003520 con 0x7fe76418c0a0 2024-02-21T07:42:41.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.029+0000 7fe76a800640 1 --2- 172.21.15.69:0/3959992125 >> v2:172.21.15.69:3300/0 conn(0x7fe7640cbf40 0x7fe7640cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.029+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 >> v2:172.21.15.69:3300/0 conn(0x7fe7640cbf40 msgr2=0x7fe7640cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:41.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fc2b7e00640 1 -- 172.21.15.69:0/1034326133 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561635393 0 0) 0x7fc2a4001110 con 0x7fc2b80cd7f0 2024-02-21T07:42:41.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fc2b7e00640 1 -- 172.21.15.69:0/1034326133 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a0003520 con 0x7fc2b80cd7f0 2024-02-21T07:42:41.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fc2bda00640 1 --2- 172.21.15.69:0/1034326133 >> v2:172.21.15.174:3300/0 conn(0x7fc2b818a660 0x7fc2b80cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.031+0000 7fc2bda00640 1 -- 172.21.15.69:0/1034326133 >> v2:172.21.15.69:3300/0 conn(0x7fc2b818da00 msgr2=0x7fc2b80f48c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:41.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.031+0000 7fc2bda00640 1 --2- 172.21.15.69:0/1034326133 >> v2:172.21.15.69:3300/0 conn(0x7fc2b818da00 0x7fc2b80f48c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.031+0000 7fc2bda00640 1 -- 172.21.15.69:0/1034326133 >> v1:172.21.15.69:6789/0 conn(0x7fc2b80cd7f0 legacy=0x7fc2b818d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.031+0000 7fc2bda00640 1 -- 172.21.15.69:0/1034326133 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80cce20 con 0x7fc2b818a660 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fe763e00640 1 --2- 172.21.15.69:0/3959992125 >> v2:172.21.15.69:3300/0 conn(0x7fe7640cbf40 0x7fe7640cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 >> v1:172.21.15.69:6789/0 conn(0x7fe76418c480 legacy=0x7fe76418c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764072040 con 0x7fe76418c0a0 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7fe75c0019f0 con 0x7fe76418c0a0 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 >> v1:172.21.15.174:6789/0 conn(0x7fe76418c0a0 legacy=0x7fe76408e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fe763e00640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74c0039c0 0x7fe74c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fe763e00640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe74c0047c0 0x7fe74c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.030+0000 7fe763e00640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe74c012180 0x7fe74c014570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.031+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c014b60 con 0x7fe74c0047c0 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.031+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c014ca0 con 0x7fe74c012180 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.031+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c014e60 con 0x7fe74c0039c0 2024-02-21T07:42:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.031+0000 7fe76a800640 1 --2- 172.21.15.69:0/3959992125 >> v2:172.21.15.69:3300/0 conn(0x7fe7640cbf40 0x7fe7640cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:41.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.032+0000 7fe769400640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74c0039c0 0x7fe74c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.033+0000 7fe769400640 1 -- 172.21.15.69:0/3959992125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe74c012180 msgr2=0x7fe74c014570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:41.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.033+0000 7fe769400640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe74c012180 0x7fe74c014570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.033+0000 7fe769400640 1 -- 172.21.15.69:0/3959992125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe74c0047c0 msgr2=0x7fe74c004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:41.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.033+0000 7fe768a00640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe74c0047c0 0x7fe74c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.033+0000 7fe769400640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe74c0047c0 0x7fe74c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.033+0000 7fe76a800640 1 -- 172.21.15.69:0/3959992125 reap_dead start 2024-02-21T07:42:41.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.035+0000 7fc2bda00640 1 --2- 172.21.15.69:0/1034326133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2b818a660 0x7fc2b80cd2b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc2b808e160 tx=0x7fc2ac02b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa6d6853c0059ea4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.033+0000 7fe769400640 1 -- 172.21.15.69:0/3959992125 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764072040 con 0x7fe74c0039c0 2024-02-21T07:42:41.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.035+0000 7fe768a00640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe74c0047c0 0x7fe74c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:41.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.036+0000 7fc2b7e00640 1 -- 172.21.15.69:0/1034326133 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac031750 con 0x7fc2b818a660 2024-02-21T07:42:41.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.036+0000 7fc2b7e00640 1 -- 172.21.15.69:0/1034326133 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac0318b0 con 0x7fc2b818a660 2024-02-21T07:42:41.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.036+0000 7fc2b7e00640 1 -- 172.21.15.69:0/1034326133 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac031750 con 0x7fc2b818a660 2024-02-21T07:42:41.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.037+0000 7fc2c0400640 1 -- 172.21.15.69:0/1034326133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2b818a660 msgr2=0x7fc2b80cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.037+0000 7fc2c0400640 1 --2- 172.21.15.69:0/1034326133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2b818a660 0x7fc2b80cd2b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc2b808e160 tx=0x7fc2ac02b7f0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.039+0000 7fc2c0400640 1 -- 172.21.15.69:0/1034326133 shutdown_connections 2024-02-21T07:42:41.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.039+0000 7fc2c0400640 1 --2- 172.21.15.69:0/1034326133 >> v2:172.21.15.69:3300/0 conn(0x7fc2b818da00 0x7fc2b80f48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.039+0000 7fc2c0400640 1 --2- 172.21.15.69:0/1034326133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2b818a660 0x7fc2b80cd2b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.040+0000 7fc2c0400640 1 -- 172.21.15.69:0/1034326133 >> 172.21.15.69:0/1034326133 conn(0x7fc2b80f69c0 msgr2=0x7fc2b80f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.040+0000 7fc2c0400640 1 -- 172.21.15.69:0/1034326133 shutdown_connections 2024-02-21T07:42:41.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.040+0000 7fc2c0400640 1 -- 172.21.15.69:0/1034326133 wait complete. 2024-02-21T07:42:41.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.043+0000 7fc2c0400640 1 Processor -- start 2024-02-21T07:42:41.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.044+0000 7fc2c0400640 1 -- start start 2024-02-21T07:42:41.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.045+0000 7fe769400640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74c0039c0 0x7fe74c003de0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00a870 tx=0x7fe74c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee1233eea1d9d4c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.047+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0072d0 con 0x7fe74c0039c0 2024-02-21T07:42:41.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.047+0000 7fc2c0400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2b80cd7f0 0x7fc2b81799d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.047+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c02f070 con 0x7fe74c0039c0 2024-02-21T07:42:41.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.047+0000 7fc2c0400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2b818a660 0x7fc2b8179f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.047+0000 7fc2c0400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2b818da00 0x7fc2b82215a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.048+0000 7fc2be400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2b818da00 0x7fc2b82215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.048+0000 7fc2be400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2b818da00 0x7fc2b82215a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33862/0 (socket says 172.21.15.69:33862) 2024-02-21T07:42:41.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.049+0000 7fc2be400640 1 -- 172.21.15.69:0/4001449684 learned_addr learned my addr 172.21.15.69:0/4001449684 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.049+0000 7fe763e00640 1 -- 172.21.15.69:0/3959992125 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0076f0 con 0x7fe74c0039c0 2024-02-21T07:42:41.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.049+0000 7fc2c0400640 1 -- 172.21.15.69:0/4001449684 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8221180 con 0x7fc2b818da00 2024-02-21T07:42:41.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.049+0000 7fc2bda00640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2b80cd7f0 0x7fc2b81799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.049+0000 7fc2bd000640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2b818a660 0x7fc2b8179f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.049+0000 7fc2c0400640 1 -- 172.21.15.69:0/4001449684 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b815f6c0 con 0x7fc2b818a660 2024-02-21T07:42:41.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.049+0000 7fc2c0400640 1 -- 172.21.15.69:0/4001449684 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8225800 con 0x7fc2b80cd7f0 2024-02-21T07:42:41.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.050+0000 7fc2be400640 1 -- 172.21.15.69:0/4001449684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2b80cd7f0 msgr2=0x7fc2b81799d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.050+0000 7fc2be400640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2b80cd7f0 0x7fc2b81799d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.051+0000 7fc2be400640 1 -- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2b818a660 msgr2=0x7fc2b8179f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.051+0000 7fc2be400640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2b818a660 0x7fc2b8179f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.051+0000 7fc2be400640 1 -- 172.21.15.69:0/4001449684 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac009400 con 0x7fc2b818da00 2024-02-21T07:42:41.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.051+0000 7fc2bd000640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2b818a660 0x7fc2b8179f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:41.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.050+0000 7fe76be00640 1 -- 172.21.15.69:0/3959992125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74c0039c0 msgr2=0x7fe74c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.050+0000 7fe76be00640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74c0039c0 0x7fe74c003de0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00a870 tx=0x7fe74c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.052+0000 7fe76be00640 1 -- 172.21.15.69:0/3959992125 shutdown_connections 2024-02-21T07:42:41.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.052+0000 7fe76be00640 1 --2- 172.21.15.69:0/3959992125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe74c0039c0 0x7fe74c003de0 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00a870 tx=0x7fe74c0057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.052+0000 7fe76be00640 1 -- 172.21.15.69:0/3959992125 >> 172.21.15.69:0/3959992125 conn(0x7fe7640f8110 msgr2=0x7fe7640f8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.052+0000 7fc2be400640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2b818da00 0x7fc2b82215a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000b990 tx=0x7fc2b000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.053+0000 7fc2b5600640 1 -- 172.21.15.69:0/4001449684 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b000cba0 con 0x7fc2b818da00 2024-02-21T07:42:41.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.053+0000 7fc2b5600640 1 -- 172.21.15.69:0/4001449684 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b000cd00 con 0x7fc2b818da00 2024-02-21T07:42:41.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.053+0000 7fc2b5600640 1 -- 172.21.15.69:0/4001449684 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0014680 con 0x7fc2b818da00 2024-02-21T07:42:41.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.054+0000 7fe76be00640 1 -- 172.21.15.69:0/3959992125 shutdown_connections 2024-02-21T07:42:41.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.054+0000 7fc2c0400640 1 -- 172.21.15.69:0/4001449684 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b8225ae0 con 0x7fc2b818da00 2024-02-21T07:42:41.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.054+0000 7fe76be00640 1 -- 172.21.15.69:0/3959992125 wait complete. 2024-02-21T07:42:41.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.055+0000 7fc2c0400640 1 -- 172.21.15.69:0/4001449684 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b8220da0 con 0x7fc2b818da00 2024-02-21T07:42:41.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.056+0000 7f556a400640 1 Processor -- start 2024-02-21T07:42:41.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.056+0000 7f556a400640 1 -- start start 2024-02-21T07:42:41.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.060+0000 7f556a400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f55640fd740 0x7f55640fe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.060+0000 7f5569000640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f556415dad0 0x7f5564189d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60576/0 (socket says 172.21.15.69:60576) 2024-02-21T07:42:41.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.060+0000 7f5569000640 1 -- 172.21.15.69:0/1191939842 learned_addr learned my addr 172.21.15.69:0/1191939842 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:41.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.061+0000 7f556a400640 1 --2- 172.21.15.69:0/1191939842 >> v2:172.21.15.69:3300/0 conn(0x7f55640fe590 0x7f55640fe9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.061+0000 7f5569a00640 1 --2- 172.21.15.69:0/1191939842 >> v2:172.21.15.69:3300/0 conn(0x7f55640fe590 0x7f55640fe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.062+0000 7f556a400640 1 -- 172.21.15.69:0/1191939842 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55641897f0 con 0x7f556415dad0 2024-02-21T07:42:41.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.062+0000 7f5563e00640 1 --2- 172.21.15.69:0/1191939842 >> v2:172.21.15.174:3300/0 conn(0x7f55640fd740 0x7f55640fe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.062+0000 7f5563400640 1 -- 172.21.15.69:0/1191939842 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570183615 0 0) 0x7f55641897f0 con 0x7f556415dad0 2024-02-21T07:42:41.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.062+0000 7f556a400640 1 -- 172.21.15.69:0/1191939842 --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55640fdbd0 con 0x7f55640fe590 2024-02-21T07:42:41.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.062+0000 7f556a400640 1 -- 172.21.15.69:0/1191939842 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55640fc3c0 con 0x7f55640fd740 2024-02-21T07:42:41.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.063+0000 7fc2b5600640 1 -- 172.21.15.69:0/4001449684 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc2b00147e0 con 0x7fc2b818da00 2024-02-21T07:42:41.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.064+0000 7f5563400640 1 -- 172.21.15.69:0/1191939842 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f554c003520 con 0x7f556415dad0 2024-02-21T07:42:41.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.067+0000 7fc2b5600640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc29809f1b0 0x7fc2980a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.065+0000 7fe76be00640 1 Processor -- start 2024-02-21T07:42:41.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.065+0000 7fe76be00640 1 -- start start 2024-02-21T07:42:41.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.067+0000 7fe76be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641749b0 0x7fe764174d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.067+0000 7fe76be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe76421e9f0 0x7fe764219900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.067+0000 7fe76be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe764219e40 0x7fe764176470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.067+0000 7fe76be00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76421ee70 con 0x7fe764219e40 2024-02-21T07:42:41.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.067+0000 7fe76be00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7642188f0 con 0x7fe76421e9f0 2024-02-21T07:42:41.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.067+0000 7fe76be00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640d3c90 con 0x7fe7641749b0 2024-02-21T07:42:41.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.068+0000 7fc2b5600640 1 -- 172.21.15.69:0/4001449684 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fc2b00c9b50 con 0x7fc2b818da00 2024-02-21T07:42:41.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.068+0000 7fe768a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe76421e9f0 0x7fe764219900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.068+0000 7fe768a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe76421e9f0 0x7fe764219900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42322/0 (socket says 172.21.15.69:42322) 2024-02-21T07:42:41.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.068+0000 7fe768a00640 1 -- 172.21.15.69:0/2504694922 learned_addr learned my addr 172.21.15.69:0/2504694922 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.068+0000 7fe76a800640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe764219e40 0x7fe764176470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.066+0000 7f5563e00640 1 -- 172.21.15.69:0/1191939842 >> v2:172.21.15.69:3300/0 conn(0x7f55640fe590 msgr2=0x7f55640fe9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:41.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.066+0000 7f5563e00640 1 --2- 172.21.15.69:0/1191939842 >> v2:172.21.15.69:3300/0 conn(0x7f55640fe590 0x7f55640fe9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.066+0000 7f5563e00640 1 -- 172.21.15.69:0/1191939842 >> v1:172.21.15.174:6789/0 conn(0x7f556415dad0 legacy=0x7f5564189d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.066+0000 7f5563e00640 1 -- 172.21.15.69:0/1191939842 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55640fc6a0 con 0x7f55640fd740 2024-02-21T07:42:41.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.068+0000 7f5569a00640 1 --2- 172.21.15.69:0/1191939842 >> v2:172.21.15.69:3300/0 conn(0x7f55640fe590 0x7f55640fe9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:41.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.068+0000 7fe769400640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641749b0 0x7fe764174d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.069+0000 7f5563e00640 1 --2- 172.21.15.69:0/1191939842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55640fd740 0x7f55640fe050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f55640727b0 tx=0x7f555002b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ea545ad8e6e9fcc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.069+0000 7fc2aaa00640 1 -- 172.21.15.69:0/4001449684 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b82212c0 con 0x7fc2b818da00 2024-02-21T07:42:41.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.069+0000 7fe76a800640 1 -- 172.21.15.69:0/2504694922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641749b0 msgr2=0x7fe764174d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.069+0000 7fe76a800640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641749b0 0x7fe764174d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.069+0000 7fe76a800640 1 -- 172.21.15.69:0/2504694922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe76421e9f0 msgr2=0x7fe764219900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.069+0000 7fe76a800640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe76421e9f0 0x7fe764219900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.069+0000 7fe76a800640 1 -- 172.21.15.69:0/2504694922 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764218b40 con 0x7fe764219e40 2024-02-21T07:42:41.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.070+0000 7fe76a800640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe764219e40 0x7fe764176470 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe7640d0ba0 tx=0x7fe75801d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.071+0000 7fc2bda00640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc29809f1b0 0x7fc2980a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.072+0000 7fc2bda00640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc29809f1b0 0x7fc2980a1670 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac035000 tx=0x7fc2ac008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.071+0000 7f5563400640 1 -- 172.21.15.69:0/1191939842 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550030710 con 0x7f55640fd740 2024-02-21T07:42:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.074+0000 7f5563400640 1 -- 172.21.15.69:0/1191939842 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555002e050 con 0x7f55640fd740 2024-02-21T07:42:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.074+0000 7f5563400640 1 -- 172.21.15.69:0/1191939842 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550030a90 con 0x7f55640fd740 2024-02-21T07:42:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.075+0000 7f556a400640 1 -- 172.21.15.69:0/1191939842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55640fd740 msgr2=0x7f55640fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.075+0000 7f556a400640 1 --2- 172.21.15.69:0/1191939842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55640fd740 0x7f55640fe050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f55640727b0 tx=0x7f555002b740 comp rx=0 tx=0).stop 2024-02-21T07:42:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.075+0000 7f556a400640 1 -- 172.21.15.69:0/1191939842 shutdown_connections 2024-02-21T07:42:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.075+0000 7f556a400640 1 --2- 172.21.15.69:0/1191939842 >> v2:172.21.15.69:3300/0 conn(0x7f55640fe590 0x7f55640fe9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.075+0000 7f556a400640 1 --2- 172.21.15.69:0/1191939842 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55640fd740 0x7f55640fe050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.075+0000 7f556a400640 1 -- 172.21.15.69:0/1191939842 >> 172.21.15.69:0/1191939842 conn(0x7f55640d2c90 msgr2=0x7f55640d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.075+0000 7f556a400640 1 -- 172.21.15.69:0/1191939842 shutdown_connections 2024-02-21T07:42:41.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.075+0000 7f556a400640 1 -- 172.21.15.69:0/1191939842 wait complete. 2024-02-21T07:42:41.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.078+0000 7f556a400640 1 Processor -- start 2024-02-21T07:42:41.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.079+0000 7f556a400640 1 -- start start 2024-02-21T07:42:41.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.081+0000 7fc2b5600640 1 -- 172.21.15.69:0/4001449684 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc2b82212c0 con 0x7fc2b818da00 2024-02-21T07:42:41.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.082+0000 7fe761600640 1 -- 172.21.15.69:0/2504694922 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758004240 con 0x7fe764219e40 2024-02-21T07:42:41.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.082+0000 7fe761600640 1 -- 172.21.15.69:0/2504694922 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7580043a0 con 0x7fe764219e40 2024-02-21T07:42:41.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.082+0000 7fe761600640 1 -- 172.21.15.69:0/2504694922 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758004240 con 0x7fe764219e40 2024-02-21T07:42:41.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.082+0000 7fe76be00640 1 -- 172.21.15.69:0/2504694922 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe764218e20 con 0x7fe764219e40 2024-02-21T07:42:41.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.085+0000 7f556a400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55640fd740 0x7f556421f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.085+0000 7f751d600640 1 Processor -- start 2024-02-21T07:42:41.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.085+0000 7f751d600640 1 -- start start 2024-02-21T07:42:41.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.088+0000 7fe76be00640 1 -- 172.21.15.69:0/2504694922 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7642193e0 con 0x7fe764219e40 2024-02-21T07:42:41.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.089+0000 7f556a400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f55640fe590 0x7f5564183890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.089+0000 7f556a400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f556415dad0 0x7f5564183dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.089+0000 7f5569000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55640fd740 0x7f556421f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.089+0000 7f556a400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564221230 con 0x7f55640fe590 2024-02-21T07:42:41.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.089+0000 7f556a400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564220340 con 0x7f55640fd740 2024-02-21T07:42:41.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.089+0000 7f556a400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564220620 con 0x7f556415dad0 2024-02-21T07:42:41.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.089+0000 7f5569000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55640fd740 0x7f556421f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42338/0 (socket says 172.21.15.69:42338) 2024-02-21T07:42:41.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.090+0000 7f5569000640 1 -- 172.21.15.69:0/1708223990 learned_addr learned my addr 172.21.15.69:0/1708223990 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.090+0000 7f5569a00640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f556415dad0 0x7f5564183dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.091+0000 7fe76be00640 1 -- 172.21.15.69:0/2504694922 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe764067ce0 con 0x7fe764219e40 2024-02-21T07:42:41.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.091+0000 7f5569a00640 1 -- 172.21.15.69:0/1708223990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55640fd740 msgr2=0x7f556421f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.091+0000 7f5569a00640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55640fd740 0x7f556421f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.091+0000 7f5569a00640 1 -- 172.21.15.69:0/1708223990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f55640fe590 msgr2=0x7f5564183890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.091+0000 7f5569a00640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f55640fe590 0x7f5564183890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.091+0000 7f5569a00640 1 -- 172.21.15.69:0/1708223990 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5550009400 con 0x7f556415dad0 2024-02-21T07:42:41.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.091+0000 7fe761600640 1 -- 172.21.15.69:0/2504694922 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe758003610 con 0x7fe764219e40 2024-02-21T07:42:41.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.093+0000 7f5569a00640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f556415dad0 0x7f5564183dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f555c007de0 tx=0x7f555c00d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.093+0000 7f5560c00640 1 -- 172.21.15.69:0/1708223990 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c003b90 con 0x7f556415dad0 2024-02-21T07:42:41.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.094+0000 7f5560c00640 1 -- 172.21.15.69:0/1708223990 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c00f040 con 0x7f556415dad0 2024-02-21T07:42:41.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.094+0000 7f556a400640 1 -- 172.21.15.69:0/1708223990 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5564220900 con 0x7f556415dad0 2024-02-21T07:42:41.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.094+0000 7f556a400640 1 -- 172.21.15.69:0/1708223990 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5564220ec0 con 0x7f556415dad0 2024-02-21T07:42:41.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.095+0000 7f5560c00640 1 -- 172.21.15.69:0/1708223990 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c00de80 con 0x7f556415dad0 2024-02-21T07:42:41.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.099+0000 7f751d600640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751817ed40 con 0x7f751808cfc0 2024-02-21T07:42:41.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.099+0000 7f751d600640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75180711c0 con 0x7f751817e8e0 2024-02-21T07:42:41.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.099+0000 7f751d600640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75180714a0 con 0x7f75180708d0 2024-02-21T07:42:41.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.100+0000 7f7517400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f751817e8e0 0x7f75180701c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60588/0 (socket says 172.21.15.69:60588) 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.100+0000 7f7517400640 1 -- 172.21.15.69:0/2977336836 learned_addr learned my addr 172.21.15.69:0/2977336836 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.100+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268519597 0 0) 0x7f75180711c0 con 0x7f751817e8e0 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.100+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74fc003520 con 0x7f751817e8e0 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.100+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1977111487 0 0) 0x7f74fc003520 con 0x7f751817e8e0 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.100+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 >> v1:172.21.15.184:6789/0 conn(0x7f75180708d0 legacy=0x7f75180f9690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.100+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 >> v1:172.21.15.69:6789/0 conn(0x7f751808cfc0 legacy=0x7f75180f5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.100+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518071780 con 0x7f751817e8e0 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.100+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f75100019d0 con 0x7f751817e8e0 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.100+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 >> v1:172.21.15.174:6789/0 conn(0x7f751817e8e0 legacy=0x7f75180701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.101+0000 7f7516a00640 1 --2- 172.21.15.69:0/2977336836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74fc0039f0 0x7f74fc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.101+0000 7f7516a00640 1 --2- 172.21.15.69:0/2977336836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74fc0047c0 0x7f74fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.101+0000 7f7516a00640 1 --2- 172.21.15.69:0/2977336836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc005380 0x7f74fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.101+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc00c2a0 con 0x7f74fc0039f0 2024-02-21T07:42:41.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.101+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc00c410 con 0x7f74fc005380 2024-02-21T07:42:41.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.101+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc00c5d0 con 0x7f74fc0047c0 2024-02-21T07:42:41.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.101+0000 7f7517400640 1 --2- 172.21.15.69:0/2977336836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74fc0047c0 0x7f74fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.102+0000 7f7517400640 1 -- 172.21.15.69:0/2977336836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc005380 msgr2=0x7f74fc00b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:41.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.102+0000 7f7517400640 1 --2- 172.21.15.69:0/2977336836 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f74fc005380 0x7f74fc00b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.102+0000 7f7517400640 1 -- 172.21.15.69:0/2977336836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74fc0039f0 msgr2=0x7f74fc003e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:41.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.102+0000 7f7517400640 1 --2- 172.21.15.69:0/2977336836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74fc0039f0 0x7f74fc003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.102+0000 7f7517400640 1 -- 172.21.15.69:0/2977336836 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518071780 con 0x7f74fc0047c0 2024-02-21T07:42:41.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.102+0000 7f556a400640 1 -- 172.21.15.69:0/1708223990 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5540005290 con 0x7f556415dad0 2024-02-21T07:42:41.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.104+0000 7fe761600640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe74409f1c0 0x7fe7440a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.108+0000 7f7517400640 1 --2- 172.21.15.69:0/2977336836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74fc0047c0 0x7f74fc004c40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f751000a810 tx=0x7f74fc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b538970057a3aeb9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.104+0000 7fe761600640 1 -- 172.21.15.69:0/2504694922 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe7580e1350 con 0x7fe764219e40 2024-02-21T07:42:41.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.108+0000 7fe769400640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe74409f1c0 0x7fe7440a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.110+0000 7f751cc00640 1 -- 172.21.15.69:0/2977336836 reap_dead start 2024-02-21T07:42:41.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.110+0000 7fe769400640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe74409f1c0 0x7fe7440a1680 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe75c034000 tx=0x7fe75c007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.110+0000 7fe761600640 1 -- 172.21.15.69:0/2504694922 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe7580de060 con 0x7fe764219e40 2024-02-21T07:42:41.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.112+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751002cea0 con 0x7f74fc0047c0 2024-02-21T07:42:41.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.112+0000 7f7516a00640 1 -- 172.21.15.69:0/2977336836 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751002f070 con 0x7f74fc0047c0 2024-02-21T07:42:41.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.113+0000 7f751d600640 1 -- 172.21.15.69:0/2977336836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74fc0047c0 msgr2=0x7f74fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.113+0000 7f751d600640 1 --2- 172.21.15.69:0/2977336836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74fc0047c0 0x7f74fc004c40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f751000a810 tx=0x7f74fc0057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.113+0000 7f751d600640 1 -- 172.21.15.69:0/2977336836 shutdown_connections 2024-02-21T07:42:41.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.113+0000 7f751d600640 1 --2- 172.21.15.69:0/2977336836 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f74fc0047c0 0x7f74fc004c40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.113+0000 7f751d600640 1 -- 172.21.15.69:0/2977336836 >> 172.21.15.69:0/2977336836 conn(0x7f75180ce290 msgr2=0x7f75180ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.113+0000 7f751d600640 1 -- 172.21.15.69:0/2977336836 shutdown_connections 2024-02-21T07:42:41.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.114+0000 7f751d600640 1 -- 172.21.15.69:0/2977336836 wait complete. 2024-02-21T07:42:41.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.111+0000 7f5560c00640 1 -- 172.21.15.69:0/1708223990 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f555c003ef0 con 0x7f556415dad0 2024-02-21T07:42:41.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.117+0000 7f5560c00640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f554409f200 0x7f55440a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.118+0000 7f751d600640 1 Processor -- start 2024-02-21T07:42:41.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.118+0000 7f751d600640 1 -- start start 2024-02-21T07:42:41.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.118+0000 7f5569000640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f554409f200 0x7f55440a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.122+0000 7f5560c00640 1 -- 172.21.15.69:0/1708223990 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f555c0ca2f0 con 0x7f556415dad0 2024-02-21T07:42:41.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.123+0000 7f5560c00640 1 -- 172.21.15.69:0/1708223990 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f555c0ca7d0 con 0x7f556415dad0 2024-02-21T07:42:41.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.123+0000 7f5569000640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f554409f200 0x7f55440a16c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5558007680 tx=0x7f5558007c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.125+0000 7f751d600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7518158430 0x7f7518224980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.126+0000 7f751d600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7518158810 0x7f751818abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.126+0000 7f751d600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f751815e0f0 0x7f7518226a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.126+0000 7f751d600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7518158c90 con 0x7f7518158430 2024-02-21T07:42:41.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.126+0000 7f751d600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751815dc60 con 0x7f751815e0f0 2024-02-21T07:42:41.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.126+0000 7f751d600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751815cd70 con 0x7f7518158810 2024-02-21T07:42:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.127+0000 7f7517e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7518158430 0x7f7518224980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.127+0000 7f7517400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7518158810 0x7f751818abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.127+0000 7f751cc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f751815e0f0 0x7f7518226a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.127+0000 7f751cc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f751815e0f0 0x7f7518226a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42342/0 (socket says 172.21.15.69:42342) 2024-02-21T07:42:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.127+0000 7f751cc00640 1 -- 172.21.15.69:0/2060904728 learned_addr learned my addr 172.21.15.69:0/2060904728 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.129+0000 7f751cc00640 1 -- 172.21.15.69:0/2060904728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7518158810 msgr2=0x7f751818abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.129+0000 7f751cc00640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7518158810 0x7f751818abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.129+0000 7f751cc00640 1 -- 172.21.15.69:0/2060904728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7518158430 msgr2=0x7f7518224980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.129+0000 7f751cc00640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7518158430 0x7f7518224980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.129+0000 7f751cc00640 1 -- 172.21.15.69:0/2060904728 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751815d050 con 0x7f751815e0f0 2024-02-21T07:42:41.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.129+0000 7f7517e00640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7518158430 0x7f7518224980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:41.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.130+0000 7f751cc00640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f751815e0f0 0x7f7518226a80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7518160c70 tx=0x7f750400b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.131+0000 7f750fe00640 1 -- 172.21.15.69:0/2060904728 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504003c60 con 0x7f751815e0f0 2024-02-21T07:42:41.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.131+0000 7f750fe00640 1 -- 172.21.15.69:0/2060904728 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7504003dc0 con 0x7f751815e0f0 2024-02-21T07:42:41.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.131+0000 7f750fe00640 1 -- 172.21.15.69:0/2060904728 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75040052b0 con 0x7f751815e0f0 2024-02-21T07:42:41.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.131+0000 7f751d600640 1 -- 172.21.15.69:0/2060904728 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751815d330 con 0x7f751815e0f0 2024-02-21T07:42:41.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.131+0000 7f751d600640 1 -- 172.21.15.69:0/2060904728 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751815d8f0 con 0x7f751815e0f0 2024-02-21T07:42:41.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.137+0000 7f751d600640 1 -- 172.21.15.69:0/2060904728 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75180683b0 con 0x7f751815e0f0 2024-02-21T07:42:41.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.141+0000 7f8ee7e00640 1 Processor -- start 2024-02-21T07:42:41.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.141+0000 7f8ee7e00640 1 -- start start 2024-02-21T07:42:41.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.144+0000 7f8ee7e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8ee817f110 0x7f8ee80f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.144+0000 7f8ee7e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8ee806ebf0 0x7f8ee80f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.144+0000 7f8ee7e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee81898b0 con 0x7f8ee817f4f0 2024-02-21T07:42:41.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.144+0000 7f8ee7e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee80f8eb0 con 0x7f8ee817f110 2024-02-21T07:42:41.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.144+0000 7f8ee7e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee8071a00 con 0x7f8ee806ebf0 2024-02-21T07:42:41.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.144+0000 7f8ee6000640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f8ee817f4f0 0x7f8ee806d010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:48804/0 (socket says 172.21.15.69:48804) 2024-02-21T07:42:41.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.145+0000 7f8ee6000640 1 -- 172.21.15.69:0/3738905488 learned_addr learned my addr 172.21.15.69:0/3738905488 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:41.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.145+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122837986 0 0) 0x7f8ee81898b0 con 0x7f8ee817f4f0 2024-02-21T07:42:41.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.145+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ecc003520 con 0x7f8ee817f4f0 2024-02-21T07:42:41.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.139+0000 7f750fe00640 1 -- 172.21.15.69:0/2060904728 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f7504005410 con 0x7f751815e0f0 2024-02-21T07:42:41.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.145+0000 7f8ee7400640 1 --2- 172.21.15.69:0/3738905488 >> v2:172.21.15.184:3300/0 conn(0x7f8ee806ebf0 0x7f8ee80f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.145+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2003231922 0 0) 0x7f8ecc003520 con 0x7f8ee817f4f0 2024-02-21T07:42:41.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.145+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 >> v2:172.21.15.184:3300/0 conn(0x7f8ee806ebf0 msgr2=0x7f8ee80f9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:41.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.145+0000 7f8ee5600640 1 --2- 172.21.15.69:0/3738905488 >> v2:172.21.15.184:3300/0 conn(0x7f8ee806ebf0 0x7f8ee80f9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.145+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 >> v2:172.21.15.69:3300/0 conn(0x7f8ee817f110 msgr2=0x7f8ee80f92d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:41.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee6a00640 1 --2- 172.21.15.69:0/3738905488 >> v2:172.21.15.69:3300/0 conn(0x7f8ee817f110 0x7f8ee80f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f750fe00640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f74f809f130 0x7f74f80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee5600640 1 --2- 172.21.15.69:0/3738905488 >> v2:172.21.15.69:3300/0 conn(0x7f8ee817f110 0x7f8ee80f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee80f8230 con 0x7f8ee817f4f0 2024-02-21T07:42:41.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.147+0000 7f750fe00640 1 -- 172.21.15.69:0/2060904728 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f75040c8d40 con 0x7f751815e0f0 2024-02-21T07:42:41.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f8ed4001650 con 0x7f8ee817f4f0 2024-02-21T07:42:41.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.147+0000 7f7517e00640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f74f809f130 0x7f74f80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 >> v1:172.21.15.184:6789/0 conn(0x7f8ee817f4f0 legacy=0x7f8ee806d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee5600640 1 --2- 172.21.15.69:0/3738905488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ecc003a10 0x7f8ecc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee5600640 1 --2- 172.21.15.69:0/3738905488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc0047c0 0x7f8ecc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.150+0000 7f7517e00640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f74f809f130 0x7f74f80a15f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7508001750 tx=0x7f7508009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee5600640 1 --2- 172.21.15.69:0/3738905488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ecc009970 0x7f8ecc00bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee80f8eb0 con 0x7f8ecc0047c0 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee8071a00 con 0x7f8ecc003a10 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.146+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc00c430 con 0x7f8ecc009970 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.147+0000 7f8ee6000640 1 --2- 172.21.15.69:0/3738905488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc0047c0 0x7f8ecc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.148+0000 7f8ee6000640 1 -- 172.21.15.69:0/3738905488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ecc009970 msgr2=0x7f8ecc00bd60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.148+0000 7f8ee6000640 1 --2- 172.21.15.69:0/3738905488 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ecc009970 0x7f8ecc00bd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.148+0000 7f8ee6000640 1 -- 172.21.15.69:0/3738905488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ecc003a10 msgr2=0x7f8ecc003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.148+0000 7f8ee6000640 1 --2- 172.21.15.69:0/3738905488 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ecc003a10 0x7f8ecc003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.148+0000 7f8ee6000640 1 -- 172.21.15.69:0/3738905488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc003520 con 0x7f8ecc0047c0 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.150+0000 7f8ee6a00640 1 --2- 172.21.15.69:0/3738905488 >> v2:172.21.15.69:3300/0 conn(0x7f8ee817f110 0x7f8ee80f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:42:41.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.151+0000 7f8ee7400640 1 -- 172.21.15.69:0/3738905488 reap_dead start 2024-02-21T07:42:41.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.151+0000 7f750fe00640 1 -- 172.21.15.69:0/2060904728 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7504092ab0 con 0x7f751815e0f0 2024-02-21T07:42:41.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.153+0000 7f8ee6000640 1 --2- 172.21.15.69:0/3738905488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc0047c0 0x7f8ecc004c40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4007fb0 tx=0x7f8ecc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484125dfb937a1d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.153+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4012310 con 0x7f8ecc0047c0 2024-02-21T07:42:41.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.154+0000 7f8ee5600640 1 -- 172.21.15.69:0/3738905488 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed4037030 con 0x7f8ecc0047c0 2024-02-21T07:42:41.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.155+0000 7f8ee7e00640 1 -- 172.21.15.69:0/3738905488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc0047c0 msgr2=0x7f8ecc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.155+0000 7f8ee7e00640 1 --2- 172.21.15.69:0/3738905488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc0047c0 0x7f8ecc004c40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4007fb0 tx=0x7f8ecc0057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.157+0000 7f8ee7e00640 1 -- 172.21.15.69:0/3738905488 shutdown_connections 2024-02-21T07:42:41.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.157+0000 7f8ee7e00640 1 --2- 172.21.15.69:0/3738905488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ecc0047c0 0x7f8ecc004c40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.157+0000 7f8ee7e00640 1 -- 172.21.15.69:0/3738905488 >> 172.21.15.69:0/3738905488 conn(0x7f8ee80f6840 msgr2=0x7f8ee80f6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.158+0000 7f8ee7e00640 1 -- 172.21.15.69:0/3738905488 shutdown_connections 2024-02-21T07:42:41.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.158+0000 7f8ee7e00640 1 -- 172.21.15.69:0/3738905488 wait complete. 2024-02-21T07:42:41.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.168+0000 7f8ee7e00640 1 Processor -- start 2024-02-21T07:42:41.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.168+0000 7f8ee7e00640 1 -- start start 2024-02-21T07:42:41.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.171+0000 7f8ee7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ecc0047c0 0x7f8ee8156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.171+0000 7f8ee7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ee821a0e0 0x7f8ee821a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.171+0000 7f8ee6a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ecc0047c0 0x7f8ee8156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.171+0000 7f8ee6a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ecc0047c0 0x7f8ee8156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42352/0 (socket says 172.21.15.69:42352) 2024-02-21T07:42:41.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.171+0000 7f8ee6a00640 1 -- 172.21.15.69:0/1251850065 learned_addr learned my addr 172.21.15.69:0/1251850065 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.172+0000 7f8ee7e00640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ee8186b10 0x7f8ee8186f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.172+0000 7f8ee6000640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ee821a0e0 0x7f8ee821a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.172+0000 7f8ee7e00640 1 -- 172.21.15.69:0/1251850065 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee821b100 con 0x7f8ee821a0e0 2024-02-21T07:42:41.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.172+0000 7f8ee7e00640 1 -- 172.21.15.69:0/1251850065 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee821b3a0 con 0x7f8ecc0047c0 2024-02-21T07:42:41.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.172+0000 7f8ee7e00640 1 -- 172.21.15.69:0/1251850065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee81879d0 con 0x7f8ee8186b10 2024-02-21T07:42:41.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.173+0000 7f8ee7400640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ee8186b10 0x7f8ee8186f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.173+0000 7f8ee7400640 1 -- 172.21.15.69:0/1251850065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ecc0047c0 msgr2=0x7f8ee8156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.173+0000 7f8ee7400640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ecc0047c0 0x7f8ee8156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.173+0000 7f8ee7400640 1 -- 172.21.15.69:0/1251850065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ee821a0e0 msgr2=0x7f8ee821a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.173+0000 7f8ee7400640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ee821a0e0 0x7f8ee821a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.173+0000 7f8ee7400640 1 -- 172.21.15.69:0/1251850065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee8187cb0 con 0x7f8ee8186b10 2024-02-21T07:42:41.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.177+0000 7f8ee6000640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ee821a0e0 0x7f8ee821a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:41.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.177+0000 7f8ee7400640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ee8186b10 0x7f8ee8186f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ee817f8d0 tx=0x7f8ed800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.184+0000 7f8edea00640 1 -- 172.21.15.69:0/1251850065 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8011800 con 0x7f8ee8186b10 2024-02-21T07:42:41.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.184+0000 7f8edea00640 1 -- 172.21.15.69:0/1251850065 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed8011960 con 0x7f8ee8186b10 2024-02-21T07:42:41.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.184+0000 7f8ee7e00640 1 -- 172.21.15.69:0/1251850065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee8187f90 con 0x7f8ee8186b10 2024-02-21T07:42:41.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.184+0000 7f8edea00640 1 -- 172.21.15.69:0/1251850065 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8011800 con 0x7f8ee8186b10 2024-02-21T07:42:41.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.184+0000 7f8ee7e00640 1 -- 172.21.15.69:0/1251850065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee821aaa0 con 0x7f8ee8186b10 2024-02-21T07:42:41.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.192+0000 7f8ed3e00640 1 -- 172.21.15.69:0/1251850065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee8069c10 con 0x7f8ee8186b10 2024-02-21T07:42:41.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.238+0000 7f8edea00640 1 -- 172.21.15.69:0/1251850065 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f8ed8011ad0 con 0x7f8ee8186b10 2024-02-21T07:42:41.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.243+0000 7f8edea00640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8ecc0a0e20 0x7f8ecc0a32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.243+0000 7f8edea00640 1 -- 172.21.15.69:0/1251850065 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f8ed80c92d0 con 0x7f8ee8186b10 2024-02-21T07:42:41.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.244+0000 7f8ee6a00640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8ecc0a0e20 0x7f8ecc0a32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.244+0000 7f8edea00640 1 -- 172.21.15.69:0/1251850065 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8ed80c97d0 con 0x7f8ee8186b10 2024-02-21T07:42:41.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.244+0000 7f8ee6a00640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8ecc0a0e20 0x7f8ecc0a32e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8072750 tx=0x7f8ee0007600 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.256+0000 7fad45600640 1 Processor -- start 2024-02-21T07:42:41.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.256+0000 7fad45600640 1 -- start start 2024-02-21T07:42:41.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.263+0000 7fad45600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fad40190340 0x7fad4018acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.263+0000 7fad45600640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fad400718c0 0x7fad4018b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.263+0000 7fad45600640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fad40190720 0x7fad40190b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.263+0000 7fad45600640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad40070540 con 0x7fad40190340 2024-02-21T07:42:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.263+0000 7fad45600640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad40070820 con 0x7fad400718c0 2024-02-21T07:42:41.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.263+0000 7fad45600640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad40070b00 con 0x7fad40190720 2024-02-21T07:42:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.264+0000 7fad44c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fad40190720 0x7fad40190b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.264+0000 7fad44c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fad40190720 0x7fad40190b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34532/0 (socket says 172.21.15.69:34532) 2024-02-21T07:42:41.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.264+0000 7fad44c00640 1 -- 172.21.15.69:0/360423300 learned_addr learned my addr 172.21.15.69:0/360423300 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.264+0000 7fad44c00640 1 -- 172.21.15.69:0/360423300 >> v2:172.21.15.174:3300/0 conn(0x7fad400718c0 msgr2=0x7fad4018b200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:42:41.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.264+0000 7fad44c00640 1 --2- 172.21.15.69:0/360423300 >> v2:172.21.15.174:3300/0 conn(0x7fad400718c0 0x7fad4018b200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.264+0000 7fad44c00640 1 -- 172.21.15.69:0/360423300 >> v2:172.21.15.69:3300/0 conn(0x7fad40190340 msgr2=0x7fad4018acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:41.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.264+0000 7fad44c00640 1 --2- 172.21.15.69:0/360423300 >> v2:172.21.15.69:3300/0 conn(0x7fad40190340 0x7fad4018acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.264+0000 7fad44c00640 1 -- 172.21.15.69:0/360423300 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad40070de0 con 0x7fad40190720 2024-02-21T07:42:41.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.266+0000 7fad44c00640 1 --2- 172.21.15.69:0/360423300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad40190720 0x7fad40190b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fad4008e110 tx=0x7fad3002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e45c9cb9e6fbf67f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.267+0000 7fad3ea00640 1 -- 172.21.15.69:0/360423300 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30031830 con 0x7fad40190720 2024-02-21T07:42:41.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.267+0000 7fad3ea00640 1 -- 172.21.15.69:0/360423300 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad30031990 con 0x7fad40190720 2024-02-21T07:42:41.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.271+0000 7fad3ea00640 1 -- 172.21.15.69:0/360423300 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30031830 con 0x7fad40190720 2024-02-21T07:42:41.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.272+0000 7fad45600640 1 -- 172.21.15.69:0/360423300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad40190720 msgr2=0x7fad40190b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.272+0000 7fad45600640 1 --2- 172.21.15.69:0/360423300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad40190720 0x7fad40190b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fad4008e110 tx=0x7fad3002b8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.272+0000 7fc5c3e00640 1 Processor -- start 2024-02-21T07:42:41.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.272+0000 7fc5c3e00640 1 -- start start 2024-02-21T07:42:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.273+0000 7fad45600640 1 -- 172.21.15.69:0/360423300 shutdown_connections 2024-02-21T07:42:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.273+0000 7fad45600640 1 --2- 172.21.15.69:0/360423300 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad40190720 0x7fad40190b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.273+0000 7fad45600640 1 --2- 172.21.15.69:0/360423300 >> v2:172.21.15.174:3300/0 conn(0x7fad400718c0 0x7fad4018b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.273+0000 7fad45600640 1 --2- 172.21.15.69:0/360423300 >> v2:172.21.15.69:3300/0 conn(0x7fad40190340 0x7fad4018acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.273+0000 7fad45600640 1 -- 172.21.15.69:0/360423300 >> 172.21.15.69:0/360423300 conn(0x7fad400ce290 msgr2=0x7fad400ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.273+0000 7fad45600640 1 -- 172.21.15.69:0/360423300 shutdown_connections 2024-02-21T07:42:41.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.273+0000 7fad45600640 1 -- 172.21.15.69:0/360423300 wait complete. 2024-02-21T07:42:41.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.280+0000 7fdb13200640 1 Processor -- start 2024-02-21T07:42:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.280+0000 7fdb13200640 1 -- start start 2024-02-21T07:42:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.282+0000 7fad45600640 1 Processor -- start 2024-02-21T07:42:41.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.282+0000 7fad45600640 1 -- start start 2024-02-21T07:42:41.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.280+0000 7fc5c3e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc5c40fe570 0x7fc5c40fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.280+0000 7fc5c2a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc5c415db10 0x7fc5c40fc200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44622/0 (socket says 172.21.15.69:44622) 2024-02-21T07:42:41.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.284+0000 7fc5c2000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc5c40fe570 0x7fc5c40fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.284+0000 7fc5c2000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc5c40fe570 0x7fc5c40fe9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34534/0 (socket says 172.21.15.69:34534) 2024-02-21T07:42:41.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.289+0000 7fc5c3e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c40fd900 con 0x7fc5c415db10 2024-02-21T07:42:41.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.289+0000 7fc5c3e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c40fca10 con 0x7fc5c4189ec0 2024-02-21T07:42:41.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.289+0000 7fc5c3e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c40fccf0 con 0x7fc5c40fe570 2024-02-21T07:42:41.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.289+0000 7fc5c3400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc5c4189ec0 0x7fc5c418a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60602/0 (socket says 172.21.15.69:60602) 2024-02-21T07:42:41.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.285+0000 7fad45600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400718c0 0x7fad40188cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.285+0000 7fad45600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad40190340 0x7fad40171930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.289+0000 7fc5c3400640 1 -- 172.21.15.69:0/2744806007 learned_addr learned my addr 172.21.15.69:0/2744806007 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:41.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.285+0000 7fad45600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad40190720 0x7fad40171e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.285+0000 7fad3fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400718c0 0x7fad40188cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.285+0000 7fad3fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400718c0 0x7fad40188cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42380/0 (socket says 172.21.15.69:42380) 2024-02-21T07:42:41.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.285+0000 7fad3f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad40190340 0x7fad40171930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.285+0000 7fad3f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad40190340 0x7fad40171930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33944/0 (socket says 172.21.15.69:33944) 2024-02-21T07:42:41.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.289+0000 7fad3fe00640 1 -- 172.21.15.69:0/2666478443 learned_addr learned my addr 172.21.15.69:0/2666478443 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.289+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4018a180 con 0x7fad40190340 2024-02-21T07:42:41.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.289+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad400cbf70 con 0x7fad400718c0 2024-02-21T07:42:41.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.290+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40189600 con 0x7fad40190720 2024-02-21T07:42:41.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.286+0000 7fdb13200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c0f9b80 con 0x7fdb0c06ec40 2024-02-21T07:42:41.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.286+0000 7fdb11e00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fdb0c072e10 0x7fdb0c193300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60600/0 (socket says 172.21.15.69:60600) 2024-02-21T07:42:41.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.286+0000 7fdb11e00640 1 -- 172.21.15.69:0/2668178694 learned_addr learned my addr 172.21.15.69:0/2668178694 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:41.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.290+0000 7fc5c2000640 1 -- 172.21.15.69:0/2744806007 >> v1:172.21.15.174:6789/0 conn(0x7fc5c4189ec0 legacy=0x7fc5c418a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.290+0000 7fc5c2000640 1 -- 172.21.15.69:0/2744806007 >> v1:172.21.15.69:6789/0 conn(0x7fc5c415db10 legacy=0x7fc5c40fc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.290+0000 7fc5c2000640 1 -- 172.21.15.69:0/2744806007 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40fcfd0 con 0x7fc5c40fe570 2024-02-21T07:42:41.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.293+0000 7fad3f400640 1 -- 172.21.15.69:0/2666478443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad40190720 msgr2=0x7fad40171e70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:42:41.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.294+0000 7fdb13200640 1 -- 172.21.15.69:0/2668178694 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c18c270 con 0x7fdb0c072e10 2024-02-21T07:42:41.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.294+0000 7fad3f400640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad40190720 0x7fad40171e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.294+0000 7fdb13200640 1 -- 172.21.15.69:0/2668178694 --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c0f8090 con 0x7fdb0c0f96f0 2024-02-21T07:42:41.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.294+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916761213 0 0) 0x7fdb0c18c270 con 0x7fdb0c072e10 2024-02-21T07:42:41.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.294+0000 7fad3f400640 1 -- 172.21.15.69:0/2666478443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400718c0 msgr2=0x7fad40188cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.294+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf4003520 con 0x7fdb0c072e10 2024-02-21T07:42:41.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.295+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122485758 0 0) 0x7fdb0c0f9b80 con 0x7fdb0c06ec40 2024-02-21T07:42:41.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.295+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb0c18c270 con 0x7fdb0c06ec40 2024-02-21T07:42:41.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.296+0000 7fc5c2000640 1 --2- 172.21.15.69:0/2744806007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5c40fe570 0x7fc5c40fe9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40097a0 tx=0x7fc5b402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10b30c3f73065ba3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.298+0000 7fad3f400640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400718c0 0x7fad40188cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.298+0000 7fad3f400640 1 -- 172.21.15.69:0/2666478443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad300094d0 con 0x7fad40190340 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.295+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2519881618 0 0) 0x7fdb0c18c270 con 0x7fdb0c06ec40 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.295+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 >> v1:172.21.15.184:6789/0 conn(0x7fdb0c0f96f0 legacy=0x7fdb0c0701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.295+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 >> v1:172.21.15.174:6789/0 conn(0x7fdb0c072e10 legacy=0x7fdb0c193300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.295+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c19dd10 con 0x7fdb0c06ec40 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.295+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7fdb080019f0 con 0x7fdb0c06ec40 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.295+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 >> v1:172.21.15.69:6789/0 conn(0x7fdb0c06ec40 legacy=0x7fdb0c06f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.295+0000 7fdb10a00640 1 --2- 172.21.15.69:0/2668178694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaf4004be0 0x7fdaf4004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.295+0000 7fdb10a00640 1 --2- 172.21.15.69:0/2668178694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdaf4003760 0x7fdaf4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.296+0000 7fdb10a00640 1 --2- 172.21.15.69:0/2668178694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004320 0x7fdaf40141b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.296+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4014a60 con 0x7fdaf4003760 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.296+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4014bd0 con 0x7fdaf4004320 2024-02-21T07:42:41.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.296+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4014d90 con 0x7fdaf4004be0 2024-02-21T07:42:41.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.298+0000 7fad3fe00640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400718c0 0x7fad40188cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:41.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.300+0000 7fc5c1600640 1 -- 172.21.15.69:0/2744806007 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4031640 con 0x7fc5c40fe570 2024-02-21T07:42:41.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.300+0000 7fc5c1600640 1 -- 172.21.15.69:0/2744806007 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b40317a0 con 0x7fc5c40fe570 2024-02-21T07:42:41.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.300+0000 7fc5c1600640 1 -- 172.21.15.69:0/2744806007 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4031b70 con 0x7fc5c40fe570 2024-02-21T07:42:41.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.298+0000 7fad3f400640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad40190340 0x7fad40171930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fad3800be20 tx=0x7fad38009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.298+0000 7fdb12800640 1 --2- 172.21.15.69:0/2668178694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004320 0x7fdaf40141b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.299+0000 7fdb11e00640 1 --2- 172.21.15.69:0/2668178694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaf4004be0 0x7fdaf4004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.300+0000 7fdb11e00640 1 -- 172.21.15.69:0/2668178694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004320 msgr2=0x7fdaf40141b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:41.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.300+0000 7fdb11e00640 1 --2- 172.21.15.69:0/2668178694 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004320 0x7fdaf40141b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.300+0000 7fdb11e00640 1 -- 172.21.15.69:0/2668178694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdaf4003760 msgr2=0x7fdaf4003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:41.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.300+0000 7fdb11e00640 1 --2- 172.21.15.69:0/2668178694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdaf4003760 0x7fdaf4003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.300+0000 7fdb11e00640 1 -- 172.21.15.69:0/2668178694 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c18c270 con 0x7fdaf4004be0 2024-02-21T07:42:41.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.301+0000 7fdb12800640 1 -- 172.21.15.69:0/2668178694 reap_dead start 2024-02-21T07:42:41.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.302+0000 7fad37e00640 1 -- 172.21.15.69:0/2666478443 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38014440 con 0x7fad40190340 2024-02-21T07:42:41.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.304+0000 7fdb11e00640 1 --2- 172.21.15.69:0/2668178694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaf4004be0 0x7fdaf4004fc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdb00001a10 tx=0x7fdaf40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a978c829cb5b1bd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.304+0000 7fad37e00640 1 -- 172.21.15.69:0/2666478443 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad380145a0 con 0x7fad40190340 2024-02-21T07:42:41.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.304+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00004b30 con 0x7fdaf4004be0 2024-02-21T07:42:41.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.304+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb00004c90 con 0x7fdaf4004be0 2024-02-21T07:42:41.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.304+0000 7fdb10a00640 1 -- 172.21.15.69:0/2668178694 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00006310 con 0x7fdaf4004be0 2024-02-21T07:42:41.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.305+0000 7fc5c3e00640 1 -- 172.21.15.69:0/2744806007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5c40fe570 msgr2=0x7fc5c40fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.305+0000 7fc5c3e00640 1 --2- 172.21.15.69:0/2744806007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5c40fe570 0x7fc5c40fe9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40097a0 tx=0x7fc5b402b8f0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.305+0000 7fc5c3e00640 1 -- 172.21.15.69:0/2744806007 shutdown_connections 2024-02-21T07:42:41.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.305+0000 7fc5c3e00640 1 --2- 172.21.15.69:0/2744806007 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5c40fe570 0x7fc5c40fe9f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.305+0000 7fc5c3e00640 1 -- 172.21.15.69:0/2744806007 >> 172.21.15.69:0/2744806007 conn(0x7fc5c40668e0 msgr2=0x7fc5c4066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.305+0000 7fc5c3e00640 1 -- 172.21.15.69:0/2744806007 shutdown_connections 2024-02-21T07:42:41.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.305+0000 7fdb13200640 1 -- 172.21.15.69:0/2668178694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaf4004be0 msgr2=0x7fdaf4004fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.305+0000 7fdb13200640 1 --2- 172.21.15.69:0/2668178694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaf4004be0 0x7fdaf4004fc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdb00001a10 tx=0x7fdaf40057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.304+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad401898e0 con 0x7fad40190340 2024-02-21T07:42:41.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.304+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad40189ea0 con 0x7fad40190340 2024-02-21T07:42:41.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.305+0000 7fc5c3e00640 1 -- 172.21.15.69:0/2744806007 wait complete. 2024-02-21T07:42:41.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.316+0000 7fc5c3e00640 1 Processor -- start 2024-02-21T07:42:41.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.316+0000 7fc5c3e00640 1 -- start start 2024-02-21T07:42:41.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.308+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad400cc170 con 0x7fad40190340 2024-02-21T07:42:41.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.317+0000 7fad37e00640 1 -- 172.21.15.69:0/2666478443 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad38014950 con 0x7fad40190340 2024-02-21T07:42:41.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.322+0000 7fdb13200640 1 -- 172.21.15.69:0/2668178694 shutdown_connections 2024-02-21T07:42:41.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.322+0000 7fdb13200640 1 --2- 172.21.15.69:0/2668178694 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdaf4004be0 0x7fdaf4004fc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.322+0000 7fdb13200640 1 -- 172.21.15.69:0/2668178694 >> 172.21.15.69:0/2668178694 conn(0x7fdb0c0f6840 msgr2=0x7fdb0c0f6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.322+0000 7fdb13200640 1 -- 172.21.15.69:0/2668178694 shutdown_connections 2024-02-21T07:42:41.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.322+0000 7fdb13200640 1 -- 172.21.15.69:0/2668178694 wait complete. 2024-02-21T07:42:41.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.325+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5c40fe570 0x7fc5c414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.325+0000 7fdb13200640 1 Processor -- start 2024-02-21T07:42:41.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.325+0000 7fad37e00640 1 -- 172.21.15.69:0/2666478443 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fad3801e440 con 0x7fad40190340 2024-02-21T07:42:41.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.328+0000 7fad37e00640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fad2009f200 0x7fad200a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.329+0000 7fad37e00640 1 -- 172.21.15.69:0/2666478443 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fad380ca390 con 0x7fad40190340 2024-02-21T07:42:41.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.329+0000 7fad3fe00640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fad2009f200 0x7fad200a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.330+0000 7fad3fe00640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fad2009f200 0x7fad200a16c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009950 tx=0x7fad2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.330+0000 7fad37e00640 1 -- 172.21.15.69:0/2666478443 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad380ca850 con 0x7fad40190340 2024-02-21T07:42:41.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.325+0000 7fdb13200640 1 -- start start 2024-02-21T07:42:41.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.327+0000 7fdb13200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004be0 0x7fdb0c08b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.327+0000 7fdb13200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb0c0cc9e0 0x7fdb0c0cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.327+0000 7fdb13200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb0c0cd3a0 0x7fdb0c06ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.327+0000 7fdb13200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c190020 con 0x7fdb0c0cc9e0 2024-02-21T07:42:41.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.327+0000 7fdb13200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0cc550 con 0x7fdaf4004be0 2024-02-21T07:42:41.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.327+0000 7fdb13200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c22e360 con 0x7fdb0c0cd3a0 2024-02-21T07:42:41.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.331+0000 7fdb11e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004be0 0x7fdb0c08b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.331+0000 7fdb11e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004be0 0x7fdb0c08b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42394/0 (socket says 172.21.15.69:42394) 2024-02-21T07:42:41.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.331+0000 7fdb11e00640 1 -- 172.21.15.69:0/2136786932 learned_addr learned my addr 172.21.15.69:0/2136786932 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.333+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5c415db10 0x7fc5c4186ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.333+0000 7fc5c3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c4189ec0 0x7fc5c421f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.333+0000 7fc5c2000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5c415db10 0x7fc5c4186ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.334+0000 7fc5c3e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41875e0 con 0x7fc5c40fe570 2024-02-21T07:42:41.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.334+0000 7fc5c2000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5c415db10 0x7fc5c4186ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34586/0 (socket says 172.21.15.69:34586) 2024-02-21T07:42:41.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.334+0000 7fc5c2000640 1 -- 172.21.15.69:0/4279635068 learned_addr learned my addr 172.21.15.69:0/4279635068 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.334+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c41878c0 con 0x7fc5c4189ec0 2024-02-21T07:42:41.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.334+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4187ba0 con 0x7fc5c415db10 2024-02-21T07:42:41.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.334+0000 7f6078400640 1 Processor -- start 2024-02-21T07:42:41.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.334+0000 7f6078400640 1 -- start start 2024-02-21T07:42:41.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.334+0000 7fc5c2a00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5c40fe570 0x7fc5c414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.335+0000 7fdb12800640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb0c0cd3a0 0x7fdb0c06ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.335+0000 7fc5c2a00640 1 -- 172.21.15.69:0/4279635068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5c415db10 msgr2=0x7fc5c4186ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.335+0000 7fc5c2a00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5c415db10 0x7fc5c4186ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.335+0000 7fc5c2a00640 1 -- 172.21.15.69:0/4279635068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c4189ec0 msgr2=0x7fc5c421f310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:42:41.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.335+0000 7fc5c2a00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c4189ec0 0x7fc5c421f310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.335+0000 7fc5c2a00640 1 -- 172.21.15.69:0/4279635068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b4009400 con 0x7fc5c40fe570 2024-02-21T07:42:41.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.335+0000 7fc5c2a00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5c40fe570 0x7fc5c414f740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0000f60 tx=0x7fc5b000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.339+0000 7fdb11e00640 1 -- 172.21.15.69:0/2136786932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb0c0cd3a0 msgr2=0x7fdb0c06ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.339+0000 7fdb11e00640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb0c0cd3a0 0x7fdb0c06ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.340+0000 7fdb11e00640 1 -- 172.21.15.69:0/2136786932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb0c0cc9e0 msgr2=0x7fdb0c0cce60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:42:41.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.341+0000 7fdb11e00640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb0c0cc9e0 0x7fdb0c0cce60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.341+0000 7fc5baa00640 1 -- 172.21.15.69:0/4279635068 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b00074e0 con 0x7fc5c40fe570 2024-02-21T07:42:41.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.341+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c4187e80 con 0x7fc5c40fe570 2024-02-21T07:42:41.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.341+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c4188440 con 0x7fc5c40fe570 2024-02-21T07:42:41.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.343+0000 7fc5baa00640 1 -- 172.21.15.69:0/4279635068 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b0007640 con 0x7fc5c40fe570 2024-02-21T07:42:41.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.343+0000 7fc5baa00640 1 -- 172.21.15.69:0/4279635068 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0004a00 con 0x7fc5c40fe570 2024-02-21T07:42:41.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.336+0000 7f6078400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6068052be0 0x7f60680585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.337+0000 7f6078400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6068058b10 0x7f6068058f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.337+0000 7f6078400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6068115f10 con 0x7f60681084a0 2024-02-21T07:42:41.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.337+0000 7f6078400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606810fde0 con 0x7f6068052be0 2024-02-21T07:42:41.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.337+0000 7f6078400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60681100c0 con 0x7f6068058b10 2024-02-21T07:42:41.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.339+0000 7f6075a00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f60681084a0 0x7f6068115800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60608/0 (socket says 172.21.15.69:60608) 2024-02-21T07:42:41.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.339+0000 7f6075a00640 1 -- 172.21.15.69:0/1649639492 learned_addr learned my addr 172.21.15.69:0/1649639492 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:41.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.340+0000 7f606fe00640 1 -- 172.21.15.69:0/1649639492 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556032010 0 0) 0x7f6068115f10 con 0x7f60681084a0 2024-02-21T07:42:41.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.340+0000 7f606fe00640 1 -- 172.21.15.69:0/1649639492 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6058003520 con 0x7f60681084a0 2024-02-21T07:42:41.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.342+0000 7f6076400640 1 --2- 172.21.15.69:0/1649639492 >> v2:172.21.15.174:3300/0 conn(0x7f6068058b10 0x7f6068058f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.342+0000 7f6076400640 1 -- 172.21.15.69:0/1649639492 >> v2:172.21.15.69:3300/0 conn(0x7f6068052be0 msgr2=0x7f60680585d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:41.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.342+0000 7f6076400640 1 --2- 172.21.15.69:0/1649639492 >> v2:172.21.15.69:3300/0 conn(0x7f6068052be0 0x7f60680585d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.342+0000 7f6076400640 1 -- 172.21.15.69:0/1649639492 >> v1:172.21.15.174:6789/0 conn(0x7f60681084a0 legacy=0x7f6068115800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.342+0000 7f6076400640 1 -- 172.21.15.69:0/1649639492 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60681103a0 con 0x7f6068058b10 2024-02-21T07:42:41.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.342+0000 7fdb11e00640 1 -- 172.21.15.69:0/2136786932 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c22dda0 con 0x7fdaf4004be0 2024-02-21T07:42:41.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.344+0000 7fdb12800640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb0c0cd3a0 0x7fdb0c06ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:41.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.345+0000 7fdb11e00640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004be0 0x7fdb0c08b840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009c90 tx=0x7fdb000012b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.348+0000 7f6076400640 1 --2- 172.21.15.69:0/1649639492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6068058b10 0x7f6068058f10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6068016890 tx=0x7f606403c6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24c69344bec34852 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.348+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c005290 con 0x7fc5c40fe570 2024-02-21T07:42:41.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.349+0000 7fdb06000640 1 -- 172.21.15.69:0/2136786932 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00006780 con 0x7fdaf4004be0 2024-02-21T07:42:41.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.349+0000 7fdb06000640 1 -- 172.21.15.69:0/2136786932 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0002c840 con 0x7fdaf4004be0 2024-02-21T07:42:41.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.349+0000 7fdb06000640 1 -- 172.21.15.69:0/2136786932 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0002ca10 con 0x7fdaf4004be0 2024-02-21T07:42:41.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.349+0000 7fdb13200640 1 -- 172.21.15.69:0/2136786932 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c22e080 con 0x7fdaf4004be0 2024-02-21T07:42:41.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.351+0000 7f606fe00640 1 -- 172.21.15.69:0/1649639492 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070073450 con 0x7f6068058b10 2024-02-21T07:42:41.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.351+0000 7f606fe00640 1 -- 172.21.15.69:0/1649639492 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606403f050 con 0x7f6068058b10 2024-02-21T07:42:41.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.351+0000 7f606fe00640 1 -- 172.21.15.69:0/1649639492 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064041730 con 0x7f6068058b10 2024-02-21T07:42:41.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.352+0000 7f6078400640 1 -- 172.21.15.69:0/1649639492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6068058b10 msgr2=0x7f6068058f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.352+0000 7f6078400640 1 --2- 172.21.15.69:0/1649639492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6068058b10 0x7f6068058f10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6068016890 tx=0x7f606403c6b0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.353+0000 7fdb13200640 1 -- 172.21.15.69:0/2136786932 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c0cc1e0 con 0x7fdaf4004be0 2024-02-21T07:42:41.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.354+0000 7f6078400640 1 -- 172.21.15.69:0/1649639492 shutdown_connections 2024-02-21T07:42:41.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.354+0000 7f6078400640 1 --2- 172.21.15.69:0/1649639492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6068058b10 0x7f6068058f10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.354+0000 7f6078400640 1 --2- 172.21.15.69:0/1649639492 >> v2:172.21.15.69:3300/0 conn(0x7f6068052be0 0x7f60680585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.354+0000 7f6078400640 1 -- 172.21.15.69:0/1649639492 >> 172.21.15.69:0/1649639492 conn(0x7f6068057250 msgr2=0x7f6068057660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.354+0000 7f6078400640 1 -- 172.21.15.69:0/1649639492 shutdown_connections 2024-02-21T07:42:41.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.359+0000 7f6078400640 1 -- 172.21.15.69:0/1649639492 wait complete. 2024-02-21T07:42:41.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.356+0000 7fdb13200640 1 -- 172.21.15.69:0/2136786932 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c0cc370 con 0x7fdaf4004be0 2024-02-21T07:42:41.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.362+0000 7f6078400640 1 Processor -- start 2024-02-21T07:42:41.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.368+0000 7f6078400640 1 -- start start 2024-02-21T07:42:41.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.369+0000 7fc5baa00640 1 -- 172.21.15.69:0/4279635068 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc5b0004b60 con 0x7fc5c40fe570 2024-02-21T07:42:41.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.371+0000 7f6078400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6068052be0 0x7f60680579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.371+0000 7f6078400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6068058b10 0x7f6068052260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.371+0000 7f6078400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60681084a0 0x7f6068107140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.372+0000 7f6075000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6068058b10 0x7f6068052260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.372+0000 7f6075000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6068058b10 0x7f6068052260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33966/0 (socket says 172.21.15.69:33966) 2024-02-21T07:42:41.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.372+0000 7f6076400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60681084a0 0x7f6068107140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.372+0000 7f6076400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60681084a0 0x7f6068107140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42424/0 (socket says 172.21.15.69:42424) 2024-02-21T07:42:41.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.373+0000 7f6075000640 1 -- 172.21.15.69:0/3049669246 learned_addr learned my addr 172.21.15.69:0/3049669246 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.373+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6068105e70 con 0x7f6068058b10 2024-02-21T07:42:41.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.373+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60680f8f00 con 0x7f60681084a0 2024-02-21T07:42:41.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.373+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60681060a0 con 0x7f6068052be0 2024-02-21T07:42:41.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.374+0000 7f6076400640 1 -- 172.21.15.69:0/3049669246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6068052be0 msgr2=0x7f60680579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.374+0000 7f6075a00640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6068052be0 0x7f60680579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.374+0000 7f6076400640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6068052be0 0x7f60680579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.374+0000 7f6076400640 1 -- 172.21.15.69:0/3049669246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6068058b10 msgr2=0x7f6068052260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.374+0000 7f6076400640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6068058b10 0x7f6068052260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.374+0000 7f6076400640 1 -- 172.21.15.69:0/3049669246 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6064009400 con 0x7f60681084a0 2024-02-21T07:42:41.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.375+0000 7f6076400640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60681084a0 0x7f6068107140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6064043000 tx=0x7f60640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.377+0000 7f606d600640 1 -- 172.21.15.69:0/3049669246 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606404d940 con 0x7f60681084a0 2024-02-21T07:42:41.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.377+0000 7f606d600640 1 -- 172.21.15.69:0/3049669246 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606404daa0 con 0x7f60681084a0 2024-02-21T07:42:41.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.379+0000 7f5599600640 1 Processor -- start 2024-02-21T07:42:41.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.378+0000 7fc5baa00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc5a409f1b0 0x7fc5a40a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.378+0000 7fc5baa00640 1 -- 172.21.15.69:0/4279635068 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fc5b00c9d30 con 0x7fc5c40fe570 2024-02-21T07:42:41.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.379+0000 7fc5baa00640 1 -- 172.21.15.69:0/4279635068 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc5b00ca110 con 0x7fc5c40fe570 2024-02-21T07:42:41.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.377+0000 7f606d600640 1 -- 172.21.15.69:0/3049669246 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606404de10 con 0x7f60681084a0 2024-02-21T07:42:41.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.380+0000 7f5599600640 1 -- start start 2024-02-21T07:42:41.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.380+0000 7fc5c2000640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc5a409f1b0 0x7fc5a40a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.369+0000 7fdb06000640 1 -- 172.21.15.69:0/2136786932 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fdb0002cb70 con 0x7fdaf4004be0 2024-02-21T07:42:41.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.371+0000 7fdb06000640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdaf009f200 0x7fdaf00a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.381+0000 7fdb11400640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdaf009f200 0x7fdaf00a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.381+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6068106380 con 0x7f60681084a0 2024-02-21T07:42:41.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.381+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6068106940 con 0x7f60681084a0 2024-02-21T07:42:41.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.383+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60680058a0 con 0x7f60681084a0 2024-02-21T07:42:41.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.384+0000 7fc5c2000640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc5a409f1b0 0x7fc5a40a1670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc5c415b080 tx=0x7fc5b403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.384+0000 7fdb11400640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdaf009f200 0x7fdaf00a16c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c18aba0 tx=0x7fdafc0079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.384+0000 7f5599600640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f558c054ac0 0x7f558c107f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.385+0000 7f5599600640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558c10a5c0 con 0x7f558c108440 2024-02-21T07:42:41.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.385+0000 7f5599600640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558c07a280 con 0x7f558c106fa0 2024-02-21T07:42:41.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.385+0000 7fdb06000640 1 -- 172.21.15.69:0/2136786932 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fdb0002ce20 con 0x7fdaf4004be0 2024-02-21T07:42:41.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.385+0000 7f5599600640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c07ab20 con 0x7f558c054ac0 2024-02-21T07:42:41.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.386+0000 7f5592000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f558c054ac0 0x7f558c107f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.386+0000 7f5592a00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f558c106fa0 0x7f558c0543b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60620/0 (socket says 172.21.15.69:60620) 2024-02-21T07:42:41.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.386+0000 7f5592a00640 1 -- 172.21.15.69:0/4113600837 learned_addr learned my addr 172.21.15.69:0/4113600837 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:41.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.389+0000 7f5592000640 1 -- 172.21.15.69:0/4113600837 >> v1:172.21.15.174:6789/0 conn(0x7f558c106fa0 legacy=0x7f558c0543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.389+0000 7f5592000640 1 -- 172.21.15.69:0/4113600837 >> v1:172.21.15.69:6789/0 conn(0x7f558c108440 legacy=0x7f558c0792c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.389+0000 7f5591600640 1 -- 172.21.15.69:0/4113600837 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771934177 0 0) 0x7f5594073450 con 0x7f558c108440 2024-02-21T07:42:41.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.389+0000 7f5592000640 1 -- 172.21.15.69:0/4113600837 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c07a560 con 0x7f558c054ac0 2024-02-21T07:42:41.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.391+0000 7f5592000640 1 --2- 172.21.15.69:0/4113600837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f558c054ac0 0x7f558c107f00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f55800097a0 tx=0x7f558002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edffd9bdb864af8a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.392+0000 7fdb06000640 1 -- 172.21.15.69:0/2136786932 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb000b6220 con 0x7fdaf4004be0 2024-02-21T07:42:41.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.392+0000 7f5591600640 1 -- 172.21.15.69:0/4113600837 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800317c0 con 0x7f558c054ac0 2024-02-21T07:42:41.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.392+0000 7f5591600640 1 -- 172.21.15.69:0/4113600837 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5580031920 con 0x7f558c054ac0 2024-02-21T07:42:41.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.392+0000 7f5591600640 1 -- 172.21.15.69:0/4113600837 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580031cb0 con 0x7f558c054ac0 2024-02-21T07:42:41.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.393+0000 7f5599600640 1 -- 172.21.15.69:0/4113600837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f558c054ac0 msgr2=0x7f558c107f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.393+0000 7f5599600640 1 --2- 172.21.15.69:0/4113600837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f558c054ac0 0x7f558c107f00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f55800097a0 tx=0x7f558002b860 comp rx=0 tx=0).stop 2024-02-21T07:42:41.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.395+0000 7f606d600640 1 -- 172.21.15.69:0/3049669246 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f606404a040 con 0x7f60681084a0 2024-02-21T07:42:41.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.395+0000 7f5599600640 1 -- 172.21.15.69:0/4113600837 shutdown_connections 2024-02-21T07:42:41.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.395+0000 7f5599600640 1 --2- 172.21.15.69:0/4113600837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f558c054ac0 0x7f558c107f00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.395+0000 7f5599600640 1 -- 172.21.15.69:0/4113600837 >> 172.21.15.69:0/4113600837 conn(0x7f558c052e10 msgr2=0x7f558c053220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.396+0000 7f5599600640 1 -- 172.21.15.69:0/4113600837 shutdown_connections 2024-02-21T07:42:41.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.396+0000 7f5599600640 1 -- 172.21.15.69:0/4113600837 wait complete. 2024-02-21T07:42:41.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.400+0000 7f606d600640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f605009f280 0x7f60500a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.400+0000 7f606d600640 1 -- 172.21.15.69:0/3049669246 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f60640fcdc0 con 0x7f60681084a0 2024-02-21T07:42:41.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.401+0000 7f606d600640 1 -- 172.21.15.69:0/3049669246 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f60640fd1a0 con 0x7f60681084a0 2024-02-21T07:42:41.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.401+0000 7f5599600640 1 Processor -- start 2024-02-21T07:42:41.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.402+0000 7f5599600640 1 -- start start 2024-02-21T07:42:41.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.404+0000 7f5599600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f558c054ac0 0x7f558c0e2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.405+0000 7f5599600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558c106fa0 0x7f558c052290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.405+0000 7f5599600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f558c108440 0x7f558c1a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.406+0000 7f5599600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c107ae0 con 0x7f558c108440 2024-02-21T07:42:41.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.406+0000 7f5599600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c1a0610 con 0x7f558c106fa0 2024-02-21T07:42:41.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.406+0000 7f5599600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c0e2c60 con 0x7f558c054ac0 2024-02-21T07:42:41.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.406+0000 7f5592a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f558c054ac0 0x7f558c0e2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.406+0000 7f5592000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558c106fa0 0x7f558c052290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.406+0000 7f5592a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f558c054ac0 0x7f558c0e2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34602/0 (socket says 172.21.15.69:34602) 2024-02-21T07:42:41.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.407+0000 7f5592a00640 1 -- 172.21.15.69:0/3867021214 learned_addr learned my addr 172.21.15.69:0/3867021214 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.407+0000 7f5593400640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f558c108440 0x7f558c1a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.409+0000 7f5592000640 1 -- 172.21.15.69:0/3867021214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f558c054ac0 msgr2=0x7f558c0e2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.409+0000 7f5592000640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f558c054ac0 0x7f558c0e2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.409+0000 7f5592000640 1 -- 172.21.15.69:0/3867021214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f558c108440 msgr2=0x7f558c1a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.409+0000 7f5592000640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f558c108440 0x7f558c1a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.409+0000 7f5592000640 1 -- 172.21.15.69:0/3867021214 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580009400 con 0x7f558c106fa0 2024-02-21T07:42:41.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.410+0000 7f5593400640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f558c108440 0x7f558c1a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:41.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.410+0000 7f5592000640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558c106fa0 0x7f558c052290 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5580033000 tx=0x7f55800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.410+0000 7f558aa00640 1 -- 172.21.15.69:0/3867021214 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580032a20 con 0x7f558c106fa0 2024-02-21T07:42:41.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.410+0000 7f558aa00640 1 -- 172.21.15.69:0/3867021214 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5580032b80 con 0x7f558c106fa0 2024-02-21T07:42:41.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.410+0000 7f558aa00640 1 -- 172.21.15.69:0/3867021214 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800453f0 con 0x7f558c106fa0 2024-02-21T07:42:41.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.411+0000 7f5599600640 1 -- 172.21.15.69:0/3867021214 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558c0e2f40 con 0x7f558c106fa0 2024-02-21T07:42:41.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.411+0000 7f5599600640 1 -- 172.21.15.69:0/3867021214 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558c0e3500 con 0x7f558c106fa0 2024-02-21T07:42:41.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.413+0000 7f5599600640 1 -- 172.21.15.69:0/3867021214 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558c005480 con 0x7f558c106fa0 2024-02-21T07:42:41.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.435+0000 7f6494200640 1 Processor -- start 2024-02-21T07:42:41.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.435+0000 7f6494200640 1 -- start start 2024-02-21T07:42:41.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.438+0000 7f558aa00640 1 -- 172.21.15.69:0/3867021214 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5580005990 con 0x7f558c106fa0 2024-02-21T07:42:41.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.440+0000 7f6494200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f648c185da0 0x7f648c0cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.439+0000 7f6075a00640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f605009f280 0x7f60500a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.439+0000 7f6075a00640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f605009f280 0x7f60500a1740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f60700506c0 tx=0x7f607006d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.442+0000 7f6494200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0f9bd0 con 0x7f648c18c600 2024-02-21T07:42:41.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.442+0000 7f6490e00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f648c0cf1f0 0x7f648c18bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60632/0 (socket says 172.21.15.69:60632) 2024-02-21T07:42:41.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.442+0000 7f6490e00640 1 -- 172.21.15.69:0/2070422198 learned_addr learned my addr 172.21.15.69:0/2070422198 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:41.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.442+0000 7f6494200640 1 -- 172.21.15.69:0/2070422198 --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0f9e90 con 0x7f648c0cf1f0 2024-02-21T07:42:41.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.442+0000 7f6494200640 1 -- 172.21.15.69:0/2070422198 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c187620 con 0x7f648c185da0 2024-02-21T07:42:41.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.444+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641908126 0 0) 0x7f648c0f9e90 con 0x7f648c0cf1f0 2024-02-21T07:42:41.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.444+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6474003520 con 0x7f648c0cf1f0 2024-02-21T07:42:41.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.445+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1392558067 0 0) 0x7f6474003520 con 0x7f648c0cf1f0 2024-02-21T07:42:41.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.445+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 >> v2:172.21.15.184:3300/0 conn(0x7f648c185da0 msgr2=0x7f648c0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:41.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.445+0000 7f648be00640 1 --2- 172.21.15.69:0/2070422198 >> v2:172.21.15.184:3300/0 conn(0x7f648c185da0 0x7f648c0cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.445+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 >> v1:172.21.15.69:6789/0 conn(0x7f648c18c600 legacy=0x7f648c18f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.445+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c1869a0 con 0x7f648c0cf1f0 2024-02-21T07:42:41.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.445+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f6480001670 con 0x7f648c0cf1f0 2024-02-21T07:42:41.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.445+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 >> v1:172.21.15.174:6789/0 conn(0x7f648c0cf1f0 legacy=0x7f648c18bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.445+0000 7f648be00640 1 --2- 172.21.15.69:0/2070422198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64740039c0 0x7f6474003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.445+0000 7f648be00640 1 --2- 172.21.15.69:0/2070422198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 0x7f6474004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.446+0000 7f648be00640 1 --2- 172.21.15.69:0/2070422198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64740053b0 0x7f6474014230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.446+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c187620 con 0x7f64740039c0 2024-02-21T07:42:41.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.446+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6474014b10 con 0x7f64740047c0 2024-02-21T07:42:41.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.446+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6474014cd0 con 0x7f64740053b0 2024-02-21T07:42:41.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.448+0000 7f6490e00640 1 --2- 172.21.15.69:0/2070422198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 0x7f6474004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.449+0000 7f6490e00640 1 -- 172.21.15.69:0/2070422198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64740053b0 msgr2=0x7f6474014230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:42:41.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.449+0000 7f6490e00640 1 --2- 172.21.15.69:0/2070422198 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f64740053b0 0x7f6474014230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.449+0000 7f6490e00640 1 -- 172.21.15.69:0/2070422198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64740039c0 msgr2=0x7f6474003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:41.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.449+0000 7f6490e00640 1 --2- 172.21.15.69:0/2070422198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64740039c0 0x7f6474003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.449+0000 7f6490e00640 1 -- 172.21.15.69:0/2070422198 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474003520 con 0x7f64740047c0 2024-02-21T07:42:41.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.449+0000 7f6492200640 1 -- 172.21.15.69:0/2070422198 reap_dead start 2024-02-21T07:42:41.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.440+0000 7f558aa00640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f557409f280 0x7f55740a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.440+0000 7f558aa00640 1 -- 172.21.15.69:0/3867021214 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f55800ec090 con 0x7f558c106fa0 2024-02-21T07:42:41.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.456+0000 7f6490e00640 1 --2- 172.21.15.69:0/2070422198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 0x7f6474004c40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6480004fc0 tx=0x7f64740057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3246718e94b63c4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.456+0000 7f558aa00640 1 -- 172.21.15.69:0/3867021214 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f55800b5eb0 con 0x7f558c106fa0 2024-02-21T07:42:41.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.456+0000 7f5592a00640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f557409f280 0x7f55740a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.457+0000 7f5592a00640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f557409f280 0x7f55740a1740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5584006110 tx=0x7f5584005ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.456+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480005ad0 con 0x7f64740047c0 2024-02-21T07:42:41.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.456+0000 7f648be00640 1 -- 172.21.15.69:0/2070422198 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648002f070 con 0x7f64740047c0 2024-02-21T07:42:41.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.457+0000 7f6494200640 1 -- 172.21.15.69:0/2070422198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 msgr2=0x7f6474004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.457+0000 7f6494200640 1 --2- 172.21.15.69:0/2070422198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 0x7f6474004c40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6480004fc0 tx=0x7f64740057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.461+0000 7f6494200640 1 -- 172.21.15.69:0/2070422198 shutdown_connections 2024-02-21T07:42:41.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.461+0000 7f6494200640 1 --2- 172.21.15.69:0/2070422198 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 0x7f6474004c40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.461+0000 7f6494200640 1 -- 172.21.15.69:0/2070422198 >> 172.21.15.69:0/2070422198 conn(0x7f648c071b80 msgr2=0x7f648c0668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.461+0000 7f6494200640 1 -- 172.21.15.69:0/2070422198 shutdown_connections 2024-02-21T07:42:41.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.461+0000 7f6494200640 1 -- 172.21.15.69:0/2070422198 wait complete. 2024-02-21T07:42:41.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.472+0000 7f6494200640 1 Processor -- start 2024-02-21T07:42:41.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.479+0000 7f6494200640 1 -- start start 2024-02-21T07:42:41.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.489+0000 7f6494200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 0x7f648c2181b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.489+0000 7f6494200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c18b580 0x7f648c21d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.493+0000 7f6494200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648c21dcf0 0x7f648c16c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.493+0000 7f6490e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c18b580 0x7f648c21d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.493+0000 7f6494200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c18b160 con 0x7f648c21dcf0 2024-02-21T07:42:41.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.493+0000 7f6494200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c18a570 con 0x7f64740047c0 2024-02-21T07:42:41.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.493+0000 7f6494200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c21e580 con 0x7f648c18b580 2024-02-21T07:42:41.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.493+0000 7f6491800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 0x7f648c2181b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.494+0000 7f6490e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c18b580 0x7f648c21d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34628/0 (socket says 172.21.15.69:34628) 2024-02-21T07:42:41.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.494+0000 7f6490e00640 1 -- 172.21.15.69:0/1573510486 learned_addr learned my addr 172.21.15.69:0/1573510486 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:41.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.494+0000 7f6492200640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648c21dcf0 0x7f648c16c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.499+0000 7f6490e00640 1 -- 172.21.15.69:0/1573510486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 msgr2=0x7f648c2181b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.499+0000 7f6490e00640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 0x7f648c2181b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.499+0000 7f6490e00640 1 -- 172.21.15.69:0/1573510486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648c21dcf0 msgr2=0x7f648c16c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.499+0000 7f6490e00640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648c21dcf0 0x7f648c16c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.499+0000 7f6490e00640 1 -- 172.21.15.69:0/1573510486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c18a7c0 con 0x7f648c18b580 2024-02-21T07:42:41.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.499+0000 7f6492200640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648c21dcf0 0x7f648c16c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:41.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.500+0000 7f6490e00640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c18b580 0x7f648c21d7b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f64800050e0 tx=0x7f6480004980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.504+0000 7f6489600640 1 -- 172.21.15.69:0/1573510486 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480039070 con 0x7f648c18b580 2024-02-21T07:42:41.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.504+0000 7f6489600640 1 -- 172.21.15.69:0/1573510486 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480001890 con 0x7f648c18b580 2024-02-21T07:42:41.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.504+0000 7f6489600640 1 -- 172.21.15.69:0/1573510486 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480005e70 con 0x7f648c18b580 2024-02-21T07:42:41.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.509+0000 7f6494200640 1 -- 172.21.15.69:0/1573510486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c18aaa0 con 0x7f648c18b580 2024-02-21T07:42:41.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.509+0000 7f6494200640 1 -- 172.21.15.69:0/1573510486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c18ba00 con 0x7f648c18b580 2024-02-21T07:42:41.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.513+0000 7f6494200640 1 -- 172.21.15.69:0/1573510486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c069d50 con 0x7f648c18b580 2024-02-21T07:42:41.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.533+0000 7f6eacc00640 1 -- 172.21.15.69:0/4035873654 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6eb80f8460 con 0x7f6eb81829d0 2024-02-21T07:42:41.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.534+0000 7f6eaf400640 1 -- 172.21.15.69:0/4035873654 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6eb0004860 con 0x7f6eb81829d0 2024-02-21T07:42:41.540 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:41.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.537+0000 7f6489600640 1 -- 172.21.15.69:0/1573510486 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f64800082f0 con 0x7f648c18b580 2024-02-21T07:42:41.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.540+0000 7f6489600640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f646c09f1b0 0x7f646c0a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:41.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.541+0000 7f6eacc00640 1 -- 172.21.15.69:0/4035873654 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e9809f280 msgr2=0x7f6e980a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.541+0000 7f6eacc00640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e9809f280 0x7f6e980a1740 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80cf230 tx=0x7f6ea8007840 comp rx=0 tx=0).stop 2024-02-21T07:42:41.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.541+0000 7f6eacc00640 1 -- 172.21.15.69:0/4035873654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81829d0 msgr2=0x7f6eb80f37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.541+0000 7f6eacc00640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81829d0 0x7f6eb80f37e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0036040 tx=0x7f6eb0004a40 comp rx=0 tx=0).stop 2024-02-21T07:42:41.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.540+0000 7f6489600640 1 -- 172.21.15.69:0/1573510486 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f64800eb1e0 con 0x7f648c18b580 2024-02-21T07:42:41.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.541+0000 7f6491800640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f646c09f1b0 0x7f646c0a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:41.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.542+0000 7f6491800640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f646c09f1b0 0x7f646c0a1670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f648c0d6080 tx=0x7f6478009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:41.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.545+0000 7f6eacc00640 1 -- 172.21.15.69:0/4035873654 shutdown_connections 2024-02-21T07:42:41.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.545+0000 7f6eacc00640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e9809f280 0x7f6e980a1740 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.545+0000 7f6eacc00640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6eb81829d0 0x7f6eb80f37e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.545+0000 7f6eacc00640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6eb817eb50 0x7f6eb80f32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.545+0000 7f6eacc00640 1 --2- 172.21.15.69:0/4035873654 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6eb80701c0 0x7f6eb8168e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.545+0000 7f6eacc00640 1 -- 172.21.15.69:0/4035873654 >> 172.21.15.69:0/4035873654 conn(0x7f6eb80ce290 msgr2=0x7f6eb80cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.545+0000 7f6489600640 1 -- 172.21.15.69:0/1573510486 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f648007b8c0 con 0x7f648c18b580 2024-02-21T07:42:41.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.545+0000 7f6eacc00640 1 -- 172.21.15.69:0/4035873654 shutdown_connections 2024-02-21T07:42:41.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.546+0000 7f6eacc00640 1 -- 172.21.15.69:0/4035873654 wait complete. 2024-02-21T07:42:41.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444044 for osd.7 2024-02-21T07:42:41.607 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.615+0000 7f556a400640 1 -- 172.21.15.69:0/1708223990 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5540005810 con 0x7f556415dad0 2024-02-21T07:42:41.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.616+0000 7f5560c00640 1 -- 172.21.15.69:0/1708223990 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f555c094060 con 0x7f556415dad0 2024-02-21T07:42:41.622 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:41.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.621+0000 7f556a400640 1 -- 172.21.15.69:0/1708223990 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f554409f200 msgr2=0x7f55440a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.621+0000 7f556a400640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f554409f200 0x7f55440a16c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5558007680 tx=0x7f5558007c90 comp rx=0 tx=0).stop 2024-02-21T07:42:41.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.621+0000 7f556a400640 1 -- 172.21.15.69:0/1708223990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f556415dad0 msgr2=0x7f5564183dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.621+0000 7f556a400640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f556415dad0 0x7f5564183dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f555c007de0 tx=0x7f555c00d4a0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.625+0000 7f556a400640 1 -- 172.21.15.69:0/1708223990 shutdown_connections 2024-02-21T07:42:41.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.625+0000 7f556a400640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f554409f200 0x7f55440a16c0 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5558007680 tx=0x7f5558007c90 comp rx=0 tx=0).stop 2024-02-21T07:42:41.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.625+0000 7f556a400640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f556415dad0 0x7f5564183dd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.625+0000 7f556a400640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f55640fe590 0x7f5564183890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.625+0000 7f556a400640 1 --2- 172.21.15.69:0/1708223990 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f55640fd740 0x7f556421f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.625+0000 7f556a400640 1 -- 172.21.15.69:0/1708223990 >> 172.21.15.69:0/1708223990 conn(0x7f55640d2c90 msgr2=0x7f5564189c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.631+0000 7f556a400640 1 -- 172.21.15.69:0/1708223990 shutdown_connections 2024-02-21T07:42:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.631+0000 7f556a400640 1 -- 172.21.15.69:0/1708223990 wait complete. 2024-02-21T07:42:41.665 INFO:teuthology.orchestra.run.smithi069.stdout:73014444045 2024-02-21T07:42:41.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fe76be00640 1 -- 172.21.15.69:0/2504694922 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe7641861d0 con 0x7fe764219e40 2024-02-21T07:42:41.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fe761600640 1 -- 172.21.15.69:0/2504694922 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7580a35c0 con 0x7fe764219e40 2024-02-21T07:42:41.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.652+0000 7fc2aaa00640 1 -- 172.21.15.69:0/4001449684 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2b82212c0 con 0x7fc2b818da00 2024-02-21T07:42:41.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.656+0000 7fc2b5600640 1 -- 172.21.15.69:0/4001449684 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc2b82212c0 con 0x7fc2b818da00 2024-02-21T07:42:41.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fc2aaa00640 1 -- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc29809f1b0 msgr2=0x7fc2980a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fc2aaa00640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc29809f1b0 0x7fc2980a1670 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac035000 tx=0x7fc2ac008030 comp rx=0 tx=0).stop 2024-02-21T07:42:41.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fc2aaa00640 1 -- 172.21.15.69:0/4001449684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2b818da00 msgr2=0x7fc2b82215a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fc2aaa00640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2b818da00 0x7fc2b82215a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000b990 tx=0x7fc2b000be50 comp rx=0 tx=0).stop 2024-02-21T07:42:41.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fc2aaa00640 1 -- 172.21.15.69:0/4001449684 shutdown_connections 2024-02-21T07:42:41.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fc2aaa00640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc29809f1b0 0x7fc2980a1670 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fc2aaa00640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2b818da00 0x7fc2b82215a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fc2aaa00640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2b818a660 0x7fc2b8179f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fc2aaa00640 1 --2- 172.21.15.69:0/4001449684 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc2b80cd7f0 0x7fc2b81799d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.660+0000 7fc2aaa00640 1 -- 172.21.15.69:0/4001449684 >> 172.21.15.69:0/4001449684 conn(0x7fc2b80f69c0 msgr2=0x7fc2b818cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.661+0000 7fc2aaa00640 1 -- 172.21.15.69:0/4001449684 shutdown_connections 2024-02-21T07:42:41.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.661+0000 7fc2aaa00640 1 -- 172.21.15.69:0/4001449684 wait complete. 2024-02-21T07:42:41.670 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:41.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.672+0000 7fe76be00640 1 -- 172.21.15.69:0/2504694922 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe74409f1c0 msgr2=0x7fe7440a1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.672+0000 7fe76be00640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe74409f1c0 0x7fe7440a1680 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe75c034000 tx=0x7fe75c007000 comp rx=0 tx=0).stop 2024-02-21T07:42:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.672+0000 7fe76be00640 1 -- 172.21.15.69:0/2504694922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe764219e40 msgr2=0x7fe764176470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.672+0000 7fe76be00640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe764219e40 0x7fe764176470 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe7640d0ba0 tx=0x7fe75801d880 comp rx=0 tx=0).stop 2024-02-21T07:42:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.672+0000 7fe76be00640 1 -- 172.21.15.69:0/2504694922 shutdown_connections 2024-02-21T07:42:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.672+0000 7fe76be00640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe74409f1c0 0x7fe7440a1680 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.672+0000 7fe76be00640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe764219e40 0x7fe764176470 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.672+0000 7fe76be00640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe76421e9f0 0x7fe764219900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.672+0000 7fe76be00640 1 --2- 172.21.15.69:0/2504694922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7641749b0 0x7fe764174d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.672+0000 7fe76be00640 1 -- 172.21.15.69:0/2504694922 >> 172.21.15.69:0/2504694922 conn(0x7fe7640f8110 msgr2=0x7fe76408cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.673+0000 7fe76be00640 1 -- 172.21.15.69:0/2504694922 shutdown_connections 2024-02-21T07:42:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.673+0000 7fe76be00640 1 -- 172.21.15.69:0/2504694922 wait complete. 2024-02-21T07:42:41.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444044 for osd.2 2024-02-21T07:42:41.699 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444044 for osd.5 2024-02-21T07:42:41.732 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444045 got 73014444045 for osd.0 2024-02-21T07:42:41.742 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.770+0000 7f8ed3e00640 1 -- 172.21.15.69:0/1251850065 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8ee80f7e70 con 0x7f8ee8186b10 2024-02-21T07:42:41.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.771+0000 7f8edea00640 1 -- 172.21.15.69:0/1251850065 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ed8092fc0 con 0x7f8ee8186b10 2024-02-21T07:42:41.777 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:41.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.775+0000 7f8ed3e00640 1 -- 172.21.15.69:0/1251850065 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8ecc0a0e20 msgr2=0x7f8ecc0a32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.775+0000 7f8ed3e00640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8ecc0a0e20 0x7f8ecc0a32e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8072750 tx=0x7f8ee0007600 comp rx=0 tx=0).stop 2024-02-21T07:42:41.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.775+0000 7f8ed3e00640 1 -- 172.21.15.69:0/1251850065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ee8186b10 msgr2=0x7f8ee8186f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.775+0000 7f8ed3e00640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ee8186b10 0x7f8ee8186f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ee817f8d0 tx=0x7f8ed800c890 comp rx=0 tx=0).stop 2024-02-21T07:42:41.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.776+0000 7f8ed3e00640 1 -- 172.21.15.69:0/1251850065 shutdown_connections 2024-02-21T07:42:41.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.776+0000 7f8ed3e00640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8ecc0a0e20 0x7f8ecc0a32e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.776+0000 7f8ed3e00640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8ee8186b10 0x7f8ee8186f90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.776+0000 7f8ed3e00640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ee821a0e0 0x7f8ee821a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.776+0000 7f8ed3e00640 1 --2- 172.21.15.69:0/1251850065 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8ecc0047c0 0x7f8ee8156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.776+0000 7f8ed3e00640 1 -- 172.21.15.69:0/1251850065 >> 172.21.15.69:0/1251850065 conn(0x7f8ee80f6840 msgr2=0x7f8ee8171eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.777+0000 7f8ed3e00640 1 -- 172.21.15.69:0/1251850065 shutdown_connections 2024-02-21T07:42:41.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.777+0000 7f8ed3e00640 1 -- 172.21.15.69:0/1251850065 wait complete. 2024-02-21T07:42:41.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444044 for osd.1 2024-02-21T07:42:41.809 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.812+0000 7f751d600640 1 -- 172.21.15.69:0/2060904728 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f7518069c10 con 0x7f751815e0f0 2024-02-21T07:42:41.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.813+0000 7f750fe00640 1 -- 172.21.15.69:0/2060904728 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f750400bea0 con 0x7f751815e0f0 2024-02-21T07:42:41.819 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:41.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.814+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fad400cc130 con 0x7fad40190340 2024-02-21T07:42:41.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.815+0000 7fad37e00640 1 -- 172.21.15.69:0/2666478443 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad38019070 con 0x7fad40190340 2024-02-21T07:42:41.821 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:41.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 -- 172.21.15.69:0/2060904728 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f74f809f130 msgr2=0x7f74f80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f74f809f130 0x7f74f80a15f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7508001750 tx=0x7f7508009040 comp rx=0 tx=0).stop 2024-02-21T07:42:41.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 -- 172.21.15.69:0/2060904728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f751815e0f0 msgr2=0x7f7518226a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f751815e0f0 0x7f7518226a80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7518160c70 tx=0x7f750400b820 comp rx=0 tx=0).stop 2024-02-21T07:42:41.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 -- 172.21.15.69:0/2060904728 shutdown_connections 2024-02-21T07:42:41.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f74f809f130 0x7f74f80a15f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f751815e0f0 0x7f7518226a80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7518158810 0x7f751818abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 --2- 172.21.15.69:0/2060904728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7518158430 0x7f7518224980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 -- 172.21.15.69:0/2060904728 >> 172.21.15.69:0/2060904728 conn(0x7f75180ce290 msgr2=0x7f75180cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.817+0000 7f751d600640 1 -- 172.21.15.69:0/2060904728 shutdown_connections 2024-02-21T07:42:41.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.818+0000 7f751d600640 1 -- 172.21.15.69:0/2060904728 wait complete. 2024-02-21T07:42:41.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.818+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fad2009f200 msgr2=0x7fad200a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.818+0000 7fad45600640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fad2009f200 0x7fad200a16c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fad2c009950 tx=0x7fad2c008040 comp rx=0 tx=0).stop 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.818+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad40190340 msgr2=0x7fad40171930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.818+0000 7fad45600640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad40190340 0x7fad40171930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fad3800be20 tx=0x7fad38009f70 comp rx=0 tx=0).stop 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.819+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 shutdown_connections 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.819+0000 7fad45600640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fad2009f200 0x7fad200a16c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.819+0000 7fad45600640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad40190720 0x7fad40171e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.819+0000 7fad45600640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad40190340 0x7fad40171930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.819+0000 7fad45600640 1 --2- 172.21.15.69:0/2666478443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fad400718c0 0x7fad40188cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.819+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 >> 172.21.15.69:0/2666478443 conn(0x7fad400ce290 msgr2=0x7fad400ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.819+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 shutdown_connections 2024-02-21T07:42:41.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.819+0000 7fad45600640 1 -- 172.21.15.69:0/2666478443 wait complete. 2024-02-21T07:42:41.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.835+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f6068112310 con 0x7f60681084a0 2024-02-21T07:42:41.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.836+0000 7f606d600640 1 -- 172.21.15.69:0/3049669246 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f606405e020 con 0x7f60681084a0 2024-02-21T07:42:41.841 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:41.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.838+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f605009f280 msgr2=0x7f60500a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.838+0000 7f6078400640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f605009f280 0x7f60500a1740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f60700506c0 tx=0x7f607006d040 comp rx=0 tx=0).stop 2024-02-21T07:42:41.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.838+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60681084a0 msgr2=0x7f6068107140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.838+0000 7f6078400640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60681084a0 0x7f6068107140 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6064043000 tx=0x7f60640046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.838+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 shutdown_connections 2024-02-21T07:42:41.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.838+0000 7f6078400640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f605009f280 0x7f60500a1740 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.838+0000 7f6078400640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f60681084a0 0x7f6068107140 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.838+0000 7f6078400640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6068058b10 0x7f6068052260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.838+0000 7f6078400640 1 --2- 172.21.15.69:0/3049669246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6068052be0 0x7f60680579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.838+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 >> 172.21.15.69:0/3049669246 conn(0x7f6068057250 msgr2=0x7f60680544a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.839+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 shutdown_connections 2024-02-21T07:42:41.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.839+0000 7f6078400640 1 -- 172.21.15.69:0/3049669246 wait complete. 2024-02-21T07:42:41.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444044 for osd.10 2024-02-21T07:42:41.853 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.853 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444044 for osd.4 2024-02-21T07:42:41.854 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444044 for osd.9 2024-02-21T07:42:41.861 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.908+0000 7fdb13200640 1 -- 172.21.15.69:0/2136786932 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fdb0c069c10 con 0x7fdaf4004be0 2024-02-21T07:42:41.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.909+0000 7fdb06000640 1 -- 172.21.15.69:0/2136786932 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7fdb00042070 con 0x7fdaf4004be0 2024-02-21T07:42:41.915 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:41.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.911+0000 7fdb13200640 1 -- 172.21.15.69:0/2136786932 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdaf009f200 msgr2=0x7fdaf00a16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.911+0000 7fdb13200640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdaf009f200 0x7fdaf00a16c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c18aba0 tx=0x7fdafc0079b0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.911+0000 7fdb13200640 1 -- 172.21.15.69:0/2136786932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004be0 msgr2=0x7fdb0c08b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.911+0000 7fdb13200640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004be0 0x7fdb0c08b840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009c90 tx=0x7fdb000012b0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.912+0000 7fdb13200640 1 -- 172.21.15.69:0/2136786932 shutdown_connections 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.912+0000 7fdb13200640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdaf009f200 0x7fdaf00a16c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.912+0000 7fdb13200640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdb0c0cd3a0 0x7fdb0c06ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.912+0000 7fdb13200640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb0c0cc9e0 0x7fdb0c0cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.912+0000 7fdb13200640 1 --2- 172.21.15.69:0/2136786932 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdaf4004be0 0x7fdb0c08b840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.912+0000 7fdb13200640 1 -- 172.21.15.69:0/2136786932 >> 172.21.15.69:0/2136786932 conn(0x7fdb0c0f6840 msgr2=0x7fdb0c071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.912+0000 7fdb13200640 1 -- 172.21.15.69:0/2136786932 shutdown_connections 2024-02-21T07:42:41.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.912+0000 7fdb13200640 1 -- 172.21.15.69:0/2136786932 wait complete. 2024-02-21T07:42:41.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444044 for osd.11 2024-02-21T07:42:41.935 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.940+0000 7f6494200640 1 -- 172.21.15.69:0/1573510486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f648c0d3540 con 0x7f648c18b580 2024-02-21T07:42:41.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.940+0000 7f6489600640 1 -- 172.21.15.69:0/1573510486 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6480045020 con 0x7f648c18b580 2024-02-21T07:42:41.946 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.942+0000 7f6494200640 1 -- 172.21.15.69:0/1573510486 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f646c09f1b0 msgr2=0x7f646c0a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.942+0000 7f6494200640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f646c09f1b0 0x7f646c0a1670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f648c0d6080 tx=0x7f6478009110 comp rx=0 tx=0).stop 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.942+0000 7f6494200640 1 -- 172.21.15.69:0/1573510486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c18b580 msgr2=0x7f648c21d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.942+0000 7f6494200640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c18b580 0x7f648c21d7b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f64800050e0 tx=0x7f6480004980 comp rx=0 tx=0).stop 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.943+0000 7f6494200640 1 -- 172.21.15.69:0/1573510486 shutdown_connections 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.943+0000 7f6494200640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f646c09f1b0 0x7f646c0a1670 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.943+0000 7f6494200640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648c21dcf0 0x7f648c16c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.943+0000 7f6494200640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c18b580 0x7f648c21d7b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.943+0000 7f6494200640 1 --2- 172.21.15.69:0/1573510486 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f64740047c0 0x7f648c2181b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.943+0000 7f6494200640 1 -- 172.21.15.69:0/1573510486 >> 172.21.15.69:0/1573510486 conn(0x7f648c071b80 msgr2=0x7f648c0cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.943+0000 7f6494200640 1 -- 172.21.15.69:0/1573510486 shutdown_connections 2024-02-21T07:42:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.943+0000 7f6494200640 1 -- 172.21.15.69:0/1573510486 wait complete. 2024-02-21T07:42:41.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.955+0000 7f5599600640 1 -- 172.21.15.69:0/3867021214 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f558c1a0750 con 0x7f558c106fa0 2024-02-21T07:42:41.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.955+0000 7f558aa00640 1 -- 172.21.15.69:0/3867021214 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f55800b9570 con 0x7f558c106fa0 2024-02-21T07:42:41.961 INFO:teuthology.orchestra.run.smithi069.stdout:73014444044 2024-02-21T07:42:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 -- 172.21.15.69:0/3867021214 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f557409f280 msgr2=0x7f55740a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f557409f280 0x7f55740a1740 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5584006110 tx=0x7f5584005ed0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 -- 172.21.15.69:0/3867021214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558c106fa0 msgr2=0x7f558c052290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558c106fa0 0x7f558c052290 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5580033000 tx=0x7f55800046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 -- 172.21.15.69:0/3867021214 shutdown_connections 2024-02-21T07:42:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f557409f280 0x7f55740a1740 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f558c108440 0x7f558c1a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f558c106fa0 0x7f558c052290 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 --2- 172.21.15.69:0/3867021214 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f558c054ac0 0x7f558c0e2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 -- 172.21.15.69:0/3867021214 >> 172.21.15.69:0/3867021214 conn(0x7f558c052e10 msgr2=0x7f558c0056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 -- 172.21.15.69:0/3867021214 shutdown_connections 2024-02-21T07:42:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.958+0000 7f5599600640 1 -- 172.21.15.69:0/3867021214 wait complete. 2024-02-21T07:42:41.966 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444044 for osd.6 2024-02-21T07:42:41.966 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.961+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fc59c005810 con 0x7fc5c40fe570 2024-02-21T07:42:41.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.962+0000 7fc5baa00640 1 -- 172.21.15.69:0/4279635068 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc5b0093ad0 con 0x7fc5c40fe570 2024-02-21T07:42:41.967 INFO:teuthology.orchestra.run.smithi069.stdout:73014444043 2024-02-21T07:42:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc5a409f1b0 msgr2=0x7fc5a40a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc5a409f1b0 0x7fc5a40a1670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc5c415b080 tx=0x7fc5b403c040 comp rx=0 tx=0).stop 2024-02-21T07:42:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5c40fe570 msgr2=0x7fc5c414f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5c40fe570 0x7fc5c414f740 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0000f60 tx=0x7fc5b000c800 comp rx=0 tx=0).stop 2024-02-21T07:42:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 shutdown_connections 2024-02-21T07:42:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc5a409f1b0 0x7fc5a40a1670 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc5c4189ec0 0x7fc5c421f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc5c415db10 0x7fc5c4186ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 --2- 172.21.15.69:0/4279635068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5c40fe570 0x7fc5c414f740 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 >> 172.21.15.69:0/4279635068 conn(0x7fc5c40668e0 msgr2=0x7fc5c418a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 shutdown_connections 2024-02-21T07:42:41.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:41.964+0000 7fc5c3e00640 1 -- 172.21.15.69:0/4279635068 wait complete. 2024-02-21T07:42:41.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444044 got 73014444044 for osd.3 2024-02-21T07:42:41.981 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444043 for osd.8 2024-02-21T07:42:41.986 DEBUG:teuthology.parallel:result is None 2024-02-21T07:42:41.986 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-21T07:42:41.986 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:42:42.120 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:42:42.127 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:42:42.130 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:42:42.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.223+0000 7f7c5be00640 1 Processor -- start 2024-02-21T07:42:42.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.224+0000 7f7c5be00640 1 -- start start 2024-02-21T07:42:42.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.226+0000 7f7c5be00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7c540f6310 0x7f7c5406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.226+0000 7f7c5be00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c54187740 con 0x7f7c54183fa0 2024-02-21T07:42:42.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.226+0000 7f7c5be00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c540ce230 con 0x7f7c540cd090 2024-02-21T07:42:42.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.226+0000 7f7c5be00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c54184380 con 0x7f7c540f6310 2024-02-21T07:42:42.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.226+0000 7f7c59400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7c54183fa0 0x7f7c54188270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44678/0 (socket says 172.21.15.69:44678) 2024-02-21T07:42:42.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.226+0000 7f7c59400640 1 -- 172.21.15.69:0/89025649 learned_addr learned my addr 172.21.15.69:0/89025649 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:42.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.226+0000 7f7c59e00640 1 --2- 172.21.15.69:0/89025649 >> v2:172.21.15.69:3300/0 conn(0x7f7c540f6310 0x7f7c5406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.226+0000 7f7c59e00640 1 -- 172.21.15.69:0/89025649 >> v1:172.21.15.184:6789/0 conn(0x7f7c540cd090 legacy=0x7f7c54188980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.226+0000 7f7c59e00640 1 -- 172.21.15.69:0/89025649 >> v1:172.21.15.69:6789/0 conn(0x7f7c54183fa0 legacy=0x7f7c54188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.226+0000 7f7c59e00640 1 -- 172.21.15.69:0/89025649 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540cd6b0 con 0x7f7c540f6310 2024-02-21T07:42:42.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.227+0000 7f7c59e00640 1 --2- 172.21.15.69:0/89025649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 0x7f7c5406ccc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009d90 tx=0x7f7c4c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f89fe6fdb189708 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:42.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.228+0000 7f7c53e00640 1 -- 172.21.15.69:0/89025649 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c02cbd0 con 0x7f7c540f6310 2024-02-21T07:42:42.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.228+0000 7f7c53e00640 1 -- 172.21.15.69:0/89025649 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c02cd30 con 0x7f7c540f6310 2024-02-21T07:42:42.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.228+0000 7f7c53e00640 1 -- 172.21.15.69:0/89025649 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c02cea0 con 0x7f7c540f6310 2024-02-21T07:42:42.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.228+0000 7f7c5be00640 1 -- 172.21.15.69:0/89025649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 msgr2=0x7f7c5406ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.228+0000 7f7c5be00640 1 --2- 172.21.15.69:0/89025649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 0x7f7c5406ccc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009d90 tx=0x7f7c4c02be20 comp rx=0 tx=0).stop 2024-02-21T07:42:42.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.228+0000 7f7c5be00640 1 -- 172.21.15.69:0/89025649 shutdown_connections 2024-02-21T07:42:42.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.228+0000 7f7c5be00640 1 --2- 172.21.15.69:0/89025649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 0x7f7c5406ccc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.228+0000 7f7c5be00640 1 -- 172.21.15.69:0/89025649 >> 172.21.15.69:0/89025649 conn(0x7f7c540f69c0 msgr2=0x7f7c540f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:42.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.228+0000 7f7c5be00640 1 -- 172.21.15.69:0/89025649 shutdown_connections 2024-02-21T07:42:42.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.228+0000 7f7c5be00640 1 -- 172.21.15.69:0/89025649 wait complete. 2024-02-21T07:42:42.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.230+0000 7f7c5be00640 1 Processor -- start 2024-02-21T07:42:42.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.230+0000 7f7c5be00640 1 -- start start 2024-02-21T07:42:42.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.231+0000 7f7c5be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c540cd090 0x7f7c54166320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.231+0000 7f7c5be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 0x7f7c5421dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c5be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c54183fa0 0x7f7c5421e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c5be00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5421e6a0 con 0x7f7c540f6310 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c5be00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5421e8d0 con 0x7f7c54183fa0 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c5be00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5421ebb0 con 0x7f7c540cd090 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c58a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 0x7f7c5421dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c59400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c540cd090 0x7f7c54166320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c58a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 0x7f7c5421dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34012/0 (socket says 172.21.15.69:34012) 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c58a00640 1 -- 172.21.15.69:0/3033791515 learned_addr learned my addr 172.21.15.69:0/3033791515 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c59e00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c54183fa0 0x7f7c5421e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c58a00640 1 -- 172.21.15.69:0/3033791515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c540cd090 msgr2=0x7f7c54166320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c58a00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c540cd090 0x7f7c54166320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c58a00640 1 -- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c54183fa0 msgr2=0x7f7c5421e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c58a00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c54183fa0 0x7f7c5421e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c58a00640 1 -- 172.21.15.69:0/3033791515 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c009a70 con 0x7f7c540f6310 2024-02-21T07:42:42.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c59e00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c54183fa0 0x7f7c5421e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:42.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.232+0000 7f7c58a00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 0x7f7c5421dc20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000c3c0 tx=0x7f7c4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:42.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.233+0000 7f7c51600640 1 -- 172.21.15.69:0/3033791515 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c400052d0 con 0x7f7c540f6310 2024-02-21T07:42:42.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.233+0000 7f7c51600640 1 -- 172.21.15.69:0/3033791515 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40005450 con 0x7f7c540f6310 2024-02-21T07:42:42.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.233+0000 7f7c51600640 1 -- 172.21.15.69:0/3033791515 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40007260 con 0x7f7c540f6310 2024-02-21T07:42:42.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.233+0000 7f7c5be00640 1 -- 172.21.15.69:0/3033791515 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5421ee90 con 0x7f7c540f6310 2024-02-21T07:42:42.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.233+0000 7f7c5be00640 1 -- 172.21.15.69:0/3033791515 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5421f450 con 0x7f7c540f6310 2024-02-21T07:42:42.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.234+0000 7f7c5be00640 1 -- 172.21.15.69:0/3033791515 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c54069d50 con 0x7f7c540f6310 2024-02-21T07:42:42.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.235+0000 7f7c51600640 1 -- 172.21.15.69:0/3033791515 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f7c400073c0 con 0x7f7c540f6310 2024-02-21T07:42:42.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.237+0000 7f7c51600640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c3409f130 0x7f7c340a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.237+0000 7f7c51600640 1 -- 172.21.15.69:0/3033791515 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f7c400c8f30 con 0x7f7c540f6310 2024-02-21T07:42:42.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.237+0000 7f7c59400640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c3409f130 0x7f7c340a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.238+0000 7f7c59400640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c3409f130 0x7f7c340a15f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7c48007fd0 tx=0x7f7c48007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:42.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.240+0000 7f7c51600640 1 -- 172.21.15.69:0/3033791515 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7c4004c8c0 con 0x7f7c540f6310 2024-02-21T07:42:42.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.419+0000 7f7c5be00640 1 -- 172.21.15.69:0/3033791515 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7c540cdc70 con 0x7f7c3409f130 2024-02-21T07:42:42.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.431+0000 7f7c51600640 1 -- 172.21.15.69:0/3033791515 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368050 (secure 0 0 0) 0x7f7c48001460 con 0x7f7c3409f130 2024-02-21T07:42:42.444 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:42.447 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 -- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c3409f130 msgr2=0x7f7c340a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c3409f130 0x7f7c340a15f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7c48007fd0 tx=0x7f7c48007e80 comp rx=0 tx=0).stop 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 -- 172.21.15.69:0/3033791515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 msgr2=0x7f7c5421dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 0x7f7c5421dc20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000c3c0 tx=0x7f7c4000c880 comp rx=0 tx=0).stop 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 -- 172.21.15.69:0/3033791515 shutdown_connections 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7c3409f130 0x7f7c340a15f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7c54183fa0 0x7f7c5421e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c540f6310 0x7f7c5421dc20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 --2- 172.21.15.69:0/3033791515 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c540cd090 0x7f7c54166320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 -- 172.21.15.69:0/3033791515 >> 172.21.15.69:0/3033791515 conn(0x7f7c540f69c0 msgr2=0x7f7c540cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 -- 172.21.15.69:0/3033791515 shutdown_connections 2024-02-21T07:42:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.439+0000 7f7c5be00640 1 -- 172.21.15.69:0/3033791515 wait complete. 2024-02-21T07:42:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-02-21T07:42:40.451491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":643884,"num_objects":102,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":232,"num_read_kb":223,"num_write":415,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":329416,"kb_used_data":5224,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132132664,"statfs":{"total":1159641169920,"available":1159303847936,"internally_reserved":0,"allocated":5349376,"data_stored":3014096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":331855161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48876,"num_objects":78,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":106,"num_read_kb":114,"num_write":185,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003216"},"pg_stats":[{"pgid":"2.1f","version":"29'13","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:37.353824+0000","last_change":"2024-02-21T07:42:01.938302+0000","last_active":"2024-02-21T07:42:37.353824+0000","last_peered":"2024-02-21T07:42:37.353824+0000","last_clean":"2024-02-21T07:42:37.353824+0000","last_became_active":"2024-02-21T07:42:01.935737+0000","last_became_peered":"2024-02-21T07:42:01.935737+0000","last_unstale":"2024-02-21T07:42:37.353824+0000","last_undegraded":"2024-02-21T07:42:37.353824+0000","last_fullsized":"2024-02-21T07:42:37.353824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997031+0000","last_change":"2024-02-21T07:42:02.963926+0000","last_active":"2024-02-21T07:42:07.997031+0000","last_peered":"2024-02-21T07:42:07.997031+0000","last_clean":"2024-02-21T07:42:07.997031+0000","last_became_active":"2024-02-21T07:42:02.963585+0000","last_became_peered":"2024-02-21T07:42:02.963585+0000","last_unstale":"2024-02-21T07:42:07.997031+0000","last_undegraded":"2024-02-21T07:42:07.997031+0000","last_fullsized":"2024-02-21T07:42:07.997031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840648+0000","last_change":"2024-02-21T07:42:07.017236+0000","last_active":"2024-02-21T07:42:09.840648+0000","last_peered":"2024-02-21T07:42:09.840648+0000","last_clean":"2024-02-21T07:42:09.840648+0000","last_became_active":"2024-02-21T07:42:07.016750+0000","last_became_peered":"2024-02-21T07:42:07.016750+0000","last_unstale":"2024-02-21T07:42:09.840648+0000","last_undegraded":"2024-02-21T07:42:09.840648+0000","last_fullsized":"2024-02-21T07:42:09.840648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997651+0000","last_change":"2024-02-21T07:42:01.947176+0000","last_active":"2024-02-21T07:42:07.997651+0000","last_peered":"2024-02-21T07:42:07.997651+0000","last_clean":"2024-02-21T07:42:07.997651+0000","last_became_active":"2024-02-21T07:42:01.946831+0000","last_became_peered":"2024-02-21T07:42:01.946831+0000","last_unstale":"2024-02-21T07:42:07.997651+0000","last_undegraded":"2024-02-21T07:42:07.997651+0000","last_fullsized":"2024-02-21T07:42:07.997651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293106+0000","last_change":"2024-02-21T07:42:02.970038+0000","last_active":"2024-02-21T07:42:08.293106+0000","last_peered":"2024-02-21T07:42:08.293106+0000","last_clean":"2024-02-21T07:42:08.293106+0000","last_became_active":"2024-02-21T07:42:02.969433+0000","last_became_peered":"2024-02-21T07:42:02.969433+0000","last_unstale":"2024-02-21T07:42:08.293106+0000","last_undegraded":"2024-02-21T07:42:08.293106+0000","last_fullsized":"2024-02-21T07:42:08.293106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157309+0000","last_change":"2024-02-21T07:42:07.009585+0000","last_active":"2024-02-21T07:42:10.157309+0000","last_peered":"2024-02-21T07:42:10.157309+0000","last_clean":"2024-02-21T07:42:10.157309+0000","last_became_active":"2024-02-21T07:42:07.009264+0000","last_became_peered":"2024-02-21T07:42:07.009264+0000","last_unstale":"2024-02-21T07:42:10.157309+0000","last_undegraded":"2024-02-21T07:42:10.157309+0000","last_fullsized":"2024-02-21T07:42:10.157309+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'12","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.316614+0000","last_change":"2024-02-21T07:42:01.930474+0000","last_active":"2024-02-21T07:42:32.316614+0000","last_peered":"2024-02-21T07:42:32.316614+0000","last_clean":"2024-02-21T07:42:32.316614+0000","last_became_active":"2024-02-21T07:42:01.930173+0000","last_became_peered":"2024-02-21T07:42:01.930173+0000","last_unstale":"2024-02-21T07:42:32.316614+0000","last_undegraded":"2024-02-21T07:42:32.316614+0000","last_fullsized":"2024-02-21T07:42:32.316614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:42.554637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186921+0000","last_change":"2024-02-21T07:42:02.955640+0000","last_active":"2024-02-21T07:42:08.186921+0000","last_peered":"2024-02-21T07:42:08.186921+0000","last_clean":"2024-02-21T07:42:08.186921+0000","last_became_active":"2024-02-21T07:42:02.955341+0000","last_became_peered":"2024-02-21T07:42:02.955341+0000","last_unstale":"2024-02-21T07:42:08.186921+0000","last_undegraded":"2024-02-21T07:42:08.186921+0000","last_fullsized":"2024-02-21T07:42:08.186921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157595+0000","last_change":"2024-02-21T07:42:07.013240+0000","last_active":"2024-02-21T07:42:10.157595+0000","last_peered":"2024-02-21T07:42:10.157595+0000","last_clean":"2024-02-21T07:42:10.157595+0000","last_became_active":"2024-02-21T07:42:07.012852+0000","last_became_peered":"2024-02-21T07:42:07.012852+0000","last_unstale":"2024-02-21T07:42:10.157595+0000","last_undegraded":"2024-02-21T07:42:10.157595+0000","last_fullsized":"2024-02-21T07:42:10.157595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.316459+0000","last_change":"2024-02-21T07:42:01.933225+0000","last_active":"2024-02-21T07:42:32.316459+0000","last_peered":"2024-02-21T07:42:32.316459+0000","last_clean":"2024-02-21T07:42:32.316459+0000","last_became_active":"2024-02-21T07:42:01.932908+0000","last_became_peered":"2024-02-21T07:42:01.932908+0000","last_unstale":"2024-02-21T07:42:32.316459+0000","last_undegraded":"2024-02-21T07:42:32.316459+0000","last_fullsized":"2024-02-21T07:42:32.316459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113448+0000","last_change":"2024-02-21T07:42:02.965143+0000","last_active":"2024-02-21T07:42:08.113448+0000","last_peered":"2024-02-21T07:42:08.113448+0000","last_clean":"2024-02-21T07:42:08.113448+0000","last_became_active":"2024-02-21T07:42:02.964614+0000","last_became_peered":"2024-02-21T07:42:02.964614+0000","last_unstale":"2024-02-21T07:42:08.113448+0000","last_undegraded":"2024-02-21T07:42:08.113448+0000","last_fullsized":"2024-02-21T07:42:08.113448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157408+0000","last_change":"2024-02-21T07:42:07.017243+0000","last_active":"2024-02-21T07:42:10.157408+0000","last_peered":"2024-02-21T07:42:10.157408+0000","last_clean":"2024-02-21T07:42:10.157408+0000","last_became_active":"2024-02-21T07:42:07.016898+0000","last_became_peered":"2024-02-21T07:42:07.016898+0000","last_unstale":"2024-02-21T07:42:10.157408+0000","last_undegraded":"2024-02-21T07:42:10.157408+0000","last_fullsized":"2024-02-21T07:42:10.157408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124848+0000","last_change":"2024-02-21T07:42:02.961021+0000","last_active":"2024-02-21T07:42:10.124848+0000","last_peered":"2024-02-21T07:42:10.124848+0000","last_clean":"2024-02-21T07:42:10.124848+0000","last_became_active":"2024-02-21T07:42:02.960723+0000","last_became_peered":"2024-02-21T07:42:02.960723+0000","last_unstale":"2024-02-21T07:42:10.124848+0000","last_undegraded":"2024-02-21T07:42:10.124848+0000","last_fullsized":"2024-02-21T07:42:10.124848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.107460+0000","last_change":"2024-02-21T07:42:01.928055+0000","last_active":"2024-02-21T07:42:30.107460+0000","last_peered":"2024-02-21T07:42:30.107460+0000","last_clean":"2024-02-21T07:42:30.107460+0000","last_became_active":"2024-02-21T07:42:01.927733+0000","last_became_peered":"2024-02-21T07:42:01.927733+0000","last_unstale":"2024-02-21T07:42:30.107460+0000","last_undegraded":"2024-02-21T07:42:30.107460+0000","last_fullsized":"2024-02-21T07:42:30.107460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157702+0000","last_change":"2024-02-21T07:42:07.124695+0000","last_active":"2024-02-21T07:42:10.157702+0000","last_peered":"2024-02-21T07:42:10.157702+0000","last_clean":"2024-02-21T07:42:10.157702+0000","last_became_active":"2024-02-21T07:42:07.123973+0000","last_became_peered":"2024-02-21T07:42:07.123973+0000","last_unstale":"2024-02-21T07:42:10.157702+0000","last_undegraded":"2024-02-21T07:42:10.157702+0000","last_fullsized":"2024-02-21T07:42:10.157702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996795+0000","last_change":"2024-02-21T07:42:02.982537+0000","last_active":"2024-02-21T07:42:07.996795+0000","last_peered":"2024-02-21T07:42:07.996795+0000","last_clean":"2024-02-21T07:42:07.996795+0000","last_became_active":"2024-02-21T07:42:02.982222+0000","last_became_peered":"2024-02-21T07:42:02.982222+0000","last_unstale":"2024-02-21T07:42:07.996795+0000","last_undegraded":"2024-02-21T07:42:07.996795+0000","last_fullsized":"2024-02-21T07:42:07.996795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.127468+0000","last_change":"2024-02-21T07:42:01.942392+0000","last_active":"2024-02-21T07:42:32.127468+0000","last_peered":"2024-02-21T07:42:32.127468+0000","last_clean":"2024-02-21T07:42:32.127468+0000","last_became_active":"2024-02-21T07:42:01.942152+0000","last_became_peered":"2024-02-21T07:42:01.942152+0000","last_unstale":"2024-02-21T07:42:32.127468+0000","last_undegraded":"2024-02-21T07:42:32.127468+0000","last_fullsized":"2024-02-21T07:42:32.127468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.491378+0000","last_change":"2024-02-21T07:42:07.015054+0000","last_active":"2024-02-21T07:42:10.491378+0000","last_peered":"2024-02-21T07:42:10.491378+0000","last_clean":"2024-02-21T07:42:10.491378+0000","last_became_active":"2024-02-21T07:42:07.014713+0000","last_became_peered":"2024-02-21T07:42:07.014713+0000","last_unstale":"2024-02-21T07:42:10.491378+0000","last_undegraded":"2024-02-21T07:42:10.491378+0000","last_fullsized":"2024-02-21T07:42:10.491378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192537+0000","last_change":"2024-02-21T07:42:02.970973+0000","last_active":"2024-02-21T07:42:09.192537+0000","last_peered":"2024-02-21T07:42:09.192537+0000","last_clean":"2024-02-21T07:42:09.192537+0000","last_became_active":"2024-02-21T07:42:02.970644+0000","last_became_peered":"2024-02-21T07:42:02.970644+0000","last_unstale":"2024-02-21T07:42:09.192537+0000","last_undegraded":"2024-02-21T07:42:09.192537+0000","last_fullsized":"2024-02-21T07:42:09.192537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'7","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.318173+0000","last_change":"2024-02-21T07:42:01.947758+0000","last_active":"2024-02-21T07:42:32.318173+0000","last_peered":"2024-02-21T07:42:32.318173+0000","last_clean":"2024-02-21T07:42:32.318173+0000","last_became_active":"2024-02-21T07:42:01.947407+0000","last_became_peered":"2024-02-21T07:42:01.947407+0000","last_unstale":"2024-02-21T07:42:32.318173+0000","last_undegraded":"2024-02-21T07:42:32.318173+0000","last_fullsized":"2024-02-21T07:42:32.318173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417671+0000","last_change":"2024-02-21T07:42:07.023243+0000","last_active":"2024-02-21T07:42:10.417671+0000","last_peered":"2024-02-21T07:42:10.417671+0000","last_clean":"2024-02-21T07:42:10.417671+0000","last_became_active":"2024-02-21T07:42:07.022308+0000","last_became_peered":"2024-02-21T07:42:07.022308+0000","last_unstale":"2024-02-21T07:42:10.417671+0000","last_undegraded":"2024-02-21T07:42:10.417671+0000","last_fullsized":"2024-02-21T07:42:10.417671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:24.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993327+0000","last_change":"2024-02-21T07:42:02.963456+0000","last_active":"2024-02-21T07:42:07.993327+0000","last_peered":"2024-02-21T07:42:07.993327+0000","last_clean":"2024-02-21T07:42:07.993327+0000","last_became_active":"2024-02-21T07:42:02.963049+0000","last_became_peered":"2024-02-21T07:42:02.963049+0000","last_unstale":"2024-02-21T07:42:07.993327+0000","last_undegraded":"2024-02-21T07:42:07.993327+0000","last_fullsized":"2024-02-21T07:42:07.993327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.106442+0000","last_change":"2024-02-21T07:42:01.930737+0000","last_active":"2024-02-21T07:42:30.106442+0000","last_peered":"2024-02-21T07:42:30.106442+0000","last_clean":"2024-02-21T07:42:30.106442+0000","last_became_active":"2024-02-21T07:42:01.930465+0000","last_became_peered":"2024-02-21T07:42:01.930465+0000","last_unstale":"2024-02-21T07:42:30.106442+0000","last_undegraded":"2024-02-21T07:42:30.106442+0000","last_fullsized":"2024-02-21T07:42:30.106442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:08:11.073826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157596+0000","last_change":"2024-02-21T07:42:07.124659+0000","last_active":"2024-02-21T07:42:10.157596+0000","last_peered":"2024-02-21T07:42:10.157596+0000","last_clean":"2024-02-21T07:42:10.157596+0000","last_became_active":"2024-02-21T07:42:07.124217+0000","last_became_peered":"2024-02-21T07:42:07.124217+0000","last_unstale":"2024-02-21T07:42:10.157596+0000","last_undegraded":"2024-02-21T07:42:10.157596+0000","last_fullsized":"2024-02-21T07:42:10.157596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293041+0000","last_change":"2024-02-21T07:42:02.980306+0000","last_active":"2024-02-21T07:42:08.293041+0000","last_peered":"2024-02-21T07:42:08.293041+0000","last_clean":"2024-02-21T07:42:08.293041+0000","last_became_active":"2024-02-21T07:42:02.978879+0000","last_became_peered":"2024-02-21T07:42:02.978879+0000","last_unstale":"2024-02-21T07:42:08.293041+0000","last_undegraded":"2024-02-21T07:42:08.293041+0000","last_fullsized":"2024-02-21T07:42:08.293041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.310890+0000","last_change":"2024-02-21T07:42:01.931986+0000","last_active":"2024-02-21T07:42:32.310890+0000","last_peered":"2024-02-21T07:42:32.310890+0000","last_clean":"2024-02-21T07:42:32.310890+0000","last_became_active":"2024-02-21T07:42:01.931671+0000","last_became_peered":"2024-02-21T07:42:01.931671+0000","last_unstale":"2024-02-21T07:42:32.310890+0000","last_undegraded":"2024-02-21T07:42:32.310890+0000","last_fullsized":"2024-02-21T07:42:32.310890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840491+0000","last_change":"2024-02-21T07:42:06.999795+0000","last_active":"2024-02-21T07:42:09.840491+0000","last_peered":"2024-02-21T07:42:09.840491+0000","last_clean":"2024-02-21T07:42:09.840491+0000","last_became_active":"2024-02-21T07:42:06.999315+0000","last_became_peered":"2024-02-21T07:42:06.999315+0000","last_unstale":"2024-02-21T07:42:09.840491+0000","last_undegraded":"2024-02-21T07:42:09.840491+0000","last_fullsized":"2024-02-21T07:42:09.840491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997838+0000","last_change":"2024-02-21T07:42:02.968914+0000","last_active":"2024-02-21T07:42:07.997838+0000","last_peered":"2024-02-21T07:42:07.997838+0000","last_clean":"2024-02-21T07:42:07.997838+0000","last_became_active":"2024-02-21T07:42:02.961877+0000","last_became_peered":"2024-02-21T07:42:02.961877+0000","last_unstale":"2024-02-21T07:42:07.997838+0000","last_undegraded":"2024-02-21T07:42:07.997838+0000","last_fullsized":"2024-02-21T07:42:07.997838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'11","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:34.976565+0000","last_change":"2024-02-21T07:42:01.937837+0000","last_active":"2024-02-21T07:42:34.976565+0000","last_peered":"2024-02-21T07:42:34.976565+0000","last_clean":"2024-02-21T07:42:34.976565+0000","last_became_active":"2024-02-21T07:42:01.937536+0000","last_became_peered":"2024-02-21T07:42:01.937536+0000","last_unstale":"2024-02-21T07:42:34.976565+0000","last_undegraded":"2024-02-21T07:42:34.976565+0000","last_fullsized":"2024-02-21T07:42:34.976565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995749+0000","last_change":"2024-02-21T07:42:07.125588+0000","last_active":"2024-02-21T07:42:07.995749+0000","last_peered":"2024-02-21T07:42:07.995749+0000","last_clean":"2024-02-21T07:42:07.995749+0000","last_became_active":"2024-02-21T07:42:07.124044+0000","last_became_peered":"2024-02-21T07:42:07.124044+0000","last_unstale":"2024-02-21T07:42:07.995749+0000","last_undegraded":"2024-02-21T07:42:07.995749+0000","last_fullsized":"2024-02-21T07:42:07.995749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992717+0000","last_change":"2024-02-21T07:42:02.961820+0000","last_active":"2024-02-21T07:42:07.992717+0000","last_peered":"2024-02-21T07:42:07.992717+0000","last_clean":"2024-02-21T07:42:07.992717+0000","last_became_active":"2024-02-21T07:42:02.961478+0000","last_became_peered":"2024-02-21T07:42:02.961478+0000","last_unstale":"2024-02-21T07:42:07.992717+0000","last_undegraded":"2024-02-21T07:42:07.992717+0000","last_fullsized":"2024-02-21T07:42:07.992717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.302240+0000","last_change":"2024-02-21T07:42:01.947736+0000","last_active":"2024-02-21T07:42:32.302240+0000","last_peered":"2024-02-21T07:42:32.302240+0000","last_clean":"2024-02-21T07:42:32.302240+0000","last_became_active":"2024-02-21T07:42:01.947443+0000","last_became_peered":"2024-02-21T07:42:01.947443+0000","last_unstale":"2024-02-21T07:42:32.302240+0000","last_undegraded":"2024-02-21T07:42:32.302240+0000","last_fullsized":"2024-02-21T07:42:32.302240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:17.915214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192630+0000","last_change":"2024-02-21T07:42:07.008819+0000","last_active":"2024-02-21T07:42:09.192630+0000","last_peered":"2024-02-21T07:42:09.192630+0000","last_clean":"2024-02-21T07:42:09.192630+0000","last_became_active":"2024-02-21T07:42:07.008423+0000","last_became_peered":"2024-02-21T07:42:07.008423+0000","last_unstale":"2024-02-21T07:42:09.192630+0000","last_undegraded":"2024-02-21T07:42:09.192630+0000","last_fullsized":"2024-02-21T07:42:09.192630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413836+0000","last_change":"2024-02-21T07:42:02.975343+0000","last_active":"2024-02-21T07:42:10.413836+0000","last_peered":"2024-02-21T07:42:10.413836+0000","last_clean":"2024-02-21T07:42:10.413836+0000","last_became_active":"2024-02-21T07:42:02.975041+0000","last_became_peered":"2024-02-21T07:42:02.975041+0000","last_unstale":"2024-02-21T07:42:10.413836+0000","last_undegraded":"2024-02-21T07:42:10.413836+0000","last_fullsized":"2024-02-21T07:42:10.413836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416266+0000","last_change":"2024-02-21T07:42:01.935020+0000","last_active":"2024-02-21T07:42:10.416266+0000","last_peered":"2024-02-21T07:42:10.416266+0000","last_clean":"2024-02-21T07:42:10.416266+0000","last_became_active":"2024-02-21T07:42:01.934752+0000","last_became_peered":"2024-02-21T07:42:01.934752+0000","last_unstale":"2024-02-21T07:42:10.416266+0000","last_undegraded":"2024-02-21T07:42:10.416266+0000","last_fullsized":"2024-02-21T07:42:10.416266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993582+0000","last_change":"2024-02-21T07:42:07.124477+0000","last_active":"2024-02-21T07:42:07.993582+0000","last_peered":"2024-02-21T07:42:07.993582+0000","last_clean":"2024-02-21T07:42:07.993582+0000","last_became_active":"2024-02-21T07:42:07.123915+0000","last_became_peered":"2024-02-21T07:42:07.123915+0000","last_unstale":"2024-02-21T07:42:07.993582+0000","last_undegraded":"2024-02-21T07:42:07.993582+0000","last_fullsized":"2024-02-21T07:42:07.993582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413746+0000","last_change":"2024-02-21T07:42:02.964531+0000","last_active":"2024-02-21T07:42:10.413746+0000","last_peered":"2024-02-21T07:42:10.413746+0000","last_clean":"2024-02-21T07:42:10.413746+0000","last_became_active":"2024-02-21T07:42:02.964185+0000","last_became_peered":"2024-02-21T07:42:02.964185+0000","last_unstale":"2024-02-21T07:42:10.413746+0000","last_undegraded":"2024-02-21T07:42:10.413746+0000","last_fullsized":"2024-02-21T07:42:10.413746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:37.354456+0000","last_change":"2024-02-21T07:42:01.934093+0000","last_active":"2024-02-21T07:42:37.354456+0000","last_peered":"2024-02-21T07:42:37.354456+0000","last_clean":"2024-02-21T07:42:37.354456+0000","last_became_active":"2024-02-21T07:42:01.933841+0000","last_became_peered":"2024-02-21T07:42:01.933841+0000","last_unstale":"2024-02-21T07:42:37.354456+0000","last_undegraded":"2024-02-21T07:42:37.354456+0000","last_fullsized":"2024-02-21T07:42:37.354456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992564+0000","last_change":"2024-02-21T07:42:07.018134+0000","last_active":"2024-02-21T07:42:07.992564+0000","last_peered":"2024-02-21T07:42:07.992564+0000","last_clean":"2024-02-21T07:42:07.992564+0000","last_became_active":"2024-02-21T07:42:07.017670+0000","last_became_peered":"2024-02-21T07:42:07.017670+0000","last_unstale":"2024-02-21T07:42:07.992564+0000","last_undegraded":"2024-02-21T07:42:07.992564+0000","last_fullsized":"2024-02-21T07:42:07.992564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113034+0000","last_change":"2024-02-21T07:42:02.962279+0000","last_active":"2024-02-21T07:42:08.113034+0000","last_peered":"2024-02-21T07:42:08.113034+0000","last_clean":"2024-02-21T07:42:08.113034+0000","last_became_active":"2024-02-21T07:42:02.961965+0000","last_became_peered":"2024-02-21T07:42:02.961965+0000","last_unstale":"2024-02-21T07:42:08.113034+0000","last_undegraded":"2024-02-21T07:42:08.113034+0000","last_fullsized":"2024-02-21T07:42:08.113034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'5","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:37.315985+0000","last_change":"2024-02-21T07:42:01.948478+0000","last_active":"2024-02-21T07:42:37.315985+0000","last_peered":"2024-02-21T07:42:37.315985+0000","last_clean":"2024-02-21T07:42:37.315985+0000","last_became_active":"2024-02-21T07:42:01.948184+0000","last_became_peered":"2024-02-21T07:42:01.948184+0000","last_unstale":"2024-02-21T07:42:37.315985+0000","last_undegraded":"2024-02-21T07:42:37.315985+0000","last_fullsized":"2024-02-21T07:42:37.315985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993308+0000","last_change":"2024-02-21T07:42:07.124759+0000","last_active":"2024-02-21T07:42:07.993308+0000","last_peered":"2024-02-21T07:42:07.993308+0000","last_clean":"2024-02-21T07:42:07.993308+0000","last_became_active":"2024-02-21T07:42:07.124275+0000","last_became_peered":"2024-02-21T07:42:07.124275+0000","last_unstale":"2024-02-21T07:42:07.993308+0000","last_undegraded":"2024-02-21T07:42:07.993308+0000","last_fullsized":"2024-02-21T07:42:07.993308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.991454+0000","last_change":"2024-02-21T07:42:02.961213+0000","last_active":"2024-02-21T07:42:07.991454+0000","last_peered":"2024-02-21T07:42:07.991454+0000","last_clean":"2024-02-21T07:42:07.991454+0000","last_became_active":"2024-02-21T07:42:02.960477+0000","last_became_peered":"2024-02-21T07:42:02.960477+0000","last_unstale":"2024-02-21T07:42:07.991454+0000","last_undegraded":"2024-02-21T07:42:07.991454+0000","last_fullsized":"2024-02-21T07:42:07.991454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:31.115599+0000","last_change":"2024-02-21T07:42:01.928302+0000","last_active":"2024-02-21T07:42:31.115599+0000","last_peered":"2024-02-21T07:42:31.115599+0000","last_clean":"2024-02-21T07:42:31.115599+0000","last_became_active":"2024-02-21T07:42:01.927234+0000","last_became_peered":"2024-02-21T07:42:01.927234+0000","last_unstale":"2024-02-21T07:42:31.115599+0000","last_undegraded":"2024-02-21T07:42:31.115599+0000","last_fullsized":"2024-02-21T07:42:31.115599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113596+0000","last_change":"2024-02-21T07:42:07.124715+0000","last_active":"2024-02-21T07:42:08.113596+0000","last_peered":"2024-02-21T07:42:08.113596+0000","last_clean":"2024-02-21T07:42:08.113596+0000","last_became_active":"2024-02-21T07:42:07.124248+0000","last_became_peered":"2024-02-21T07:42:07.124248+0000","last_unstale":"2024-02-21T07:42:08.113596+0000","last_undegraded":"2024-02-21T07:42:08.113596+0000","last_fullsized":"2024-02-21T07:42:08.113596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:17:21.721728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996414+0000","last_change":"2024-02-21T07:42:02.971762+0000","last_active":"2024-02-21T07:42:07.996414+0000","last_peered":"2024-02-21T07:42:07.996414+0000","last_clean":"2024-02-21T07:42:07.996414+0000","last_became_active":"2024-02-21T07:42:02.970032+0000","last_became_peered":"2024-02-21T07:42:02.970032+0000","last_unstale":"2024-02-21T07:42:07.996414+0000","last_undegraded":"2024-02-21T07:42:07.996414+0000","last_fullsized":"2024-02-21T07:42:07.996414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'6","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.311057+0000","last_change":"2024-02-21T07:42:01.932968+0000","last_active":"2024-02-21T07:42:32.311057+0000","last_peered":"2024-02-21T07:42:32.311057+0000","last_clean":"2024-02-21T07:42:32.311057+0000","last_became_active":"2024-02-21T07:42:01.932620+0000","last_became_peered":"2024-02-21T07:42:01.932620+0000","last_unstale":"2024-02-21T07:42:32.311057+0000","last_undegraded":"2024-02-21T07:42:32.311057+0000","last_fullsized":"2024-02-21T07:42:32.311057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124899+0000","last_change":"2024-02-21T07:41:57.883808+0000","last_active":"2024-02-21T07:42:10.124899+0000","last_peered":"2024-02-21T07:42:10.124899+0000","last_clean":"2024-02-21T07:42:10.124899+0000","last_became_active":"2024-02-21T07:41:57.883530+0000","last_became_peered":"2024-02-21T07:41:57.883530+0000","last_unstale":"2024-02-21T07:42:10.124899+0000","last_undegraded":"2024-02-21T07:42:10.124899+0000","last_fullsized":"2024-02-21T07:42:10.124899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_clean_scrub_stamp":"2024-02-21T07:41:56.862963+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:09:51.756066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.492525+0000","last_change":"2024-02-21T07:42:07.011954+0000","last_active":"2024-02-21T07:42:10.492525+0000","last_peered":"2024-02-21T07:42:10.492525+0000","last_clean":"2024-02-21T07:42:10.492525+0000","last_became_active":"2024-02-21T07:42:07.011654+0000","last_became_peered":"2024-02-21T07:42:07.011654+0000","last_unstale":"2024-02-21T07:42:10.492525+0000","last_undegraded":"2024-02-21T07:42:10.492525+0000","last_fullsized":"2024-02-21T07:42:10.492525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125300+0000","last_change":"2024-02-21T07:42:02.956569+0000","last_active":"2024-02-21T07:42:10.125300+0000","last_peered":"2024-02-21T07:42:10.125300+0000","last_clean":"2024-02-21T07:42:10.125300+0000","last_became_active":"2024-02-21T07:42:02.956232+0000","last_became_peered":"2024-02-21T07:42:02.956232+0000","last_unstale":"2024-02-21T07:42:10.125300+0000","last_undegraded":"2024-02-21T07:42:10.125300+0000","last_fullsized":"2024-02-21T07:42:10.125300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'6","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:37.313506+0000","last_change":"2024-02-21T07:42:01.926736+0000","last_active":"2024-02-21T07:42:37.313506+0000","last_peered":"2024-02-21T07:42:37.313506+0000","last_clean":"2024-02-21T07:42:37.313506+0000","last_became_active":"2024-02-21T07:42:01.926454+0000","last_became_peered":"2024-02-21T07:42:01.926454+0000","last_unstale":"2024-02-21T07:42:37.313506+0000","last_undegraded":"2024-02-21T07:42:37.313506+0000","last_fullsized":"2024-02-21T07:42:37.313506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186824+0000","last_change":"2024-02-21T07:42:07.003371+0000","last_active":"2024-02-21T07:42:08.186824+0000","last_peered":"2024-02-21T07:42:08.186824+0000","last_clean":"2024-02-21T07:42:08.186824+0000","last_became_active":"2024-02-21T07:42:07.002940+0000","last_became_peered":"2024-02-21T07:42:07.002940+0000","last_unstale":"2024-02-21T07:42:08.186824+0000","last_undegraded":"2024-02-21T07:42:08.186824+0000","last_fullsized":"2024-02-21T07:42:08.186824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:17.859796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125133+0000","last_change":"2024-02-21T07:42:02.976255+0000","last_active":"2024-02-21T07:42:10.125133+0000","last_peered":"2024-02-21T07:42:10.125133+0000","last_clean":"2024-02-21T07:42:10.125133+0000","last_became_active":"2024-02-21T07:42:02.975927+0000","last_became_peered":"2024-02-21T07:42:02.975927+0000","last_unstale":"2024-02-21T07:42:10.125133+0000","last_undegraded":"2024-02-21T07:42:10.125133+0000","last_fullsized":"2024-02-21T07:42:10.125133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.302904+0000","last_change":"2024-02-21T07:42:01.932488+0000","last_active":"2024-02-21T07:42:32.302904+0000","last_peered":"2024-02-21T07:42:32.302904+0000","last_clean":"2024-02-21T07:42:32.302904+0000","last_became_active":"2024-02-21T07:42:01.932131+0000","last_became_peered":"2024-02-21T07:42:01.932131+0000","last_unstale":"2024-02-21T07:42:32.302904+0000","last_undegraded":"2024-02-21T07:42:32.302904+0000","last_fullsized":"2024-02-21T07:42:32.302904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292501+0000","last_change":"2024-02-21T07:42:07.017329+0000","last_active":"2024-02-21T07:42:08.292501+0000","last_peered":"2024-02-21T07:42:08.292501+0000","last_clean":"2024-02-21T07:42:08.292501+0000","last_became_active":"2024-02-21T07:42:07.016916+0000","last_became_peered":"2024-02-21T07:42:07.016916+0000","last_unstale":"2024-02-21T07:42:08.292501+0000","last_undegraded":"2024-02-21T07:42:08.292501+0000","last_fullsized":"2024-02-21T07:42:08.292501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125268+0000","last_change":"2024-02-21T07:42:02.959157+0000","last_active":"2024-02-21T07:42:10.125268+0000","last_peered":"2024-02-21T07:42:10.125268+0000","last_clean":"2024-02-21T07:42:10.125268+0000","last_became_active":"2024-02-21T07:42:02.958593+0000","last_became_peered":"2024-02-21T07:42:02.958593+0000","last_unstale":"2024-02-21T07:42:10.125268+0000","last_undegraded":"2024-02-21T07:42:10.125268+0000","last_fullsized":"2024-02-21T07:42:10.125268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:55.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.315527+0000","last_change":"2024-02-21T07:42:01.949434+0000","last_active":"2024-02-21T07:42:32.315527+0000","last_peered":"2024-02-21T07:42:32.315527+0000","last_clean":"2024-02-21T07:42:32.315527+0000","last_became_active":"2024-02-21T07:42:01.948805+0000","last_became_peered":"2024-02-21T07:42:01.948805+0000","last_unstale":"2024-02-21T07:42:32.315527+0000","last_undegraded":"2024-02-21T07:42:32.315527+0000","last_fullsized":"2024-02-21T07:42:32.315527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.112966+0000","last_change":"2024-02-21T07:42:07.003190+0000","last_active":"2024-02-21T07:42:08.112966+0000","last_peered":"2024-02-21T07:42:08.112966+0000","last_clean":"2024-02-21T07:42:08.112966+0000","last_became_active":"2024-02-21T07:42:07.002780+0000","last_became_peered":"2024-02-21T07:42:07.002780+0000","last_unstale":"2024-02-21T07:42:08.112966+0000","last_undegraded":"2024-02-21T07:42:08.112966+0000","last_fullsized":"2024-02-21T07:42:08.112966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192778+0000","last_change":"2024-02-21T07:42:02.959569+0000","last_active":"2024-02-21T07:42:09.192778+0000","last_peered":"2024-02-21T07:42:09.192778+0000","last_clean":"2024-02-21T07:42:09.192778+0000","last_became_active":"2024-02-21T07:42:02.959146+0000","last_became_peered":"2024-02-21T07:42:02.959146+0000","last_unstale":"2024-02-21T07:42:09.192778+0000","last_undegraded":"2024-02-21T07:42:09.192778+0000","last_fullsized":"2024-02-21T07:42:09.192778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.112889+0000","last_change":"2024-02-21T07:42:01.926878+0000","last_active":"2024-02-21T07:42:32.112889+0000","last_peered":"2024-02-21T07:42:32.112889+0000","last_clean":"2024-02-21T07:42:32.112889+0000","last_became_active":"2024-02-21T07:42:01.926212+0000","last_became_peered":"2024-02-21T07:42:01.926212+0000","last_unstale":"2024-02-21T07:42:32.112889+0000","last_undegraded":"2024-02-21T07:42:32.112889+0000","last_fullsized":"2024-02-21T07:42:32.112889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113080+0000","last_change":"2024-02-21T07:42:07.017443+0000","last_active":"2024-02-21T07:42:08.113080+0000","last_peered":"2024-02-21T07:42:08.113080+0000","last_clean":"2024-02-21T07:42:08.113080+0000","last_became_active":"2024-02-21T07:42:07.016918+0000","last_became_peered":"2024-02-21T07:42:07.016918+0000","last_unstale":"2024-02-21T07:42:08.113080+0000","last_undegraded":"2024-02-21T07:42:08.113080+0000","last_fullsized":"2024-02-21T07:42:08.113080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:49:35.717727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113122+0000","last_change":"2024-02-21T07:42:02.965178+0000","last_active":"2024-02-21T07:42:08.113122+0000","last_peered":"2024-02-21T07:42:08.113122+0000","last_clean":"2024-02-21T07:42:08.113122+0000","last_became_active":"2024-02-21T07:42:02.964846+0000","last_became_peered":"2024-02-21T07:42:02.964846+0000","last_unstale":"2024-02-21T07:42:08.113122+0000","last_undegraded":"2024-02-21T07:42:08.113122+0000","last_fullsized":"2024-02-21T07:42:08.113122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'17","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.301994+0000","last_change":"2024-02-21T07:42:01.946183+0000","last_active":"2024-02-21T07:42:32.301994+0000","last_peered":"2024-02-21T07:42:32.301994+0000","last_clean":"2024-02-21T07:42:32.301994+0000","last_became_active":"2024-02-21T07:42:01.945960+0000","last_became_peered":"2024-02-21T07:42:01.945960+0000","last_unstale":"2024-02-21T07:42:32.301994+0000","last_undegraded":"2024-02-21T07:42:32.301994+0000","last_fullsized":"2024-02-21T07:42:32.301994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993395+0000","last_change":"2024-02-21T07:42:07.021166+0000","last_active":"2024-02-21T07:42:07.993395+0000","last_peered":"2024-02-21T07:42:07.993395+0000","last_clean":"2024-02-21T07:42:07.993395+0000","last_became_active":"2024-02-21T07:42:07.017128+0000","last_became_peered":"2024-02-21T07:42:07.017128+0000","last_unstale":"2024-02-21T07:42:07.993395+0000","last_undegraded":"2024-02-21T07:42:07.993395+0000","last_fullsized":"2024-02-21T07:42:07.993395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124773+0000","last_change":"2024-02-21T07:42:02.960144+0000","last_active":"2024-02-21T07:42:10.124773+0000","last_peered":"2024-02-21T07:42:10.124773+0000","last_clean":"2024-02-21T07:42:10.124773+0000","last_became_active":"2024-02-21T07:42:02.959714+0000","last_became_peered":"2024-02-21T07:42:02.959714+0000","last_unstale":"2024-02-21T07:42:10.124773+0000","last_undegraded":"2024-02-21T07:42:10.124773+0000","last_fullsized":"2024-02-21T07:42:10.124773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:37.316664+0000","last_change":"2024-02-21T07:42:01.930429+0000","last_active":"2024-02-21T07:42:37.316664+0000","last_peered":"2024-02-21T07:42:37.316664+0000","last_clean":"2024-02-21T07:42:37.316664+0000","last_became_active":"2024-02-21T07:42:01.930076+0000","last_became_peered":"2024-02-21T07:42:01.930076+0000","last_unstale":"2024-02-21T07:42:37.316664+0000","last_undegraded":"2024-02-21T07:42:37.316664+0000","last_fullsized":"2024-02-21T07:42:37.316664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417833+0000","last_change":"2024-02-21T07:42:07.025234+0000","last_active":"2024-02-21T07:42:10.417833+0000","last_peered":"2024-02-21T07:42:10.417833+0000","last_clean":"2024-02-21T07:42:10.417833+0000","last_became_active":"2024-02-21T07:42:07.024452+0000","last_became_peered":"2024-02-21T07:42:07.024452+0000","last_unstale":"2024-02-21T07:42:10.417833+0000","last_undegraded":"2024-02-21T07:42:10.417833+0000","last_fullsized":"2024-02-21T07:42:10.417833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124980+0000","last_change":"2024-02-21T07:42:02.958015+0000","last_active":"2024-02-21T07:42:10.124980+0000","last_peered":"2024-02-21T07:42:10.124980+0000","last_clean":"2024-02-21T07:42:10.124980+0000","last_became_active":"2024-02-21T07:42:02.956436+0000","last_became_peered":"2024-02-21T07:42:02.956436+0000","last_unstale":"2024-02-21T07:42:10.124980+0000","last_undegraded":"2024-02-21T07:42:10.124980+0000","last_fullsized":"2024-02-21T07:42:10.124980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:39.265082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.312216+0000","last_change":"2024-02-21T07:42:01.943079+0000","last_active":"2024-02-21T07:42:32.312216+0000","last_peered":"2024-02-21T07:42:32.312216+0000","last_clean":"2024-02-21T07:42:32.312216+0000","last_became_active":"2024-02-21T07:42:01.942831+0000","last_became_peered":"2024-02-21T07:42:01.942831+0000","last_unstale":"2024-02-21T07:42:32.312216+0000","last_undegraded":"2024-02-21T07:42:32.312216+0000","last_fullsized":"2024-02-21T07:42:32.312216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192731+0000","last_change":"2024-02-21T07:42:07.015228+0000","last_active":"2024-02-21T07:42:09.192731+0000","last_peered":"2024-02-21T07:42:09.192731+0000","last_clean":"2024-02-21T07:42:09.192731+0000","last_became_active":"2024-02-21T07:42:07.014798+0000","last_became_peered":"2024-02-21T07:42:07.014798+0000","last_unstale":"2024-02-21T07:42:09.192731+0000","last_undegraded":"2024-02-21T07:42:09.192731+0000","last_fullsized":"2024-02-21T07:42:09.192731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.991844+0000","last_change":"2024-02-21T07:42:02.965287+0000","last_active":"2024-02-21T07:42:07.991844+0000","last_peered":"2024-02-21T07:42:07.991844+0000","last_clean":"2024-02-21T07:42:07.991844+0000","last_became_active":"2024-02-21T07:42:02.960780+0000","last_became_peered":"2024-02-21T07:42:02.960780+0000","last_unstale":"2024-02-21T07:42:07.991844+0000","last_undegraded":"2024-02-21T07:42:07.991844+0000","last_fullsized":"2024-02-21T07:42:07.991844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.317068+0000","last_change":"2024-02-21T07:42:01.932401+0000","last_active":"2024-02-21T07:42:32.317068+0000","last_peered":"2024-02-21T07:42:32.317068+0000","last_clean":"2024-02-21T07:42:32.317068+0000","last_became_active":"2024-02-21T07:42:01.932108+0000","last_became_peered":"2024-02-21T07:42:01.932108+0000","last_unstale":"2024-02-21T07:42:32.317068+0000","last_undegraded":"2024-02-21T07:42:32.317068+0000","last_fullsized":"2024-02-21T07:42:32.317068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113526+0000","last_change":"2024-02-21T07:42:07.018725+0000","last_active":"2024-02-21T07:42:08.113526+0000","last_peered":"2024-02-21T07:42:08.113526+0000","last_clean":"2024-02-21T07:42:08.113526+0000","last_became_active":"2024-02-21T07:42:07.018322+0000","last_became_peered":"2024-02-21T07:42:07.018322+0000","last_unstale":"2024-02-21T07:42:08.113526+0000","last_undegraded":"2024-02-21T07:42:08.113526+0000","last_fullsized":"2024-02-21T07:42:08.113526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:04:05.896966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993773+0000","last_change":"2024-02-21T07:42:02.963384+0000","last_active":"2024-02-21T07:42:07.993773+0000","last_peered":"2024-02-21T07:42:07.993773+0000","last_clean":"2024-02-21T07:42:07.993773+0000","last_became_active":"2024-02-21T07:42:02.963098+0000","last_became_peered":"2024-02-21T07:42:02.963098+0000","last_unstale":"2024-02-21T07:42:07.993773+0000","last_undegraded":"2024-02-21T07:42:07.993773+0000","last_fullsized":"2024-02-21T07:42:07.993773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"29'26","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:38.320875+0000","last_change":"2024-02-21T07:42:01.936472+0000","last_active":"2024-02-21T07:42:38.320875+0000","last_peered":"2024-02-21T07:42:38.320875+0000","last_clean":"2024-02-21T07:42:38.320875+0000","last_became_active":"2024-02-21T07:42:01.936181+0000","last_became_peered":"2024-02-21T07:42:01.936181+0000","last_unstale":"2024-02-21T07:42:38.320875+0000","last_undegraded":"2024-02-21T07:42:38.320875+0000","last_fullsized":"2024-02-21T07:42:38.320875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45675,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":54,"num_write":28,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416924+0000","last_change":"2024-02-21T07:42:07.013938+0000","last_active":"2024-02-21T07:42:10.416924+0000","last_peered":"2024-02-21T07:42:10.416924+0000","last_clean":"2024-02-21T07:42:10.416924+0000","last_became_active":"2024-02-21T07:42:07.013409+0000","last_became_peered":"2024-02-21T07:42:07.013409+0000","last_unstale":"2024-02-21T07:42:10.416924+0000","last_undegraded":"2024-02-21T07:42:10.416924+0000","last_fullsized":"2024-02-21T07:42:10.416924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:52:00.302670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186924+0000","last_change":"2024-02-21T07:42:02.960084+0000","last_active":"2024-02-21T07:42:08.186924+0000","last_peered":"2024-02-21T07:42:08.186924+0000","last_clean":"2024-02-21T07:42:08.186924+0000","last_became_active":"2024-02-21T07:42:02.959610+0000","last_became_peered":"2024-02-21T07:42:02.959610+0000","last_unstale":"2024-02-21T07:42:08.186924+0000","last_undegraded":"2024-02-21T07:42:08.186924+0000","last_fullsized":"2024-02-21T07:42:08.186924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.127720+0000","last_change":"2024-02-21T07:42:01.946668+0000","last_active":"2024-02-21T07:42:32.127720+0000","last_peered":"2024-02-21T07:42:32.127720+0000","last_clean":"2024-02-21T07:42:32.127720+0000","last_became_active":"2024-02-21T07:42:01.946454+0000","last_became_peered":"2024-02-21T07:42:01.946454+0000","last_unstale":"2024-02-21T07:42:32.127720+0000","last_undegraded":"2024-02-21T07:42:32.127720+0000","last_fullsized":"2024-02-21T07:42:32.127720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157319+0000","last_change":"2024-02-21T07:42:07.013560+0000","last_active":"2024-02-21T07:42:10.157319+0000","last_peered":"2024-02-21T07:42:10.157319+0000","last_clean":"2024-02-21T07:42:10.157319+0000","last_became_active":"2024-02-21T07:42:07.012952+0000","last_became_peered":"2024-02-21T07:42:07.012952+0000","last_unstale":"2024-02-21T07:42:10.157319+0000","last_undegraded":"2024-02-21T07:42:10.157319+0000","last_fullsized":"2024-02-21T07:42:10.157319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293193+0000","last_change":"2024-02-21T07:42:02.969725+0000","last_active":"2024-02-21T07:42:08.293193+0000","last_peered":"2024-02-21T07:42:08.293193+0000","last_clean":"2024-02-21T07:42:08.293193+0000","last_became_active":"2024-02-21T07:42:02.969125+0000","last_became_peered":"2024-02-21T07:42:02.969125+0000","last_unstale":"2024-02-21T07:42:08.293193+0000","last_undegraded":"2024-02-21T07:42:08.293193+0000","last_fullsized":"2024-02-21T07:42:08.293193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.316300+0000","last_change":"2024-02-21T07:42:01.931035+0000","last_active":"2024-02-21T07:42:32.316300+0000","last_peered":"2024-02-21T07:42:32.316300+0000","last_clean":"2024-02-21T07:42:32.316300+0000","last_became_active":"2024-02-21T07:42:01.930665+0000","last_became_peered":"2024-02-21T07:42:01.930665+0000","last_unstale":"2024-02-21T07:42:32.316300+0000","last_undegraded":"2024-02-21T07:42:32.316300+0000","last_fullsized":"2024-02-21T07:42:32.316300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416501+0000","last_change":"2024-02-21T07:42:07.022730+0000","last_active":"2024-02-21T07:42:10.416501+0000","last_peered":"2024-02-21T07:42:10.416501+0000","last_clean":"2024-02-21T07:42:10.416501+0000","last_became_active":"2024-02-21T07:42:07.022349+0000","last_became_peered":"2024-02-21T07:42:07.022349+0000","last_unstale":"2024-02-21T07:42:10.416501+0000","last_undegraded":"2024-02-21T07:42:10.416501+0000","last_fullsized":"2024-02-21T07:42:10.416501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:17.859796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.187028+0000","last_change":"2024-02-21T07:42:02.956416+0000","last_active":"2024-02-21T07:42:08.187028+0000","last_peered":"2024-02-21T07:42:08.187028+0000","last_clean":"2024-02-21T07:42:08.187028+0000","last_became_active":"2024-02-21T07:42:02.956098+0000","last_became_peered":"2024-02-21T07:42:02.956098+0000","last_unstale":"2024-02-21T07:42:08.187028+0000","last_undegraded":"2024-02-21T07:42:08.187028+0000","last_fullsized":"2024-02-21T07:42:08.187028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:38.314506+0000","last_change":"2024-02-21T07:42:01.937810+0000","last_active":"2024-02-21T07:42:38.314506+0000","last_peered":"2024-02-21T07:42:38.314506+0000","last_clean":"2024-02-21T07:42:38.314506+0000","last_became_active":"2024-02-21T07:42:01.937555+0000","last_became_peered":"2024-02-21T07:42:01.937555+0000","last_unstale":"2024-02-21T07:42:38.314506+0000","last_undegraded":"2024-02-21T07:42:38.314506+0000","last_fullsized":"2024-02-21T07:42:38.314506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996295+0000","last_change":"2024-02-21T07:42:07.013284+0000","last_active":"2024-02-21T07:42:07.996295+0000","last_peered":"2024-02-21T07:42:07.996295+0000","last_clean":"2024-02-21T07:42:07.996295+0000","last_became_active":"2024-02-21T07:42:07.012412+0000","last_became_peered":"2024-02-21T07:42:07.012412+0000","last_unstale":"2024-02-21T07:42:07.996295+0000","last_undegraded":"2024-02-21T07:42:07.996295+0000","last_fullsized":"2024-02-21T07:42:07.996295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292443+0000","last_change":"2024-02-21T07:42:07.016945+0000","last_active":"2024-02-21T07:42:08.292443+0000","last_peered":"2024-02-21T07:42:08.292443+0000","last_clean":"2024-02-21T07:42:08.292443+0000","last_became_active":"2024-02-21T07:42:07.016572+0000","last_became_peered":"2024-02-21T07:42:07.016572+0000","last_unstale":"2024-02-21T07:42:08.292443+0000","last_undegraded":"2024-02-21T07:42:08.292443+0000","last_fullsized":"2024-02-21T07:42:08.292443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416578+0000","last_change":"2024-02-21T07:42:02.977972+0000","last_active":"2024-02-21T07:42:10.416578+0000","last_peered":"2024-02-21T07:42:10.416578+0000","last_clean":"2024-02-21T07:42:10.416578+0000","last_became_active":"2024-02-21T07:42:02.977632+0000","last_became_peered":"2024-02-21T07:42:02.977632+0000","last_unstale":"2024-02-21T07:42:10.416578+0000","last_undegraded":"2024-02-21T07:42:10.416578+0000","last_fullsized":"2024-02-21T07:42:10.416578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.304904+0000","last_change":"2024-02-21T07:42:01.930402+0000","last_active":"2024-02-21T07:42:32.304904+0000","last_peered":"2024-02-21T07:42:32.304904+0000","last_clean":"2024-02-21T07:42:32.304904+0000","last_became_active":"2024-02-21T07:42:01.930084+0000","last_became_peered":"2024-02-21T07:42:01.930084+0000","last_unstale":"2024-02-21T07:42:32.304904+0000","last_undegraded":"2024-02-21T07:42:32.304904+0000","last_fullsized":"2024-02-21T07:42:32.304904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192889+0000","last_change":"2024-02-21T07:42:07.016859+0000","last_active":"2024-02-21T07:42:09.192889+0000","last_peered":"2024-02-21T07:42:09.192889+0000","last_clean":"2024-02-21T07:42:09.192889+0000","last_became_active":"2024-02-21T07:42:07.016372+0000","last_became_peered":"2024-02-21T07:42:07.016372+0000","last_unstale":"2024-02-21T07:42:09.192889+0000","last_undegraded":"2024-02-21T07:42:09.192889+0000","last_fullsized":"2024-02-21T07:42:09.192889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995924+0000","last_change":"2024-02-21T07:42:02.948576+0000","last_active":"2024-02-21T07:42:07.995924+0000","last_peered":"2024-02-21T07:42:07.995924+0000","last_clean":"2024-02-21T07:42:07.995924+0000","last_became_active":"2024-02-21T07:42:02.947666+0000","last_became_peered":"2024-02-21T07:42:02.947666+0000","last_unstale":"2024-02-21T07:42:07.995924+0000","last_undegraded":"2024-02-21T07:42:07.995924+0000","last_fullsized":"2024-02-21T07:42:07.995924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:31.120967+0000","last_change":"2024-02-21T07:42:01.929126+0000","last_active":"2024-02-21T07:42:31.120967+0000","last_peered":"2024-02-21T07:42:31.120967+0000","last_clean":"2024-02-21T07:42:31.120967+0000","last_became_active":"2024-02-21T07:42:01.928667+0000","last_became_peered":"2024-02-21T07:42:01.928667+0000","last_unstale":"2024-02-21T07:42:31.120967+0000","last_undegraded":"2024-02-21T07:42:31.120967+0000","last_fullsized":"2024-02-21T07:42:31.120967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.128601+0000","last_change":"2024-02-21T07:42:01.933903+0000","last_active":"2024-02-21T07:42:32.128601+0000","last_peered":"2024-02-21T07:42:32.128601+0000","last_clean":"2024-02-21T07:42:32.128601+0000","last_became_active":"2024-02-21T07:42:01.933578+0000","last_became_peered":"2024-02-21T07:42:01.933578+0000","last_unstale":"2024-02-21T07:42:32.128601+0000","last_undegraded":"2024-02-21T07:42:32.128601+0000","last_fullsized":"2024-02-21T07:42:32.128601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113230+0000","last_change":"2024-02-21T07:42:02.964660+0000","last_active":"2024-02-21T07:42:08.113230+0000","last_peered":"2024-02-21T07:42:08.113230+0000","last_clean":"2024-02-21T07:42:08.113230+0000","last_became_active":"2024-02-21T07:42:02.964389+0000","last_became_peered":"2024-02-21T07:42:02.964389+0000","last_unstale":"2024-02-21T07:42:08.113230+0000","last_undegraded":"2024-02-21T07:42:08.113230+0000","last_fullsized":"2024-02-21T07:42:08.113230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840629+0000","last_change":"2024-02-21T07:42:07.015720+0000","last_active":"2024-02-21T07:42:09.840629+0000","last_peered":"2024-02-21T07:42:09.840629+0000","last_clean":"2024-02-21T07:42:09.840629+0000","last_became_active":"2024-02-21T07:42:07.015315+0000","last_became_peered":"2024-02-21T07:42:07.015315+0000","last_unstale":"2024-02-21T07:42:09.840629+0000","last_undegraded":"2024-02-21T07:42:09.840629+0000","last_fullsized":"2024-02-21T07:42:09.840629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:37.313483+0000","last_change":"2024-02-21T07:42:01.927978+0000","last_active":"2024-02-21T07:42:37.313483+0000","last_peered":"2024-02-21T07:42:37.313483+0000","last_clean":"2024-02-21T07:42:37.313483+0000","last_became_active":"2024-02-21T07:42:01.927661+0000","last_became_peered":"2024-02-21T07:42:01.927661+0000","last_unstale":"2024-02-21T07:42:37.313483+0000","last_undegraded":"2024-02-21T07:42:37.313483+0000","last_fullsized":"2024-02-21T07:42:37.313483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993701+0000","last_change":"2024-02-21T07:42:02.971175+0000","last_active":"2024-02-21T07:42:07.993701+0000","last_peered":"2024-02-21T07:42:07.993701+0000","last_clean":"2024-02-21T07:42:07.993701+0000","last_became_active":"2024-02-21T07:42:02.970886+0000","last_became_peered":"2024-02-21T07:42:02.970886+0000","last_unstale":"2024-02-21T07:42:07.993701+0000","last_undegraded":"2024-02-21T07:42:07.993701+0000","last_fullsized":"2024-02-21T07:42:07.993701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840892+0000","last_change":"2024-02-21T07:42:07.003267+0000","last_active":"2024-02-21T07:42:09.840892+0000","last_peered":"2024-02-21T07:42:09.840892+0000","last_clean":"2024-02-21T07:42:09.840892+0000","last_became_active":"2024-02-21T07:42:07.002824+0000","last_became_peered":"2024-02-21T07:42:07.002824+0000","last_unstale":"2024-02-21T07:42:09.840892+0000","last_undegraded":"2024-02-21T07:42:09.840892+0000","last_fullsized":"2024-02-21T07:42:09.840892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192386+0000","last_change":"2024-02-21T07:42:02.960884+0000","last_active":"2024-02-21T07:42:09.192386+0000","last_peered":"2024-02-21T07:42:09.192386+0000","last_clean":"2024-02-21T07:42:09.192386+0000","last_became_active":"2024-02-21T07:42:02.960515+0000","last_became_peered":"2024-02-21T07:42:02.960515+0000","last_unstale":"2024-02-21T07:42:09.192386+0000","last_undegraded":"2024-02-21T07:42:09.192386+0000","last_fullsized":"2024-02-21T07:42:09.192386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840732+0000","last_change":"2024-02-21T07:42:02.960807+0000","last_active":"2024-02-21T07:42:09.840732+0000","last_peered":"2024-02-21T07:42:09.840732+0000","last_clean":"2024-02-21T07:42:09.840732+0000","last_became_active":"2024-02-21T07:42:02.960478+0000","last_became_peered":"2024-02-21T07:42:02.960478+0000","last_unstale":"2024-02-21T07:42:09.840732+0000","last_undegraded":"2024-02-21T07:42:09.840732+0000","last_fullsized":"2024-02-21T07:42:09.840732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840455+0000","last_change":"2024-02-21T07:42:02.966666+0000","last_active":"2024-02-21T07:42:09.840455+0000","last_peered":"2024-02-21T07:42:09.840455+0000","last_clean":"2024-02-21T07:42:09.840455+0000","last_became_active":"2024-02-21T07:42:02.966350+0000","last_became_peered":"2024-02-21T07:42:02.966350+0000","last_unstale":"2024-02-21T07:42:09.840455+0000","last_undegraded":"2024-02-21T07:42:09.840455+0000","last_fullsized":"2024-02-21T07:42:09.840455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292232+0000","last_change":"2024-02-21T07:42:02.973149+0000","last_active":"2024-02-21T07:42:08.292232+0000","last_peered":"2024-02-21T07:42:08.292232+0000","last_clean":"2024-02-21T07:42:08.292232+0000","last_became_active":"2024-02-21T07:42:02.972869+0000","last_became_peered":"2024-02-21T07:42:02.972869+0000","last_unstale":"2024-02-21T07:42:08.292232+0000","last_undegraded":"2024-02-21T07:42:08.292232+0000","last_fullsized":"2024-02-21T07:42:08.292232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992632+0000","last_change":"2024-02-21T07:42:02.957623+0000","last_active":"2024-02-21T07:42:07.992632+0000","last_peered":"2024-02-21T07:42:07.992632+0000","last_clean":"2024-02-21T07:42:07.992632+0000","last_became_active":"2024-02-21T07:42:02.956527+0000","last_became_peered":"2024-02-21T07:42:02.956527+0000","last_unstale":"2024-02-21T07:42:07.992632+0000","last_undegraded":"2024-02-21T07:42:07.992632+0000","last_fullsized":"2024-02-21T07:42:07.992632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192705+0000","last_change":"2024-02-21T07:42:02.961369+0000","last_active":"2024-02-21T07:42:09.192705+0000","last_peered":"2024-02-21T07:42:09.192705+0000","last_clean":"2024-02-21T07:42:09.192705+0000","last_became_active":"2024-02-21T07:42:02.961075+0000","last_became_peered":"2024-02-21T07:42:02.961075+0000","last_unstale":"2024-02-21T07:42:09.192705+0000","last_undegraded":"2024-02-21T07:42:09.192705+0000","last_fullsized":"2024-02-21T07:42:09.192705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840881+0000","last_change":"2024-02-21T07:42:02.960461+0000","last_active":"2024-02-21T07:42:09.840881+0000","last_peered":"2024-02-21T07:42:09.840881+0000","last_clean":"2024-02-21T07:42:09.840881+0000","last_became_active":"2024-02-21T07:42:02.960168+0000","last_became_peered":"2024-02-21T07:42:02.960168+0000","last_unstale":"2024-02-21T07:42:09.840881+0000","last_undegraded":"2024-02-21T07:42:09.840881+0000","last_fullsized":"2024-02-21T07:42:09.840881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997823+0000","last_change":"2024-02-21T07:42:02.966173+0000","last_active":"2024-02-21T07:42:07.997823+0000","last_peered":"2024-02-21T07:42:07.997823+0000","last_clean":"2024-02-21T07:42:07.997823+0000","last_became_active":"2024-02-21T07:42:02.964280+0000","last_became_peered":"2024-02-21T07:42:02.964280+0000","last_unstale":"2024-02-21T07:42:07.997823+0000","last_undegraded":"2024-02-21T07:42:07.997823+0000","last_fullsized":"2024-02-21T07:42:07.997823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113001+0000","last_change":"2024-02-21T07:42:02.975012+0000","last_active":"2024-02-21T07:42:08.113001+0000","last_peered":"2024-02-21T07:42:08.113001+0000","last_clean":"2024-02-21T07:42:08.113001+0000","last_became_active":"2024-02-21T07:42:02.974682+0000","last_became_peered":"2024-02-21T07:42:02.974682+0000","last_unstale":"2024-02-21T07:42:08.113001+0000","last_undegraded":"2024-02-21T07:42:08.113001+0000","last_fullsized":"2024-02-21T07:42:08.113001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996451+0000","last_change":"2024-02-21T07:42:02.966976+0000","last_active":"2024-02-21T07:42:07.996451+0000","last_peered":"2024-02-21T07:42:07.996451+0000","last_clean":"2024-02-21T07:42:07.996451+0000","last_became_active":"2024-02-21T07:42:02.966422+0000","last_became_peered":"2024-02-21T07:42:02.966422+0000","last_unstale":"2024-02-21T07:42:07.996451+0000","last_undegraded":"2024-02-21T07:42:07.996451+0000","last_fullsized":"2024-02-21T07:42:07.996451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186750+0000","last_change":"2024-02-21T07:42:02.957398+0000","last_active":"2024-02-21T07:42:08.186750+0000","last_peered":"2024-02-21T07:42:08.186750+0000","last_clean":"2024-02-21T07:42:08.186750+0000","last_became_active":"2024-02-21T07:42:02.957115+0000","last_became_peered":"2024-02-21T07:42:02.957115+0000","last_unstale":"2024-02-21T07:42:08.186750+0000","last_undegraded":"2024-02-21T07:42:08.186750+0000","last_fullsized":"2024-02-21T07:42:08.186750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992415+0000","last_change":"2024-02-21T07:42:02.956114+0000","last_active":"2024-02-21T07:42:07.992415+0000","last_peered":"2024-02-21T07:42:07.992415+0000","last_clean":"2024-02-21T07:42:07.992415+0000","last_became_active":"2024-02-21T07:42:02.955476+0000","last_became_peered":"2024-02-21T07:42:02.955476+0000","last_unstale":"2024-02-21T07:42:07.992415+0000","last_undegraded":"2024-02-21T07:42:07.992415+0000","last_fullsized":"2024-02-21T07:42:07.992415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192545+0000","last_change":"2024-02-21T07:42:02.955604+0000","last_active":"2024-02-21T07:42:09.192545+0000","last_peered":"2024-02-21T07:42:09.192545+0000","last_clean":"2024-02-21T07:42:09.192545+0000","last_became_active":"2024-02-21T07:42:02.955327+0000","last_became_peered":"2024-02-21T07:42:02.955327+0000","last_unstale":"2024-02-21T07:42:09.192545+0000","last_undegraded":"2024-02-21T07:42:09.192545+0000","last_fullsized":"2024-02-21T07:42:09.192545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840939+0000","last_change":"2024-02-21T07:42:02.967092+0000","last_active":"2024-02-21T07:42:09.840939+0000","last_peered":"2024-02-21T07:42:09.840939+0000","last_clean":"2024-02-21T07:42:09.840939+0000","last_became_active":"2024-02-21T07:42:02.966845+0000","last_became_peered":"2024-02-21T07:42:02.966845+0000","last_unstale":"2024-02-21T07:42:09.840939+0000","last_undegraded":"2024-02-21T07:42:09.840939+0000","last_fullsized":"2024-02-21T07:42:09.840939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417187+0000","last_change":"2024-02-21T07:42:02.973535+0000","last_active":"2024-02-21T07:42:10.417187+0000","last_peered":"2024-02-21T07:42:10.417187+0000","last_clean":"2024-02-21T07:42:10.417187+0000","last_became_active":"2024-02-21T07:42:02.973202+0000","last_became_peered":"2024-02-21T07:42:02.973202+0000","last_unstale":"2024-02-21T07:42:10.417187+0000","last_undegraded":"2024-02-21T07:42:10.417187+0000","last_fullsized":"2024-02-21T07:42:10.417187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192968+0000","last_change":"2024-02-21T07:42:02.954398+0000","last_active":"2024-02-21T07:42:09.192968+0000","last_peered":"2024-02-21T07:42:09.192968+0000","last_clean":"2024-02-21T07:42:09.192968+0000","last_became_active":"2024-02-21T07:42:02.954099+0000","last_became_peered":"2024-02-21T07:42:02.954099+0000","last_unstale":"2024-02-21T07:42:09.192968+0000","last_undegraded":"2024-02-21T07:42:09.192968+0000","last_fullsized":"2024-02-21T07:42:09.192968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186572+0000","last_change":"2024-02-21T07:42:02.958214+0000","last_active":"2024-02-21T07:42:08.186572+0000","last_peered":"2024-02-21T07:42:08.186572+0000","last_clean":"2024-02-21T07:42:08.186572+0000","last_became_active":"2024-02-21T07:42:02.957885+0000","last_became_peered":"2024-02-21T07:42:02.957885+0000","last_unstale":"2024-02-21T07:42:08.186572+0000","last_undegraded":"2024-02-21T07:42:08.186572+0000","last_fullsized":"2024-02-21T07:42:08.186572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292117+0000","last_change":"2024-02-21T07:42:02.980607+0000","last_active":"2024-02-21T07:42:08.292117+0000","last_peered":"2024-02-21T07:42:08.292117+0000","last_clean":"2024-02-21T07:42:08.292117+0000","last_became_active":"2024-02-21T07:42:02.980239+0000","last_became_peered":"2024-02-21T07:42:02.980239+0000","last_unstale":"2024-02-21T07:42:08.292117+0000","last_undegraded":"2024-02-21T07:42:08.292117+0000","last_fullsized":"2024-02-21T07:42:08.292117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.291998+0000","last_change":"2024-02-21T07:42:02.972536+0000","last_active":"2024-02-21T07:42:08.291998+0000","last_peered":"2024-02-21T07:42:08.291998+0000","last_clean":"2024-02-21T07:42:08.291998+0000","last_became_active":"2024-02-21T07:42:02.972216+0000","last_became_peered":"2024-02-21T07:42:02.972216+0000","last_unstale":"2024-02-21T07:42:08.291998+0000","last_undegraded":"2024-02-21T07:42:08.291998+0000","last_fullsized":"2024-02-21T07:42:08.291998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992288+0000","last_change":"2024-02-21T07:42:02.958082+0000","last_active":"2024-02-21T07:42:07.992288+0000","last_peered":"2024-02-21T07:42:07.992288+0000","last_clean":"2024-02-21T07:42:07.992288+0000","last_became_active":"2024-02-21T07:42:02.957711+0000","last_became_peered":"2024-02-21T07:42:02.957711+0000","last_unstale":"2024-02-21T07:42:07.992288+0000","last_undegraded":"2024-02-21T07:42:07.992288+0000","last_fullsized":"2024-02-21T07:42:07.992288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157664+0000","last_change":"2024-02-21T07:42:02.957799+0000","last_active":"2024-02-21T07:42:10.157664+0000","last_peered":"2024-02-21T07:42:10.157664+0000","last_clean":"2024-02-21T07:42:10.157664+0000","last_became_active":"2024-02-21T07:42:02.957510+0000","last_became_peered":"2024-02-21T07:42:02.957510+0000","last_unstale":"2024-02-21T07:42:10.157664+0000","last_undegraded":"2024-02-21T07:42:10.157664+0000","last_fullsized":"2024-02-21T07:42:10.157664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125190+0000","last_change":"2024-02-21T07:42:02.962565+0000","last_active":"2024-02-21T07:42:10.125190+0000","last_peered":"2024-02-21T07:42:10.125190+0000","last_clean":"2024-02-21T07:42:10.125190+0000","last_became_active":"2024-02-21T07:42:02.962298+0000","last_became_peered":"2024-02-21T07:42:02.962298+0000","last_unstale":"2024-02-21T07:42:10.125190+0000","last_undegraded":"2024-02-21T07:42:10.125190+0000","last_fullsized":"2024-02-21T07:42:10.125190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413913+0000","last_change":"2024-02-21T07:42:02.961018+0000","last_active":"2024-02-21T07:42:10.413913+0000","last_peered":"2024-02-21T07:42:10.413913+0000","last_clean":"2024-02-21T07:42:10.413913+0000","last_became_active":"2024-02-21T07:42:02.960634+0000","last_became_peered":"2024-02-21T07:42:02.960634+0000","last_unstale":"2024-02-21T07:42:10.413913+0000","last_undegraded":"2024-02-21T07:42:10.413913+0000","last_fullsized":"2024-02-21T07:42:10.413913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.187102+0000","last_change":"2024-02-21T07:42:02.959426+0000","last_active":"2024-02-21T07:42:08.187102+0000","last_peered":"2024-02-21T07:42:08.187102+0000","last_clean":"2024-02-21T07:42:08.187102+0000","last_became_active":"2024-02-21T07:42:02.959021+0000","last_became_peered":"2024-02-21T07:42:02.959021+0000","last_unstale":"2024-02-21T07:42:08.187102+0000","last_undegraded":"2024-02-21T07:42:08.187102+0000","last_fullsized":"2024-02-21T07:42:08.187102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995727+0000","last_change":"2024-02-21T07:42:02.971151+0000","last_active":"2024-02-21T07:42:07.995727+0000","last_peered":"2024-02-21T07:42:07.995727+0000","last_clean":"2024-02-21T07:42:07.995727+0000","last_became_active":"2024-02-21T07:42:02.967323+0000","last_became_peered":"2024-02-21T07:42:02.967323+0000","last_unstale":"2024-02-21T07:42:07.995727+0000","last_undegraded":"2024-02-21T07:42:07.995727+0000","last_fullsized":"2024-02-21T07:42:07.995727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124824+0000","last_change":"2024-02-21T07:42:02.974767+0000","last_active":"2024-02-21T07:42:10.124824+0000","last_peered":"2024-02-21T07:42:10.124824+0000","last_clean":"2024-02-21T07:42:10.124824+0000","last_became_active":"2024-02-21T07:42:02.974292+0000","last_became_peered":"2024-02-21T07:42:02.974292+0000","last_unstale":"2024-02-21T07:42:10.124824+0000","last_undegraded":"2024-02-21T07:42:10.124824+0000","last_fullsized":"2024-02-21T07:42:10.124824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413730+0000","last_change":"2024-02-21T07:42:02.968079+0000","last_active":"2024-02-21T07:42:10.413730+0000","last_peered":"2024-02-21T07:42:10.413730+0000","last_clean":"2024-02-21T07:42:10.413730+0000","last_became_active":"2024-02-21T07:42:02.967767+0000","last_became_peered":"2024-02-21T07:42:02.967767+0000","last_unstale":"2024-02-21T07:42:10.413730+0000","last_undegraded":"2024-02-21T07:42:10.413730+0000","last_fullsized":"2024-02-21T07:42:10.413730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993396+0000","last_change":"2024-02-21T07:42:02.978031+0000","last_active":"2024-02-21T07:42:07.993396+0000","last_peered":"2024-02-21T07:42:07.993396+0000","last_clean":"2024-02-21T07:42:07.993396+0000","last_became_active":"2024-02-21T07:42:02.977704+0000","last_became_peered":"2024-02-21T07:42:02.977704+0000","last_unstale":"2024-02-21T07:42:07.993396+0000","last_undegraded":"2024-02-21T07:42:07.993396+0000","last_fullsized":"2024-02-21T07:42:07.993396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157552+0000","last_change":"2024-02-21T07:42:02.959959+0000","last_active":"2024-02-21T07:42:10.157552+0000","last_peered":"2024-02-21T07:42:10.157552+0000","last_clean":"2024-02-21T07:42:10.157552+0000","last_became_active":"2024-02-21T07:42:02.959655+0000","last_became_peered":"2024-02-21T07:42:02.959655+0000","last_unstale":"2024-02-21T07:42:10.157552+0000","last_undegraded":"2024-02-21T07:42:10.157552+0000","last_fullsized":"2024-02-21T07:42:10.157552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292334+0000","last_change":"2024-02-21T07:42:02.975851+0000","last_active":"2024-02-21T07:42:08.292334+0000","last_peered":"2024-02-21T07:42:08.292334+0000","last_clean":"2024-02-21T07:42:08.292334+0000","last_became_active":"2024-02-21T07:42:02.973848+0000","last_became_peered":"2024-02-21T07:42:02.973848+0000","last_unstale":"2024-02-21T07:42:08.292334+0000","last_undegraded":"2024-02-21T07:42:08.292334+0000","last_fullsized":"2024-02-21T07:42:08.292334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292889+0000","last_change":"2024-02-21T07:42:02.981681+0000","last_active":"2024-02-21T07:42:08.292889+0000","last_peered":"2024-02-21T07:42:08.292889+0000","last_clean":"2024-02-21T07:42:08.292889+0000","last_became_active":"2024-02-21T07:42:02.981324+0000","last_became_peered":"2024-02-21T07:42:02.981324+0000","last_unstale":"2024-02-21T07:42:08.292889+0000","last_undegraded":"2024-02-21T07:42:08.292889+0000","last_fullsized":"2024-02-21T07:42:08.292889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192896+0000","last_change":"2024-02-21T07:42:02.954466+0000","last_active":"2024-02-21T07:42:09.192896+0000","last_peered":"2024-02-21T07:42:09.192896+0000","last_clean":"2024-02-21T07:42:09.192896+0000","last_became_active":"2024-02-21T07:42:02.954168+0000","last_became_peered":"2024-02-21T07:42:02.954168+0000","last_unstale":"2024-02-21T07:42:09.192896+0000","last_undegraded":"2024-02-21T07:42:09.192896+0000","last_fullsized":"2024-02-21T07:42:09.192896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53282,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":106,"num_read_kb":114,"num_write":232,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":106564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444044,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":146852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":10,"up_from":17,"seq":73014444044,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":187230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":9,"up_from":17,"seq":73014444044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":150123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6499999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9730000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.754}]}]},{"osd":8,"up_from":17,"seq":73014444043,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":146093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":7,"up_from":17,"seq":73014444044,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":933888,"data_stored":741972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]}]},{"osd":6,"up_from":17,"seq":73014444044,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":141869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]}]},{"osd":5,"up_from":17,"seq":73014444044,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":954368,"data_stored":738266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":146338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":3,"up_from":17,"seq":73014444044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":141461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.571}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.627}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":143819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":188008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":0,"up_from":17,"seq":73014444045,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":142065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.573}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":46839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":46061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:42:42.473 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:42:42.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.701+0000 7fa96f600640 1 Processor -- start 2024-02-21T07:42:42.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.702+0000 7fa96f600640 1 -- start start 2024-02-21T07:42:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.703+0000 7fa96f600640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa968186210 0x7fa968188e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.703+0000 7fa96f600640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa968189340 0x7fa96818ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa96f600640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9681865f0 con 0x7fa96818b1a0 2024-02-21T07:42:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa96f600640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96806dcd0 con 0x7fa968186210 2024-02-21T07:42:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa96f600640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9680cd1d0 con 0x7fa968189340 2024-02-21T07:42:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa96d600640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fa96818b1a0 0x7fa9680cc210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60646/0 (socket says 172.21.15.69:60646) 2024-02-21T07:42:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa96d600640 1 -- 172.21.15.69:0/392394804 learned_addr learned my addr 172.21.15.69:0/392394804 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa96cc00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fa968186210 0x7fa968188e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa95fe00640 1 --2- 172.21.15.69:0/392394804 >> v2:172.21.15.184:3300/0 conn(0x7fa968189340 0x7fa96818ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa967e00640 1 -- 172.21.15.69:0/392394804 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589357540 0 0) 0x7fa9681865f0 con 0x7fa96818b1a0 2024-02-21T07:42:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa967e00640 1 -- 172.21.15.69:0/392394804 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa94c003520 con 0x7fa96818b1a0 2024-02-21T07:42:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa96cc00640 1 -- 172.21.15.69:0/392394804 >> v2:172.21.15.184:3300/0 conn(0x7fa968189340 msgr2=0x7fa96818ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa96cc00640 1 --2- 172.21.15.69:0/392394804 >> v2:172.21.15.184:3300/0 conn(0x7fa968189340 0x7fa96818ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa96cc00640 1 -- 172.21.15.69:0/392394804 >> v1:172.21.15.174:6789/0 conn(0x7fa96818b1a0 legacy=0x7fa9680cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.704+0000 7fa96cc00640 1 -- 172.21.15.69:0/392394804 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680cd4b0 con 0x7fa968186210 2024-02-21T07:42:42.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.706+0000 7fa96cc00640 1 --2- 172.21.15.69:0/392394804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa968186210 0x7fa968188e00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa96808e750 tx=0x7fa95802b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78f997c930d3c115 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:42.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.706+0000 7fa967e00640 1 -- 172.21.15.69:0/392394804 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958031710 con 0x7fa968186210 2024-02-21T07:42:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.706+0000 7fa967e00640 1 -- 172.21.15.69:0/392394804 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95802f050 con 0x7fa968186210 2024-02-21T07:42:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.706+0000 7fa967e00640 1 -- 172.21.15.69:0/392394804 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958031a70 con 0x7fa968186210 2024-02-21T07:42:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.707+0000 7fa96f600640 1 -- 172.21.15.69:0/392394804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa968186210 msgr2=0x7fa968188e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.707+0000 7fa96f600640 1 --2- 172.21.15.69:0/392394804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa968186210 0x7fa968188e00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa96808e750 tx=0x7fa95802b7b0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.707+0000 7fa96f600640 1 -- 172.21.15.69:0/392394804 shutdown_connections 2024-02-21T07:42:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.707+0000 7fa96f600640 1 --2- 172.21.15.69:0/392394804 >> v2:172.21.15.184:3300/0 conn(0x7fa968189340 0x7fa96818ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.707+0000 7fa96f600640 1 --2- 172.21.15.69:0/392394804 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa968186210 0x7fa968188e00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.707+0000 7fa96f600640 1 -- 172.21.15.69:0/392394804 >> 172.21.15.69:0/392394804 conn(0x7fa9680f69c0 msgr2=0x7fa9680f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.707+0000 7fa96f600640 1 -- 172.21.15.69:0/392394804 shutdown_connections 2024-02-21T07:42:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.707+0000 7fa96f600640 1 -- 172.21.15.69:0/392394804 wait complete. 2024-02-21T07:42:42.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.709+0000 7fa96f600640 1 Processor -- start 2024-02-21T07:42:42.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.709+0000 7fa96f600640 1 -- start start 2024-02-21T07:42:42.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96f600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa968186210 0x7fa96817c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96f600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa968189340 0x7fa968182e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96f600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa96818b1a0 0x7fa96815e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96f600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96815f710 con 0x7fa96818b1a0 2024-02-21T07:42:42.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96f600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680f9bb0 con 0x7fa968186210 2024-02-21T07:42:42.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96f600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96815ee70 con 0x7fa968189340 2024-02-21T07:42:42.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96d600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa96818b1a0 0x7fa96815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa95fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa968189340 0x7fa968182e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96d600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa96818b1a0 0x7fa96815e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34024/0 (socket says 172.21.15.69:34024) 2024-02-21T07:42:42.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96d600640 1 -- 172.21.15.69:0/4230536516 learned_addr learned my addr 172.21.15.69:0/4230536516 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:42.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96cc00640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa968186210 0x7fa96817c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96d600640 1 -- 172.21.15.69:0/4230536516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa968189340 msgr2=0x7fa968182e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96d600640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa968189340 0x7fa968182e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96d600640 1 -- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa968186210 msgr2=0x7fa96817c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96d600640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa968186210 0x7fa96817c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96d600640 1 -- 172.21.15.69:0/4230536516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa958009400 con 0x7fa96818b1a0 2024-02-21T07:42:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.711+0000 7fa96cc00640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa968186210 0x7fa96817c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.712+0000 7fa96d600640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa96818b1a0 0x7fa96815e250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa96000caa0 tx=0x7fa96000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.712+0000 7fa965600640 1 -- 172.21.15.69:0/4230536516 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000ac00 con 0x7fa96818b1a0 2024-02-21T07:42:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.712+0000 7fa965600640 1 -- 172.21.15.69:0/4230536516 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96000ad60 con 0x7fa96818b1a0 2024-02-21T07:42:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.712+0000 7fa965600640 1 -- 172.21.15.69:0/4230536516 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960012620 con 0x7fa96818b1a0 2024-02-21T07:42:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.712+0000 7fa96f600640 1 -- 172.21.15.69:0/4230536516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96815f150 con 0x7fa96818b1a0 2024-02-21T07:42:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.712+0000 7fa96f600640 1 -- 172.21.15.69:0/4230536516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9680f4860 con 0x7fa96818b1a0 2024-02-21T07:42:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.713+0000 7fa96f600640 1 -- 172.21.15.69:0/4230536516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa968069d50 con 0x7fa96818b1a0 2024-02-21T07:42:42.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.715+0000 7fa965600640 1 -- 172.21.15.69:0/4230536516 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fa960007070 con 0x7fa96818b1a0 2024-02-21T07:42:42.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.716+0000 7fa965600640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa94409f130 0x7fa9440a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:42.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.716+0000 7fa965600640 1 -- 172.21.15.69:0/4230536516 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa9600c9bb0 con 0x7fa96818b1a0 2024-02-21T07:42:42.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.717+0000 7fa96cc00640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa94409f130 0x7fa9440a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:42.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.717+0000 7fa96cc00640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa94409f130 0x7fa9440a15f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa958035000 tx=0x7fa958008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:42.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.720+0000 7fa965600640 1 -- 172.21.15.69:0/4230536516 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa960093970 con 0x7fa96818b1a0 2024-02-21T07:42:42.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.896+0000 7fa96f600640 1 -- 172.21.15.69:0/4230536516 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa96818a180 con 0x7fa94409f130 2024-02-21T07:42:42.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.907+0000 7fa965600640 1 -- 172.21.15.69:0/4230536516 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367990 (secure 0 0 0) 0x7fa958041070 con 0x7fa94409f130 2024-02-21T07:42:42.923 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:42.926 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-02-21T07:42:42.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 -- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa94409f130 msgr2=0x7fa9440a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa94409f130 0x7fa9440a15f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa958035000 tx=0x7fa958008030 comp rx=0 tx=0).stop 2024-02-21T07:42:42.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 -- 172.21.15.69:0/4230536516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa96818b1a0 msgr2=0x7fa96815e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:42.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa96818b1a0 0x7fa96815e250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa96000caa0 tx=0x7fa96000cf60 comp rx=0 tx=0).stop 2024-02-21T07:42:42.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 -- 172.21.15.69:0/4230536516 shutdown_connections 2024-02-21T07:42:42.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa94409f130 0x7fa9440a15f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa96818b1a0 0x7fa96815e250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa968189340 0x7fa968182e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 --2- 172.21.15.69:0/4230536516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa968186210 0x7fa96817c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 -- 172.21.15.69:0/4230536516 >> 172.21.15.69:0/4230536516 conn(0x7fa9680f69c0 msgr2=0x7fa96806bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 -- 172.21.15.69:0/4230536516 shutdown_connections 2024-02-21T07:42:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:42.913+0000 7fa96f600640 1 -- 172.21.15.69:0/4230536516 wait complete. 2024-02-21T07:42:42.937 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-02-21T07:42:42.452257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":643884,"num_objects":102,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":252,"num_read_kb":233,"num_write":419,"num_write_kb":3060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":329416,"kb_used_data":5224,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132132664,"statfs":{"total":1159641169920,"available":1159303847936,"internally_reserved":0,"allocated":5349376,"data_stored":3014096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":331855161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48876,"num_objects":78,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":189,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003524"},"pg_stats":[{"pgid":"2.1f","version":"29'13","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:39.359711+0000","last_change":"2024-02-21T07:42:01.938302+0000","last_active":"2024-02-21T07:42:39.359711+0000","last_peered":"2024-02-21T07:42:39.359711+0000","last_clean":"2024-02-21T07:42:39.359711+0000","last_became_active":"2024-02-21T07:42:01.935737+0000","last_became_peered":"2024-02-21T07:42:01.935737+0000","last_unstale":"2024-02-21T07:42:39.359711+0000","last_undegraded":"2024-02-21T07:42:39.359711+0000","last_fullsized":"2024-02-21T07:42:39.359711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997031+0000","last_change":"2024-02-21T07:42:02.963926+0000","last_active":"2024-02-21T07:42:07.997031+0000","last_peered":"2024-02-21T07:42:07.997031+0000","last_clean":"2024-02-21T07:42:07.997031+0000","last_became_active":"2024-02-21T07:42:02.963585+0000","last_became_peered":"2024-02-21T07:42:02.963585+0000","last_unstale":"2024-02-21T07:42:07.997031+0000","last_undegraded":"2024-02-21T07:42:07.997031+0000","last_fullsized":"2024-02-21T07:42:07.997031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840648+0000","last_change":"2024-02-21T07:42:07.017236+0000","last_active":"2024-02-21T07:42:09.840648+0000","last_peered":"2024-02-21T07:42:09.840648+0000","last_clean":"2024-02-21T07:42:09.840648+0000","last_became_active":"2024-02-21T07:42:07.016750+0000","last_became_peered":"2024-02-21T07:42:07.016750+0000","last_unstale":"2024-02-21T07:42:09.840648+0000","last_undegraded":"2024-02-21T07:42:09.840648+0000","last_fullsized":"2024-02-21T07:42:09.840648+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997651+0000","last_change":"2024-02-21T07:42:01.947176+0000","last_active":"2024-02-21T07:42:07.997651+0000","last_peered":"2024-02-21T07:42:07.997651+0000","last_clean":"2024-02-21T07:42:07.997651+0000","last_became_active":"2024-02-21T07:42:01.946831+0000","last_became_peered":"2024-02-21T07:42:01.946831+0000","last_unstale":"2024-02-21T07:42:07.997651+0000","last_undegraded":"2024-02-21T07:42:07.997651+0000","last_fullsized":"2024-02-21T07:42:07.997651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293106+0000","last_change":"2024-02-21T07:42:02.970038+0000","last_active":"2024-02-21T07:42:08.293106+0000","last_peered":"2024-02-21T07:42:08.293106+0000","last_clean":"2024-02-21T07:42:08.293106+0000","last_became_active":"2024-02-21T07:42:02.969433+0000","last_became_peered":"2024-02-21T07:42:02.969433+0000","last_unstale":"2024-02-21T07:42:08.293106+0000","last_undegraded":"2024-02-21T07:42:08.293106+0000","last_fullsized":"2024-02-21T07:42:08.293106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157309+0000","last_change":"2024-02-21T07:42:07.009585+0000","last_active":"2024-02-21T07:42:10.157309+0000","last_peered":"2024-02-21T07:42:10.157309+0000","last_clean":"2024-02-21T07:42:10.157309+0000","last_became_active":"2024-02-21T07:42:07.009264+0000","last_became_peered":"2024-02-21T07:42:07.009264+0000","last_unstale":"2024-02-21T07:42:10.157309+0000","last_undegraded":"2024-02-21T07:42:10.157309+0000","last_fullsized":"2024-02-21T07:42:10.157309+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'12","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.316614+0000","last_change":"2024-02-21T07:42:01.930474+0000","last_active":"2024-02-21T07:42:32.316614+0000","last_peered":"2024-02-21T07:42:32.316614+0000","last_clean":"2024-02-21T07:42:32.316614+0000","last_became_active":"2024-02-21T07:42:01.930173+0000","last_became_peered":"2024-02-21T07:42:01.930173+0000","last_unstale":"2024-02-21T07:42:32.316614+0000","last_undegraded":"2024-02-21T07:42:32.316614+0000","last_fullsized":"2024-02-21T07:42:32.316614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:42.554637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186921+0000","last_change":"2024-02-21T07:42:02.955640+0000","last_active":"2024-02-21T07:42:08.186921+0000","last_peered":"2024-02-21T07:42:08.186921+0000","last_clean":"2024-02-21T07:42:08.186921+0000","last_became_active":"2024-02-21T07:42:02.955341+0000","last_became_peered":"2024-02-21T07:42:02.955341+0000","last_unstale":"2024-02-21T07:42:08.186921+0000","last_undegraded":"2024-02-21T07:42:08.186921+0000","last_fullsized":"2024-02-21T07:42:08.186921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157595+0000","last_change":"2024-02-21T07:42:07.013240+0000","last_active":"2024-02-21T07:42:10.157595+0000","last_peered":"2024-02-21T07:42:10.157595+0000","last_clean":"2024-02-21T07:42:10.157595+0000","last_became_active":"2024-02-21T07:42:07.012852+0000","last_became_peered":"2024-02-21T07:42:07.012852+0000","last_unstale":"2024-02-21T07:42:10.157595+0000","last_undegraded":"2024-02-21T07:42:10.157595+0000","last_fullsized":"2024-02-21T07:42:10.157595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.316459+0000","last_change":"2024-02-21T07:42:01.933225+0000","last_active":"2024-02-21T07:42:32.316459+0000","last_peered":"2024-02-21T07:42:32.316459+0000","last_clean":"2024-02-21T07:42:32.316459+0000","last_became_active":"2024-02-21T07:42:01.932908+0000","last_became_peered":"2024-02-21T07:42:01.932908+0000","last_unstale":"2024-02-21T07:42:32.316459+0000","last_undegraded":"2024-02-21T07:42:32.316459+0000","last_fullsized":"2024-02-21T07:42:32.316459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113448+0000","last_change":"2024-02-21T07:42:02.965143+0000","last_active":"2024-02-21T07:42:08.113448+0000","last_peered":"2024-02-21T07:42:08.113448+0000","last_clean":"2024-02-21T07:42:08.113448+0000","last_became_active":"2024-02-21T07:42:02.964614+0000","last_became_peered":"2024-02-21T07:42:02.964614+0000","last_unstale":"2024-02-21T07:42:08.113448+0000","last_undegraded":"2024-02-21T07:42:08.113448+0000","last_fullsized":"2024-02-21T07:42:08.113448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157408+0000","last_change":"2024-02-21T07:42:07.017243+0000","last_active":"2024-02-21T07:42:10.157408+0000","last_peered":"2024-02-21T07:42:10.157408+0000","last_clean":"2024-02-21T07:42:10.157408+0000","last_became_active":"2024-02-21T07:42:07.016898+0000","last_became_peered":"2024-02-21T07:42:07.016898+0000","last_unstale":"2024-02-21T07:42:10.157408+0000","last_undegraded":"2024-02-21T07:42:10.157408+0000","last_fullsized":"2024-02-21T07:42:10.157408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124848+0000","last_change":"2024-02-21T07:42:02.961021+0000","last_active":"2024-02-21T07:42:10.124848+0000","last_peered":"2024-02-21T07:42:10.124848+0000","last_clean":"2024-02-21T07:42:10.124848+0000","last_became_active":"2024-02-21T07:42:02.960723+0000","last_became_peered":"2024-02-21T07:42:02.960723+0000","last_unstale":"2024-02-21T07:42:10.124848+0000","last_undegraded":"2024-02-21T07:42:10.124848+0000","last_fullsized":"2024-02-21T07:42:10.124848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.107460+0000","last_change":"2024-02-21T07:42:01.928055+0000","last_active":"2024-02-21T07:42:30.107460+0000","last_peered":"2024-02-21T07:42:30.107460+0000","last_clean":"2024-02-21T07:42:30.107460+0000","last_became_active":"2024-02-21T07:42:01.927733+0000","last_became_peered":"2024-02-21T07:42:01.927733+0000","last_unstale":"2024-02-21T07:42:30.107460+0000","last_undegraded":"2024-02-21T07:42:30.107460+0000","last_fullsized":"2024-02-21T07:42:30.107460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157702+0000","last_change":"2024-02-21T07:42:07.124695+0000","last_active":"2024-02-21T07:42:10.157702+0000","last_peered":"2024-02-21T07:42:10.157702+0000","last_clean":"2024-02-21T07:42:10.157702+0000","last_became_active":"2024-02-21T07:42:07.123973+0000","last_became_peered":"2024-02-21T07:42:07.123973+0000","last_unstale":"2024-02-21T07:42:10.157702+0000","last_undegraded":"2024-02-21T07:42:10.157702+0000","last_fullsized":"2024-02-21T07:42:10.157702+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996795+0000","last_change":"2024-02-21T07:42:02.982537+0000","last_active":"2024-02-21T07:42:07.996795+0000","last_peered":"2024-02-21T07:42:07.996795+0000","last_clean":"2024-02-21T07:42:07.996795+0000","last_became_active":"2024-02-21T07:42:02.982222+0000","last_became_peered":"2024-02-21T07:42:02.982222+0000","last_unstale":"2024-02-21T07:42:07.996795+0000","last_undegraded":"2024-02-21T07:42:07.996795+0000","last_fullsized":"2024-02-21T07:42:07.996795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.127468+0000","last_change":"2024-02-21T07:42:01.942392+0000","last_active":"2024-02-21T07:42:32.127468+0000","last_peered":"2024-02-21T07:42:32.127468+0000","last_clean":"2024-02-21T07:42:32.127468+0000","last_became_active":"2024-02-21T07:42:01.942152+0000","last_became_peered":"2024-02-21T07:42:01.942152+0000","last_unstale":"2024-02-21T07:42:32.127468+0000","last_undegraded":"2024-02-21T07:42:32.127468+0000","last_fullsized":"2024-02-21T07:42:32.127468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.491378+0000","last_change":"2024-02-21T07:42:07.015054+0000","last_active":"2024-02-21T07:42:10.491378+0000","last_peered":"2024-02-21T07:42:10.491378+0000","last_clean":"2024-02-21T07:42:10.491378+0000","last_became_active":"2024-02-21T07:42:07.014713+0000","last_became_peered":"2024-02-21T07:42:07.014713+0000","last_unstale":"2024-02-21T07:42:10.491378+0000","last_undegraded":"2024-02-21T07:42:10.491378+0000","last_fullsized":"2024-02-21T07:42:10.491378+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192537+0000","last_change":"2024-02-21T07:42:02.970973+0000","last_active":"2024-02-21T07:42:09.192537+0000","last_peered":"2024-02-21T07:42:09.192537+0000","last_clean":"2024-02-21T07:42:09.192537+0000","last_became_active":"2024-02-21T07:42:02.970644+0000","last_became_peered":"2024-02-21T07:42:02.970644+0000","last_unstale":"2024-02-21T07:42:09.192537+0000","last_undegraded":"2024-02-21T07:42:09.192537+0000","last_fullsized":"2024-02-21T07:42:09.192537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'7","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.318173+0000","last_change":"2024-02-21T07:42:01.947758+0000","last_active":"2024-02-21T07:42:32.318173+0000","last_peered":"2024-02-21T07:42:32.318173+0000","last_clean":"2024-02-21T07:42:32.318173+0000","last_became_active":"2024-02-21T07:42:01.947407+0000","last_became_peered":"2024-02-21T07:42:01.947407+0000","last_unstale":"2024-02-21T07:42:32.318173+0000","last_undegraded":"2024-02-21T07:42:32.318173+0000","last_fullsized":"2024-02-21T07:42:32.318173+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417671+0000","last_change":"2024-02-21T07:42:07.023243+0000","last_active":"2024-02-21T07:42:10.417671+0000","last_peered":"2024-02-21T07:42:10.417671+0000","last_clean":"2024-02-21T07:42:10.417671+0000","last_became_active":"2024-02-21T07:42:07.022308+0000","last_became_peered":"2024-02-21T07:42:07.022308+0000","last_unstale":"2024-02-21T07:42:10.417671+0000","last_undegraded":"2024-02-21T07:42:10.417671+0000","last_fullsized":"2024-02-21T07:42:10.417671+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:24.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993327+0000","last_change":"2024-02-21T07:42:02.963456+0000","last_active":"2024-02-21T07:42:07.993327+0000","last_peered":"2024-02-21T07:42:07.993327+0000","last_clean":"2024-02-21T07:42:07.993327+0000","last_became_active":"2024-02-21T07:42:02.963049+0000","last_became_peered":"2024-02-21T07:42:02.963049+0000","last_unstale":"2024-02-21T07:42:07.993327+0000","last_undegraded":"2024-02-21T07:42:07.993327+0000","last_fullsized":"2024-02-21T07:42:07.993327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:30.106442+0000","last_change":"2024-02-21T07:42:01.930737+0000","last_active":"2024-02-21T07:42:30.106442+0000","last_peered":"2024-02-21T07:42:30.106442+0000","last_clean":"2024-02-21T07:42:30.106442+0000","last_became_active":"2024-02-21T07:42:01.930465+0000","last_became_peered":"2024-02-21T07:42:01.930465+0000","last_unstale":"2024-02-21T07:42:30.106442+0000","last_undegraded":"2024-02-21T07:42:30.106442+0000","last_fullsized":"2024-02-21T07:42:30.106442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:08:11.073826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157596+0000","last_change":"2024-02-21T07:42:07.124659+0000","last_active":"2024-02-21T07:42:10.157596+0000","last_peered":"2024-02-21T07:42:10.157596+0000","last_clean":"2024-02-21T07:42:10.157596+0000","last_became_active":"2024-02-21T07:42:07.124217+0000","last_became_peered":"2024-02-21T07:42:07.124217+0000","last_unstale":"2024-02-21T07:42:10.157596+0000","last_undegraded":"2024-02-21T07:42:10.157596+0000","last_fullsized":"2024-02-21T07:42:10.157596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293041+0000","last_change":"2024-02-21T07:42:02.980306+0000","last_active":"2024-02-21T07:42:08.293041+0000","last_peered":"2024-02-21T07:42:08.293041+0000","last_clean":"2024-02-21T07:42:08.293041+0000","last_became_active":"2024-02-21T07:42:02.978879+0000","last_became_peered":"2024-02-21T07:42:02.978879+0000","last_unstale":"2024-02-21T07:42:08.293041+0000","last_undegraded":"2024-02-21T07:42:08.293041+0000","last_fullsized":"2024-02-21T07:42:08.293041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.310890+0000","last_change":"2024-02-21T07:42:01.931986+0000","last_active":"2024-02-21T07:42:32.310890+0000","last_peered":"2024-02-21T07:42:32.310890+0000","last_clean":"2024-02-21T07:42:32.310890+0000","last_became_active":"2024-02-21T07:42:01.931671+0000","last_became_peered":"2024-02-21T07:42:01.931671+0000","last_unstale":"2024-02-21T07:42:32.310890+0000","last_undegraded":"2024-02-21T07:42:32.310890+0000","last_fullsized":"2024-02-21T07:42:32.310890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840491+0000","last_change":"2024-02-21T07:42:06.999795+0000","last_active":"2024-02-21T07:42:09.840491+0000","last_peered":"2024-02-21T07:42:09.840491+0000","last_clean":"2024-02-21T07:42:09.840491+0000","last_became_active":"2024-02-21T07:42:06.999315+0000","last_became_peered":"2024-02-21T07:42:06.999315+0000","last_unstale":"2024-02-21T07:42:09.840491+0000","last_undegraded":"2024-02-21T07:42:09.840491+0000","last_fullsized":"2024-02-21T07:42:09.840491+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997838+0000","last_change":"2024-02-21T07:42:02.968914+0000","last_active":"2024-02-21T07:42:07.997838+0000","last_peered":"2024-02-21T07:42:07.997838+0000","last_clean":"2024-02-21T07:42:07.997838+0000","last_became_active":"2024-02-21T07:42:02.961877+0000","last_became_peered":"2024-02-21T07:42:02.961877+0000","last_unstale":"2024-02-21T07:42:07.997838+0000","last_undegraded":"2024-02-21T07:42:07.997838+0000","last_fullsized":"2024-02-21T07:42:07.997838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'13","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:38.981728+0000","last_change":"2024-02-21T07:42:01.937837+0000","last_active":"2024-02-21T07:42:38.981728+0000","last_peered":"2024-02-21T07:42:38.981728+0000","last_clean":"2024-02-21T07:42:38.981728+0000","last_became_active":"2024-02-21T07:42:01.937536+0000","last_became_peered":"2024-02-21T07:42:01.937536+0000","last_unstale":"2024-02-21T07:42:38.981728+0000","last_undegraded":"2024-02-21T07:42:38.981728+0000","last_fullsized":"2024-02-21T07:42:38.981728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995749+0000","last_change":"2024-02-21T07:42:07.125588+0000","last_active":"2024-02-21T07:42:07.995749+0000","last_peered":"2024-02-21T07:42:07.995749+0000","last_clean":"2024-02-21T07:42:07.995749+0000","last_became_active":"2024-02-21T07:42:07.124044+0000","last_became_peered":"2024-02-21T07:42:07.124044+0000","last_unstale":"2024-02-21T07:42:07.995749+0000","last_undegraded":"2024-02-21T07:42:07.995749+0000","last_fullsized":"2024-02-21T07:42:07.995749+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992717+0000","last_change":"2024-02-21T07:42:02.961820+0000","last_active":"2024-02-21T07:42:07.992717+0000","last_peered":"2024-02-21T07:42:07.992717+0000","last_clean":"2024-02-21T07:42:07.992717+0000","last_became_active":"2024-02-21T07:42:02.961478+0000","last_became_peered":"2024-02-21T07:42:02.961478+0000","last_unstale":"2024-02-21T07:42:07.992717+0000","last_undegraded":"2024-02-21T07:42:07.992717+0000","last_fullsized":"2024-02-21T07:42:07.992717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.302240+0000","last_change":"2024-02-21T07:42:01.947736+0000","last_active":"2024-02-21T07:42:32.302240+0000","last_peered":"2024-02-21T07:42:32.302240+0000","last_clean":"2024-02-21T07:42:32.302240+0000","last_became_active":"2024-02-21T07:42:01.947443+0000","last_became_peered":"2024-02-21T07:42:01.947443+0000","last_unstale":"2024-02-21T07:42:32.302240+0000","last_undegraded":"2024-02-21T07:42:32.302240+0000","last_fullsized":"2024-02-21T07:42:32.302240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:17.915214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192630+0000","last_change":"2024-02-21T07:42:07.008819+0000","last_active":"2024-02-21T07:42:09.192630+0000","last_peered":"2024-02-21T07:42:09.192630+0000","last_clean":"2024-02-21T07:42:09.192630+0000","last_became_active":"2024-02-21T07:42:07.008423+0000","last_became_peered":"2024-02-21T07:42:07.008423+0000","last_unstale":"2024-02-21T07:42:09.192630+0000","last_undegraded":"2024-02-21T07:42:09.192630+0000","last_fullsized":"2024-02-21T07:42:09.192630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413836+0000","last_change":"2024-02-21T07:42:02.975343+0000","last_active":"2024-02-21T07:42:10.413836+0000","last_peered":"2024-02-21T07:42:10.413836+0000","last_clean":"2024-02-21T07:42:10.413836+0000","last_became_active":"2024-02-21T07:42:02.975041+0000","last_became_peered":"2024-02-21T07:42:02.975041+0000","last_unstale":"2024-02-21T07:42:10.413836+0000","last_undegraded":"2024-02-21T07:42:10.413836+0000","last_fullsized":"2024-02-21T07:42:10.413836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416266+0000","last_change":"2024-02-21T07:42:01.935020+0000","last_active":"2024-02-21T07:42:10.416266+0000","last_peered":"2024-02-21T07:42:10.416266+0000","last_clean":"2024-02-21T07:42:10.416266+0000","last_became_active":"2024-02-21T07:42:01.934752+0000","last_became_peered":"2024-02-21T07:42:01.934752+0000","last_unstale":"2024-02-21T07:42:10.416266+0000","last_undegraded":"2024-02-21T07:42:10.416266+0000","last_fullsized":"2024-02-21T07:42:10.416266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993582+0000","last_change":"2024-02-21T07:42:07.124477+0000","last_active":"2024-02-21T07:42:07.993582+0000","last_peered":"2024-02-21T07:42:07.993582+0000","last_clean":"2024-02-21T07:42:07.993582+0000","last_became_active":"2024-02-21T07:42:07.123915+0000","last_became_peered":"2024-02-21T07:42:07.123915+0000","last_unstale":"2024-02-21T07:42:07.993582+0000","last_undegraded":"2024-02-21T07:42:07.993582+0000","last_fullsized":"2024-02-21T07:42:07.993582+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413746+0000","last_change":"2024-02-21T07:42:02.964531+0000","last_active":"2024-02-21T07:42:10.413746+0000","last_peered":"2024-02-21T07:42:10.413746+0000","last_clean":"2024-02-21T07:42:10.413746+0000","last_became_active":"2024-02-21T07:42:02.964185+0000","last_became_peered":"2024-02-21T07:42:02.964185+0000","last_unstale":"2024-02-21T07:42:10.413746+0000","last_undegraded":"2024-02-21T07:42:10.413746+0000","last_fullsized":"2024-02-21T07:42:10.413746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:39.360270+0000","last_change":"2024-02-21T07:42:01.934093+0000","last_active":"2024-02-21T07:42:39.360270+0000","last_peered":"2024-02-21T07:42:39.360270+0000","last_clean":"2024-02-21T07:42:39.360270+0000","last_became_active":"2024-02-21T07:42:01.933841+0000","last_became_peered":"2024-02-21T07:42:01.933841+0000","last_unstale":"2024-02-21T07:42:39.360270+0000","last_undegraded":"2024-02-21T07:42:39.360270+0000","last_fullsized":"2024-02-21T07:42:39.360270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992564+0000","last_change":"2024-02-21T07:42:07.018134+0000","last_active":"2024-02-21T07:42:07.992564+0000","last_peered":"2024-02-21T07:42:07.992564+0000","last_clean":"2024-02-21T07:42:07.992564+0000","last_became_active":"2024-02-21T07:42:07.017670+0000","last_became_peered":"2024-02-21T07:42:07.017670+0000","last_unstale":"2024-02-21T07:42:07.992564+0000","last_undegraded":"2024-02-21T07:42:07.992564+0000","last_fullsized":"2024-02-21T07:42:07.992564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113034+0000","last_change":"2024-02-21T07:42:02.962279+0000","last_active":"2024-02-21T07:42:08.113034+0000","last_peered":"2024-02-21T07:42:08.113034+0000","last_clean":"2024-02-21T07:42:08.113034+0000","last_became_active":"2024-02-21T07:42:02.961965+0000","last_became_peered":"2024-02-21T07:42:02.961965+0000","last_unstale":"2024-02-21T07:42:08.113034+0000","last_undegraded":"2024-02-21T07:42:08.113034+0000","last_fullsized":"2024-02-21T07:42:08.113034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'5","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:39.320432+0000","last_change":"2024-02-21T07:42:01.948478+0000","last_active":"2024-02-21T07:42:39.320432+0000","last_peered":"2024-02-21T07:42:39.320432+0000","last_clean":"2024-02-21T07:42:39.320432+0000","last_became_active":"2024-02-21T07:42:01.948184+0000","last_became_peered":"2024-02-21T07:42:01.948184+0000","last_unstale":"2024-02-21T07:42:39.320432+0000","last_undegraded":"2024-02-21T07:42:39.320432+0000","last_fullsized":"2024-02-21T07:42:39.320432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993308+0000","last_change":"2024-02-21T07:42:07.124759+0000","last_active":"2024-02-21T07:42:07.993308+0000","last_peered":"2024-02-21T07:42:07.993308+0000","last_clean":"2024-02-21T07:42:07.993308+0000","last_became_active":"2024-02-21T07:42:07.124275+0000","last_became_peered":"2024-02-21T07:42:07.124275+0000","last_unstale":"2024-02-21T07:42:07.993308+0000","last_undegraded":"2024-02-21T07:42:07.993308+0000","last_fullsized":"2024-02-21T07:42:07.993308+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.991454+0000","last_change":"2024-02-21T07:42:02.961213+0000","last_active":"2024-02-21T07:42:07.991454+0000","last_peered":"2024-02-21T07:42:07.991454+0000","last_clean":"2024-02-21T07:42:07.991454+0000","last_became_active":"2024-02-21T07:42:02.960477+0000","last_became_peered":"2024-02-21T07:42:02.960477+0000","last_unstale":"2024-02-21T07:42:07.991454+0000","last_undegraded":"2024-02-21T07:42:07.991454+0000","last_fullsized":"2024-02-21T07:42:07.991454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:31.115599+0000","last_change":"2024-02-21T07:42:01.928302+0000","last_active":"2024-02-21T07:42:31.115599+0000","last_peered":"2024-02-21T07:42:31.115599+0000","last_clean":"2024-02-21T07:42:31.115599+0000","last_became_active":"2024-02-21T07:42:01.927234+0000","last_became_peered":"2024-02-21T07:42:01.927234+0000","last_unstale":"2024-02-21T07:42:31.115599+0000","last_undegraded":"2024-02-21T07:42:31.115599+0000","last_fullsized":"2024-02-21T07:42:31.115599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113596+0000","last_change":"2024-02-21T07:42:07.124715+0000","last_active":"2024-02-21T07:42:08.113596+0000","last_peered":"2024-02-21T07:42:08.113596+0000","last_clean":"2024-02-21T07:42:08.113596+0000","last_became_active":"2024-02-21T07:42:07.124248+0000","last_became_peered":"2024-02-21T07:42:07.124248+0000","last_unstale":"2024-02-21T07:42:08.113596+0000","last_undegraded":"2024-02-21T07:42:08.113596+0000","last_fullsized":"2024-02-21T07:42:08.113596+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:17:21.721728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996414+0000","last_change":"2024-02-21T07:42:02.971762+0000","last_active":"2024-02-21T07:42:07.996414+0000","last_peered":"2024-02-21T07:42:07.996414+0000","last_clean":"2024-02-21T07:42:07.996414+0000","last_became_active":"2024-02-21T07:42:02.970032+0000","last_became_peered":"2024-02-21T07:42:02.970032+0000","last_unstale":"2024-02-21T07:42:07.996414+0000","last_undegraded":"2024-02-21T07:42:07.996414+0000","last_fullsized":"2024-02-21T07:42:07.996414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'6","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.311057+0000","last_change":"2024-02-21T07:42:01.932968+0000","last_active":"2024-02-21T07:42:32.311057+0000","last_peered":"2024-02-21T07:42:32.311057+0000","last_clean":"2024-02-21T07:42:32.311057+0000","last_became_active":"2024-02-21T07:42:01.932620+0000","last_became_peered":"2024-02-21T07:42:01.932620+0000","last_unstale":"2024-02-21T07:42:32.311057+0000","last_undegraded":"2024-02-21T07:42:32.311057+0000","last_fullsized":"2024-02-21T07:42:32.311057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124899+0000","last_change":"2024-02-21T07:41:57.883808+0000","last_active":"2024-02-21T07:42:10.124899+0000","last_peered":"2024-02-21T07:42:10.124899+0000","last_clean":"2024-02-21T07:42:10.124899+0000","last_became_active":"2024-02-21T07:41:57.883530+0000","last_became_peered":"2024-02-21T07:41:57.883530+0000","last_unstale":"2024-02-21T07:42:10.124899+0000","last_undegraded":"2024-02-21T07:42:10.124899+0000","last_fullsized":"2024-02-21T07:42:10.124899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_clean_scrub_stamp":"2024-02-21T07:41:56.862963+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:09:51.756066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.492525+0000","last_change":"2024-02-21T07:42:07.011954+0000","last_active":"2024-02-21T07:42:10.492525+0000","last_peered":"2024-02-21T07:42:10.492525+0000","last_clean":"2024-02-21T07:42:10.492525+0000","last_became_active":"2024-02-21T07:42:07.011654+0000","last_became_peered":"2024-02-21T07:42:07.011654+0000","last_unstale":"2024-02-21T07:42:10.492525+0000","last_undegraded":"2024-02-21T07:42:10.492525+0000","last_fullsized":"2024-02-21T07:42:10.492525+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125300+0000","last_change":"2024-02-21T07:42:02.956569+0000","last_active":"2024-02-21T07:42:10.125300+0000","last_peered":"2024-02-21T07:42:10.125300+0000","last_clean":"2024-02-21T07:42:10.125300+0000","last_became_active":"2024-02-21T07:42:02.956232+0000","last_became_peered":"2024-02-21T07:42:02.956232+0000","last_unstale":"2024-02-21T07:42:10.125300+0000","last_undegraded":"2024-02-21T07:42:10.125300+0000","last_fullsized":"2024-02-21T07:42:10.125300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'6","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:39.316374+0000","last_change":"2024-02-21T07:42:01.926736+0000","last_active":"2024-02-21T07:42:39.316374+0000","last_peered":"2024-02-21T07:42:39.316374+0000","last_clean":"2024-02-21T07:42:39.316374+0000","last_became_active":"2024-02-21T07:42:01.926454+0000","last_became_peered":"2024-02-21T07:42:01.926454+0000","last_unstale":"2024-02-21T07:42:39.316374+0000","last_undegraded":"2024-02-21T07:42:39.316374+0000","last_fullsized":"2024-02-21T07:42:39.316374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186824+0000","last_change":"2024-02-21T07:42:07.003371+0000","last_active":"2024-02-21T07:42:08.186824+0000","last_peered":"2024-02-21T07:42:08.186824+0000","last_clean":"2024-02-21T07:42:08.186824+0000","last_became_active":"2024-02-21T07:42:07.002940+0000","last_became_peered":"2024-02-21T07:42:07.002940+0000","last_unstale":"2024-02-21T07:42:08.186824+0000","last_undegraded":"2024-02-21T07:42:08.186824+0000","last_fullsized":"2024-02-21T07:42:08.186824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:17.859796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125133+0000","last_change":"2024-02-21T07:42:02.976255+0000","last_active":"2024-02-21T07:42:10.125133+0000","last_peered":"2024-02-21T07:42:10.125133+0000","last_clean":"2024-02-21T07:42:10.125133+0000","last_became_active":"2024-02-21T07:42:02.975927+0000","last_became_peered":"2024-02-21T07:42:02.975927+0000","last_unstale":"2024-02-21T07:42:10.125133+0000","last_undegraded":"2024-02-21T07:42:10.125133+0000","last_fullsized":"2024-02-21T07:42:10.125133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.302904+0000","last_change":"2024-02-21T07:42:01.932488+0000","last_active":"2024-02-21T07:42:32.302904+0000","last_peered":"2024-02-21T07:42:32.302904+0000","last_clean":"2024-02-21T07:42:32.302904+0000","last_became_active":"2024-02-21T07:42:01.932131+0000","last_became_peered":"2024-02-21T07:42:01.932131+0000","last_unstale":"2024-02-21T07:42:32.302904+0000","last_undegraded":"2024-02-21T07:42:32.302904+0000","last_fullsized":"2024-02-21T07:42:32.302904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292501+0000","last_change":"2024-02-21T07:42:07.017329+0000","last_active":"2024-02-21T07:42:08.292501+0000","last_peered":"2024-02-21T07:42:08.292501+0000","last_clean":"2024-02-21T07:42:08.292501+0000","last_became_active":"2024-02-21T07:42:07.016916+0000","last_became_peered":"2024-02-21T07:42:07.016916+0000","last_unstale":"2024-02-21T07:42:08.292501+0000","last_undegraded":"2024-02-21T07:42:08.292501+0000","last_fullsized":"2024-02-21T07:42:08.292501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125268+0000","last_change":"2024-02-21T07:42:02.959157+0000","last_active":"2024-02-21T07:42:10.125268+0000","last_peered":"2024-02-21T07:42:10.125268+0000","last_clean":"2024-02-21T07:42:10.125268+0000","last_became_active":"2024-02-21T07:42:02.958593+0000","last_became_peered":"2024-02-21T07:42:02.958593+0000","last_unstale":"2024-02-21T07:42:10.125268+0000","last_undegraded":"2024-02-21T07:42:10.125268+0000","last_fullsized":"2024-02-21T07:42:10.125268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:55.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.315527+0000","last_change":"2024-02-21T07:42:01.949434+0000","last_active":"2024-02-21T07:42:32.315527+0000","last_peered":"2024-02-21T07:42:32.315527+0000","last_clean":"2024-02-21T07:42:32.315527+0000","last_became_active":"2024-02-21T07:42:01.948805+0000","last_became_peered":"2024-02-21T07:42:01.948805+0000","last_unstale":"2024-02-21T07:42:32.315527+0000","last_undegraded":"2024-02-21T07:42:32.315527+0000","last_fullsized":"2024-02-21T07:42:32.315527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.112966+0000","last_change":"2024-02-21T07:42:07.003190+0000","last_active":"2024-02-21T07:42:08.112966+0000","last_peered":"2024-02-21T07:42:08.112966+0000","last_clean":"2024-02-21T07:42:08.112966+0000","last_became_active":"2024-02-21T07:42:07.002780+0000","last_became_peered":"2024-02-21T07:42:07.002780+0000","last_unstale":"2024-02-21T07:42:08.112966+0000","last_undegraded":"2024-02-21T07:42:08.112966+0000","last_fullsized":"2024-02-21T07:42:08.112966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192778+0000","last_change":"2024-02-21T07:42:02.959569+0000","last_active":"2024-02-21T07:42:09.192778+0000","last_peered":"2024-02-21T07:42:09.192778+0000","last_clean":"2024-02-21T07:42:09.192778+0000","last_became_active":"2024-02-21T07:42:02.959146+0000","last_became_peered":"2024-02-21T07:42:02.959146+0000","last_unstale":"2024-02-21T07:42:09.192778+0000","last_undegraded":"2024-02-21T07:42:09.192778+0000","last_fullsized":"2024-02-21T07:42:09.192778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.112889+0000","last_change":"2024-02-21T07:42:01.926878+0000","last_active":"2024-02-21T07:42:32.112889+0000","last_peered":"2024-02-21T07:42:32.112889+0000","last_clean":"2024-02-21T07:42:32.112889+0000","last_became_active":"2024-02-21T07:42:01.926212+0000","last_became_peered":"2024-02-21T07:42:01.926212+0000","last_unstale":"2024-02-21T07:42:32.112889+0000","last_undegraded":"2024-02-21T07:42:32.112889+0000","last_fullsized":"2024-02-21T07:42:32.112889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113080+0000","last_change":"2024-02-21T07:42:07.017443+0000","last_active":"2024-02-21T07:42:08.113080+0000","last_peered":"2024-02-21T07:42:08.113080+0000","last_clean":"2024-02-21T07:42:08.113080+0000","last_became_active":"2024-02-21T07:42:07.016918+0000","last_became_peered":"2024-02-21T07:42:07.016918+0000","last_unstale":"2024-02-21T07:42:08.113080+0000","last_undegraded":"2024-02-21T07:42:08.113080+0000","last_fullsized":"2024-02-21T07:42:08.113080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:49:35.717727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113122+0000","last_change":"2024-02-21T07:42:02.965178+0000","last_active":"2024-02-21T07:42:08.113122+0000","last_peered":"2024-02-21T07:42:08.113122+0000","last_clean":"2024-02-21T07:42:08.113122+0000","last_became_active":"2024-02-21T07:42:02.964846+0000","last_became_peered":"2024-02-21T07:42:02.964846+0000","last_unstale":"2024-02-21T07:42:08.113122+0000","last_undegraded":"2024-02-21T07:42:08.113122+0000","last_fullsized":"2024-02-21T07:42:08.113122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'17","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.301994+0000","last_change":"2024-02-21T07:42:01.946183+0000","last_active":"2024-02-21T07:42:32.301994+0000","last_peered":"2024-02-21T07:42:32.301994+0000","last_clean":"2024-02-21T07:42:32.301994+0000","last_became_active":"2024-02-21T07:42:01.945960+0000","last_became_peered":"2024-02-21T07:42:01.945960+0000","last_unstale":"2024-02-21T07:42:32.301994+0000","last_undegraded":"2024-02-21T07:42:32.301994+0000","last_fullsized":"2024-02-21T07:42:32.301994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993395+0000","last_change":"2024-02-21T07:42:07.021166+0000","last_active":"2024-02-21T07:42:07.993395+0000","last_peered":"2024-02-21T07:42:07.993395+0000","last_clean":"2024-02-21T07:42:07.993395+0000","last_became_active":"2024-02-21T07:42:07.017128+0000","last_became_peered":"2024-02-21T07:42:07.017128+0000","last_unstale":"2024-02-21T07:42:07.993395+0000","last_undegraded":"2024-02-21T07:42:07.993395+0000","last_fullsized":"2024-02-21T07:42:07.993395+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124773+0000","last_change":"2024-02-21T07:42:02.960144+0000","last_active":"2024-02-21T07:42:10.124773+0000","last_peered":"2024-02-21T07:42:10.124773+0000","last_clean":"2024-02-21T07:42:10.124773+0000","last_became_active":"2024-02-21T07:42:02.959714+0000","last_became_peered":"2024-02-21T07:42:02.959714+0000","last_unstale":"2024-02-21T07:42:10.124773+0000","last_undegraded":"2024-02-21T07:42:10.124773+0000","last_fullsized":"2024-02-21T07:42:10.124773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:39.321256+0000","last_change":"2024-02-21T07:42:01.930429+0000","last_active":"2024-02-21T07:42:39.321256+0000","last_peered":"2024-02-21T07:42:39.321256+0000","last_clean":"2024-02-21T07:42:39.321256+0000","last_became_active":"2024-02-21T07:42:01.930076+0000","last_became_peered":"2024-02-21T07:42:01.930076+0000","last_unstale":"2024-02-21T07:42:39.321256+0000","last_undegraded":"2024-02-21T07:42:39.321256+0000","last_fullsized":"2024-02-21T07:42:39.321256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417833+0000","last_change":"2024-02-21T07:42:07.025234+0000","last_active":"2024-02-21T07:42:10.417833+0000","last_peered":"2024-02-21T07:42:10.417833+0000","last_clean":"2024-02-21T07:42:10.417833+0000","last_became_active":"2024-02-21T07:42:07.024452+0000","last_became_peered":"2024-02-21T07:42:07.024452+0000","last_unstale":"2024-02-21T07:42:10.417833+0000","last_undegraded":"2024-02-21T07:42:10.417833+0000","last_fullsized":"2024-02-21T07:42:10.417833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124980+0000","last_change":"2024-02-21T07:42:02.958015+0000","last_active":"2024-02-21T07:42:10.124980+0000","last_peered":"2024-02-21T07:42:10.124980+0000","last_clean":"2024-02-21T07:42:10.124980+0000","last_became_active":"2024-02-21T07:42:02.956436+0000","last_became_peered":"2024-02-21T07:42:02.956436+0000","last_unstale":"2024-02-21T07:42:10.124980+0000","last_undegraded":"2024-02-21T07:42:10.124980+0000","last_fullsized":"2024-02-21T07:42:10.124980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:39.265082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.312216+0000","last_change":"2024-02-21T07:42:01.943079+0000","last_active":"2024-02-21T07:42:32.312216+0000","last_peered":"2024-02-21T07:42:32.312216+0000","last_clean":"2024-02-21T07:42:32.312216+0000","last_became_active":"2024-02-21T07:42:01.942831+0000","last_became_peered":"2024-02-21T07:42:01.942831+0000","last_unstale":"2024-02-21T07:42:32.312216+0000","last_undegraded":"2024-02-21T07:42:32.312216+0000","last_fullsized":"2024-02-21T07:42:32.312216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192731+0000","last_change":"2024-02-21T07:42:07.015228+0000","last_active":"2024-02-21T07:42:09.192731+0000","last_peered":"2024-02-21T07:42:09.192731+0000","last_clean":"2024-02-21T07:42:09.192731+0000","last_became_active":"2024-02-21T07:42:07.014798+0000","last_became_peered":"2024-02-21T07:42:07.014798+0000","last_unstale":"2024-02-21T07:42:09.192731+0000","last_undegraded":"2024-02-21T07:42:09.192731+0000","last_fullsized":"2024-02-21T07:42:09.192731+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.991844+0000","last_change":"2024-02-21T07:42:02.965287+0000","last_active":"2024-02-21T07:42:07.991844+0000","last_peered":"2024-02-21T07:42:07.991844+0000","last_clean":"2024-02-21T07:42:07.991844+0000","last_became_active":"2024-02-21T07:42:02.960780+0000","last_became_peered":"2024-02-21T07:42:02.960780+0000","last_unstale":"2024-02-21T07:42:07.991844+0000","last_undegraded":"2024-02-21T07:42:07.991844+0000","last_fullsized":"2024-02-21T07:42:07.991844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.317068+0000","last_change":"2024-02-21T07:42:01.932401+0000","last_active":"2024-02-21T07:42:32.317068+0000","last_peered":"2024-02-21T07:42:32.317068+0000","last_clean":"2024-02-21T07:42:32.317068+0000","last_became_active":"2024-02-21T07:42:01.932108+0000","last_became_peered":"2024-02-21T07:42:01.932108+0000","last_unstale":"2024-02-21T07:42:32.317068+0000","last_undegraded":"2024-02-21T07:42:32.317068+0000","last_fullsized":"2024-02-21T07:42:32.317068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113526+0000","last_change":"2024-02-21T07:42:07.018725+0000","last_active":"2024-02-21T07:42:08.113526+0000","last_peered":"2024-02-21T07:42:08.113526+0000","last_clean":"2024-02-21T07:42:08.113526+0000","last_became_active":"2024-02-21T07:42:07.018322+0000","last_became_peered":"2024-02-21T07:42:07.018322+0000","last_unstale":"2024-02-21T07:42:08.113526+0000","last_undegraded":"2024-02-21T07:42:08.113526+0000","last_fullsized":"2024-02-21T07:42:08.113526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:04:05.896966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993773+0000","last_change":"2024-02-21T07:42:02.963384+0000","last_active":"2024-02-21T07:42:07.993773+0000","last_peered":"2024-02-21T07:42:07.993773+0000","last_clean":"2024-02-21T07:42:07.993773+0000","last_became_active":"2024-02-21T07:42:02.963098+0000","last_became_peered":"2024-02-21T07:42:02.963098+0000","last_unstale":"2024-02-21T07:42:07.993773+0000","last_undegraded":"2024-02-21T07:42:07.993773+0000","last_fullsized":"2024-02-21T07:42:07.993773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"29'26","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:40.323467+0000","last_change":"2024-02-21T07:42:01.936472+0000","last_active":"2024-02-21T07:42:40.323467+0000","last_peered":"2024-02-21T07:42:40.323467+0000","last_clean":"2024-02-21T07:42:40.323467+0000","last_became_active":"2024-02-21T07:42:01.936181+0000","last_became_peered":"2024-02-21T07:42:01.936181+0000","last_unstale":"2024-02-21T07:42:40.323467+0000","last_undegraded":"2024-02-21T07:42:40.323467+0000","last_fullsized":"2024-02-21T07:42:40.323467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45675,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":56,"num_write":28,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416924+0000","last_change":"2024-02-21T07:42:07.013938+0000","last_active":"2024-02-21T07:42:10.416924+0000","last_peered":"2024-02-21T07:42:10.416924+0000","last_clean":"2024-02-21T07:42:10.416924+0000","last_became_active":"2024-02-21T07:42:07.013409+0000","last_became_peered":"2024-02-21T07:42:07.013409+0000","last_unstale":"2024-02-21T07:42:10.416924+0000","last_undegraded":"2024-02-21T07:42:10.416924+0000","last_fullsized":"2024-02-21T07:42:10.416924+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:52:00.302670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186924+0000","last_change":"2024-02-21T07:42:02.960084+0000","last_active":"2024-02-21T07:42:08.186924+0000","last_peered":"2024-02-21T07:42:08.186924+0000","last_clean":"2024-02-21T07:42:08.186924+0000","last_became_active":"2024-02-21T07:42:02.959610+0000","last_became_peered":"2024-02-21T07:42:02.959610+0000","last_unstale":"2024-02-21T07:42:08.186924+0000","last_undegraded":"2024-02-21T07:42:08.186924+0000","last_fullsized":"2024-02-21T07:42:08.186924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.127720+0000","last_change":"2024-02-21T07:42:01.946668+0000","last_active":"2024-02-21T07:42:32.127720+0000","last_peered":"2024-02-21T07:42:32.127720+0000","last_clean":"2024-02-21T07:42:32.127720+0000","last_became_active":"2024-02-21T07:42:01.946454+0000","last_became_peered":"2024-02-21T07:42:01.946454+0000","last_unstale":"2024-02-21T07:42:32.127720+0000","last_undegraded":"2024-02-21T07:42:32.127720+0000","last_fullsized":"2024-02-21T07:42:32.127720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157319+0000","last_change":"2024-02-21T07:42:07.013560+0000","last_active":"2024-02-21T07:42:10.157319+0000","last_peered":"2024-02-21T07:42:10.157319+0000","last_clean":"2024-02-21T07:42:10.157319+0000","last_became_active":"2024-02-21T07:42:07.012952+0000","last_became_peered":"2024-02-21T07:42:07.012952+0000","last_unstale":"2024-02-21T07:42:10.157319+0000","last_undegraded":"2024-02-21T07:42:10.157319+0000","last_fullsized":"2024-02-21T07:42:10.157319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.293193+0000","last_change":"2024-02-21T07:42:02.969725+0000","last_active":"2024-02-21T07:42:08.293193+0000","last_peered":"2024-02-21T07:42:08.293193+0000","last_clean":"2024-02-21T07:42:08.293193+0000","last_became_active":"2024-02-21T07:42:02.969125+0000","last_became_peered":"2024-02-21T07:42:02.969125+0000","last_unstale":"2024-02-21T07:42:08.293193+0000","last_undegraded":"2024-02-21T07:42:08.293193+0000","last_fullsized":"2024-02-21T07:42:08.293193+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.316300+0000","last_change":"2024-02-21T07:42:01.931035+0000","last_active":"2024-02-21T07:42:32.316300+0000","last_peered":"2024-02-21T07:42:32.316300+0000","last_clean":"2024-02-21T07:42:32.316300+0000","last_became_active":"2024-02-21T07:42:01.930665+0000","last_became_peered":"2024-02-21T07:42:01.930665+0000","last_unstale":"2024-02-21T07:42:32.316300+0000","last_undegraded":"2024-02-21T07:42:32.316300+0000","last_fullsized":"2024-02-21T07:42:32.316300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416501+0000","last_change":"2024-02-21T07:42:07.022730+0000","last_active":"2024-02-21T07:42:10.416501+0000","last_peered":"2024-02-21T07:42:10.416501+0000","last_clean":"2024-02-21T07:42:10.416501+0000","last_became_active":"2024-02-21T07:42:07.022349+0000","last_became_peered":"2024-02-21T07:42:07.022349+0000","last_unstale":"2024-02-21T07:42:10.416501+0000","last_undegraded":"2024-02-21T07:42:10.416501+0000","last_fullsized":"2024-02-21T07:42:10.416501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:17.859796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.187028+0000","last_change":"2024-02-21T07:42:02.956416+0000","last_active":"2024-02-21T07:42:08.187028+0000","last_peered":"2024-02-21T07:42:08.187028+0000","last_clean":"2024-02-21T07:42:08.187028+0000","last_became_active":"2024-02-21T07:42:02.956098+0000","last_became_peered":"2024-02-21T07:42:02.956098+0000","last_unstale":"2024-02-21T07:42:08.187028+0000","last_undegraded":"2024-02-21T07:42:08.187028+0000","last_fullsized":"2024-02-21T07:42:08.187028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:40.317212+0000","last_change":"2024-02-21T07:42:01.937810+0000","last_active":"2024-02-21T07:42:40.317212+0000","last_peered":"2024-02-21T07:42:40.317212+0000","last_clean":"2024-02-21T07:42:40.317212+0000","last_became_active":"2024-02-21T07:42:01.937555+0000","last_became_peered":"2024-02-21T07:42:01.937555+0000","last_unstale":"2024-02-21T07:42:40.317212+0000","last_undegraded":"2024-02-21T07:42:40.317212+0000","last_fullsized":"2024-02-21T07:42:40.317212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996295+0000","last_change":"2024-02-21T07:42:07.013284+0000","last_active":"2024-02-21T07:42:07.996295+0000","last_peered":"2024-02-21T07:42:07.996295+0000","last_clean":"2024-02-21T07:42:07.996295+0000","last_became_active":"2024-02-21T07:42:07.012412+0000","last_became_peered":"2024-02-21T07:42:07.012412+0000","last_unstale":"2024-02-21T07:42:07.996295+0000","last_undegraded":"2024-02-21T07:42:07.996295+0000","last_fullsized":"2024-02-21T07:42:07.996295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292443+0000","last_change":"2024-02-21T07:42:07.016945+0000","last_active":"2024-02-21T07:42:08.292443+0000","last_peered":"2024-02-21T07:42:08.292443+0000","last_clean":"2024-02-21T07:42:08.292443+0000","last_became_active":"2024-02-21T07:42:07.016572+0000","last_became_peered":"2024-02-21T07:42:07.016572+0000","last_unstale":"2024-02-21T07:42:08.292443+0000","last_undegraded":"2024-02-21T07:42:08.292443+0000","last_fullsized":"2024-02-21T07:42:08.292443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.416578+0000","last_change":"2024-02-21T07:42:02.977972+0000","last_active":"2024-02-21T07:42:10.416578+0000","last_peered":"2024-02-21T07:42:10.416578+0000","last_clean":"2024-02-21T07:42:10.416578+0000","last_became_active":"2024-02-21T07:42:02.977632+0000","last_became_peered":"2024-02-21T07:42:02.977632+0000","last_unstale":"2024-02-21T07:42:10.416578+0000","last_undegraded":"2024-02-21T07:42:10.416578+0000","last_fullsized":"2024-02-21T07:42:10.416578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.304904+0000","last_change":"2024-02-21T07:42:01.930402+0000","last_active":"2024-02-21T07:42:32.304904+0000","last_peered":"2024-02-21T07:42:32.304904+0000","last_clean":"2024-02-21T07:42:32.304904+0000","last_became_active":"2024-02-21T07:42:01.930084+0000","last_became_peered":"2024-02-21T07:42:01.930084+0000","last_unstale":"2024-02-21T07:42:32.304904+0000","last_undegraded":"2024-02-21T07:42:32.304904+0000","last_fullsized":"2024-02-21T07:42:32.304904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192889+0000","last_change":"2024-02-21T07:42:07.016859+0000","last_active":"2024-02-21T07:42:09.192889+0000","last_peered":"2024-02-21T07:42:09.192889+0000","last_clean":"2024-02-21T07:42:09.192889+0000","last_became_active":"2024-02-21T07:42:07.016372+0000","last_became_peered":"2024-02-21T07:42:07.016372+0000","last_unstale":"2024-02-21T07:42:09.192889+0000","last_undegraded":"2024-02-21T07:42:09.192889+0000","last_fullsized":"2024-02-21T07:42:09.192889+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995924+0000","last_change":"2024-02-21T07:42:02.948576+0000","last_active":"2024-02-21T07:42:07.995924+0000","last_peered":"2024-02-21T07:42:07.995924+0000","last_clean":"2024-02-21T07:42:07.995924+0000","last_became_active":"2024-02-21T07:42:02.947666+0000","last_became_peered":"2024-02-21T07:42:02.947666+0000","last_unstale":"2024-02-21T07:42:07.995924+0000","last_undegraded":"2024-02-21T07:42:07.995924+0000","last_fullsized":"2024-02-21T07:42:07.995924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:31.120967+0000","last_change":"2024-02-21T07:42:01.929126+0000","last_active":"2024-02-21T07:42:31.120967+0000","last_peered":"2024-02-21T07:42:31.120967+0000","last_clean":"2024-02-21T07:42:31.120967+0000","last_became_active":"2024-02-21T07:42:01.928667+0000","last_became_peered":"2024-02-21T07:42:01.928667+0000","last_unstale":"2024-02-21T07:42:31.120967+0000","last_undegraded":"2024-02-21T07:42:31.120967+0000","last_fullsized":"2024-02-21T07:42:31.120967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:32.128601+0000","last_change":"2024-02-21T07:42:01.933903+0000","last_active":"2024-02-21T07:42:32.128601+0000","last_peered":"2024-02-21T07:42:32.128601+0000","last_clean":"2024-02-21T07:42:32.128601+0000","last_became_active":"2024-02-21T07:42:01.933578+0000","last_became_peered":"2024-02-21T07:42:01.933578+0000","last_unstale":"2024-02-21T07:42:32.128601+0000","last_undegraded":"2024-02-21T07:42:32.128601+0000","last_fullsized":"2024-02-21T07:42:32.128601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113230+0000","last_change":"2024-02-21T07:42:02.964660+0000","last_active":"2024-02-21T07:42:08.113230+0000","last_peered":"2024-02-21T07:42:08.113230+0000","last_clean":"2024-02-21T07:42:08.113230+0000","last_became_active":"2024-02-21T07:42:02.964389+0000","last_became_peered":"2024-02-21T07:42:02.964389+0000","last_unstale":"2024-02-21T07:42:08.113230+0000","last_undegraded":"2024-02-21T07:42:08.113230+0000","last_fullsized":"2024-02-21T07:42:08.113230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840629+0000","last_change":"2024-02-21T07:42:07.015720+0000","last_active":"2024-02-21T07:42:09.840629+0000","last_peered":"2024-02-21T07:42:09.840629+0000","last_clean":"2024-02-21T07:42:09.840629+0000","last_became_active":"2024-02-21T07:42:07.015315+0000","last_became_peered":"2024-02-21T07:42:07.015315+0000","last_unstale":"2024-02-21T07:42:09.840629+0000","last_undegraded":"2024-02-21T07:42:09.840629+0000","last_fullsized":"2024-02-21T07:42:09.840629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:39.316245+0000","last_change":"2024-02-21T07:42:01.927978+0000","last_active":"2024-02-21T07:42:39.316245+0000","last_peered":"2024-02-21T07:42:39.316245+0000","last_clean":"2024-02-21T07:42:39.316245+0000","last_became_active":"2024-02-21T07:42:01.927661+0000","last_became_peered":"2024-02-21T07:42:01.927661+0000","last_unstale":"2024-02-21T07:42:39.316245+0000","last_undegraded":"2024-02-21T07:42:39.316245+0000","last_fullsized":"2024-02-21T07:42:39.316245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993701+0000","last_change":"2024-02-21T07:42:02.971175+0000","last_active":"2024-02-21T07:42:07.993701+0000","last_peered":"2024-02-21T07:42:07.993701+0000","last_clean":"2024-02-21T07:42:07.993701+0000","last_became_active":"2024-02-21T07:42:02.970886+0000","last_became_peered":"2024-02-21T07:42:02.970886+0000","last_unstale":"2024-02-21T07:42:07.993701+0000","last_undegraded":"2024-02-21T07:42:07.993701+0000","last_fullsized":"2024-02-21T07:42:07.993701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840892+0000","last_change":"2024-02-21T07:42:07.003267+0000","last_active":"2024-02-21T07:42:09.840892+0000","last_peered":"2024-02-21T07:42:09.840892+0000","last_clean":"2024-02-21T07:42:09.840892+0000","last_became_active":"2024-02-21T07:42:07.002824+0000","last_became_peered":"2024-02-21T07:42:07.002824+0000","last_unstale":"2024-02-21T07:42:09.840892+0000","last_undegraded":"2024-02-21T07:42:09.840892+0000","last_fullsized":"2024-02-21T07:42:09.840892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192386+0000","last_change":"2024-02-21T07:42:02.960884+0000","last_active":"2024-02-21T07:42:09.192386+0000","last_peered":"2024-02-21T07:42:09.192386+0000","last_clean":"2024-02-21T07:42:09.192386+0000","last_became_active":"2024-02-21T07:42:02.960515+0000","last_became_peered":"2024-02-21T07:42:02.960515+0000","last_unstale":"2024-02-21T07:42:09.192386+0000","last_undegraded":"2024-02-21T07:42:09.192386+0000","last_fullsized":"2024-02-21T07:42:09.192386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840732+0000","last_change":"2024-02-21T07:42:02.960807+0000","last_active":"2024-02-21T07:42:09.840732+0000","last_peered":"2024-02-21T07:42:09.840732+0000","last_clean":"2024-02-21T07:42:09.840732+0000","last_became_active":"2024-02-21T07:42:02.960478+0000","last_became_peered":"2024-02-21T07:42:02.960478+0000","last_unstale":"2024-02-21T07:42:09.840732+0000","last_undegraded":"2024-02-21T07:42:09.840732+0000","last_fullsized":"2024-02-21T07:42:09.840732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840455+0000","last_change":"2024-02-21T07:42:02.966666+0000","last_active":"2024-02-21T07:42:09.840455+0000","last_peered":"2024-02-21T07:42:09.840455+0000","last_clean":"2024-02-21T07:42:09.840455+0000","last_became_active":"2024-02-21T07:42:02.966350+0000","last_became_peered":"2024-02-21T07:42:02.966350+0000","last_unstale":"2024-02-21T07:42:09.840455+0000","last_undegraded":"2024-02-21T07:42:09.840455+0000","last_fullsized":"2024-02-21T07:42:09.840455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292232+0000","last_change":"2024-02-21T07:42:02.973149+0000","last_active":"2024-02-21T07:42:08.292232+0000","last_peered":"2024-02-21T07:42:08.292232+0000","last_clean":"2024-02-21T07:42:08.292232+0000","last_became_active":"2024-02-21T07:42:02.972869+0000","last_became_peered":"2024-02-21T07:42:02.972869+0000","last_unstale":"2024-02-21T07:42:08.292232+0000","last_undegraded":"2024-02-21T07:42:08.292232+0000","last_fullsized":"2024-02-21T07:42:08.292232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992632+0000","last_change":"2024-02-21T07:42:02.957623+0000","last_active":"2024-02-21T07:42:07.992632+0000","last_peered":"2024-02-21T07:42:07.992632+0000","last_clean":"2024-02-21T07:42:07.992632+0000","last_became_active":"2024-02-21T07:42:02.956527+0000","last_became_peered":"2024-02-21T07:42:02.956527+0000","last_unstale":"2024-02-21T07:42:07.992632+0000","last_undegraded":"2024-02-21T07:42:07.992632+0000","last_fullsized":"2024-02-21T07:42:07.992632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192705+0000","last_change":"2024-02-21T07:42:02.961369+0000","last_active":"2024-02-21T07:42:09.192705+0000","last_peered":"2024-02-21T07:42:09.192705+0000","last_clean":"2024-02-21T07:42:09.192705+0000","last_became_active":"2024-02-21T07:42:02.961075+0000","last_became_peered":"2024-02-21T07:42:02.961075+0000","last_unstale":"2024-02-21T07:42:09.192705+0000","last_undegraded":"2024-02-21T07:42:09.192705+0000","last_fullsized":"2024-02-21T07:42:09.192705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840881+0000","last_change":"2024-02-21T07:42:02.960461+0000","last_active":"2024-02-21T07:42:09.840881+0000","last_peered":"2024-02-21T07:42:09.840881+0000","last_clean":"2024-02-21T07:42:09.840881+0000","last_became_active":"2024-02-21T07:42:02.960168+0000","last_became_peered":"2024-02-21T07:42:02.960168+0000","last_unstale":"2024-02-21T07:42:09.840881+0000","last_undegraded":"2024-02-21T07:42:09.840881+0000","last_fullsized":"2024-02-21T07:42:09.840881+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.997823+0000","last_change":"2024-02-21T07:42:02.966173+0000","last_active":"2024-02-21T07:42:07.997823+0000","last_peered":"2024-02-21T07:42:07.997823+0000","last_clean":"2024-02-21T07:42:07.997823+0000","last_became_active":"2024-02-21T07:42:02.964280+0000","last_became_peered":"2024-02-21T07:42:02.964280+0000","last_unstale":"2024-02-21T07:42:07.997823+0000","last_undegraded":"2024-02-21T07:42:07.997823+0000","last_fullsized":"2024-02-21T07:42:07.997823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.113001+0000","last_change":"2024-02-21T07:42:02.975012+0000","last_active":"2024-02-21T07:42:08.113001+0000","last_peered":"2024-02-21T07:42:08.113001+0000","last_clean":"2024-02-21T07:42:08.113001+0000","last_became_active":"2024-02-21T07:42:02.974682+0000","last_became_peered":"2024-02-21T07:42:02.974682+0000","last_unstale":"2024-02-21T07:42:08.113001+0000","last_undegraded":"2024-02-21T07:42:08.113001+0000","last_fullsized":"2024-02-21T07:42:08.113001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.996451+0000","last_change":"2024-02-21T07:42:02.966976+0000","last_active":"2024-02-21T07:42:07.996451+0000","last_peered":"2024-02-21T07:42:07.996451+0000","last_clean":"2024-02-21T07:42:07.996451+0000","last_became_active":"2024-02-21T07:42:02.966422+0000","last_became_peered":"2024-02-21T07:42:02.966422+0000","last_unstale":"2024-02-21T07:42:07.996451+0000","last_undegraded":"2024-02-21T07:42:07.996451+0000","last_fullsized":"2024-02-21T07:42:07.996451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186750+0000","last_change":"2024-02-21T07:42:02.957398+0000","last_active":"2024-02-21T07:42:08.186750+0000","last_peered":"2024-02-21T07:42:08.186750+0000","last_clean":"2024-02-21T07:42:08.186750+0000","last_became_active":"2024-02-21T07:42:02.957115+0000","last_became_peered":"2024-02-21T07:42:02.957115+0000","last_unstale":"2024-02-21T07:42:08.186750+0000","last_undegraded":"2024-02-21T07:42:08.186750+0000","last_fullsized":"2024-02-21T07:42:08.186750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992415+0000","last_change":"2024-02-21T07:42:02.956114+0000","last_active":"2024-02-21T07:42:07.992415+0000","last_peered":"2024-02-21T07:42:07.992415+0000","last_clean":"2024-02-21T07:42:07.992415+0000","last_became_active":"2024-02-21T07:42:02.955476+0000","last_became_peered":"2024-02-21T07:42:02.955476+0000","last_unstale":"2024-02-21T07:42:07.992415+0000","last_undegraded":"2024-02-21T07:42:07.992415+0000","last_fullsized":"2024-02-21T07:42:07.992415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192545+0000","last_change":"2024-02-21T07:42:02.955604+0000","last_active":"2024-02-21T07:42:09.192545+0000","last_peered":"2024-02-21T07:42:09.192545+0000","last_clean":"2024-02-21T07:42:09.192545+0000","last_became_active":"2024-02-21T07:42:02.955327+0000","last_became_peered":"2024-02-21T07:42:02.955327+0000","last_unstale":"2024-02-21T07:42:09.192545+0000","last_undegraded":"2024-02-21T07:42:09.192545+0000","last_fullsized":"2024-02-21T07:42:09.192545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.840939+0000","last_change":"2024-02-21T07:42:02.967092+0000","last_active":"2024-02-21T07:42:09.840939+0000","last_peered":"2024-02-21T07:42:09.840939+0000","last_clean":"2024-02-21T07:42:09.840939+0000","last_became_active":"2024-02-21T07:42:02.966845+0000","last_became_peered":"2024-02-21T07:42:02.966845+0000","last_unstale":"2024-02-21T07:42:09.840939+0000","last_undegraded":"2024-02-21T07:42:09.840939+0000","last_fullsized":"2024-02-21T07:42:09.840939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.417187+0000","last_change":"2024-02-21T07:42:02.973535+0000","last_active":"2024-02-21T07:42:10.417187+0000","last_peered":"2024-02-21T07:42:10.417187+0000","last_clean":"2024-02-21T07:42:10.417187+0000","last_became_active":"2024-02-21T07:42:02.973202+0000","last_became_peered":"2024-02-21T07:42:02.973202+0000","last_unstale":"2024-02-21T07:42:10.417187+0000","last_undegraded":"2024-02-21T07:42:10.417187+0000","last_fullsized":"2024-02-21T07:42:10.417187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192968+0000","last_change":"2024-02-21T07:42:02.954398+0000","last_active":"2024-02-21T07:42:09.192968+0000","last_peered":"2024-02-21T07:42:09.192968+0000","last_clean":"2024-02-21T07:42:09.192968+0000","last_became_active":"2024-02-21T07:42:02.954099+0000","last_became_peered":"2024-02-21T07:42:02.954099+0000","last_unstale":"2024-02-21T07:42:09.192968+0000","last_undegraded":"2024-02-21T07:42:09.192968+0000","last_fullsized":"2024-02-21T07:42:09.192968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.186572+0000","last_change":"2024-02-21T07:42:02.958214+0000","last_active":"2024-02-21T07:42:08.186572+0000","last_peered":"2024-02-21T07:42:08.186572+0000","last_clean":"2024-02-21T07:42:08.186572+0000","last_became_active":"2024-02-21T07:42:02.957885+0000","last_became_peered":"2024-02-21T07:42:02.957885+0000","last_unstale":"2024-02-21T07:42:08.186572+0000","last_undegraded":"2024-02-21T07:42:08.186572+0000","last_fullsized":"2024-02-21T07:42:08.186572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292117+0000","last_change":"2024-02-21T07:42:02.980607+0000","last_active":"2024-02-21T07:42:08.292117+0000","last_peered":"2024-02-21T07:42:08.292117+0000","last_clean":"2024-02-21T07:42:08.292117+0000","last_became_active":"2024-02-21T07:42:02.980239+0000","last_became_peered":"2024-02-21T07:42:02.980239+0000","last_unstale":"2024-02-21T07:42:08.292117+0000","last_undegraded":"2024-02-21T07:42:08.292117+0000","last_fullsized":"2024-02-21T07:42:08.292117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.291998+0000","last_change":"2024-02-21T07:42:02.972536+0000","last_active":"2024-02-21T07:42:08.291998+0000","last_peered":"2024-02-21T07:42:08.291998+0000","last_clean":"2024-02-21T07:42:08.291998+0000","last_became_active":"2024-02-21T07:42:02.972216+0000","last_became_peered":"2024-02-21T07:42:02.972216+0000","last_unstale":"2024-02-21T07:42:08.291998+0000","last_undegraded":"2024-02-21T07:42:08.291998+0000","last_fullsized":"2024-02-21T07:42:08.291998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.992288+0000","last_change":"2024-02-21T07:42:02.958082+0000","last_active":"2024-02-21T07:42:07.992288+0000","last_peered":"2024-02-21T07:42:07.992288+0000","last_clean":"2024-02-21T07:42:07.992288+0000","last_became_active":"2024-02-21T07:42:02.957711+0000","last_became_peered":"2024-02-21T07:42:02.957711+0000","last_unstale":"2024-02-21T07:42:07.992288+0000","last_undegraded":"2024-02-21T07:42:07.992288+0000","last_fullsized":"2024-02-21T07:42:07.992288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157664+0000","last_change":"2024-02-21T07:42:02.957799+0000","last_active":"2024-02-21T07:42:10.157664+0000","last_peered":"2024-02-21T07:42:10.157664+0000","last_clean":"2024-02-21T07:42:10.157664+0000","last_became_active":"2024-02-21T07:42:02.957510+0000","last_became_peered":"2024-02-21T07:42:02.957510+0000","last_unstale":"2024-02-21T07:42:10.157664+0000","last_undegraded":"2024-02-21T07:42:10.157664+0000","last_fullsized":"2024-02-21T07:42:10.157664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.125190+0000","last_change":"2024-02-21T07:42:02.962565+0000","last_active":"2024-02-21T07:42:10.125190+0000","last_peered":"2024-02-21T07:42:10.125190+0000","last_clean":"2024-02-21T07:42:10.125190+0000","last_became_active":"2024-02-21T07:42:02.962298+0000","last_became_peered":"2024-02-21T07:42:02.962298+0000","last_unstale":"2024-02-21T07:42:10.125190+0000","last_undegraded":"2024-02-21T07:42:10.125190+0000","last_fullsized":"2024-02-21T07:42:10.125190+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413913+0000","last_change":"2024-02-21T07:42:02.961018+0000","last_active":"2024-02-21T07:42:10.413913+0000","last_peered":"2024-02-21T07:42:10.413913+0000","last_clean":"2024-02-21T07:42:10.413913+0000","last_became_active":"2024-02-21T07:42:02.960634+0000","last_became_peered":"2024-02-21T07:42:02.960634+0000","last_unstale":"2024-02-21T07:42:10.413913+0000","last_undegraded":"2024-02-21T07:42:10.413913+0000","last_fullsized":"2024-02-21T07:42:10.413913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.187102+0000","last_change":"2024-02-21T07:42:02.959426+0000","last_active":"2024-02-21T07:42:08.187102+0000","last_peered":"2024-02-21T07:42:08.187102+0000","last_clean":"2024-02-21T07:42:08.187102+0000","last_became_active":"2024-02-21T07:42:02.959021+0000","last_became_peered":"2024-02-21T07:42:02.959021+0000","last_unstale":"2024-02-21T07:42:08.187102+0000","last_undegraded":"2024-02-21T07:42:08.187102+0000","last_fullsized":"2024-02-21T07:42:08.187102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.995727+0000","last_change":"2024-02-21T07:42:02.971151+0000","last_active":"2024-02-21T07:42:07.995727+0000","last_peered":"2024-02-21T07:42:07.995727+0000","last_clean":"2024-02-21T07:42:07.995727+0000","last_became_active":"2024-02-21T07:42:02.967323+0000","last_became_peered":"2024-02-21T07:42:02.967323+0000","last_unstale":"2024-02-21T07:42:07.995727+0000","last_undegraded":"2024-02-21T07:42:07.995727+0000","last_fullsized":"2024-02-21T07:42:07.995727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.124824+0000","last_change":"2024-02-21T07:42:02.974767+0000","last_active":"2024-02-21T07:42:10.124824+0000","last_peered":"2024-02-21T07:42:10.124824+0000","last_clean":"2024-02-21T07:42:10.124824+0000","last_became_active":"2024-02-21T07:42:02.974292+0000","last_became_peered":"2024-02-21T07:42:02.974292+0000","last_unstale":"2024-02-21T07:42:10.124824+0000","last_undegraded":"2024-02-21T07:42:10.124824+0000","last_fullsized":"2024-02-21T07:42:10.124824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.413730+0000","last_change":"2024-02-21T07:42:02.968079+0000","last_active":"2024-02-21T07:42:10.413730+0000","last_peered":"2024-02-21T07:42:10.413730+0000","last_clean":"2024-02-21T07:42:10.413730+0000","last_became_active":"2024-02-21T07:42:02.967767+0000","last_became_peered":"2024-02-21T07:42:02.967767+0000","last_unstale":"2024-02-21T07:42:10.413730+0000","last_undegraded":"2024-02-21T07:42:10.413730+0000","last_fullsized":"2024-02-21T07:42:10.413730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:07.993396+0000","last_change":"2024-02-21T07:42:02.978031+0000","last_active":"2024-02-21T07:42:07.993396+0000","last_peered":"2024-02-21T07:42:07.993396+0000","last_clean":"2024-02-21T07:42:07.993396+0000","last_became_active":"2024-02-21T07:42:02.977704+0000","last_became_peered":"2024-02-21T07:42:02.977704+0000","last_unstale":"2024-02-21T07:42:07.993396+0000","last_undegraded":"2024-02-21T07:42:07.993396+0000","last_fullsized":"2024-02-21T07:42:07.993396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:10.157552+0000","last_change":"2024-02-21T07:42:02.959959+0000","last_active":"2024-02-21T07:42:10.157552+0000","last_peered":"2024-02-21T07:42:10.157552+0000","last_clean":"2024-02-21T07:42:10.157552+0000","last_became_active":"2024-02-21T07:42:02.959655+0000","last_became_peered":"2024-02-21T07:42:02.959655+0000","last_unstale":"2024-02-21T07:42:10.157552+0000","last_undegraded":"2024-02-21T07:42:10.157552+0000","last_fullsized":"2024-02-21T07:42:10.157552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292334+0000","last_change":"2024-02-21T07:42:02.975851+0000","last_active":"2024-02-21T07:42:08.292334+0000","last_peered":"2024-02-21T07:42:08.292334+0000","last_clean":"2024-02-21T07:42:08.292334+0000","last_became_active":"2024-02-21T07:42:02.973848+0000","last_became_peered":"2024-02-21T07:42:02.973848+0000","last_unstale":"2024-02-21T07:42:08.292334+0000","last_undegraded":"2024-02-21T07:42:08.292334+0000","last_fullsized":"2024-02-21T07:42:08.292334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:08.292889+0000","last_change":"2024-02-21T07:42:02.981681+0000","last_active":"2024-02-21T07:42:08.292889+0000","last_peered":"2024-02-21T07:42:08.292889+0000","last_clean":"2024-02-21T07:42:08.292889+0000","last_became_active":"2024-02-21T07:42:02.981324+0000","last_became_peered":"2024-02-21T07:42:02.981324+0000","last_unstale":"2024-02-21T07:42:08.292889+0000","last_undegraded":"2024-02-21T07:42:08.292889+0000","last_fullsized":"2024-02-21T07:42:08.292889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T07:42:09.192896+0000","last_change":"2024-02-21T07:42:02.954466+0000","last_active":"2024-02-21T07:42:09.192896+0000","last_peered":"2024-02-21T07:42:09.192896+0000","last_clean":"2024-02-21T07:42:09.192896+0000","last_became_active":"2024-02-21T07:42:02.954168+0000","last_became_peered":"2024-02-21T07:42:02.954168+0000","last_unstale":"2024-02-21T07:42:09.192896+0000","last_undegraded":"2024-02-21T07:42:09.192896+0000","last_fullsized":"2024-02-21T07:42:09.192896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":53282,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":126,"num_read_kb":124,"num_write":236,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":344064,"data_stored":106564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":204,"ondisk_log_size":204,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444045,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":146852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":10,"up_from":17,"seq":73014444045,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":187230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5990000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":9,"up_from":17,"seq":73014444045,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":150123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3360000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]}]},{"osd":8,"up_from":17,"seq":73014444044,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":146093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":7,"up_from":17,"seq":73014444045,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":933888,"data_stored":741972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8200000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]}]},{"osd":6,"up_from":17,"seq":73014444045,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":141869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]}]},{"osd":5,"up_from":17,"seq":73014444045,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":954368,"data_stored":738266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444045,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":146338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":3,"up_from":17,"seq":73014444045,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":141461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.724}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8080000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.835}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.899}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.988}]}]},{"osd":2,"up_from":17,"seq":73014444045,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":143819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":1,"up_from":17,"seq":73014444045,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":188008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":17,"seq":73014444046,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":142065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7450000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.573}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":46839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":46061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:42:42.945 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-21T07:42:42.945 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-21T07:42:42.945 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-21T07:42:42.945 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-21T07:42:43.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.175+0000 7fde91c00640 1 Processor -- start 2024-02-21T07:42:43.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.176+0000 7fde91c00640 1 -- start start 2024-02-21T07:42:43.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.177+0000 7fde91c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fde8c182a50 0x7fde8c0fe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.177+0000 7fde91c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fde8c0fe870 0x7fde8c188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.177+0000 7fde91c00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8c0fdea0 con 0x7fde8c0fed00 2024-02-21T07:42:43.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.177+0000 7fde91c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c182e30 con 0x7fde8c182a50 2024-02-21T07:42:43.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.177+0000 7fde91c00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8c0fd290 con 0x7fde8c0fe870 2024-02-21T07:42:43.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.178+0000 7fde8b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fde8c0fe870 0x7fde8c188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.178+0000 7fde91200640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fde8c0fed00 0x7fde8c188f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:48822/0 (socket says 172.21.15.69:48822) 2024-02-21T07:42:43.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.178+0000 7fde91200640 1 -- 172.21.15.69:0/275486767 learned_addr learned my addr 172.21.15.69:0/275486767 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:43.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.178+0000 7fde8be00640 1 --2- 172.21.15.69:0/275486767 >> v2:172.21.15.174:3300/0 conn(0x7fde8c182a50 0x7fde8c0fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.178+0000 7fde8b400640 1 -- 172.21.15.69:0/275486767 >> v2:172.21.15.174:3300/0 conn(0x7fde8c182a50 msgr2=0x7fde8c0fe330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:43.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.178+0000 7fde8b400640 1 --2- 172.21.15.69:0/275486767 >> v2:172.21.15.174:3300/0 conn(0x7fde8c182a50 0x7fde8c0fe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.178+0000 7fde8b400640 1 -- 172.21.15.69:0/275486767 >> v1:172.21.15.184:6789/0 conn(0x7fde8c0fed00 legacy=0x7fde8c188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.178+0000 7fde8b400640 1 -- 172.21.15.69:0/275486767 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c0fd570 con 0x7fde8c0fe870 2024-02-21T07:42:43.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.178+0000 7fde8aa00640 1 -- 172.21.15.69:0/275486767 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228641598 0 0) 0x7fde8c0fdea0 con 0x7fde8c0fed00 2024-02-21T07:42:43.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.179+0000 7fde8b400640 1 --2- 172.21.15.69:0/275486767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8c0fe870 0x7fde8c188a40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0d0610 tx=0x7fde7402b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95c8e2f21835d523 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:43.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.179+0000 7fde8aa00640 1 -- 172.21.15.69:0/275486767 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74031710 con 0x7fde8c0fe870 2024-02-21T07:42:43.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.180+0000 7fde8aa00640 1 -- 172.21.15.69:0/275486767 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7402f050 con 0x7fde8c0fe870 2024-02-21T07:42:43.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.180+0000 7fde8aa00640 1 -- 172.21.15.69:0/275486767 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74031a90 con 0x7fde8c0fe870 2024-02-21T07:42:43.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.180+0000 7fde91c00640 1 -- 172.21.15.69:0/275486767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8c0fe870 msgr2=0x7fde8c188a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.180+0000 7fde91c00640 1 --2- 172.21.15.69:0/275486767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8c0fe870 0x7fde8c188a40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0d0610 tx=0x7fde7402b7b0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.180+0000 7fde91c00640 1 -- 172.21.15.69:0/275486767 shutdown_connections 2024-02-21T07:42:43.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.180+0000 7fde91c00640 1 --2- 172.21.15.69:0/275486767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8c0fe870 0x7fde8c188a40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.180+0000 7fde91c00640 1 --2- 172.21.15.69:0/275486767 >> v2:172.21.15.174:3300/0 conn(0x7fde8c182a50 0x7fde8c0fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.180+0000 7fde91c00640 1 -- 172.21.15.69:0/275486767 >> 172.21.15.69:0/275486767 conn(0x7fde8c0719c0 msgr2=0x7fde8c0668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:43.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.180+0000 7fde91c00640 1 -- 172.21.15.69:0/275486767 shutdown_connections 2024-02-21T07:42:43.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.180+0000 7fde91c00640 1 -- 172.21.15.69:0/275486767 wait complete. 2024-02-21T07:42:43.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.182+0000 7fde91c00640 1 Processor -- start 2024-02-21T07:42:43.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.182+0000 7fde91c00640 1 -- start start 2024-02-21T07:42:43.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.183+0000 7fde91c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde8c0fe870 0x7fde8c21ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde91c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde8c0fed00 0x7fde8c167630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde91c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8c182a50 0x7fde8c167b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde91c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c21c460 con 0x7fde8c0fe870 2024-02-21T07:42:43.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde91c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c220dc0 con 0x7fde8c0fed00 2024-02-21T07:42:43.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde91c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c2210a0 con 0x7fde8c182a50 2024-02-21T07:42:43.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde8c0fe870 0x7fde8c21ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde8c0fe870 0x7fde8c21ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34034/0 (socket says 172.21.15.69:34034) 2024-02-21T07:42:43.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8be00640 1 -- 172.21.15.69:0/7075560 learned_addr learned my addr 172.21.15.69:0/7075560 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:43.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde91200640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8c182a50 0x7fde8c167b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8b400640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde8c0fed00 0x7fde8c167630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8be00640 1 -- 172.21.15.69:0/7075560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8c182a50 msgr2=0x7fde8c167b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8be00640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8c182a50 0x7fde8c167b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8be00640 1 -- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde8c0fed00 msgr2=0x7fde8c167630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8be00640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde8c0fed00 0x7fde8c167630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8be00640 1 -- 172.21.15.69:0/7075560 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74009400 con 0x7fde8c0fe870 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8b400640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde8c0fed00 0x7fde8c167630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.184+0000 7fde8be00640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde8c0fe870 0x7fde8c21ee80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00e870 tx=0x7fde7c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.185+0000 7fde83e00640 1 -- 172.21.15.69:0/7075560 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c009510 con 0x7fde8c0fe870 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.185+0000 7fde83e00640 1 -- 172.21.15.69:0/7075560 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c00eec0 con 0x7fde8c0fe870 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.185+0000 7fde83e00640 1 -- 172.21.15.69:0/7075560 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00cb80 con 0x7fde8c0fe870 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.185+0000 7fde91c00640 1 -- 172.21.15.69:0/7075560 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c221380 con 0x7fde8c0fe870 2024-02-21T07:42:43.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.185+0000 7fde91c00640 1 -- 172.21.15.69:0/7075560 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c21c670 con 0x7fde8c0fe870 2024-02-21T07:42:43.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.186+0000 7fde91c00640 1 -- 172.21.15.69:0/7075560 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8c069c10 con 0x7fde8c0fe870 2024-02-21T07:42:43.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.188+0000 7fde83e00640 1 -- 172.21.15.69:0/7075560 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fde7c00cd20 con 0x7fde8c0fe870 2024-02-21T07:42:43.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.189+0000 7fde83e00640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde6809f130 0x7fde680a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.189+0000 7fde83e00640 1 -- 172.21.15.69:0/7075560 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fde7c0c9cd0 con 0x7fde8c0fe870 2024-02-21T07:42:43.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.190+0000 7fde8b400640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde6809f130 0x7fde680a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.190+0000 7fde8b400640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde6809f130 0x7fde680a15f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde74035000 tx=0x7fde74008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:43.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.193+0000 7fde83e00640 1 -- 172.21.15.69:0/7075560 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fde7c093a70 con 0x7fde8c0fe870 2024-02-21T07:42:43.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.426+0000 7fde91c00640 1 -- 172.21.15.69:0/7075560 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fde8c0683b0 con 0x7fde8c0fe870 2024-02-21T07:42:43.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.426+0000 7fde83e00640 1 -- 172.21.15.69:0/7075560 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fde7c097130 con 0x7fde8c0fe870 2024-02-21T07:42:43.432 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:43.432 INFO:teuthology.orchestra.run.smithi069.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-21T07:42:43.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 -- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde6809f130 msgr2=0x7fde680a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde6809f130 0x7fde680a15f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde74035000 tx=0x7fde74008030 comp rx=0 tx=0).stop 2024-02-21T07:42:43.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 -- 172.21.15.69:0/7075560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde8c0fe870 msgr2=0x7fde8c21ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde8c0fe870 0x7fde8c21ee80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00e870 tx=0x7fde7c00ec70 comp rx=0 tx=0).stop 2024-02-21T07:42:43.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 -- 172.21.15.69:0/7075560 shutdown_connections 2024-02-21T07:42:43.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde6809f130 0x7fde680a15f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde8c182a50 0x7fde8c167b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde8c0fed00 0x7fde8c167630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 --2- 172.21.15.69:0/7075560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde8c0fe870 0x7fde8c21ee80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 -- 172.21.15.69:0/7075560 >> 172.21.15.69:0/7075560 conn(0x7fde8c0719c0 msgr2=0x7fde8c179d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:43.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 -- 172.21.15.69:0/7075560 shutdown_connections 2024-02-21T07:42:43.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.429+0000 7fde91c00640 1 -- 172.21.15.69:0/7075560 wait complete. 2024-02-21T07:42:43.455 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-21T07:42:43.455 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.656+0000 7f842ae00640 1 Processor -- start 2024-02-21T07:42:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.656+0000 7f842ae00640 1 -- start start 2024-02-21T07:42:43.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.657+0000 7f842ae00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8424189f00 0x7f8424186980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.658+0000 7f842ae00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842418a380 con 0x7f842406efb0 2024-02-21T07:42:43.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.658+0000 7f842ae00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842418a660 con 0x7f8424161680 2024-02-21T07:42:43.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.658+0000 7f842ae00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842418be10 con 0x7f8424189f00 2024-02-21T07:42:43.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.658+0000 7f8423e00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f8424161680 0x7f842418b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:48824/0 (socket says 172.21.15.69:48824) 2024-02-21T07:42:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.658+0000 7f8423e00640 1 -- 172.21.15.69:0/3609569601 learned_addr learned my addr 172.21.15.69:0/3609569601 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.658+0000 7f8423400640 1 --2- 172.21.15.69:0/3609569601 >> v2:172.21.15.174:3300/0 conn(0x7f8424189f00 0x7f8424186980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.658+0000 7f8422a00640 1 -- 172.21.15.69:0/3609569601 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397041425 0 0) 0x7f842418a660 con 0x7f8424161680 2024-02-21T07:42:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.658+0000 7f8422a00640 1 -- 172.21.15.69:0/3609569601 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8404003520 con 0x7f8424161680 2024-02-21T07:42:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.658+0000 7f8422a00640 1 -- 172.21.15.69:0/3609569601 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934020275 0 0) 0x7f842418a380 con 0x7f842406efb0 2024-02-21T07:42:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.658+0000 7f8422a00640 1 -- 172.21.15.69:0/3609569601 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f842418a660 con 0x7f842406efb0 2024-02-21T07:42:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.659+0000 7f8423400640 1 -- 172.21.15.69:0/3609569601 >> v1:172.21.15.184:6789/0 conn(0x7f8424161680 legacy=0x7f842418b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.659+0000 7f8423400640 1 -- 172.21.15.69:0/3609569601 >> v1:172.21.15.69:6789/0 conn(0x7f842406efb0 legacy=0x7f842406f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.659+0000 7f8423400640 1 -- 172.21.15.69:0/3609569601 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842418a940 con 0x7f8424189f00 2024-02-21T07:42:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.660+0000 7f8423400640 1 --2- 172.21.15.69:0/3609569601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8424189f00 0x7f8424186980 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f840c009d90 tx=0x7f840c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1bf2bca94af01bb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.660+0000 7f8422a00640 1 -- 172.21.15.69:0/3609569601 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c02cc60 con 0x7f8424189f00 2024-02-21T07:42:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.660+0000 7f8422a00640 1 -- 172.21.15.69:0/3609569601 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c02cdc0 con 0x7f8424189f00 2024-02-21T07:42:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.660+0000 7f8422a00640 1 -- 172.21.15.69:0/3609569601 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c034660 con 0x7f8424189f00 2024-02-21T07:42:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.661+0000 7f842ae00640 1 -- 172.21.15.69:0/3609569601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8424189f00 msgr2=0x7f8424186980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.661+0000 7f842ae00640 1 --2- 172.21.15.69:0/3609569601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8424189f00 0x7f8424186980 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f840c009d90 tx=0x7f840c02beb0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.661+0000 7f842ae00640 1 -- 172.21.15.69:0/3609569601 shutdown_connections 2024-02-21T07:42:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.661+0000 7f842ae00640 1 --2- 172.21.15.69:0/3609569601 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8424189f00 0x7f8424186980 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.661+0000 7f842ae00640 1 -- 172.21.15.69:0/3609569601 >> 172.21.15.69:0/3609569601 conn(0x7f84240f8c00 msgr2=0x7f84240f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.661+0000 7f842ae00640 1 -- 172.21.15.69:0/3609569601 shutdown_connections 2024-02-21T07:42:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.661+0000 7f842ae00640 1 -- 172.21.15.69:0/3609569601 wait complete. 2024-02-21T07:42:43.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.663+0000 7f842ae00640 1 Processor -- start 2024-02-21T07:42:43.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.663+0000 7f842ae00640 1 -- start start 2024-02-21T07:42:43.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.664+0000 7f842ae00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f842406efb0 0x7f84240f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.664+0000 7f842ae00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8424161680 0x7f842415f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.664+0000 7f842ae00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8424189f00 0x7f8424176cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.664+0000 7f842ae00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84240f8a70 con 0x7f842406efb0 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.664+0000 7f842ae00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842421fe70 con 0x7f8424161680 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.664+0000 7f842ae00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842421fb40 con 0x7f8424189f00 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.664+0000 7f8423e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f842406efb0 0x7f84240f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.664+0000 7f8423e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f842406efb0 0x7f84240f8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34050/0 (socket says 172.21.15.69:34050) 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.664+0000 7f8423e00640 1 -- 172.21.15.69:0/131061013 learned_addr learned my addr 172.21.15.69:0/131061013 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.664+0000 7f8423400640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8424161680 0x7f842415f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f8428e00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8424189f00 0x7f8424176cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f8423e00640 1 -- 172.21.15.69:0/131061013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8424189f00 msgr2=0x7f8424176cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f8423e00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8424189f00 0x7f8424176cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f8423e00640 1 -- 172.21.15.69:0/131061013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8424161680 msgr2=0x7f842415f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f8423e00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8424161680 0x7f842415f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f8423e00640 1 -- 172.21.15.69:0/131061013 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c009a70 con 0x7f842406efb0 2024-02-21T07:42:43.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f8423e00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f842406efb0 0x7f84240f8530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f841400c530 tx=0x7f841400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:43.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f841be00640 1 -- 172.21.15.69:0/131061013 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414005ce0 con 0x7f842406efb0 2024-02-21T07:42:43.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f841be00640 1 -- 172.21.15.69:0/131061013 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8414005e40 con 0x7f842406efb0 2024-02-21T07:42:43.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f841be00640 1 -- 172.21.15.69:0/131061013 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414007270 con 0x7f842406efb0 2024-02-21T07:42:43.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.665+0000 7f842ae00640 1 -- 172.21.15.69:0/131061013 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8424160250 con 0x7f842406efb0 2024-02-21T07:42:43.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.666+0000 7f842ae00640 1 -- 172.21.15.69:0/131061013 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8424160810 con 0x7f842406efb0 2024-02-21T07:42:43.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.667+0000 7f842ae00640 1 -- 172.21.15.69:0/131061013 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8424074ec0 con 0x7f842406efb0 2024-02-21T07:42:43.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.668+0000 7f841be00640 1 -- 172.21.15.69:0/131061013 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f84140073d0 con 0x7f842406efb0 2024-02-21T07:42:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.670+0000 7f841be00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f840009f130 0x7f84000a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.670+0000 7f841be00640 1 -- 172.21.15.69:0/131061013 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f84140c90a0 con 0x7f842406efb0 2024-02-21T07:42:43.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.670+0000 7f8423400640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f840009f130 0x7f84000a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:43.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.671+0000 7f8423400640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f840009f130 0x7f84000a15f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f840c036000 tx=0x7f840c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:43.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.674+0000 7f841be00640 1 -- 172.21.15.69:0/131061013 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f841404d8c0 con 0x7f842406efb0 2024-02-21T07:42:43.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.868+0000 7f842ae00640 1 -- 172.21.15.69:0/131061013 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8424069d50 con 0x7f842406efb0 2024-02-21T07:42:43.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.872+0000 7f841be00640 1 -- 172.21.15.69:0/131061013 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7f8414017090 con 0x7f842406efb0 2024-02-21T07:42:43.878 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:43.878 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:43.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.874+0000 7f842ae00640 1 -- 172.21.15.69:0/131061013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f840009f130 msgr2=0x7f84000a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.874+0000 7f842ae00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f840009f130 0x7f84000a15f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f840c036000 tx=0x7f840c030000 comp rx=0 tx=0).stop 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.875+0000 7f842ae00640 1 -- 172.21.15.69:0/131061013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f842406efb0 msgr2=0x7f84240f8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.875+0000 7f842ae00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f842406efb0 0x7f84240f8530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f841400c530 tx=0x7f841400c9f0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.875+0000 7f842ae00640 1 -- 172.21.15.69:0/131061013 shutdown_connections 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.875+0000 7f842ae00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f840009f130 0x7f84000a15f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.875+0000 7f842ae00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8424189f00 0x7f8424176cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.875+0000 7f842ae00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8424161680 0x7f842415f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.875+0000 7f842ae00640 1 --2- 172.21.15.69:0/131061013 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f842406efb0 0x7f84240f8530 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.875+0000 7f842ae00640 1 -- 172.21.15.69:0/131061013 >> 172.21.15.69:0/131061013 conn(0x7f84240f8c00 msgr2=0x7f84240f9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.875+0000 7f842ae00640 1 -- 172.21.15.69:0/131061013 shutdown_connections 2024-02-21T07:42:43.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:43.875+0000 7f842ae00640 1 -- 172.21.15.69:0/131061013 wait complete. 2024-02-21T07:42:43.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:41:56.520105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:42:00.759386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:42:01.409274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:42:05.025537+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:42:43.900 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:42:44.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.105+0000 7f6803e00640 1 Processor -- start 2024-02-21T07:42:44.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.106+0000 7f6803e00640 1 -- start start 2024-02-21T07:42:44.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.108+0000 7f6803e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6804182b70 0x7f6804189df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:44.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.108+0000 7f6803e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680418bae0 con 0x7f680406ac20 2024-02-21T07:42:44.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.108+0000 7f6803e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680418abf0 con 0x7f68040fb840 2024-02-21T07:42:44.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.108+0000 7f6803e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680418aed0 con 0x7f6804182b70 2024-02-21T07:42:44.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.108+0000 7f6802a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6804182b70 0x7f6804189df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:44.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.108+0000 7f6803400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f680406ac20 0x7f680406b030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44692/0 (socket says 172.21.15.69:44692) 2024-02-21T07:42:44.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.108+0000 7f6803400640 1 -- 172.21.15.69:0/2646682408 learned_addr learned my addr 172.21.15.69:0/2646682408 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:44.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.108+0000 7f6802a00640 1 -- 172.21.15.69:0/2646682408 >> v1:172.21.15.184:6789/0 conn(0x7f68040fb840 legacy=0x7f680418a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.109+0000 7f6802a00640 1 -- 172.21.15.69:0/2646682408 >> v1:172.21.15.69:6789/0 conn(0x7f680406ac20 legacy=0x7f680406b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.108+0000 7f6802000640 1 -- 172.21.15.69:0/2646682408 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417322729 0 0) 0x7f680418abf0 con 0x7f68040fb840 2024-02-21T07:42:44.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.109+0000 7f6802a00640 1 -- 172.21.15.69:0/2646682408 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680418b1b0 con 0x7f6804182b70 2024-02-21T07:42:44.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.110+0000 7f6802a00640 1 --2- 172.21.15.69:0/2646682408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6804182b70 0x7f6804189df0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67f40097a0 tx=0x7f67f402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae21bf629ab379c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:44.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.110+0000 7f6802000640 1 -- 172.21.15.69:0/2646682408 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4030710 con 0x7f6804182b70 2024-02-21T07:42:44.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.110+0000 7f6802000640 1 -- 172.21.15.69:0/2646682408 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f402e050 con 0x7f6804182b70 2024-02-21T07:42:44.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.110+0000 7f6802000640 1 -- 172.21.15.69:0/2646682408 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4030a90 con 0x7f6804182b70 2024-02-21T07:42:44.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.111+0000 7f6803e00640 1 -- 172.21.15.69:0/2646682408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6804182b70 msgr2=0x7f6804189df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.111+0000 7f6803e00640 1 --2- 172.21.15.69:0/2646682408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6804182b70 0x7f6804189df0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67f40097a0 tx=0x7f67f402b710 comp rx=0 tx=0).stop 2024-02-21T07:42:44.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.111+0000 7f6803e00640 1 -- 172.21.15.69:0/2646682408 shutdown_connections 2024-02-21T07:42:44.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.111+0000 7f6803e00640 1 --2- 172.21.15.69:0/2646682408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6804182b70 0x7f6804189df0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.111+0000 7f6803e00640 1 -- 172.21.15.69:0/2646682408 >> 172.21.15.69:0/2646682408 conn(0x7f68040d2ae0 msgr2=0x7f68040d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:44.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.111+0000 7f6803e00640 1 -- 172.21.15.69:0/2646682408 shutdown_connections 2024-02-21T07:42:44.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.111+0000 7f6803e00640 1 -- 172.21.15.69:0/2646682408 wait complete. 2024-02-21T07:42:44.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.113+0000 7f6803e00640 1 Processor -- start 2024-02-21T07:42:44.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.113+0000 7f6803e00640 1 -- start start 2024-02-21T07:42:44.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.114+0000 7f6803e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f680406ac20 0x7f68040cf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:44.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.114+0000 7f6803e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68040fb840 0x7f6804172360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:44.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.114+0000 7f6803e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6804182b70 0x7f68041756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:44.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.114+0000 7f6803e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040d1060 con 0x7f68040fb840 2024-02-21T07:42:44.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.114+0000 7f6803e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040cf550 con 0x7f6804182b70 2024-02-21T07:42:44.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.114+0000 7f6803e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68041728a0 con 0x7f680406ac20 2024-02-21T07:42:44.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f6802a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f680406ac20 0x7f68040cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:44.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f67fbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68040fb840 0x7f6804172360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:44.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f6802a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f680406ac20 0x7f68040cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34690/0 (socket says 172.21.15.69:34690) 2024-02-21T07:42:44.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f6802a00640 1 -- 172.21.15.69:0/811642353 learned_addr learned my addr 172.21.15.69:0/811642353 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:44.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f6803400640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6804182b70 0x7f68041756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:44.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f6802a00640 1 -- 172.21.15.69:0/811642353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6804182b70 msgr2=0x7f68041756b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f6802a00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6804182b70 0x7f68041756b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f6802a00640 1 -- 172.21.15.69:0/811642353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68040fb840 msgr2=0x7f6804172360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f6802a00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68040fb840 0x7f6804172360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f6802a00640 1 -- 172.21.15.69:0/811642353 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f4009400 con 0x7f680406ac20 2024-02-21T07:42:44.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.115+0000 7f67fbe00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68040fb840 0x7f6804172360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:44.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.116+0000 7f6802a00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f680406ac20 0x7f68040cf010 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f67f4000c00 tx=0x7f67f40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:44.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.116+0000 7f67faa00640 1 -- 172.21.15.69:0/811642353 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f40329d0 con 0x7f680406ac20 2024-02-21T07:42:44.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.116+0000 7f67faa00640 1 -- 172.21.15.69:0/811642353 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f4032b50 con 0x7f680406ac20 2024-02-21T07:42:44.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.116+0000 7f6803e00640 1 -- 172.21.15.69:0/811642353 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6804175bf0 con 0x7f680406ac20 2024-02-21T07:42:44.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.116+0000 7f67faa00640 1 -- 172.21.15.69:0/811642353 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f403c470 con 0x7f680406ac20 2024-02-21T07:42:44.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.116+0000 7f6803e00640 1 -- 172.21.15.69:0/811642353 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68041761a0 con 0x7f680406ac20 2024-02-21T07:42:44.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.117+0000 7f6803e00640 1 -- 172.21.15.69:0/811642353 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68040cd430 con 0x7f680406ac20 2024-02-21T07:42:44.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.120+0000 7f67faa00640 1 -- 172.21.15.69:0/811642353 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f67f4039040 con 0x7f680406ac20 2024-02-21T07:42:44.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.121+0000 7f67faa00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f67e009f130 0x7f67e00a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:44.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.121+0000 7f67faa00640 1 -- 172.21.15.69:0/811642353 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f67f40ebe10 con 0x7f680406ac20 2024-02-21T07:42:44.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.122+0000 7f67fbe00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f67e009f130 0x7f67e00a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:44.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.122+0000 7f67fbe00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f67e009f130 0x7f67e00a15f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f68040f8b00 tx=0x7f67ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:44.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.123+0000 7f67faa00640 1 -- 172.21.15.69:0/811642353 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f67f40b5be0 con 0x7f680406ac20 2024-02-21T07:42:44.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.318+0000 7f6803e00640 1 -- 172.21.15.69:0/811642353 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6804069c10 con 0x7f680406ac20 2024-02-21T07:42:44.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.319+0000 7f67faa00640 1 -- 172.21.15.69:0/811642353 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67f4037070 con 0x7f680406ac20 2024-02-21T07:42:44.325 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-02-21T07:42:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.321+0000 7f6803e00640 1 -- 172.21.15.69:0/811642353 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f67e009f130 msgr2=0x7f67e00a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.321+0000 7f6803e00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f67e009f130 0x7f67e00a15f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f68040f8b00 tx=0x7f67ec009040 comp rx=0 tx=0).stop 2024-02-21T07:42:44.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.321+0000 7f6803e00640 1 -- 172.21.15.69:0/811642353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f680406ac20 msgr2=0x7f68040cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.321+0000 7f6803e00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f680406ac20 0x7f68040cf010 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f67f4000c00 tx=0x7f67f40046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.321+0000 7f6803e00640 1 -- 172.21.15.69:0/811642353 shutdown_connections 2024-02-21T07:42:44.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.321+0000 7f6803e00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f67e009f130 0x7f67e00a15f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.321+0000 7f6803e00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6804182b70 0x7f68041756b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.321+0000 7f6803e00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68040fb840 0x7f6804172360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.321+0000 7f6803e00640 1 --2- 172.21.15.69:0/811642353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f680406ac20 0x7f68040cf010 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.321+0000 7f6803e00640 1 -- 172.21.15.69:0/811642353 >> 172.21.15.69:0/811642353 conn(0x7f68040d2ae0 msgr2=0x7f68040f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:44.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.322+0000 7f6803e00640 1 -- 172.21.15.69:0/811642353 shutdown_connections 2024-02-21T07:42:44.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.322+0000 7f6803e00640 1 -- 172.21.15.69:0/811642353 wait complete. 2024-02-21T07:42:44.348 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:42:44.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.559+0000 7fedb5000640 1 Processor -- start 2024-02-21T07:42:44.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.559+0000 7fedb5000640 1 -- start start 2024-02-21T07:42:44.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.561+0000 7fedb5000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fedb018b6d0 0x7fedb018c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:44.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.561+0000 7fedb5000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb0189f40 con 0x7fedb00fa520 2024-02-21T07:42:44.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.561+0000 7fedb5000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb00fa990 con 0x7fedb017f550 2024-02-21T07:42:44.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.561+0000 7fedb5000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb00ff310 con 0x7fedb018b6d0 2024-02-21T07:42:44.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.561+0000 7fedade00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fedb017f550 0x7fedb00f9e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:48842/0 (socket says 172.21.15.69:48842) 2024-02-21T07:42:44.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.561+0000 7fedade00640 1 -- 172.21.15.69:0/2470349144 learned_addr learned my addr 172.21.15.69:0/2470349144 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:44.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.561+0000 7fedae800640 1 --2- 172.21.15.69:0/2470349144 >> v2:172.21.15.174:3300/0 conn(0x7fedb018b6d0 0x7fedb018c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:44.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.561+0000 7fedaca00640 1 -- 172.21.15.69:0/2470349144 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663597473 0 0) 0x7fedb00fa990 con 0x7fedb017f550 2024-02-21T07:42:44.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.561+0000 7fedaca00640 1 -- 172.21.15.69:0/2470349144 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed90003520 con 0x7fedb017f550 2024-02-21T07:42:44.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.561+0000 7fedaca00640 1 -- 172.21.15.69:0/2470349144 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789682674 0 0) 0x7fedb0189f40 con 0x7fedb00fa520 2024-02-21T07:42:44.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.562+0000 7fedaca00640 1 -- 172.21.15.69:0/2470349144 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb00fa990 con 0x7fedb00fa520 2024-02-21T07:42:44.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.562+0000 7fedae800640 1 -- 172.21.15.69:0/2470349144 >> v1:172.21.15.184:6789/0 conn(0x7fedb017f550 legacy=0x7fedb00f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.562+0000 7fedae800640 1 -- 172.21.15.69:0/2470349144 >> v1:172.21.15.174:6789/0 conn(0x7fedb00fa520 legacy=0x7fedb018afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.562+0000 7fedae800640 1 -- 172.21.15.69:0/2470349144 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb017f930 con 0x7fedb018b6d0 2024-02-21T07:42:44.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.563+0000 7fedae800640 1 --2- 172.21.15.69:0/2470349144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb018b6d0 0x7fedb018c140 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feda8009d90 tx=0x7feda802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3ada60f4c2fbb12 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:44.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.563+0000 7fedaca00640 1 -- 172.21.15.69:0/2470349144 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda802cc60 con 0x7fedb018b6d0 2024-02-21T07:42:44.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.563+0000 7fedaca00640 1 -- 172.21.15.69:0/2470349144 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda802cdc0 con 0x7fedb018b6d0 2024-02-21T07:42:44.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.563+0000 7fedaca00640 1 -- 172.21.15.69:0/2470349144 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8034660 con 0x7fedb018b6d0 2024-02-21T07:42:44.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.564+0000 7fedb5000640 1 -- 172.21.15.69:0/2470349144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb018b6d0 msgr2=0x7fedb018c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.564+0000 7fedb5000640 1 --2- 172.21.15.69:0/2470349144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb018b6d0 0x7fedb018c140 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feda8009d90 tx=0x7feda802beb0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.564+0000 7fedb5000640 1 -- 172.21.15.69:0/2470349144 shutdown_connections 2024-02-21T07:42:44.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.564+0000 7fedb5000640 1 --2- 172.21.15.69:0/2470349144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb018b6d0 0x7fedb018c140 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.564+0000 7fedb5000640 1 -- 172.21.15.69:0/2470349144 >> 172.21.15.69:0/2470349144 conn(0x7fedb00668e0 msgr2=0x7fedb0066cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:44.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.564+0000 7fedb5000640 1 -- 172.21.15.69:0/2470349144 shutdown_connections 2024-02-21T07:42:44.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.564+0000 7fedb5000640 1 -- 172.21.15.69:0/2470349144 wait complete. 2024-02-21T07:42:44.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.566+0000 7fedb5000640 1 Processor -- start 2024-02-21T07:42:44.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.566+0000 7fedb5000640 1 -- start start 2024-02-21T07:42:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedb5000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb00fa520 0x7fedb0168270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedb5000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedb017f550 0x7fedb021eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:44.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedb5000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fedb018b6d0 0x7fedb021f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:44.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedb5000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb00d2010 con 0x7fedb017f550 2024-02-21T07:42:44.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedb5000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb00d1490 con 0x7fedb00fa520 2024-02-21T07:42:44.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedb5000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb00d1770 con 0x7fedb018b6d0 2024-02-21T07:42:44.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedad400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedb017f550 0x7fedb021eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:44.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedad400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedb017f550 0x7fedb021eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34080/0 (socket says 172.21.15.69:34080) 2024-02-21T07:42:44.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedade00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb00fa520 0x7fedb0168270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:44.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedad400640 1 -- 172.21.15.69:0/931268508 learned_addr learned my addr 172.21.15.69:0/931268508 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:44.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.567+0000 7fedae800640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fedb018b6d0 0x7fedb021f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:44.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7fedad400640 1 -- 172.21.15.69:0/931268508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fedb018b6d0 msgr2=0x7fedb021f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7fedad400640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fedb018b6d0 0x7fedb021f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7fedad400640 1 -- 172.21.15.69:0/931268508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb00fa520 msgr2=0x7fedb0168270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7fedad400640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb00fa520 0x7fedb0168270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7fedad400640 1 -- 172.21.15.69:0/931268508 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda8009a70 con 0x7fedb017f550 2024-02-21T07:42:44.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7fedade00640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb00fa520 0x7fedb0168270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:44.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7fedad400640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedb017f550 0x7fedb021eeb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed9800c400 tx=0x7fed9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:44.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7feda6000640 1 -- 172.21.15.69:0/931268508 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed980052d0 con 0x7fedb017f550 2024-02-21T07:42:44.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7feda6000640 1 -- 172.21.15.69:0/931268508 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed98005470 con 0x7fedb017f550 2024-02-21T07:42:44.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7feda6000640 1 -- 172.21.15.69:0/931268508 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98003830 con 0x7fedb017f550 2024-02-21T07:42:44.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7fedb5000640 1 -- 172.21.15.69:0/931268508 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb00d1a50 con 0x7fedb017f550 2024-02-21T07:42:44.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.568+0000 7fedb5000640 1 -- 172.21.15.69:0/931268508 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb021ff00 con 0x7fedb017f550 2024-02-21T07:42:44.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.570+0000 7fedb5000640 1 -- 172.21.15.69:0/931268508 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb021fd60 con 0x7fedb017f550 2024-02-21T07:42:44.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.572+0000 7feda6000640 1 -- 172.21.15.69:0/931268508 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fed98003990 con 0x7fedb017f550 2024-02-21T07:42:44.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.575+0000 7feda6000640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fed8c09f130 0x7fed8c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:44.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.575+0000 7feda6000640 1 -- 172.21.15.69:0/931268508 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fed980c8fb0 con 0x7fedb017f550 2024-02-21T07:42:44.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.575+0000 7fedade00640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fed8c09f130 0x7fed8c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:44.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.575+0000 7fedade00640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fed8c09f130 0x7fed8c0a15f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feda0000f60 tx=0x7feda0007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:44.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.578+0000 7feda6000640 1 -- 172.21.15.69:0/931268508 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fed9804d8c0 con 0x7fedb017f550 2024-02-21T07:42:44.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.761+0000 7fedb5000640 1 -- 172.21.15.69:0/931268508 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fedb00faf50 con 0x7fedb017f550 2024-02-21T07:42:44.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.761+0000 7feda6000640 1 -- 172.21.15.69:0/931268508 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed980170a0 con 0x7fedb017f550 2024-02-21T07:42:44.766 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:42:44.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 -- 172.21.15.69:0/931268508 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fed8c09f130 msgr2=0x7fed8c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fed8c09f130 0x7fed8c0a15f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feda0000f60 tx=0x7feda0007d50 comp rx=0 tx=0).stop 2024-02-21T07:42:44.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 -- 172.21.15.69:0/931268508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedb017f550 msgr2=0x7fedb021eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:44.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedb017f550 0x7fedb021eeb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed9800c400 tx=0x7fed9800c8c0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 -- 172.21.15.69:0/931268508 shutdown_connections 2024-02-21T07:42:44.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fed8c09f130 0x7fed8c0a15f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fedb018b6d0 0x7fedb021f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedb017f550 0x7fedb021eeb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 --2- 172.21.15.69:0/931268508 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fedb00fa520 0x7fedb0168270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:44.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 -- 172.21.15.69:0/931268508 >> 172.21.15.69:0/931268508 conn(0x7fedb00668e0 msgr2=0x7fedb00f92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:44.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 -- 172.21.15.69:0/931268508 shutdown_connections 2024-02-21T07:42:44.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.763+0000 7fedb5000640 1 -- 172.21.15.69:0/931268508 wait complete. 2024-02-21T07:42:44.786 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:42:44.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.993+0000 7fd91b000640 1 Processor -- start 2024-02-21T07:42:44.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.994+0000 7fd91b000640 1 -- start start 2024-02-21T07:42:45.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.995+0000 7fd91b000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd914182f00 0x7fd9140f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.995+0000 7fd91b000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd91415f0f0 0x7fd914183ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd91b000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd914183ff0 con 0x7fd914183630 2024-02-21T07:42:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd91b000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9141851b0 con 0x7fd91415f0f0 2024-02-21T07:42:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd91b000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91415f580 con 0x7fd914182f00 2024-02-21T07:42:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd919c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fd914182f00 0x7fd9140f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd919200640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd914183630 0x7fd91415e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:48844/0 (socket says 172.21.15.69:48844) 2024-02-21T07:42:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd919200640 1 -- 172.21.15.69:0/826042476 learned_addr learned my addr 172.21.15.69:0/826042476 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd91a600640 1 --2- 172.21.15.69:0/826042476 >> v2:172.21.15.174:3300/0 conn(0x7fd91415f0f0 0x7fd914183ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd919c00640 1 -- 172.21.15.69:0/826042476 >> v2:172.21.15.174:3300/0 conn(0x7fd91415f0f0 msgr2=0x7fd914183ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd913e00640 1 -- 172.21.15.69:0/826042476 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152212909 0 0) 0x7fd914183ff0 con 0x7fd914183630 2024-02-21T07:42:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd919c00640 1 --2- 172.21.15.69:0/826042476 >> v2:172.21.15.174:3300/0 conn(0x7fd91415f0f0 0x7fd914183ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd919c00640 1 -- 172.21.15.69:0/826042476 >> v1:172.21.15.184:6789/0 conn(0x7fd914183630 legacy=0x7fd91415e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.996+0000 7fd919c00640 1 -- 172.21.15.69:0/826042476 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd914184250 con 0x7fd914182f00 2024-02-21T07:42:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.997+0000 7fd919c00640 1 --2- 172.21.15.69:0/826042476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd914182f00 0x7fd9140f5a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd9140cbca0 tx=0x7fd90802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=921cc9e4f7a4ec9d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.998+0000 7fd913e00640 1 -- 172.21.15.69:0/826042476 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90802e070 con 0x7fd914182f00 2024-02-21T07:42:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.998+0000 7fd913e00640 1 -- 172.21.15.69:0/826042476 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9080315a0 con 0x7fd914182f00 2024-02-21T07:42:45.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.998+0000 7fd913e00640 1 -- 172.21.15.69:0/826042476 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908031930 con 0x7fd914182f00 2024-02-21T07:42:45.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.998+0000 7fd91b000640 1 -- 172.21.15.69:0/826042476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd914182f00 msgr2=0x7fd9140f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.998+0000 7fd91b000640 1 --2- 172.21.15.69:0/826042476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd914182f00 0x7fd9140f5a20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd9140cbca0 tx=0x7fd90802b840 comp rx=0 tx=0).stop 2024-02-21T07:42:45.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.998+0000 7fd91b000640 1 -- 172.21.15.69:0/826042476 shutdown_connections 2024-02-21T07:42:45.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.998+0000 7fd91b000640 1 --2- 172.21.15.69:0/826042476 >> v2:172.21.15.174:3300/0 conn(0x7fd91415f0f0 0x7fd914183ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.998+0000 7fd91b000640 1 --2- 172.21.15.69:0/826042476 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd914182f00 0x7fd9140f5a20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.998+0000 7fd91b000640 1 -- 172.21.15.69:0/826042476 >> 172.21.15.69:0/826042476 conn(0x7fd9140ce1b0 msgr2=0x7fd9140ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:45.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.999+0000 7fd91b000640 1 -- 172.21.15.69:0/826042476 shutdown_connections 2024-02-21T07:42:45.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:44.999+0000 7fd91b000640 1 -- 172.21.15.69:0/826042476 wait complete. 2024-02-21T07:42:45.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.001+0000 7fd91b000640 1 Processor -- start 2024-02-21T07:42:45.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.001+0000 7fd91b000640 1 -- start start 2024-02-21T07:42:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.002+0000 7fd91b000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91415f0f0 0x7fd9140cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.002+0000 7fd91b000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd914182f00 0x7fd914157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.002+0000 7fd91b000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd914183630 0x7fd91421dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.002+0000 7fd91b000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91421c9b0 con 0x7fd914183630 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.002+0000 7fd91b000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91421cc90 con 0x7fd91415f0f0 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.002+0000 7fd91b000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91421cf70 con 0x7fd914182f00 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd91a600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd914183630 0x7fd91421dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd91a600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd914183630 0x7fd91421dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34096/0 (socket says 172.21.15.69:34096) 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd91a600640 1 -- 172.21.15.69:0/863060406 learned_addr learned my addr 172.21.15.69:0/863060406 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd919200640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd914182f00 0x7fd914157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd919c00640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91415f0f0 0x7fd9140cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd91a600640 1 -- 172.21.15.69:0/863060406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd914182f00 msgr2=0x7fd914157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd91a600640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd914182f00 0x7fd914157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd91a600640 1 -- 172.21.15.69:0/863060406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91415f0f0 msgr2=0x7fd9140cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd91a600640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91415f0f0 0x7fd9140cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd91a600640 1 -- 172.21.15.69:0/863060406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908009400 con 0x7fd914183630 2024-02-21T07:42:45.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd919200640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd914182f00 0x7fd914157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:45.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.003+0000 7fd91a600640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd914183630 0x7fd91421dd30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00efc0 tx=0x7fd90c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:45.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.004+0000 7fd911600640 1 -- 172.21.15.69:0/863060406 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c009ba0 con 0x7fd914183630 2024-02-21T07:42:45.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.004+0000 7fd911600640 1 -- 172.21.15.69:0/863060406 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c00f040 con 0x7fd914183630 2024-02-21T07:42:45.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.004+0000 7fd911600640 1 -- 172.21.15.69:0/863060406 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0146c0 con 0x7fd914183630 2024-02-21T07:42:45.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.004+0000 7fd91b000640 1 -- 172.21.15.69:0/863060406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91421d250 con 0x7fd914183630 2024-02-21T07:42:45.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.004+0000 7fd91b000640 1 -- 172.21.15.69:0/863060406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91421d810 con 0x7fd914183630 2024-02-21T07:42:45.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.005+0000 7fd91b000640 1 -- 172.21.15.69:0/863060406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91421da30 con 0x7fd914183630 2024-02-21T07:42:45.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.007+0000 7fd911600640 1 -- 172.21.15.69:0/863060406 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fd90c014820 con 0x7fd914183630 2024-02-21T07:42:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.008+0000 7fd911600640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd8f409f130 0x7fd8f40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.008+0000 7fd911600640 1 -- 172.21.15.69:0/863060406 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fd90c0ca7e0 con 0x7fd914183630 2024-02-21T07:42:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.009+0000 7fd919c00640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd8f409f130 0x7fd8f40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.009+0000 7fd919c00640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd8f409f130 0x7fd8f40a15f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd908036000 tx=0x7fd90803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:45.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.012+0000 7fd911600640 1 -- 172.21.15.69:0/863060406 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd90c0943e0 con 0x7fd914183630 2024-02-21T07:42:45.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.206+0000 7fd91b000640 1 -- 172.21.15.69:0/863060406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd914069c10 con 0x7fd914183630 2024-02-21T07:42:45.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.206+0000 7fd911600640 1 -- 172.21.15.69:0/863060406 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd90c0180a0 con 0x7fd914183630 2024-02-21T07:42:45.211 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-02-21T07:42:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 -- 172.21.15.69:0/863060406 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd8f409f130 msgr2=0x7fd8f40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd8f409f130 0x7fd8f40a15f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd908036000 tx=0x7fd90803d040 comp rx=0 tx=0).stop 2024-02-21T07:42:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 -- 172.21.15.69:0/863060406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd914183630 msgr2=0x7fd91421dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd914183630 0x7fd91421dd30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00efc0 tx=0x7fd90c00c490 comp rx=0 tx=0).stop 2024-02-21T07:42:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 -- 172.21.15.69:0/863060406 shutdown_connections 2024-02-21T07:42:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd8f409f130 0x7fd8f40a15f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd914183630 0x7fd91421dd30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd914182f00 0x7fd914157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 --2- 172.21.15.69:0/863060406 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd91415f0f0 0x7fd9140cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 -- 172.21.15.69:0/863060406 >> 172.21.15.69:0/863060406 conn(0x7fd9140ce1b0 msgr2=0x7fd914183a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 -- 172.21.15.69:0/863060406 shutdown_connections 2024-02-21T07:42:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.209+0000 7fd91b000640 1 -- 172.21.15.69:0/863060406 wait complete. 2024-02-21T07:42:45.234 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:42:45.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.442+0000 7fcfbf000640 1 Processor -- start 2024-02-21T07:42:45.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.442+0000 7fcfbf000640 1 -- start start 2024-02-21T07:42:45.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.444+0000 7fcfbf000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcfb80ee640 0x7fcfb80eead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.444+0000 7fcfbf000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcfb8186bc0 0x7fcfb8187010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.444+0000 7fcfbf000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb80ef010 con 0x7fcfb8183ea0 2024-02-21T07:42:45.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.444+0000 7fcfbf000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb8186010 con 0x7fcfb80ee640 2024-02-21T07:42:45.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.444+0000 7fcfbf000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb8184df0 con 0x7fcfb8186bc0 2024-02-21T07:42:45.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.445+0000 7fcfbd000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcfb8186bc0 0x7fcfb8187010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.445+0000 7fcfb7400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcfb80ee640 0x7fcfb80eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.445+0000 7fcfbd000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fcfb8186bc0 0x7fcfb8187010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34724/0 (socket says 172.21.15.69:34724) 2024-02-21T07:42:45.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.445+0000 7fcfbd000640 1 -- 172.21.15.69:0/1952460753 learned_addr learned my addr 172.21.15.69:0/1952460753 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:45.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.445+0000 7fcfb7e00640 1 --1- 172.21.15.69:0/1952460753 >> v1:172.21.15.174:6789/0 conn(0x7fcfb8183ea0 0x7fcfb81846e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60668/0 (socket says 172.21.15.69:60668) 2024-02-21T07:42:45.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.445+0000 7fcfbd000640 1 -- 172.21.15.69:0/1952460753 >> v2:172.21.15.174:3300/0 conn(0x7fcfb80ee640 msgr2=0x7fcfb80eead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:45.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.445+0000 7fcfbd000640 1 --2- 172.21.15.69:0/1952460753 >> v2:172.21.15.174:3300/0 conn(0x7fcfb80ee640 0x7fcfb80eead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.445+0000 7fcfbd000640 1 -- 172.21.15.69:0/1952460753 >> v1:172.21.15.174:6789/0 conn(0x7fcfb8183ea0 legacy=0x7fcfb81846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.445+0000 7fcfbd000640 1 -- 172.21.15.69:0/1952460753 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb81850b0 con 0x7fcfb8186bc0 2024-02-21T07:42:45.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.446+0000 7fcfbd000640 1 --2- 172.21.15.69:0/1952460753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb8186bc0 0x7fcfb8187010 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80edae0 tx=0x7fcfb002bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b67ae45fa265aa79 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:45.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.447+0000 7fcfb6a00640 1 -- 172.21.15.69:0/1952460753 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb002ca80 con 0x7fcfb8186bc0 2024-02-21T07:42:45.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.447+0000 7fcfb6a00640 1 -- 172.21.15.69:0/1952460753 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb002cbe0 con 0x7fcfb8186bc0 2024-02-21T07:42:45.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.447+0000 7fcfb6a00640 1 -- 172.21.15.69:0/1952460753 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00343f0 con 0x7fcfb8186bc0 2024-02-21T07:42:45.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.448+0000 7fcfbf000640 1 -- 172.21.15.69:0/1952460753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb8186bc0 msgr2=0x7fcfb8187010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.448+0000 7fcfbf000640 1 --2- 172.21.15.69:0/1952460753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb8186bc0 0x7fcfb8187010 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80edae0 tx=0x7fcfb002bee0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.448+0000 7fcfbf000640 1 -- 172.21.15.69:0/1952460753 shutdown_connections 2024-02-21T07:42:45.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.448+0000 7fcfbf000640 1 --2- 172.21.15.69:0/1952460753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb8186bc0 0x7fcfb8187010 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.448+0000 7fcfbf000640 1 --2- 172.21.15.69:0/1952460753 >> v2:172.21.15.174:3300/0 conn(0x7fcfb80ee640 0x7fcfb80eead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.448+0000 7fcfbf000640 1 -- 172.21.15.69:0/1952460753 >> 172.21.15.69:0/1952460753 conn(0x7fcfb80ce3d0 msgr2=0x7fcfb80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:45.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.448+0000 7fcfbf000640 1 -- 172.21.15.69:0/1952460753 shutdown_connections 2024-02-21T07:42:45.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.448+0000 7fcfbf000640 1 -- 172.21.15.69:0/1952460753 wait complete. 2024-02-21T07:42:45.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.450+0000 7fcfbf000640 1 Processor -- start 2024-02-21T07:42:45.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.450+0000 7fcfbf000640 1 -- start start 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfbf000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfb80ee640 0x7fcfb8174520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfbf000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfb8183ea0 0x7fcfb8220ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfbf000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb8186bc0 0x7fcfb8221420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfbf000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80cf160 con 0x7fcfb80ee640 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfbf000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8220a50 con 0x7fcfb8183ea0 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfbf000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8221960 con 0x7fcfb8186bc0 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfb7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfb8183ea0 0x7fcfb8220ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfb7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfb8183ea0 0x7fcfb8220ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42576/0 (socket says 172.21.15.69:42576) 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfb7400640 1 -- 172.21.15.69:0/1722546092 learned_addr learned my addr 172.21.15.69:0/1722546092 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfbd000640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb8186bc0 0x7fcfb8221420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfb7e00640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfb80ee640 0x7fcfb8174520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfb7400640 1 -- 172.21.15.69:0/1722546092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb8186bc0 msgr2=0x7fcfb8221420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfb7400640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb8186bc0 0x7fcfb8221420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfb7400640 1 -- 172.21.15.69:0/1722546092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfb80ee640 msgr2=0x7fcfb8174520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfb7400640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfb80ee640 0x7fcfb8174520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.452+0000 7fcfb7400640 1 -- 172.21.15.69:0/1722546092 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0009b30 con 0x7fcfb8183ea0 2024-02-21T07:42:45.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.453+0000 7fcfb7400640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfb8183ea0 0x7fcfb8220ee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e870 tx=0x7fcfa400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:45.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.455+0000 7fcfafe00640 1 -- 172.21.15.69:0/1722546092 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa40094f0 con 0x7fcfb8183ea0 2024-02-21T07:42:45.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.455+0000 7fcfafe00640 1 -- 172.21.15.69:0/1722546092 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa400c940 con 0x7fcfb8183ea0 2024-02-21T07:42:45.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.455+0000 7fcfafe00640 1 -- 172.21.15.69:0/1722546092 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400ccf0 con 0x7fcfb8183ea0 2024-02-21T07:42:45.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.455+0000 7fcfbf000640 1 -- 172.21.15.69:0/1722546092 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb821fb60 con 0x7fcfb8183ea0 2024-02-21T07:42:45.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.455+0000 7fcfbf000640 1 -- 172.21.15.69:0/1722546092 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb8220120 con 0x7fcfb8183ea0 2024-02-21T07:42:45.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.456+0000 7fcfbf000640 1 -- 172.21.15.69:0/1722546092 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb8069d50 con 0x7fcfb8183ea0 2024-02-21T07:42:45.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.458+0000 7fcfafe00640 1 -- 172.21.15.69:0/1722546092 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fcfa4013470 con 0x7fcfb8183ea0 2024-02-21T07:42:45.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.459+0000 7fcfafe00640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf9809f130 0x7fcf980a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.459+0000 7fcfafe00640 1 -- 172.21.15.69:0/1722546092 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fcfa40c9fa0 con 0x7fcfb8183ea0 2024-02-21T07:42:45.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.459+0000 7fcfb7e00640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf9809f130 0x7fcf980a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.460+0000 7fcfb7e00640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf9809f130 0x7fcf980a15f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000f60 tx=0x7fcfa8000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.463+0000 7fcfafe00640 1 -- 172.21.15.69:0/1722546092 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fcfa4093d60 con 0x7fcfb8183ea0 2024-02-21T07:42:45.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.660+0000 7fcfbf000640 1 -- 172.21.15.69:0/1722546092 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcfb80f6000 con 0x7fcfb8183ea0 2024-02-21T07:42:45.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.661+0000 7fcfafe00640 1 -- 172.21.15.69:0/1722546092 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fcfa40170a0 con 0x7fcfb8183ea0 2024-02-21T07:42:45.666 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:42:45.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.663+0000 7fcfbf000640 1 -- 172.21.15.69:0/1722546092 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf9809f130 msgr2=0x7fcf980a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.663+0000 7fcfbf000640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf9809f130 0x7fcf980a15f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000f60 tx=0x7fcfa8000ed0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.663+0000 7fcfbf000640 1 -- 172.21.15.69:0/1722546092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfb8183ea0 msgr2=0x7fcfb8220ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.663+0000 7fcfbf000640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfb8183ea0 0x7fcfb8220ee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e870 tx=0x7fcfa400ed30 comp rx=0 tx=0).stop 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.664+0000 7fcfbf000640 1 -- 172.21.15.69:0/1722546092 shutdown_connections 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.664+0000 7fcfbf000640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcf9809f130 0x7fcf980a15f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.664+0000 7fcfbf000640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfb8186bc0 0x7fcfb8221420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.664+0000 7fcfbf000640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcfb8183ea0 0x7fcfb8220ee0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.664+0000 7fcfbf000640 1 --2- 172.21.15.69:0/1722546092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcfb80ee640 0x7fcfb8174520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.664+0000 7fcfbf000640 1 -- 172.21.15.69:0/1722546092 >> 172.21.15.69:0/1722546092 conn(0x7fcfb80ce3d0 msgr2=0x7fcfb80ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.664+0000 7fcfbf000640 1 -- 172.21.15.69:0/1722546092 shutdown_connections 2024-02-21T07:42:45.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.664+0000 7fcfbf000640 1 -- 172.21.15.69:0/1722546092 wait complete. 2024-02-21T07:42:45.688 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:42:45.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.892+0000 7f8d78000640 1 Processor -- start 2024-02-21T07:42:45.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.893+0000 7f8d78000640 1 -- start start 2024-02-21T07:42:45.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.894+0000 7f8d78000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8d70186210 0x7f8d70188e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d78000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8d7018b370 0x7f8d700cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d78000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d701865f0 con 0x7f8d70189340 2024-02-21T07:42:45.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d78000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7006dcd0 con 0x7f8d70186210 2024-02-21T07:42:45.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d78000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d700cd1d0 con 0x7f8d7018b370 2024-02-21T07:42:45.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d75600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8d70186210 0x7f8d70188e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d74c00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8d70189340 0x7f8d7018ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44704/0 (socket says 172.21.15.69:44704) 2024-02-21T07:42:45.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d74c00640 1 -- 172.21.15.69:0/1727552634 learned_addr learned my addr 172.21.15.69:0/1727552634 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:45.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d76000640 1 --2- 172.21.15.69:0/1727552634 >> v2:172.21.15.174:3300/0 conn(0x7f8d7018b370 0x7f8d700cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d75600640 1 -- 172.21.15.69:0/1727552634 >> v2:172.21.15.174:3300/0 conn(0x7f8d7018b370 msgr2=0x7f8d700cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:45.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d75600640 1 --2- 172.21.15.69:0/1727552634 >> v2:172.21.15.174:3300/0 conn(0x7f8d7018b370 0x7f8d700cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.896+0000 7f8d75600640 1 -- 172.21.15.69:0/1727552634 >> v1:172.21.15.69:6789/0 conn(0x7f8d70189340 legacy=0x7f8d7018ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.895+0000 7f8d6fe00640 1 -- 172.21.15.69:0/1727552634 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41593065 0 0) 0x7f8d701865f0 con 0x7f8d70189340 2024-02-21T07:42:45.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.896+0000 7f8d75600640 1 -- 172.21.15.69:0/1727552634 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d700cd4b0 con 0x7f8d70186210 2024-02-21T07:42:45.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.896+0000 7f8d76000640 1 --2- 172.21.15.69:0/1727552634 >> v2:172.21.15.174:3300/0 conn(0x7f8d7018b370 0x7f8d700cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:45.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.897+0000 7f8d75600640 1 --2- 172.21.15.69:0/1727552634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 0x7f8d70188e00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d70164510 tx=0x7f8d6402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5614696a53d9572e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:45.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.897+0000 7f8d6fe00640 1 -- 172.21.15.69:0/1727552634 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64031710 con 0x7f8d70186210 2024-02-21T07:42:45.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.897+0000 7f8d6fe00640 1 -- 172.21.15.69:0/1727552634 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6402f050 con 0x7f8d70186210 2024-02-21T07:42:45.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.897+0000 7f8d6fe00640 1 -- 172.21.15.69:0/1727552634 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64031a90 con 0x7f8d70186210 2024-02-21T07:42:45.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.898+0000 7f8d78000640 1 -- 172.21.15.69:0/1727552634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 msgr2=0x7f8d70188e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.898+0000 7f8d78000640 1 --2- 172.21.15.69:0/1727552634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 0x7f8d70188e00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8d70164510 tx=0x7f8d6402b7b0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.898+0000 7f8d78000640 1 -- 172.21.15.69:0/1727552634 shutdown_connections 2024-02-21T07:42:45.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.898+0000 7f8d78000640 1 --2- 172.21.15.69:0/1727552634 >> v2:172.21.15.174:3300/0 conn(0x7f8d7018b370 0x7f8d700cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.898+0000 7f8d78000640 1 --2- 172.21.15.69:0/1727552634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 0x7f8d70188e00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.898+0000 7f8d78000640 1 -- 172.21.15.69:0/1727552634 >> 172.21.15.69:0/1727552634 conn(0x7f8d700f69c0 msgr2=0x7f8d700f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:45.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.898+0000 7f8d78000640 1 -- 172.21.15.69:0/1727552634 shutdown_connections 2024-02-21T07:42:45.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.898+0000 7f8d78000640 1 -- 172.21.15.69:0/1727552634 wait complete. 2024-02-21T07:42:45.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.900+0000 7f8d78000640 1 Processor -- start 2024-02-21T07:42:45.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.901+0000 7f8d78000640 1 -- start start 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d78000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 0x7f8d70162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d78000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d70189340 0x7f8d70162fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d78000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d7018b370 0x7f8d702209c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d78000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7021fc90 con 0x7f8d70186210 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d78000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70163970 con 0x7f8d7018b370 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d78000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70163c50 con 0x7f8d70189340 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d75600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 0x7f8d70162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d75600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 0x7f8d70162a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34136/0 (socket says 172.21.15.69:34136) 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d75600640 1 -- 172.21.15.69:0/190731734 learned_addr learned my addr 172.21.15.69:0/190731734 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d76000640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d7018b370 0x7f8d702209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d74c00640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d70189340 0x7f8d70162fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d75600640 1 -- 172.21.15.69:0/190731734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d70189340 msgr2=0x7f8d70162fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d75600640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d70189340 0x7f8d70162fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d75600640 1 -- 172.21.15.69:0/190731734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d7018b370 msgr2=0x7f8d702209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d75600640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d7018b370 0x7f8d702209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.902+0000 7f8d75600640 1 -- 172.21.15.69:0/190731734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d68009a70 con 0x7f8d70186210 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.903+0000 7f8d75600640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 0x7f8d70162a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d64000c00 tx=0x7f8d640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.903+0000 7f8d6d600640 1 -- 172.21.15.69:0/190731734 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6403d880 con 0x7f8d70186210 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.903+0000 7f8d6d600640 1 -- 172.21.15.69:0/190731734 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6403da00 con 0x7f8d70186210 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.903+0000 7f8d6d600640 1 -- 172.21.15.69:0/190731734 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6403ddb0 con 0x7f8d70186210 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.903+0000 7f8d78000640 1 -- 172.21.15.69:0/190731734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d64009400 con 0x7f8d70186210 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.903+0000 7f8d78000640 1 -- 172.21.15.69:0/190731734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d702201c0 con 0x7f8d70186210 2024-02-21T07:42:45.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.904+0000 7f8d78000640 1 -- 172.21.15.69:0/190731734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d70069d50 con 0x7f8d70186210 2024-02-21T07:42:45.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.906+0000 7f8d6d600640 1 -- 172.21.15.69:0/190731734 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f8d6403a040 con 0x7f8d70186210 2024-02-21T07:42:45.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.907+0000 7f8d6d600640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8d5009f160 0x7f8d500a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:45.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.908+0000 7f8d6d600640 1 -- 172.21.15.69:0/190731734 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f8d640eb8f0 con 0x7f8d70186210 2024-02-21T07:42:45.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.908+0000 7f8d74c00640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8d5009f160 0x7f8d500a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:45.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.909+0000 7f8d74c00640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8d5009f160 0x7f8d500a1620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8d700f4fa0 tx=0x7f8d5c007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:45.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:45.911+0000 7f8d6d600640 1 -- 172.21.15.69:0/190731734 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d640b54f0 con 0x7f8d70186210 2024-02-21T07:42:46.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.144+0000 7f8d78000640 1 -- 172.21.15.69:0/190731734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d7017be00 con 0x7f8d70186210 2024-02-21T07:42:46.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.145+0000 7f8d6d600640 1 -- 172.21.15.69:0/190731734 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f8d640b7420 con 0x7f8d70186210 2024-02-21T07:42:46.151 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:46.151 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:33.311078+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:42:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 18 2024-02-21T07:42:46.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 -- 172.21.15.69:0/190731734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8d5009f160 msgr2=0x7f8d500a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8d5009f160 0x7f8d500a1620 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8d700f4fa0 tx=0x7f8d5c007e40 comp rx=0 tx=0).stop 2024-02-21T07:42:46.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 -- 172.21.15.69:0/190731734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 msgr2=0x7f8d70162a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 0x7f8d70162a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8d64000c00 tx=0x7f8d640046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 -- 172.21.15.69:0/190731734 shutdown_connections 2024-02-21T07:42:46.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8d5009f160 0x7f8d500a1620 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8d7018b370 0x7f8d702209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d70189340 0x7f8d70162fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 --2- 172.21.15.69:0/190731734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d70186210 0x7f8d70162a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 -- 172.21.15.69:0/190731734 >> 172.21.15.69:0/190731734 conn(0x7f8d700f69c0 msgr2=0x7f8d7018ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:46.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 -- 172.21.15.69:0/190731734 shutdown_connections 2024-02-21T07:42:46.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.148+0000 7f8d78000640 1 -- 172.21.15.69:0/190731734 wait complete. 2024-02-21T07:42:46.174 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:46.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.380+0000 7efe2ca00640 1 Processor -- start 2024-02-21T07:42:46.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.380+0000 7efe2ca00640 1 -- start start 2024-02-21T07:42:46.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.382+0000 7efe2ca00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe28183000 0x7efe28183620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.382+0000 7efe2ca00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efe28186230 0x7efe280cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.382+0000 7efe2ca00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe281866a0 con 0x7efe28183b60 2024-02-21T07:42:46.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.382+0000 7efe2ca00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe281833e0 con 0x7efe28186230 2024-02-21T07:42:46.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.382+0000 7efe2ca00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe280f62a0 con 0x7efe28183000 2024-02-21T07:42:46.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.382+0000 7efe26800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efe28186230 0x7efe280cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.382+0000 7efe25400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7efe28183b60 0x7efe28185b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60682/0 (socket says 172.21.15.69:60682) 2024-02-21T07:42:46.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.382+0000 7efe25400640 1 -- 172.21.15.69:0/1430660209 learned_addr learned my addr 172.21.15.69:0/1430660209 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:46.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.382+0000 7efe25e00640 1 --2- 172.21.15.69:0/1430660209 >> v2:172.21.15.174:3300/0 conn(0x7efe28183000 0x7efe28183620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.383+0000 7efe24a00640 1 -- 172.21.15.69:0/1430660209 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328330684 0 0) 0x7efe14001110 con 0x7efe28183b60 2024-02-21T07:42:46.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.383+0000 7efe25e00640 1 -- 172.21.15.69:0/1430660209 >> v2:172.21.15.69:3300/0 conn(0x7efe28186230 msgr2=0x7efe280cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:46.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.383+0000 7efe25e00640 1 --2- 172.21.15.69:0/1430660209 >> v2:172.21.15.69:3300/0 conn(0x7efe28186230 0x7efe280cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.383+0000 7efe25e00640 1 -- 172.21.15.69:0/1430660209 >> v1:172.21.15.174:6789/0 conn(0x7efe28183b60 legacy=0x7efe28185b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.383+0000 7efe25e00640 1 -- 172.21.15.69:0/1430660209 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2806dcd0 con 0x7efe28183000 2024-02-21T07:42:46.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.384+0000 7efe25e00640 1 --2- 172.21.15.69:0/1430660209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 0x7efe28183620 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efe28074900 tx=0x7efe1802b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ba00f51441d3b2d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:46.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.384+0000 7efe24a00640 1 -- 172.21.15.69:0/1430660209 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18031710 con 0x7efe28183000 2024-02-21T07:42:46.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.384+0000 7efe24a00640 1 -- 172.21.15.69:0/1430660209 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1802f050 con 0x7efe28183000 2024-02-21T07:42:46.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.384+0000 7efe24a00640 1 -- 172.21.15.69:0/1430660209 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18031a90 con 0x7efe28183000 2024-02-21T07:42:46.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.385+0000 7efe2ca00640 1 -- 172.21.15.69:0/1430660209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 msgr2=0x7efe28183620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.385+0000 7efe2ca00640 1 --2- 172.21.15.69:0/1430660209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 0x7efe28183620 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efe28074900 tx=0x7efe1802b7b0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.385+0000 7efe2ca00640 1 -- 172.21.15.69:0/1430660209 shutdown_connections 2024-02-21T07:42:46.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.385+0000 7efe2ca00640 1 --2- 172.21.15.69:0/1430660209 >> v2:172.21.15.69:3300/0 conn(0x7efe28186230 0x7efe280cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.385+0000 7efe2ca00640 1 --2- 172.21.15.69:0/1430660209 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 0x7efe28183620 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.385+0000 7efe2ca00640 1 -- 172.21.15.69:0/1430660209 >> 172.21.15.69:0/1430660209 conn(0x7efe280f69c0 msgr2=0x7efe280f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:46.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.385+0000 7efe2ca00640 1 -- 172.21.15.69:0/1430660209 shutdown_connections 2024-02-21T07:42:46.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.385+0000 7efe2ca00640 1 -- 172.21.15.69:0/1430660209 wait complete. 2024-02-21T07:42:46.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.388+0000 7efe2ca00640 1 Processor -- start 2024-02-21T07:42:46.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.388+0000 7efe2ca00640 1 -- start start 2024-02-21T07:42:46.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.389+0000 7efe2ca00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 0x7efe280f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.389+0000 7efe2ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe28183b60 0x7efe280cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.389+0000 7efe2ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe28186230 0x7efe280cfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.389+0000 7efe2ca00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280cf460 con 0x7efe28186230 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.389+0000 7efe2ca00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe282200e0 con 0x7efe28183000 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.389+0000 7efe2ca00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280d0370 con 0x7efe28183b60 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe26800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe28186230 0x7efe280cfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe25e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 0x7efe280f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe25e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 0x7efe280f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42610/0 (socket says 172.21.15.69:42610) 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe25400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe28183b60 0x7efe280cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe25e00640 1 -- 172.21.15.69:0/1897991847 learned_addr learned my addr 172.21.15.69:0/1897991847 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe25e00640 1 -- 172.21.15.69:0/1897991847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe28183b60 msgr2=0x7efe280cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe25e00640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe28183b60 0x7efe280cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe25e00640 1 -- 172.21.15.69:0/1897991847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe28186230 msgr2=0x7efe280cfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe25e00640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe28186230 0x7efe280cfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe25e00640 1 -- 172.21.15.69:0/1897991847 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe18009400 con 0x7efe28183000 2024-02-21T07:42:46.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.390+0000 7efe25e00640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 0x7efe280f1010 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efe18000c00 tx=0x7efe180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:46.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.391+0000 7efe1e000640 1 -- 172.21.15.69:0/1897991847 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18004230 con 0x7efe28183000 2024-02-21T07:42:46.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.391+0000 7efe1e000640 1 -- 172.21.15.69:0/1897991847 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe180043b0 con 0x7efe28183000 2024-02-21T07:42:46.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.391+0000 7efe1e000640 1 -- 172.21.15.69:0/1897991847 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18004520 con 0x7efe28183000 2024-02-21T07:42:46.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.391+0000 7efe2ca00640 1 -- 172.21.15.69:0/1897991847 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe280f19e0 con 0x7efe28183000 2024-02-21T07:42:46.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.391+0000 7efe2ca00640 1 -- 172.21.15.69:0/1897991847 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe280cee10 con 0x7efe28183000 2024-02-21T07:42:46.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.392+0000 7efe2ca00640 1 -- 172.21.15.69:0/1897991847 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe28069d50 con 0x7efe28183000 2024-02-21T07:42:46.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.394+0000 7efe1e000640 1 -- 172.21.15.69:0/1897991847 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7efe1803a040 con 0x7efe28183000 2024-02-21T07:42:46.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.395+0000 7efe1e000640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe0809f0b0 0x7efe080a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.395+0000 7efe1e000640 1 -- 172.21.15.69:0/1897991847 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7efe180eb6d0 con 0x7efe28183000 2024-02-21T07:42:46.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.395+0000 7efe25400640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe0809f0b0 0x7efe080a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.396+0000 7efe25400640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe0809f0b0 0x7efe080a1570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efe28186180 tx=0x7efe14007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:46.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.397+0000 7efe1e000640 1 -- 172.21.15.69:0/1897991847 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe180b53f0 con 0x7efe28183000 2024-02-21T07:42:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.596+0000 7efe2ca00640 1 -- 172.21.15.69:0/1897991847 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe2806df40 con 0x7efe28183000 2024-02-21T07:42:46.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.598+0000 7efe1e000640 1 -- 172.21.15.69:0/1897991847 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23546 (secure 0 0 0) 0x7efe180b8ab0 con 0x7efe28183000 2024-02-21T07:42:46.604 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:46.604 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:07.472357+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:46.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 -- 172.21.15.69:0/1897991847 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe0809f0b0 msgr2=0x7efe080a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe0809f0b0 0x7efe080a1570 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efe28186180 tx=0x7efe14007e40 comp rx=0 tx=0).stop 2024-02-21T07:42:46.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 -- 172.21.15.69:0/1897991847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 msgr2=0x7efe280f1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 0x7efe280f1010 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efe18000c00 tx=0x7efe180046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 -- 172.21.15.69:0/1897991847 shutdown_connections 2024-02-21T07:42:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe0809f0b0 0x7efe080a1570 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe28186230 0x7efe280cfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe28183b60 0x7efe280cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 --2- 172.21.15.69:0/1897991847 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe28183000 0x7efe280f1010 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 -- 172.21.15.69:0/1897991847 >> 172.21.15.69:0/1897991847 conn(0x7efe280f69c0 msgr2=0x7efe2806abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 -- 172.21.15.69:0/1897991847 shutdown_connections 2024-02-21T07:42:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.601+0000 7efe2ca00640 1 -- 172.21.15.69:0/1897991847 wait complete. 2024-02-21T07:42:46.624 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:41:56.520105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:42:00.759386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:42:01.409274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:42:05.025537+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:42:46.624 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:42:46.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.835+0000 7f1b56000640 1 Processor -- start 2024-02-21T07:42:46.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.835+0000 7f1b56000640 1 -- start start 2024-02-21T07:42:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.837+0000 7f1b56000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1b50183670 0x7f1b501850e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.837+0000 7f1b56000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b50184c50 con 0x7f1b5017f700 2024-02-21T07:42:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.837+0000 7f1b56000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b50183af0 con 0x7f1b50185cc0 2024-02-21T07:42:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.837+0000 7f1b56000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b50185620 con 0x7f1b50183670 2024-02-21T07:42:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.838+0000 7f1b4f400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1b5017f700 0x7f1b500cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44712/0 (socket says 172.21.15.69:44712) 2024-02-21T07:42:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.838+0000 7f1b4f400640 1 -- 172.21.15.69:0/136598610 learned_addr learned my addr 172.21.15.69:0/136598610 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:46.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.838+0000 7f1b47e00640 1 --2- 172.21.15.69:0/136598610 >> v2:172.21.15.174:3300/0 conn(0x7f1b50183670 0x7f1b501850e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.838+0000 7f1b4ea00640 1 -- 172.21.15.69:0/136598610 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571295008 0 0) 0x7f1b50184c50 con 0x7f1b5017f700 2024-02-21T07:42:46.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.838+0000 7f1b4ea00640 1 -- 172.21.15.69:0/136598610 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b34003520 con 0x7f1b5017f700 2024-02-21T07:42:46.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.838+0000 7f1b4ea00640 1 -- 172.21.15.69:0/136598610 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968167314 0 0) 0x7f1b50183af0 con 0x7f1b50185cc0 2024-02-21T07:42:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.838+0000 7f1b4ea00640 1 -- 172.21.15.69:0/136598610 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b50184c50 con 0x7f1b50185cc0 2024-02-21T07:42:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.838+0000 7f1b47e00640 1 -- 172.21.15.69:0/136598610 >> v1:172.21.15.174:6789/0 conn(0x7f1b50185cc0 legacy=0x7f1b50186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.838+0000 7f1b47e00640 1 -- 172.21.15.69:0/136598610 >> v1:172.21.15.69:6789/0 conn(0x7f1b5017f700 legacy=0x7f1b500cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.838+0000 7f1b47e00640 1 -- 172.21.15.69:0/136598610 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b50183d60 con 0x7f1b50183670 2024-02-21T07:42:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.839+0000 7f1b47e00640 1 --2- 172.21.15.69:0/136598610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 0x7f1b501850e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1b380097a0 tx=0x7f1b3802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d12b7161b19dfe4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.840+0000 7f1b4ea00640 1 -- 172.21.15.69:0/136598610 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3802e070 con 0x7f1b50183670 2024-02-21T07:42:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.840+0000 7f1b4ea00640 1 -- 172.21.15.69:0/136598610 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b380315a0 con 0x7f1b50183670 2024-02-21T07:42:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.840+0000 7f1b4ea00640 1 -- 172.21.15.69:0/136598610 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38031930 con 0x7f1b50183670 2024-02-21T07:42:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.840+0000 7f1b56000640 1 -- 172.21.15.69:0/136598610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 msgr2=0x7f1b501850e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.840+0000 7f1b56000640 1 --2- 172.21.15.69:0/136598610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 0x7f1b501850e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1b380097a0 tx=0x7f1b3802b840 comp rx=0 tx=0).stop 2024-02-21T07:42:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.841+0000 7f1b56000640 1 -- 172.21.15.69:0/136598610 shutdown_connections 2024-02-21T07:42:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.841+0000 7f1b56000640 1 --2- 172.21.15.69:0/136598610 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 0x7f1b501850e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.841+0000 7f1b56000640 1 -- 172.21.15.69:0/136598610 >> 172.21.15.69:0/136598610 conn(0x7f1b500ce3d0 msgr2=0x7f1b500ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.841+0000 7f1b56000640 1 -- 172.21.15.69:0/136598610 shutdown_connections 2024-02-21T07:42:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.841+0000 7f1b56000640 1 -- 172.21.15.69:0/136598610 wait complete. 2024-02-21T07:42:46.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.843+0000 7f1b56000640 1 Processor -- start 2024-02-21T07:42:46.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.843+0000 7f1b56000640 1 -- start start 2024-02-21T07:42:46.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b56000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b5017f700 0x7f1b5016ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b56000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 0x7f1b5016f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b56000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b50185cc0 0x7f1b500cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b56000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50171880 con 0x7f1b50185cc0 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b56000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50171ca0 con 0x7f1b50183670 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b56000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5017add0 con 0x7f1b5017f700 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 0x7f1b5016f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b4fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b50185cc0 0x7f1b500cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b4fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b50185cc0 0x7f1b500cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34168/0 (socket says 172.21.15.69:34168) 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b4fe00640 1 -- 172.21.15.69:0/353025850 learned_addr learned my addr 172.21.15.69:0/353025850 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 0x7f1b5016f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:42632/0 (socket says 172.21.15.69:42632) 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.844+0000 7f1b4f400640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b5017f700 0x7f1b5016ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b47e00640 1 -- 172.21.15.69:0/353025850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b5017f700 msgr2=0x7f1b5016ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b47e00640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b5017f700 0x7f1b5016ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b47e00640 1 -- 172.21.15.69:0/353025850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b50185cc0 msgr2=0x7f1b500cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b47e00640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b50185cc0 0x7f1b500cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b47e00640 1 -- 172.21.15.69:0/353025850 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b38009400 con 0x7f1b50183670 2024-02-21T07:42:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b4fe00640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b50185cc0 0x7f1b500cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b47e00640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 0x7f1b5016f2c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b5008d680 tx=0x7f1b380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b47400640 1 -- 172.21.15.69:0/353025850 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38032630 con 0x7f1b50183670 2024-02-21T07:42:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b47400640 1 -- 172.21.15.69:0/353025850 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b380327b0 con 0x7f1b50183670 2024-02-21T07:42:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b47400640 1 -- 172.21.15.69:0/353025850 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38032b60 con 0x7f1b50183670 2024-02-21T07:42:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b56000640 1 -- 172.21.15.69:0/353025850 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b50170920 con 0x7f1b50183670 2024-02-21T07:42:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.845+0000 7f1b56000640 1 -- 172.21.15.69:0/353025850 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b50170ee0 con 0x7f1b50183670 2024-02-21T07:42:46.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.847+0000 7f1b56000640 1 -- 172.21.15.69:0/353025850 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b50069d50 con 0x7f1b50183670 2024-02-21T07:42:46.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.848+0000 7f1b47400640 1 -- 172.21.15.69:0/353025850 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1b3804e430 con 0x7f1b50183670 2024-02-21T07:42:46.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.850+0000 7f1b47400640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2c09f130 0x7f1b2c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:46.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.850+0000 7f1b47400640 1 -- 172.21.15.69:0/353025850 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f1b380ebf00 con 0x7f1b50183670 2024-02-21T07:42:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.850+0000 7f1b4f400640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2c09f130 0x7f1b2c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.851+0000 7f1b4f400640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2c09f130 0x7f1b2c0a15f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b40000f60 tx=0x7f1b40009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:46.852+0000 7f1b47400640 1 -- 172.21.15.69:0/353025850 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1b380b5c20 con 0x7f1b50183670 2024-02-21T07:42:47.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.051+0000 7f1b56000640 1 -- 172.21.15.69:0/353025850 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b500f3900 con 0x7f1b50183670 2024-02-21T07:42:47.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.052+0000 7f1b47400640 1 -- 172.21.15.69:0/353025850 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b380b92e0 con 0x7f1b50183670 2024-02-21T07:42:47.057 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-02-21T07:42:47.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.054+0000 7f1b56000640 1 -- 172.21.15.69:0/353025850 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2c09f130 msgr2=0x7f1b2c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.054+0000 7f1b56000640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2c09f130 0x7f1b2c0a15f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1b40000f60 tx=0x7f1b40009040 comp rx=0 tx=0).stop 2024-02-21T07:42:47.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.054+0000 7f1b56000640 1 -- 172.21.15.69:0/353025850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 msgr2=0x7f1b5016f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.054+0000 7f1b56000640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 0x7f1b5016f2c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b5008d680 tx=0x7f1b380046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.055+0000 7f1b56000640 1 -- 172.21.15.69:0/353025850 shutdown_connections 2024-02-21T07:42:47.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.055+0000 7f1b56000640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f1b2c09f130 0x7f1b2c0a15f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.055+0000 7f1b56000640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b50185cc0 0x7f1b500cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.055+0000 7f1b56000640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1b50183670 0x7f1b5016f2c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.055+0000 7f1b56000640 1 --2- 172.21.15.69:0/353025850 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b5017f700 0x7f1b5016ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.055+0000 7f1b56000640 1 -- 172.21.15.69:0/353025850 >> 172.21.15.69:0/353025850 conn(0x7f1b500ce3d0 msgr2=0x7f1b50214f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:47.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.055+0000 7f1b56000640 1 -- 172.21.15.69:0/353025850 shutdown_connections 2024-02-21T07:42:47.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.055+0000 7f1b56000640 1 -- 172.21.15.69:0/353025850 wait complete. 2024-02-21T07:42:47.079 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:42:47.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.280+0000 7f4ed2000640 1 Processor -- start 2024-02-21T07:42:47.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.280+0000 7f4ed2000640 1 -- start start 2024-02-21T07:42:47.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.282+0000 7f4ed2000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4ecc180690 0x7f4ecc184570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.282+0000 7f4ed2000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4ecc184ab0 0x7f4ecc18a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.282+0000 7f4ed2000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ecc1863e0 con 0x7f4ecc18a5f0 2024-02-21T07:42:47.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.282+0000 7f4ed2000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc185060 con 0x7f4ecc180690 2024-02-21T07:42:47.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.282+0000 7f4ed2000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc185340 con 0x7f4ecc184ab0 2024-02-21T07:42:47.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.283+0000 7f4ed0c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4ecc180690 0x7f4ecc184570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.283+0000 7f4ec3e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4ecc184ab0 0x7f4ecc18a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.283+0000 7f4ed0c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4ecc180690 0x7f4ecc184570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34178/0 (socket says 172.21.15.69:34178) 2024-02-21T07:42:47.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.283+0000 7f4ed0c00640 1 -- 172.21.15.69:0/1821137766 learned_addr learned my addr 172.21.15.69:0/1821137766 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:47.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.283+0000 7f4ecbe00640 1 -- 172.21.15.69:0/1821137766 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531744777 0 0) 0x7f4ecc1863e0 con 0x7f4ecc18a5f0 2024-02-21T07:42:47.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.283+0000 7f4ed0c00640 1 -- 172.21.15.69:0/1821137766 >> v2:172.21.15.174:3300/0 conn(0x7f4ecc184ab0 msgr2=0x7f4ecc18a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:47.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.283+0000 7f4ed0c00640 1 --2- 172.21.15.69:0/1821137766 >> v2:172.21.15.174:3300/0 conn(0x7f4ecc184ab0 0x7f4ecc18a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.283+0000 7f4ed0c00640 1 -- 172.21.15.69:0/1821137766 >> v1:172.21.15.184:6789/0 conn(0x7f4ecc18a5f0 legacy=0x7f4ecc0f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.283+0000 7f4ed0c00640 1 -- 172.21.15.69:0/1821137766 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc185620 con 0x7f4ecc180690 2024-02-21T07:42:47.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.283+0000 7f4ec3e00640 1 --2- 172.21.15.69:0/1821137766 >> v2:172.21.15.174:3300/0 conn(0x7f4ecc184ab0 0x7f4ecc18a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:47.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.284+0000 7f4ed0c00640 1 --2- 172.21.15.69:0/1821137766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc180690 0x7f4ecc184570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0ed7e0 tx=0x7f4ebc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea8f0a5effbb88 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:47.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.285+0000 7f4ecbe00640 1 -- 172.21.15.69:0/1821137766 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc0317e0 con 0x7f4ecc180690 2024-02-21T07:42:47.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.285+0000 7f4ecbe00640 1 -- 172.21.15.69:0/1821137766 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ebc031940 con 0x7f4ecc180690 2024-02-21T07:42:47.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.285+0000 7f4ecbe00640 1 -- 172.21.15.69:0/1821137766 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ebc031cd0 con 0x7f4ecc180690 2024-02-21T07:42:47.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.285+0000 7f4ed2000640 1 -- 172.21.15.69:0/1821137766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc180690 msgr2=0x7f4ecc184570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.285+0000 7f4ed2000640 1 --2- 172.21.15.69:0/1821137766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc180690 0x7f4ecc184570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0ed7e0 tx=0x7f4ebc02b880 comp rx=0 tx=0).stop 2024-02-21T07:42:47.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.285+0000 7f4ed2000640 1 -- 172.21.15.69:0/1821137766 shutdown_connections 2024-02-21T07:42:47.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.285+0000 7f4ed2000640 1 --2- 172.21.15.69:0/1821137766 >> v2:172.21.15.174:3300/0 conn(0x7f4ecc184ab0 0x7f4ecc18a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.285+0000 7f4ed2000640 1 --2- 172.21.15.69:0/1821137766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc180690 0x7f4ecc184570 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.286+0000 7f4ed2000640 1 -- 172.21.15.69:0/1821137766 >> 172.21.15.69:0/1821137766 conn(0x7f4ecc0ce1b0 msgr2=0x7f4ecc0ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:47.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.286+0000 7f4ed2000640 1 -- 172.21.15.69:0/1821137766 shutdown_connections 2024-02-21T07:42:47.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.286+0000 7f4ed2000640 1 -- 172.21.15.69:0/1821137766 wait complete. 2024-02-21T07:42:47.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.288+0000 7f4ed2000640 1 Processor -- start 2024-02-21T07:42:47.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.288+0000 7f4ed2000640 1 -- start start 2024-02-21T07:42:47.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ed2000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ecc180690 0x7f4ecc21a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ed2000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc184ab0 0x7f4ecc21bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ed2000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc18a5f0 0x7f4ecc1694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ed2000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc21b6e0 con 0x7f4ecc184ab0 2024-02-21T07:42:47.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ed2000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc21a7f0 con 0x7f4ecc18a5f0 2024-02-21T07:42:47.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ed2000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc21aad0 con 0x7f4ecc180690 2024-02-21T07:42:47.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ec3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc184ab0 0x7f4ecc21bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ed1600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc18a5f0 0x7f4ecc1694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ed0c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ecc180690 0x7f4ecc21a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ec3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc184ab0 0x7f4ecc21bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34194/0 (socket says 172.21.15.69:34194) 2024-02-21T07:42:47.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.289+0000 7f4ec3e00640 1 -- 172.21.15.69:0/1946352690 learned_addr learned my addr 172.21.15.69:0/1946352690 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:47.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ec3e00640 1 -- 172.21.15.69:0/1946352690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ecc180690 msgr2=0x7f4ecc21a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ec3e00640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ecc180690 0x7f4ecc21a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ec3e00640 1 -- 172.21.15.69:0/1946352690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc18a5f0 msgr2=0x7f4ecc1694d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ec3e00640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc18a5f0 0x7f4ecc1694d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ec3e00640 1 -- 172.21.15.69:0/1946352690 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb4009400 con 0x7f4ecc184ab0 2024-02-21T07:42:47.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ec3e00640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc184ab0 0x7f4ecc21bb70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400e960 tx=0x7f4eb400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:47.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ec9600640 1 -- 172.21.15.69:0/1946352690 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb400ca00 con 0x7f4ecc184ab0 2024-02-21T07:42:47.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ec9600640 1 -- 172.21.15.69:0/1946352690 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb400cb60 con 0x7f4ecc184ab0 2024-02-21T07:42:47.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ec9600640 1 -- 172.21.15.69:0/1946352690 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4013470 con 0x7f4ecc184ab0 2024-02-21T07:42:47.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ed2000640 1 -- 172.21.15.69:0/1946352690 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ebc0094d0 con 0x7f4ecc184ab0 2024-02-21T07:42:47.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.290+0000 7f4ed2000640 1 -- 172.21.15.69:0/1946352690 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc21b090 con 0x7f4ecc184ab0 2024-02-21T07:42:47.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.291+0000 7f4ed2000640 1 -- 172.21.15.69:0/1946352690 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc18a410 con 0x7f4ecc184ab0 2024-02-21T07:42:47.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.293+0000 7f4ec9600640 1 -- 172.21.15.69:0/1946352690 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f4eb40135d0 con 0x7f4ecc184ab0 2024-02-21T07:42:47.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.294+0000 7f4ec9600640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ea809f160 0x7f4ea80a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.295+0000 7f4ec9600640 1 -- 172.21.15.69:0/1946352690 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f4eb40c9d20 con 0x7f4ecc184ab0 2024-02-21T07:42:47.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.295+0000 7f4ed0c00640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ea809f160 0x7f4ea80a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.296+0000 7f4ed0c00640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ea809f160 0x7f4ea80a1620 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc036000 tx=0x7f4ebc03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:47.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.299+0000 7f4ec9600640 1 -- 172.21.15.69:0/1946352690 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4eb4093b70 con 0x7f4ecc184ab0 2024-02-21T07:42:47.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.511+0000 7f4ed2000640 1 -- 172.21.15.69:0/1946352690 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ecc04ef80 con 0x7f4ecc184ab0 2024-02-21T07:42:47.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.512+0000 7f4ec9600640 1 -- 172.21.15.69:0/1946352690 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4eb4017020 con 0x7f4ecc184ab0 2024-02-21T07:42:47.518 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 -- 172.21.15.69:0/1946352690 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ea809f160 msgr2=0x7f4ea80a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ea809f160 0x7f4ea80a1620 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc036000 tx=0x7f4ebc03d040 comp rx=0 tx=0).stop 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 -- 172.21.15.69:0/1946352690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc184ab0 msgr2=0x7f4ecc21bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc184ab0 0x7f4ecc21bb70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400e960 tx=0x7f4eb400ee20 comp rx=0 tx=0).stop 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 -- 172.21.15.69:0/1946352690 shutdown_connections 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ea809f160 0x7f4ea80a1620 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4ecc18a5f0 0x7f4ecc1694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ecc184ab0 0x7f4ecc21bb70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 --2- 172.21.15.69:0/1946352690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ecc180690 0x7f4ecc21a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 -- 172.21.15.69:0/1946352690 >> 172.21.15.69:0/1946352690 conn(0x7f4ecc0ce1b0 msgr2=0x7f4ecc0f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 -- 172.21.15.69:0/1946352690 shutdown_connections 2024-02-21T07:42:47.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.515+0000 7f4ed2000640 1 -- 172.21.15.69:0/1946352690 wait complete. 2024-02-21T07:42:47.540 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:42:47.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.740+0000 7efdeec00640 1 Processor -- start 2024-02-21T07:42:47.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.740+0000 7efdeec00640 1 -- start start 2024-02-21T07:42:47.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.742+0000 7efdeec00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efde8180690 0x7efde8184570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.742+0000 7efdeec00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efde818a7c0 0x7efde80f1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.742+0000 7efdeec00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde81863e0 con 0x7efde8184ab0 2024-02-21T07:42:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.742+0000 7efdeec00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde8185060 con 0x7efde818a7c0 2024-02-21T07:42:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.742+0000 7efdeec00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde8185340 con 0x7efde8180690 2024-02-21T07:42:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.743+0000 7efded800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efde8180690 0x7efde8184570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.743+0000 7efded800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7efde8180690 0x7efde8184570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34758/0 (socket says 172.21.15.69:34758) 2024-02-21T07:42:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.743+0000 7efded800640 1 -- 172.21.15.69:0/2890158151 learned_addr learned my addr 172.21.15.69:0/2890158151 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.743+0000 7efdee200640 1 --2- 172.21.15.69:0/2890158151 >> v2:172.21.15.69:3300/0 conn(0x7efde818a7c0 0x7efde80f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.743+0000 7efded800640 1 -- 172.21.15.69:0/2890158151 >> v2:172.21.15.69:3300/0 conn(0x7efde818a7c0 msgr2=0x7efde80f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.743+0000 7efded800640 1 --2- 172.21.15.69:0/2890158151 >> v2:172.21.15.69:3300/0 conn(0x7efde818a7c0 0x7efde80f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.743+0000 7efded800640 1 -- 172.21.15.69:0/2890158151 >> v1:172.21.15.69:6789/0 conn(0x7efde8184ab0 legacy=0x7efde818a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.743+0000 7efded800640 1 -- 172.21.15.69:0/2890158151 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8185620 con 0x7efde8180690 2024-02-21T07:42:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.745+0000 7efded800640 1 --2- 172.21.15.69:0/2890158151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8180690 0x7efde8184570 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efde80cf2d0 tx=0x7efddc02b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19baedca17b7766f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:47.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.745+0000 7efde7e00640 1 -- 172.21.15.69:0/2890158151 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0317e0 con 0x7efde8180690 2024-02-21T07:42:47.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.745+0000 7efde7e00640 1 -- 172.21.15.69:0/2890158151 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc031940 con 0x7efde8180690 2024-02-21T07:42:47.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.745+0000 7efde7e00640 1 -- 172.21.15.69:0/2890158151 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc031cd0 con 0x7efde8180690 2024-02-21T07:42:47.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.745+0000 7efdeec00640 1 -- 172.21.15.69:0/2890158151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8180690 msgr2=0x7efde8184570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.745+0000 7efdeec00640 1 --2- 172.21.15.69:0/2890158151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8180690 0x7efde8184570 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efde80cf2d0 tx=0x7efddc02b880 comp rx=0 tx=0).stop 2024-02-21T07:42:47.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.746+0000 7efdeec00640 1 -- 172.21.15.69:0/2890158151 shutdown_connections 2024-02-21T07:42:47.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.746+0000 7efdeec00640 1 --2- 172.21.15.69:0/2890158151 >> v2:172.21.15.69:3300/0 conn(0x7efde818a7c0 0x7efde80f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.746+0000 7efdeec00640 1 --2- 172.21.15.69:0/2890158151 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8180690 0x7efde8184570 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.746+0000 7efdeec00640 1 -- 172.21.15.69:0/2890158151 >> 172.21.15.69:0/2890158151 conn(0x7efde80ce1b0 msgr2=0x7efde80ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:47.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.746+0000 7efdeec00640 1 -- 172.21.15.69:0/2890158151 shutdown_connections 2024-02-21T07:42:47.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.746+0000 7efdeec00640 1 -- 172.21.15.69:0/2890158151 wait complete. 2024-02-21T07:42:47.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.748+0000 7efdeec00640 1 Processor -- start 2024-02-21T07:42:47.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.749+0000 7efdeec00640 1 -- start start 2024-02-21T07:42:47.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.750+0000 7efdeec00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efde8180690 0x7efde816c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.750+0000 7efdeec00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8184ab0 0x7efde81720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.750+0000 7efdeec00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde818a7c0 0x7efde8172610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.750+0000 7efdeec00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde8172b50 con 0x7efde818a7c0 2024-02-21T07:42:47.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.750+0000 7efdeec00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde806ab20 con 0x7efde8180690 2024-02-21T07:42:47.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.750+0000 7efdeec00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde817c870 con 0x7efde8184ab0 2024-02-21T07:42:47.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efdee200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde818a7c0 0x7efde8172610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efdece00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8184ab0 0x7efde81720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efdece00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8184ab0 0x7efde81720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:34760/0 (socket says 172.21.15.69:34760) 2024-02-21T07:42:47.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efdece00640 1 -- 172.21.15.69:0/1270707400 learned_addr learned my addr 172.21.15.69:0/1270707400 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:47.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efded800640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efde8180690 0x7efde816c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efdece00640 1 -- 172.21.15.69:0/1270707400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efde8180690 msgr2=0x7efde816c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efdece00640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efde8180690 0x7efde816c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efdece00640 1 -- 172.21.15.69:0/1270707400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde818a7c0 msgr2=0x7efde8172610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efdece00640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde818a7c0 0x7efde8172610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efdece00640 1 -- 172.21.15.69:0/1270707400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc0094d0 con 0x7efde8184ab0 2024-02-21T07:42:47.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.751+0000 7efdece00640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8184ab0 0x7efde81720d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdd400c3c0 tx=0x7efdd400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:47.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.752+0000 7efde5600640 1 -- 172.21.15.69:0/1270707400 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd40052d0 con 0x7efde8184ab0 2024-02-21T07:42:47.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.752+0000 7efde5600640 1 -- 172.21.15.69:0/1270707400 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd4005450 con 0x7efde8184ab0 2024-02-21T07:42:47.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.752+0000 7efde5600640 1 -- 172.21.15.69:0/1270707400 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd4007260 con 0x7efde8184ab0 2024-02-21T07:42:47.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.752+0000 7efdeec00640 1 -- 172.21.15.69:0/1270707400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde8171030 con 0x7efde8184ab0 2024-02-21T07:42:47.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.752+0000 7efdeec00640 1 -- 172.21.15.69:0/1270707400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde81715f0 con 0x7efde8184ab0 2024-02-21T07:42:47.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.753+0000 7efdeec00640 1 -- 172.21.15.69:0/1270707400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde8069c10 con 0x7efde8184ab0 2024-02-21T07:42:47.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.755+0000 7efde5600640 1 -- 172.21.15.69:0/1270707400 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7efdd40073c0 con 0x7efde8184ab0 2024-02-21T07:42:47.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.756+0000 7efde5600640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdc809f130 0x7efdc80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:47.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.756+0000 7efde5600640 1 -- 172.21.15.69:0/1270707400 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efdd40c93b0 con 0x7efde8184ab0 2024-02-21T07:42:47.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.757+0000 7efded800640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdc809f130 0x7efdc80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:47.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.757+0000 7efded800640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdc809f130 0x7efdc80a15f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efddc036000 tx=0x7efddc03d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:47.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.758+0000 7efde5600640 1 -- 172.21.15.69:0/1270707400 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efdd4093190 con 0x7efde8184ab0 2024-02-21T07:42:47.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.954+0000 7efdeec00640 1 -- 172.21.15.69:0/1270707400 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efde80ed5c0 con 0x7efde8184ab0 2024-02-21T07:42:47.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.955+0000 7efde5600640 1 -- 172.21.15.69:0/1270707400 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7efdd4020020 con 0x7efde8184ab0 2024-02-21T07:42:47.961 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-02-21T07:42:47.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 -- 172.21.15.69:0/1270707400 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdc809f130 msgr2=0x7efdc80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdc809f130 0x7efdc80a15f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efddc036000 tx=0x7efddc03d040 comp rx=0 tx=0).stop 2024-02-21T07:42:47.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 -- 172.21.15.69:0/1270707400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8184ab0 msgr2=0x7efde81720d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:47.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8184ab0 0x7efde81720d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efdd400c3c0 tx=0x7efdd400c880 comp rx=0 tx=0).stop 2024-02-21T07:42:47.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 -- 172.21.15.69:0/1270707400 shutdown_connections 2024-02-21T07:42:47.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdc809f130 0x7efdc80a15f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efde818a7c0 0x7efde8172610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efde8184ab0 0x7efde81720d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 --2- 172.21.15.69:0/1270707400 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efde8180690 0x7efde816c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:47.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 -- 172.21.15.69:0/1270707400 >> 172.21.15.69:0/1270707400 conn(0x7efde80ce1b0 msgr2=0x7efde80f4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:47.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 -- 172.21.15.69:0/1270707400 shutdown_connections 2024-02-21T07:42:47.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:47.958+0000 7efdeec00640 1 -- 172.21.15.69:0/1270707400 wait complete. 2024-02-21T07:42:47.981 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:42:48.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.177+0000 7fe411200640 1 Processor -- start 2024-02-21T07:42:48.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.177+0000 7fe411200640 1 -- start start 2024-02-21T07:42:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.179+0000 7fe411200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe40c183670 0x7fe40c1850e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.179+0000 7fe411200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40c184c50 con 0x7fe40c185cc0 2024-02-21T07:42:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.179+0000 7fe411200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40c183af0 con 0x7fe40c17f700 2024-02-21T07:42:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.179+0000 7fe411200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40c185620 con 0x7fe40c183670 2024-02-21T07:42:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.179+0000 7fe409e00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe40c17f700 0x7fe40c0cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:60696/0 (socket says 172.21.15.69:60696) 2024-02-21T07:42:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.179+0000 7fe409e00640 1 -- 172.21.15.69:0/3645089546 learned_addr learned my addr 172.21.15.69:0/3645089546 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:48.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.179+0000 7fe403e00640 1 --2- 172.21.15.69:0/3645089546 >> v2:172.21.15.69:3300/0 conn(0x7fe40c183670 0x7fe40c1850e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:48.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.180+0000 7fe409400640 1 -- 172.21.15.69:0/3645089546 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449569456 0 0) 0x7fe40c183af0 con 0x7fe40c17f700 2024-02-21T07:42:48.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.180+0000 7fe409400640 1 -- 172.21.15.69:0/3645089546 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f0005730 con 0x7fe40c17f700 2024-02-21T07:42:48.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.180+0000 7fe409400640 1 -- 172.21.15.69:0/3645089546 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019335554 0 0) 0x7fe40c184c50 con 0x7fe40c185cc0 2024-02-21T07:42:48.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.180+0000 7fe403e00640 1 -- 172.21.15.69:0/3645089546 >> v1:172.21.15.174:6789/0 conn(0x7fe40c17f700 legacy=0x7fe40c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.180+0000 7fe403e00640 1 -- 172.21.15.69:0/3645089546 >> v1:172.21.15.69:6789/0 conn(0x7fe40c185cc0 legacy=0x7fe40c186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.180+0000 7fe403e00640 1 -- 172.21.15.69:0/3645089546 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c183d60 con 0x7fe40c183670 2024-02-21T07:42:48.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.181+0000 7fe403e00640 1 --2- 172.21.15.69:0/3645089546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 0x7fe40c1850e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40097a0 tx=0x7fe3f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da8f63c68da7fd7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:48.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.181+0000 7fe409400640 1 -- 172.21.15.69:0/3645089546 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f402e070 con 0x7fe40c183670 2024-02-21T07:42:48.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.181+0000 7fe409400640 1 -- 172.21.15.69:0/3645089546 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f40315a0 con 0x7fe40c183670 2024-02-21T07:42:48.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.181+0000 7fe409400640 1 -- 172.21.15.69:0/3645089546 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4031930 con 0x7fe40c183670 2024-02-21T07:42:48.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.182+0000 7fe411200640 1 -- 172.21.15.69:0/3645089546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 msgr2=0x7fe40c1850e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.182+0000 7fe411200640 1 --2- 172.21.15.69:0/3645089546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 0x7fe40c1850e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40097a0 tx=0x7fe3f402b840 comp rx=0 tx=0).stop 2024-02-21T07:42:48.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.182+0000 7fe411200640 1 -- 172.21.15.69:0/3645089546 shutdown_connections 2024-02-21T07:42:48.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.182+0000 7fe411200640 1 --2- 172.21.15.69:0/3645089546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 0x7fe40c1850e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.182+0000 7fe411200640 1 -- 172.21.15.69:0/3645089546 >> 172.21.15.69:0/3645089546 conn(0x7fe40c0ce3d0 msgr2=0x7fe40c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:48.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.182+0000 7fe411200640 1 -- 172.21.15.69:0/3645089546 shutdown_connections 2024-02-21T07:42:48.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.182+0000 7fe411200640 1 -- 172.21.15.69:0/3645089546 wait complete. 2024-02-21T07:42:48.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.184+0000 7fe411200640 1 Processor -- start 2024-02-21T07:42:48.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.184+0000 7fe411200640 1 -- start start 2024-02-21T07:42:48.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.185+0000 7fe411200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe40c17f700 0x7fe40c072630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:48.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.185+0000 7fe411200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 0x7fe40c17cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:48.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.185+0000 7fe411200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe40c185cc0 0x7fe40c2201f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:48.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.185+0000 7fe411200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c21fd60 con 0x7fe40c183670 2024-02-21T07:42:48.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.185+0000 7fe411200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c0ccdf0 con 0x7fe40c185cc0 2024-02-21T07:42:48.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.185+0000 7fe411200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40c17da10 con 0x7fe40c17f700 2024-02-21T07:42:48.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.186+0000 7fe403e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 0x7fe40c17cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:48.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.186+0000 7fe403e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 0x7fe40c17cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34226/0 (socket says 172.21.15.69:34226) 2024-02-21T07:42:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.186+0000 7fe403e00640 1 -- 172.21.15.69:0/599199851 learned_addr learned my addr 172.21.15.69:0/599199851 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.186+0000 7fe409e00640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe40c17f700 0x7fe40c072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.186+0000 7fe40a800640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe40c185cc0 0x7fe40c2201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.186+0000 7fe403e00640 1 -- 172.21.15.69:0/599199851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe40c17f700 msgr2=0x7fe40c072630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.186+0000 7fe403e00640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe40c17f700 0x7fe40c072630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.186+0000 7fe403e00640 1 -- 172.21.15.69:0/599199851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe40c185cc0 msgr2=0x7fe40c2201f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.186+0000 7fe403e00640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe40c185cc0 0x7fe40c2201f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.186+0000 7fe403e00640 1 -- 172.21.15.69:0/599199851 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f4009400 con 0x7fe40c183670 2024-02-21T07:42:48.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.187+0000 7fe403e00640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 0x7fe40c17cf20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4034040 tx=0x7fe3f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.187+0000 7fe402000640 1 -- 172.21.15.69:0/599199851 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4032630 con 0x7fe40c183670 2024-02-21T07:42:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.187+0000 7fe402000640 1 -- 172.21.15.69:0/599199851 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f40327b0 con 0x7fe40c183670 2024-02-21T07:42:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.187+0000 7fe402000640 1 -- 172.21.15.69:0/599199851 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4032b60 con 0x7fe40c183670 2024-02-21T07:42:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.187+0000 7fe411200640 1 -- 172.21.15.69:0/599199851 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe40c17dcf0 con 0x7fe40c183670 2024-02-21T07:42:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.187+0000 7fe411200640 1 -- 172.21.15.69:0/599199851 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe40c17e2b0 con 0x7fe40c183670 2024-02-21T07:42:48.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.188+0000 7fe411200640 1 -- 172.21.15.69:0/599199851 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe40c184300 con 0x7fe40c183670 2024-02-21T07:42:48.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.190+0000 7fe402000640 1 -- 172.21.15.69:0/599199851 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe3f4043070 con 0x7fe40c183670 2024-02-21T07:42:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.192+0000 7fe402000640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3e809f160 0x7fe3e80a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.192+0000 7fe402000640 1 -- 172.21.15.69:0/599199851 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe3f40eb320 con 0x7fe40c183670 2024-02-21T07:42:48.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.193+0000 7fe409e00640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3e809f160 0x7fe3e80a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:48.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.193+0000 7fe409e00640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3e809f160 0x7fe3e80a1620 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0011e0 tx=0x7fe3fc007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:48.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.197+0000 7fe402000640 1 -- 172.21.15.69:0/599199851 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe40c184300 con 0x7fe40c183670 2024-02-21T07:42:48.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.388+0000 7fe411200640 1 -- 172.21.15.69:0/599199851 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe40c184300 con 0x7fe40c183670 2024-02-21T07:42:48.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.389+0000 7fe402000640 1 -- 172.21.15.69:0/599199851 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe40c184300 con 0x7fe40c183670 2024-02-21T07:42:48.395 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:42:48.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.391+0000 7fe411200640 1 -- 172.21.15.69:0/599199851 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3e809f160 msgr2=0x7fe3e80a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.391+0000 7fe411200640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3e809f160 0x7fe3e80a1620 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0011e0 tx=0x7fe3fc007d30 comp rx=0 tx=0).stop 2024-02-21T07:42:48.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.391+0000 7fe411200640 1 -- 172.21.15.69:0/599199851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 msgr2=0x7fe40c17cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.391+0000 7fe411200640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 0x7fe40c17cf20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe3f4034040 tx=0x7fe3f40046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.391+0000 7fe411200640 1 -- 172.21.15.69:0/599199851 shutdown_connections 2024-02-21T07:42:48.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.391+0000 7fe411200640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3e809f160 0x7fe3e80a1620 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.391+0000 7fe411200640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe40c185cc0 0x7fe40c2201f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.391+0000 7fe411200640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe40c183670 0x7fe40c17cf20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.391+0000 7fe411200640 1 --2- 172.21.15.69:0/599199851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe40c17f700 0x7fe40c072630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.391+0000 7fe411200640 1 -- 172.21.15.69:0/599199851 >> 172.21.15.69:0/599199851 conn(0x7fe40c0ce3d0 msgr2=0x7fe40c1893d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:48.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.392+0000 7fe411200640 1 -- 172.21.15.69:0/599199851 shutdown_connections 2024-02-21T07:42:48.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.392+0000 7fe411200640 1 -- 172.21.15.69:0/599199851 wait complete. 2024-02-21T07:42:48.416 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:42:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.612+0000 7fd849c00640 1 Processor -- start 2024-02-21T07:42:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.612+0000 7fd849c00640 1 -- start start 2024-02-21T07:42:48.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.614+0000 7fd849c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd844186200 0x7fd844189df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:48.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.614+0000 7fd849c00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8441865e0 con 0x7fd84418a330 2024-02-21T07:42:48.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.614+0000 7fd849c00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8441898d0 con 0x7fd84418a7c0 2024-02-21T07:42:48.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.614+0000 7fd849c00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84408d930 con 0x7fd844186200 2024-02-21T07:42:48.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.614+0000 7fd842a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd844186200 0x7fd844189df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:48.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.614+0000 7fd842a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd844186200 0x7fd844189df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34236/0 (socket says 172.21.15.69:34236) 2024-02-21T07:42:48.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.614+0000 7fd842a00640 1 -- 172.21.15.69:0/2006702130 learned_addr learned my addr 172.21.15.69:0/2006702130 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:48.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.615+0000 7fd842a00640 1 -- 172.21.15.69:0/2006702130 >> v1:172.21.15.184:6789/0 conn(0x7fd84418a7c0 legacy=0x7fd84418c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.615+0000 7fd842a00640 1 -- 172.21.15.69:0/2006702130 >> v1:172.21.15.174:6789/0 conn(0x7fd84418a330 legacy=0x7fd84418bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.615+0000 7fd842a00640 1 -- 172.21.15.69:0/2006702130 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84408dc10 con 0x7fd844186200 2024-02-21T07:42:48.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.615+0000 7fd841600640 1 -- 172.21.15.69:0/2006702130 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954001025 0 0) 0x7fd8441898d0 con 0x7fd84418a7c0 2024-02-21T07:42:48.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.616+0000 7fd842a00640 1 --2- 172.21.15.69:0/2006702130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 0x7fd844189df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd834009870 tx=0x7fd83402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903da8883f12f075 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:48.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.616+0000 7fd841600640 1 -- 172.21.15.69:0/2006702130 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83402f840 con 0x7fd844186200 2024-02-21T07:42:48.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.616+0000 7fd841600640 1 -- 172.21.15.69:0/2006702130 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83402f9a0 con 0x7fd844186200 2024-02-21T07:42:48.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.616+0000 7fd841600640 1 -- 172.21.15.69:0/2006702130 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83402fd30 con 0x7fd844186200 2024-02-21T07:42:48.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.616+0000 7fd849c00640 1 -- 172.21.15.69:0/2006702130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 msgr2=0x7fd844189df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.616+0000 7fd849c00640 1 --2- 172.21.15.69:0/2006702130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 0x7fd844189df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd834009870 tx=0x7fd83402ba20 comp rx=0 tx=0).stop 2024-02-21T07:42:48.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.617+0000 7fd849c00640 1 -- 172.21.15.69:0/2006702130 shutdown_connections 2024-02-21T07:42:48.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.617+0000 7fd849c00640 1 --2- 172.21.15.69:0/2006702130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 0x7fd844189df0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.617+0000 7fd849c00640 1 -- 172.21.15.69:0/2006702130 >> 172.21.15.69:0/2006702130 conn(0x7fd8440d04d0 msgr2=0x7fd8440d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:48.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.617+0000 7fd849c00640 1 -- 172.21.15.69:0/2006702130 shutdown_connections 2024-02-21T07:42:48.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.617+0000 7fd849c00640 1 -- 172.21.15.69:0/2006702130 wait complete. 2024-02-21T07:42:48.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.618+0000 7fd849c00640 1 Processor -- start 2024-02-21T07:42:48.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.619+0000 7fd849c00640 1 -- start start 2024-02-21T07:42:48.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd849c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 0x7fd844181200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:48.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd849c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd84418a330 0x7fd844181740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:48.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd849c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8441798c0 0x7fd844179d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:48.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd849c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844181c80 con 0x7fd844186200 2024-02-21T07:42:48.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd849c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844182190 con 0x7fd84418a330 2024-02-21T07:42:48.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd849c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844181eb0 con 0x7fd8441798c0 2024-02-21T07:42:48.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd842a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 0x7fd844181200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd842a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 0x7fd844181200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34250/0 (socket says 172.21.15.69:34250) 2024-02-21T07:42:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd842a00640 1 -- 172.21.15.69:0/4245357878 learned_addr learned my addr 172.21.15.69:0/4245357878 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd842000640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd84418a330 0x7fd844181740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd843400640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8441798c0 0x7fd844179d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd842a00640 1 -- 172.21.15.69:0/4245357878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8441798c0 msgr2=0x7fd844179d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd842a00640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8441798c0 0x7fd844179d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd842a00640 1 -- 172.21.15.69:0/4245357878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd84418a330 msgr2=0x7fd844181740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd842a00640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd84418a330 0x7fd844181740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.620+0000 7fd842a00640 1 -- 172.21.15.69:0/4245357878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340094d0 con 0x7fd844186200 2024-02-21T07:42:48.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.621+0000 7fd842a00640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 0x7fd844181200 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd834009870 tx=0x7fd834004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:48.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.621+0000 7fd83aa00640 1 -- 172.21.15.69:0/4245357878 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83402f7f0 con 0x7fd844186200 2024-02-21T07:42:48.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.621+0000 7fd83aa00640 1 -- 172.21.15.69:0/4245357878 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834041400 con 0x7fd844186200 2024-02-21T07:42:48.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.621+0000 7fd83aa00640 1 -- 172.21.15.69:0/4245357878 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8340417b0 con 0x7fd844186200 2024-02-21T07:42:48.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.621+0000 7fd849c00640 1 -- 172.21.15.69:0/4245357878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd844210f80 con 0x7fd844186200 2024-02-21T07:42:48.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.621+0000 7fd849c00640 1 -- 172.21.15.69:0/4245357878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd844211540 con 0x7fd844186200 2024-02-21T07:42:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.622+0000 7fd849c00640 1 -- 172.21.15.69:0/4245357878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd844069d50 con 0x7fd844186200 2024-02-21T07:42:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.624+0000 7fd83aa00640 1 -- 172.21.15.69:0/4245357878 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fd834041910 con 0x7fd844186200 2024-02-21T07:42:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.625+0000 7fd83aa00640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd82409f130 0x7fd8240a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.625+0000 7fd83aa00640 1 -- 172.21.15.69:0/4245357878 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd83403c070 con 0x7fd844186200 2024-02-21T07:42:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.626+0000 7fd842000640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd82409f130 0x7fd8240a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:48.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.626+0000 7fd842000640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd82409f130 0x7fd8240a15f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd8440cb050 tx=0x7fd830009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:48.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.629+0000 7fd83aa00640 1 -- 172.21.15.69:0/4245357878 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd8340b67b0 con 0x7fd844186200 2024-02-21T07:42:48.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.864+0000 7fd849c00640 1 -- 172.21.15.69:0/4245357878 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8440686d0 con 0x7fd844186200 2024-02-21T07:42:48.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.866+0000 7fd83aa00640 1 -- 172.21.15.69:0/4245357878 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11372 (secure 0 0 0) 0x7fd8340b9e70 con 0x7fd844186200 2024-02-21T07:42:48.872 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:48.872 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:33.311078+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:42:48.872 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 18 2024-02-21T07:42:48.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 -- 172.21.15.69:0/4245357878 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd82409f130 msgr2=0x7fd8240a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd82409f130 0x7fd8240a15f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd8440cb050 tx=0x7fd830009040 comp rx=0 tx=0).stop 2024-02-21T07:42:48.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 -- 172.21.15.69:0/4245357878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 msgr2=0x7fd844181200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:48.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 0x7fd844181200 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd834009870 tx=0x7fd834004730 comp rx=0 tx=0).stop 2024-02-21T07:42:48.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 -- 172.21.15.69:0/4245357878 shutdown_connections 2024-02-21T07:42:48.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd82409f130 0x7fd8240a15f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8441798c0 0x7fd844179d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd84418a330 0x7fd844181740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 --2- 172.21.15.69:0/4245357878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd844186200 0x7fd844181200 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:48.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 -- 172.21.15.69:0/4245357878 >> 172.21.15.69:0/4245357878 conn(0x7fd8440d04d0 msgr2=0x7fd84417b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:48.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.868+0000 7fd849c00640 1 -- 172.21.15.69:0/4245357878 shutdown_connections 2024-02-21T07:42:48.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:48.869+0000 7fd849c00640 1 -- 172.21.15.69:0/4245357878 wait complete. 2024-02-21T07:42:48.893 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:49.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.087+0000 7f8c34a00640 1 Processor -- start 2024-02-21T07:42:49.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.088+0000 7f8c34a00640 1 -- start start 2024-02-21T07:42:49.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.090+0000 7f8c34a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8c30182a60 0x7f8c300fe490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.090+0000 7f8c34a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8c300fe9d0 0x7f8c30188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.090+0000 7f8c34a00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c30188730 con 0x7f8c300fee50 2024-02-21T07:42:49.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.090+0000 7f8c34a00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c300fd430 con 0x7f8c300fe9d0 2024-02-21T07:42:49.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.090+0000 7f8c34a00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c300fd6d0 con 0x7f8c30182a60 2024-02-21T07:42:49.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.090+0000 7f8c2d400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8c300fe9d0 0x7f8c30188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.090+0000 7f8c2e800640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8c300fee50 0x7f8c30188f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:41642/0 (socket says 172.21.15.69:41642) 2024-02-21T07:42:49.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.090+0000 7f8c2de00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8c30182a60 0x7f8c300fe490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.090+0000 7f8c2e800640 1 -- 172.21.15.69:0/2201592143 learned_addr learned my addr 172.21.15.69:0/2201592143 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:49.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.091+0000 7f8c2de00640 1 -- 172.21.15.69:0/2201592143 >> v2:172.21.15.69:3300/0 conn(0x7f8c300fe9d0 msgr2=0x7f8c30188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:49.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.091+0000 7f8c2de00640 1 --2- 172.21.15.69:0/2201592143 >> v2:172.21.15.69:3300/0 conn(0x7f8c300fe9d0 0x7f8c30188a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.091+0000 7f8c2de00640 1 -- 172.21.15.69:0/2201592143 >> v1:172.21.15.69:6789/0 conn(0x7f8c300fee50 legacy=0x7f8c30188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.091+0000 7f8c2de00640 1 -- 172.21.15.69:0/2201592143 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c300fd9b0 con 0x7f8c30182a60 2024-02-21T07:42:49.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.091+0000 7f8c2d400640 1 --2- 172.21.15.69:0/2201592143 >> v2:172.21.15.69:3300/0 conn(0x7f8c300fe9d0 0x7f8c30188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:49.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.092+0000 7f8c2de00640 1 --2- 172.21.15.69:0/2201592143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c30182a60 0x7f8c300fe490 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8c300ff390 tx=0x7f8c2002b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31b6db06f0f09b51 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:49.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.092+0000 7f8c2ca00640 1 -- 172.21.15.69:0/2201592143 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20031710 con 0x7f8c30182a60 2024-02-21T07:42:49.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.092+0000 7f8c2ca00640 1 -- 172.21.15.69:0/2201592143 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2002f050 con 0x7f8c30182a60 2024-02-21T07:42:49.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.092+0000 7f8c2ca00640 1 -- 172.21.15.69:0/2201592143 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20031a90 con 0x7f8c30182a60 2024-02-21T07:42:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.093+0000 7f8c34a00640 1 -- 172.21.15.69:0/2201592143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c30182a60 msgr2=0x7f8c300fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.093+0000 7f8c34a00640 1 --2- 172.21.15.69:0/2201592143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c30182a60 0x7f8c300fe490 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8c300ff390 tx=0x7f8c2002b7b0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.093+0000 7f8c34a00640 1 -- 172.21.15.69:0/2201592143 shutdown_connections 2024-02-21T07:42:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.093+0000 7f8c34a00640 1 --2- 172.21.15.69:0/2201592143 >> v2:172.21.15.69:3300/0 conn(0x7f8c300fe9d0 0x7f8c30188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.093+0000 7f8c34a00640 1 --2- 172.21.15.69:0/2201592143 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c30182a60 0x7f8c300fe490 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.093+0000 7f8c34a00640 1 -- 172.21.15.69:0/2201592143 >> 172.21.15.69:0/2201592143 conn(0x7f8c30071e00 msgr2=0x7f8c300668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.093+0000 7f8c34a00640 1 -- 172.21.15.69:0/2201592143 shutdown_connections 2024-02-21T07:42:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.093+0000 7f8c34a00640 1 -- 172.21.15.69:0/2201592143 wait complete. 2024-02-21T07:42:49.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.095+0000 7f8c34a00640 1 Processor -- start 2024-02-21T07:42:49.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.095+0000 7f8c34a00640 1 -- start start 2024-02-21T07:42:49.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c34a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c300fe9d0 0x7f8c3016e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c34a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c300fee50 0x7f8c30221190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c34a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c30182a60 0x7f8c3021e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c34a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3021fe10 con 0x7f8c30182a60 2024-02-21T07:42:49.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c34a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c302200f0 con 0x7f8c300fe9d0 2024-02-21T07:42:49.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c34a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c302203d0 con 0x7f8c300fee50 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c2e800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c30182a60 0x7f8c3021e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c2de00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c300fe9d0 0x7f8c3016e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c2e800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c30182a60 0x7f8c3021e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53510/0 (socket says 172.21.15.69:53510) 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c2e800640 1 -- 172.21.15.69:0/2618832332 learned_addr learned my addr 172.21.15.69:0/2618832332 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.096+0000 7f8c2d400640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c300fee50 0x7f8c30221190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c2e800640 1 -- 172.21.15.69:0/2618832332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c300fee50 msgr2=0x7f8c30221190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c2e800640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c300fee50 0x7f8c30221190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c2e800640 1 -- 172.21.15.69:0/2618832332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c300fe9d0 msgr2=0x7f8c3016e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c2e800640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c300fe9d0 0x7f8c3016e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c2e800640 1 -- 172.21.15.69:0/2618832332 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c009400 con 0x7f8c30182a60 2024-02-21T07:42:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c2de00640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c300fe9d0 0x7f8c3016e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:49.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c2e800640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c30182a60 0x7f8c3021e780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800caa0 tx=0x7f8c2800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:49.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c26000640 1 -- 172.21.15.69:0/2618832332 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2800ac00 con 0x7f8c30182a60 2024-02-21T07:42:49.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c26000640 1 -- 172.21.15.69:0/2618832332 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2800ad60 con 0x7f8c30182a60 2024-02-21T07:42:49.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c26000640 1 -- 172.21.15.69:0/2618832332 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28012600 con 0x7f8c30182a60 2024-02-21T07:42:49.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c34a00640 1 -- 172.21.15.69:0/2618832332 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c20009400 con 0x7f8c30182a60 2024-02-21T07:42:49.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.097+0000 7f8c34a00640 1 -- 172.21.15.69:0/2618832332 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c30220990 con 0x7f8c30182a60 2024-02-21T07:42:49.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.099+0000 7f8c34a00640 1 -- 172.21.15.69:0/2618832332 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c30069d50 con 0x7f8c30182a60 2024-02-21T07:42:49.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.100+0000 7f8c26000640 1 -- 172.21.15.69:0/2618832332 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f8c28007070 con 0x7f8c30182a60 2024-02-21T07:42:49.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.102+0000 7f8c26000640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8c1009f130 0x7f8c100a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.102+0000 7f8c26000640 1 -- 172.21.15.69:0/2618832332 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8c280c9ab0 con 0x7f8c30182a60 2024-02-21T07:42:49.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.102+0000 7f8c2de00640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8c1009f130 0x7f8c100a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.103+0000 7f8c2de00640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8c1009f130 0x7f8c100a15f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c20035000 tx=0x7f8c20008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:49.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.106+0000 7f8c26000640 1 -- 172.21.15.69:0/2618832332 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8c2804d8c0 con 0x7f8c30182a60 2024-02-21T07:42:49.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.307+0000 7f8c34a00640 1 -- 172.21.15.69:0/2618832332 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c300fd070 con 0x7f8c30182a60 2024-02-21T07:42:49.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.311+0000 7f8c26000640 1 -- 172.21.15.69:0/2618832332 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23736 (secure 0 0 0) 0x7f8c28093800 con 0x7f8c30182a60 2024-02-21T07:42:49.317 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:49.317 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":31,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:48.463144+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:49.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 -- 172.21.15.69:0/2618832332 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8c1009f130 msgr2=0x7f8c100a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8c1009f130 0x7f8c100a15f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8c20035000 tx=0x7f8c20008030 comp rx=0 tx=0).stop 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 -- 172.21.15.69:0/2618832332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c30182a60 msgr2=0x7f8c3021e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c30182a60 0x7f8c3021e780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800caa0 tx=0x7f8c2800cf60 comp rx=0 tx=0).stop 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 -- 172.21.15.69:0/2618832332 shutdown_connections 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8c1009f130 0x7f8c100a15f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c30182a60 0x7f8c3021e780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8c300fee50 0x7f8c30221190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 --2- 172.21.15.69:0/2618832332 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8c300fe9d0 0x7f8c3016e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 -- 172.21.15.69:0/2618832332 >> 172.21.15.69:0/2618832332 conn(0x7f8c30071e00 msgr2=0x7f8c30068a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.313+0000 7f8c34a00640 1 -- 172.21.15.69:0/2618832332 shutdown_connections 2024-02-21T07:42:49.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.314+0000 7f8c34a00640 1 -- 172.21.15.69:0/2618832332 wait complete. 2024-02-21T07:42:49.339 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:42:49.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.539+0000 7f90afe00640 1 Processor -- start 2024-02-21T07:42:49.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.540+0000 7f90afe00640 1 -- start start 2024-02-21T07:42:49.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.541+0000 7f90afe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f90a8186210 0x7f90a8188e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.541+0000 7f90afe00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a806dcd0 con 0x7f90a8189340 2024-02-21T07:42:49.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.542+0000 7f90afe00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a81865f0 con 0x7f90a818b370 2024-02-21T07:42:49.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.542+0000 7f90afe00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a80cd1d0 con 0x7f90a8186210 2024-02-21T07:42:49.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.542+0000 7f90aca00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f90a8189340 0x7f90a818ac60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:41648/0 (socket says 172.21.15.69:41648) 2024-02-21T07:42:49.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.542+0000 7f90aca00640 1 -- 172.21.15.69:0/1985476362 learned_addr learned my addr 172.21.15.69:0/1985476362 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:49.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.542+0000 7f90ad400640 1 --2- 172.21.15.69:0/1985476362 >> v2:172.21.15.69:3300/0 conn(0x7f90a8186210 0x7f90a8188e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.542+0000 7f90ad400640 1 -- 172.21.15.69:0/1985476362 >> v1:172.21.15.174:6789/0 conn(0x7f90a818b370 legacy=0x7f90a80cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.542+0000 7f90ad400640 1 -- 172.21.15.69:0/1985476362 >> v1:172.21.15.69:6789/0 conn(0x7f90a8189340 legacy=0x7f90a818ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.542+0000 7f90ad400640 1 -- 172.21.15.69:0/1985476362 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80cd4b0 con 0x7f90a8186210 2024-02-21T07:42:49.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.543+0000 7f90ad400640 1 --2- 172.21.15.69:0/1985476362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 0x7f90a8188e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90980097a0 tx=0x7f909802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79998fa1bae52fce server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:49.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.544+0000 7f90a7e00640 1 -- 172.21.15.69:0/1985476362 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909802e070 con 0x7f90a8186210 2024-02-21T07:42:49.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.544+0000 7f90a7e00640 1 -- 172.21.15.69:0/1985476362 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90980315a0 con 0x7f90a8186210 2024-02-21T07:42:49.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.544+0000 7f90a7e00640 1 -- 172.21.15.69:0/1985476362 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098031930 con 0x7f90a8186210 2024-02-21T07:42:49.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.544+0000 7f90afe00640 1 -- 172.21.15.69:0/1985476362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 msgr2=0x7f90a8188e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.544+0000 7f90afe00640 1 --2- 172.21.15.69:0/1985476362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 0x7f90a8188e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90980097a0 tx=0x7f909802b840 comp rx=0 tx=0).stop 2024-02-21T07:42:49.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.544+0000 7f90afe00640 1 -- 172.21.15.69:0/1985476362 shutdown_connections 2024-02-21T07:42:49.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.544+0000 7f90afe00640 1 --2- 172.21.15.69:0/1985476362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 0x7f90a8188e00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.544+0000 7f90afe00640 1 -- 172.21.15.69:0/1985476362 >> 172.21.15.69:0/1985476362 conn(0x7f90a80f69c0 msgr2=0x7f90a80f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:49.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.544+0000 7f90afe00640 1 -- 172.21.15.69:0/1985476362 shutdown_connections 2024-02-21T07:42:49.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.545+0000 7f90afe00640 1 -- 172.21.15.69:0/1985476362 wait complete. 2024-02-21T07:42:49.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.546+0000 7f90afe00640 1 Processor -- start 2024-02-21T07:42:49.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.547+0000 7f90afe00640 1 -- start start 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90afe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 0x7f90a821eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90afe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90a8189340 0x7f90a80f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90afe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90a818b370 0x7f90a81572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90afe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8181ea0 con 0x7f90a8186210 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90afe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8159cc0 con 0x7f90a818b370 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90afe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81820f0 con 0x7f90a8189340 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90ad400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 0x7f90a821eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90ad400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 0x7f90a821eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53532/0 (socket says 172.21.15.69:53532) 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90ad400640 1 -- 172.21.15.69:0/4193641425 learned_addr learned my addr 172.21.15.69:0/4193641425 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90ade00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90a818b370 0x7f90a81572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90aca00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90a8189340 0x7f90a80f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90ad400640 1 -- 172.21.15.69:0/4193641425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90a8189340 msgr2=0x7f90a80f47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90ad400640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90a8189340 0x7f90a80f47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90ad400640 1 -- 172.21.15.69:0/4193641425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90a818b370 msgr2=0x7f90a81572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90ad400640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90a818b370 0x7f90a81572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90ad400640 1 -- 172.21.15.69:0/4193641425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098009400 con 0x7f90a8186210 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.548+0000 7f90aca00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90a8189340 0x7f90a80f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.549+0000 7f90ad400640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 0x7f90a821eef0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9098034040 tx=0x7f90980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.549+0000 7f90a5600640 1 -- 172.21.15.69:0/4193641425 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098032840 con 0x7f90a8186210 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.549+0000 7f90a5600640 1 -- 172.21.15.69:0/4193641425 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90980329c0 con 0x7f90a8186210 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.549+0000 7f90afe00640 1 -- 172.21.15.69:0/4193641425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a81823d0 con 0x7f90a8186210 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.549+0000 7f90a5600640 1 -- 172.21.15.69:0/4193641425 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9098032d70 con 0x7f90a8186210 2024-02-21T07:42:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.549+0000 7f90afe00640 1 -- 172.21.15.69:0/4193641425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a8182990 con 0x7f90a8186210 2024-02-21T07:42:49.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.550+0000 7f90afe00640 1 -- 172.21.15.69:0/4193641425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a8069d50 con 0x7f90a8186210 2024-02-21T07:42:49.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.552+0000 7f90a5600640 1 -- 172.21.15.69:0/4193641425 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f909804e430 con 0x7f90a8186210 2024-02-21T07:42:49.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.554+0000 7f90a5600640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f908809f130 0x7f90880a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:49.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.554+0000 7f90a5600640 1 -- 172.21.15.69:0/4193641425 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f90980ebf10 con 0x7f90a8186210 2024-02-21T07:42:49.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.554+0000 7f90aca00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f908809f130 0x7f90880a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:49.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.555+0000 7f90aca00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f908809f130 0x7f90880a15f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f90a818c7a0 tx=0x7f9094009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:49.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.558+0000 7f90a5600640 1 -- 172.21.15.69:0/4193641425 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90980b5aa0 con 0x7f90a8186210 2024-02-21T07:42:49.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.793+0000 7f90afe00640 1 -- 172.21.15.69:0/4193641425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90a8181c60 con 0x7f90a8186210 2024-02-21T07:42:49.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.795+0000 7f90a5600640 1 -- 172.21.15.69:0/4193641425 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f90980b79d0 con 0x7f90a8186210 2024-02-21T07:42:49.801 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:49.801 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:33.311078+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:42:49.802 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 18 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.797+0000 7f90afe00640 1 -- 172.21.15.69:0/4193641425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f908809f130 msgr2=0x7f90880a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f908809f130 0x7f90880a15f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f90a818c7a0 tx=0x7f9094009040 comp rx=0 tx=0).stop 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 -- 172.21.15.69:0/4193641425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 msgr2=0x7f90a821eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 0x7f90a821eef0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9098034040 tx=0x7f90980046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 -- 172.21.15.69:0/4193641425 shutdown_connections 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f908809f130 0x7f90880a15f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f90a818b370 0x7f90a81572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f90a8189340 0x7f90a80f47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 --2- 172.21.15.69:0/4193641425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90a8186210 0x7f90a821eef0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 -- 172.21.15.69:0/4193641425 >> 172.21.15.69:0/4193641425 conn(0x7f90a80f69c0 msgr2=0x7f90a80ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 -- 172.21.15.69:0/4193641425 shutdown_connections 2024-02-21T07:42:49.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:49.798+0000 7f90afe00640 1 -- 172.21.15.69:0/4193641425 wait complete. 2024-02-21T07:42:51.031 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-02-21T07:42:02.396796+0000', 'modified': '2024-02-21T07:42:33.311078+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4378, 'mds_1': 4375, 'mds_2': 4363, 'mds_3': 4360, 'mds_4': 4321}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4318': {'gid': 4318, 'name': 'h', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.174:6839/2813302146', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6838', 'nonce': 2813302146}, {'type': 'v1', 'addr': '172.21.15.174:6839', 'nonce': 2813302146}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4321': {'gid': 4321, 'name': 'b', 'rank': 4, 'incarnation': 16, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.174:6841/2567176191', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.174:6840', 'nonce': 2567176191}, {'type': 'v1', 'addr': '172.21.15.174:6841', 'nonce': 2567176191}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4325': {'gid': 4325, 'name': 'c', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6833/241275309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6832', 'nonce': 241275309}, {'type': 'v1', 'addr': '172.21.15.184:6833', 'nonce': 241275309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4334': {'gid': 4334, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6839/1152335050', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6838', 'nonce': 1152335050}, {'type': 'v1', 'addr': '172.21.15.184:6839', 'nonce': 1152335050}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4345': {'gid': 4345, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6835/833362199', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6834', 'nonce': 833362199}, {'type': 'v1', 'addr': '172.21.15.184:6835', 'nonce': 833362199}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4348': {'gid': 4348, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.184:6837/2656539850', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.184:6836', 'nonce': 2656539850}, {'type': 'v1', 'addr': '172.21.15.184:6837', 'nonce': 2656539850}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4360': {'gid': 4360, 'name': 'd', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.69:6833/3664160916', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6832', 'nonce': 3664160916}, {'type': 'v1', 'addr': '172.21.15.69:6833', 'nonce': 3664160916}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4363': {'gid': 4363, 'name': 'g', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.69:6835/3538407092', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6834', 'nonce': 3538407092}, {'type': 'v1', 'addr': '172.21.15.69:6835', 'nonce': 3538407092}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4375': {'gid': 4375, 'name': 'j', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.69:6837/2966352085', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6836', 'nonce': 2966352085}, {'type': 'v1', 'addr': '172.21.15.69:6837', 'nonce': 2966352085}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4378': {'gid': 4378, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.69:6839/3963425058', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6838', 'nonce': 3963425058}, {'type': 'v1', 'addr': '172.21.15.69:6839', 'nonce': 3963425058}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-21T07:42:51.032 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-02-21T07:42:51.032 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-02-21T07:42:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.245+0000 7f4e25c00640 1 Processor -- start 2024-02-21T07:42:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.246+0000 7f4e25c00640 1 -- start start 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.247+0000 7f4e25c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4e200f4e60 0x7f4e2006ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.247+0000 7f4e25c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4e20185b00 0x7f4e20182dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.247+0000 7f4e25c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4e20183310 0x7f4e200f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e25c00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200f5350 con 0x7f4e20185b00 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e25c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200f5630 con 0x7f4e20183310 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e25c00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200f5910 con 0x7f4e200f4e60 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e16000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4e20185b00 0x7f4e20182dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e16000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4e20185b00 0x7f4e20182dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53548/0 (socket says 172.21.15.69:53548) 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e1ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f4e200f4e60 0x7f4e2006ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e16000640 1 -- 172.21.15.69:0/1284573301 learned_addr learned my addr 172.21.15.69:0/1284573301 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e1f400640 1 --2- 172.21.15.69:0/1284573301 >> v2:172.21.15.174:3300/0 conn(0x7f4e20183310 0x7f4e200f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e16000640 1 -- 172.21.15.69:0/1284573301 >> v2:172.21.15.184:3300/0 conn(0x7f4e200f4e60 msgr2=0x7f4e2006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e16000640 1 --2- 172.21.15.69:0/1284573301 >> v2:172.21.15.184:3300/0 conn(0x7f4e200f4e60 0x7f4e2006ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e16000640 1 -- 172.21.15.69:0/1284573301 >> v2:172.21.15.174:3300/0 conn(0x7f4e20183310 msgr2=0x7f4e200f7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e16000640 1 --2- 172.21.15.69:0/1284573301 >> v2:172.21.15.174:3300/0 conn(0x7f4e20183310 0x7f4e200f7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.248+0000 7f4e16000640 1 -- 172.21.15.69:0/1284573301 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200f5bf0 con 0x7f4e20185b00 2024-02-21T07:42:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.249+0000 7f4e16000640 1 --2- 172.21.15.69:0/1284573301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e20185b00 0x7f4e20182dd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006db00 tx=0x7f4e0802b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac0b43257ec5861 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.250+0000 7f4e1e000640 1 -- 172.21.15.69:0/1284573301 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08031890 con 0x7f4e20185b00 2024-02-21T07:42:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.250+0000 7f4e1e000640 1 -- 172.21.15.69:0/1284573301 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e080319f0 con 0x7f4e20185b00 2024-02-21T07:42:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.250+0000 7f4e1e000640 1 -- 172.21.15.69:0/1284573301 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08031d80 con 0x7f4e20185b00 2024-02-21T07:42:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.250+0000 7f4e25c00640 1 -- 172.21.15.69:0/1284573301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e20185b00 msgr2=0x7f4e20182dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.250+0000 7f4e25c00640 1 --2- 172.21.15.69:0/1284573301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e20185b00 0x7f4e20182dd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006db00 tx=0x7f4e0802b930 comp rx=0 tx=0).stop 2024-02-21T07:42:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.251+0000 7f4e25c00640 1 -- 172.21.15.69:0/1284573301 shutdown_connections 2024-02-21T07:42:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.251+0000 7f4e25c00640 1 --2- 172.21.15.69:0/1284573301 >> v2:172.21.15.174:3300/0 conn(0x7f4e20183310 0x7f4e200f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.251+0000 7f4e25c00640 1 --2- 172.21.15.69:0/1284573301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e20185b00 0x7f4e20182dd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.251+0000 7f4e25c00640 1 --2- 172.21.15.69:0/1284573301 >> v2:172.21.15.184:3300/0 conn(0x7f4e200f4e60 0x7f4e2006ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.251+0000 7f4e25c00640 1 -- 172.21.15.69:0/1284573301 >> 172.21.15.69:0/1284573301 conn(0x7f4e200f69c0 msgr2=0x7f4e200f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.251+0000 7f4e25c00640 1 -- 172.21.15.69:0/1284573301 shutdown_connections 2024-02-21T07:42:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.251+0000 7f4e25c00640 1 -- 172.21.15.69:0/1284573301 wait complete. 2024-02-21T07:42:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.253+0000 7f4e25c00640 1 Processor -- start 2024-02-21T07:42:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.253+0000 7f4e25c00640 1 -- start start 2024-02-21T07:42:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e25c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e200f4e60 0x7f4e20162300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e25c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e20183310 0x7f4e2006ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e25c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e20185b00 0x7f4e2006b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e25c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2006c490 con 0x7f4e20185b00 2024-02-21T07:42:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e25c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2006b910 con 0x7f4e200f4e60 2024-02-21T07:42:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e25c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2006bbf0 con 0x7f4e20183310 2024-02-21T07:42:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e1f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e20185b00 0x7f4e2006b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e1ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e200f4e60 0x7f4e20162300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e1ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e200f4e60 0x7f4e20162300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:50744/0 (socket says 172.21.15.69:50744) 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e1ea00640 1 -- 172.21.15.69:0/2357572523 learned_addr learned my addr 172.21.15.69:0/2357572523 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.254+0000 7f4e16000640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e20183310 0x7f4e2006ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e1ea00640 1 -- 172.21.15.69:0/2357572523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e20183310 msgr2=0x7f4e2006ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e20183310 0x7f4e2006ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e1ea00640 1 -- 172.21.15.69:0/2357572523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e20185b00 msgr2=0x7f4e2006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e20185b00 0x7f4e2006b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e1ea00640 1 -- 172.21.15.69:0/2357572523 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e080094d0 con 0x7f4e200f4e60 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e200f4e60 0x7f4e20162300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000e870 tx=0x7f4e1000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e17400640 1 -- 172.21.15.69:0/2357572523 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1000ee60 con 0x7f4e200f4e60 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e17400640 1 -- 172.21.15.69:0/2357572523 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1000c940 con 0x7f4e200f4e60 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e25c00640 1 -- 172.21.15.69:0/2357572523 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2006bed0 con 0x7f4e200f4e60 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e17400640 1 -- 172.21.15.69:0/2357572523 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1000ccf0 con 0x7f4e200f4e60 2024-02-21T07:42:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.255+0000 7f4e25c00640 1 -- 172.21.15.69:0/2357572523 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e20220120 con 0x7f4e200f4e60 2024-02-21T07:42:51.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.259+0000 7f4e17400640 1 -- 172.21.15.69:0/2357572523 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f4e10013470 con 0x7f4e200f4e60 2024-02-21T07:42:51.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.259+0000 7f4e28987740 1 Processor -- start 2024-02-21T07:42:51.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.259+0000 7f4e28987740 1 -- start start 2024-02-21T07:42:51.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.260+0000 7f4e17400640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4dfc09f0b0 0x7f4dfc0a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.260+0000 7f4e17400640 1 -- 172.21.15.69:0/2357572523 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4e100c9d30 con 0x7f4e200f4e60 2024-02-21T07:42:51.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.260+0000 7f4e1f400640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4dfc09f0b0 0x7f4dfc0a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e28987740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b167e0 0x55c0b4b16bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e28987740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 0x55c0b4b51970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e28987740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4b52c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e28987740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b4a49b30 con 0x55c0b4b17100 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e28987740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b4a47060 con 0x55c0b4b167e0 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e28987740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b4a42840 con 0x55c0b4b51eb0 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b167e0 0x55c0b4b16bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b167e0 0x55c0b4b16bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:50760/0 (socket says 172.21.15.69:50760) 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1ea00640 1 -- 172.21.15.69:0/3541727158 learned_addr learned my addr 172.21.15.69:0/3541727158 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e16000640 1 --2- 172.21.15.69:0/3541727158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 0x55c0b4b51970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1f400640 1 --2- 172.21.15.69:0/3541727158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4b52c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1f400640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4dfc09f0b0 0x7f4dfc0a1570 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e18011420 tx=0x7f4e1800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1ea00640 1 -- 172.21.15.69:0/3541727158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 msgr2=0x55c0b4b52c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/3541727158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4b52c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1ea00640 1 -- 172.21.15.69:0/3541727158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 msgr2=0x55c0b4b51970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/3541727158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 0x55c0b4b51970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1ea00640 1 -- 172.21.15.69:0/3541727158 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0b4a0a4c0 con 0x55c0b4b167e0 2024-02-21T07:42:51.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.261+0000 7f4e1f400640 1 --2- 172.21.15.69:0/3541727158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4b52c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:51.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/3541727158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b167e0 0x55c0b4b16bc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4e100958f0 tx=0x7f4e100959b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=832c31fa885bf401 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e0f400640 1 -- 172.21.15.69:0/3541727158 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1009ff60 con 0x55c0b4b167e0 2024-02-21T07:42:51.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e0f400640 1 -- 172.21.15.69:0/3541727158 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e10093e50 con 0x55c0b4b167e0 2024-02-21T07:42:51.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e0f400640 1 -- 172.21.15.69:0/3541727158 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e100c7d90 con 0x55c0b4b167e0 2024-02-21T07:42:51.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e28987740 1 -- 172.21.15.69:0/3541727158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b167e0 msgr2=0x55c0b4b16bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e28987740 1 --2- 172.21.15.69:0/3541727158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b167e0 0x55c0b4b16bc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4e100958f0 tx=0x7f4e100959b0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e28987740 1 -- 172.21.15.69:0/3541727158 shutdown_connections 2024-02-21T07:42:51.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e28987740 1 --2- 172.21.15.69:0/3541727158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4b52c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e28987740 1 --2- 172.21.15.69:0/3541727158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 0x55c0b4b51970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e28987740 1 --2- 172.21.15.69:0/3541727158 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b167e0 0x55c0b4b16bc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.262+0000 7f4e28987740 1 -- 172.21.15.69:0/3541727158 >> 172.21.15.69:0/3541727158 conn(0x55c0b4ad8db0 msgr2=0x55c0b4ad9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.263+0000 7f4e28987740 1 -- 172.21.15.69:0/3541727158 shutdown_connections 2024-02-21T07:42:51.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.263+0000 7f4e28987740 1 -- 172.21.15.69:0/3541727158 wait complete. 2024-02-21T07:42:51.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.263+0000 7f4e28987740 1 -- start start 2024-02-21T07:42:51.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.264+0000 7f4e28987740 1 Processor -- start 2024-02-21T07:42:51.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e28987740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b1d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e28987740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4b15c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e28987740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 0x55c0b4b58470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e28987740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b49e7ea0 con 0x55c0b4b590d0 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e28987740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b49e7b40 con 0x55c0b4b17100 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e28987740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b478af20 con 0x55c0b4b51eb0 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e28987740 10 client.0 _ll_register_callbacks cb 0x55c0b49fb950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e1ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b1d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e1ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b1d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:50766/0 (socket says 172.21.15.69:50766) 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e1ea00640 1 -- 172.21.15.69:0/2320728436 learned_addr learned my addr 172.21.15.69:0/2320728436 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e16000640 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4b15c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.265+0000 7f4e1f400640 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 0x55c0b4b58470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e1ea00640 1 -- 172.21.15.69:0/2320728436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 msgr2=0x55c0b4b15c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4b15c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e1ea00640 1 -- 172.21.15.69:0/2320728436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 msgr2=0x55c0b4b58470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 0x55c0b4b58470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e1ea00640 1 -- 172.21.15.69:0/2320728436 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e20220120 con 0x55c0b4b17100 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b1d920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4e100958f0 tx=0x7f4e10021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78662ce61684703a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e03e00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e03e00640 1 -- 172.21.15.69:0/2320728436 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10096ec0 con 0x55c0b4b17100 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e03e00640 1 -- 172.21.15.69:0/2320728436 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4e10093fc0 con 0x55c0b4b17100 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e28987740 1 -- 172.21.15.69:0/2320728436 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0b4a66c40 con 0x55c0b4b17100 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e03e00640 1 -- 172.21.15.69:0/2320728436 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e10097020 con 0x55c0b4b17100 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e28987740 10 client.4999 fetch_fsmap learned FSMap version 18 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.266+0000 7f4e28987740 1 -- 172.21.15.69:0/2320728436 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55c0b4a40ec0 con 0x55c0b4b17100 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.267+0000 7f4e03e00640 1 -- 172.21.15.69:0/2320728436 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1007b020 con 0x55c0b4b17100 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.267+0000 7f4e03e00640 1 -- 172.21.15.69:0/2320728436 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 18) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4e10011070 con 0x55c0b4b17100 2024-02-21T07:42:51.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.267+0000 7f4e28987740 10 client.4999 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:42:51.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.267+0000 7f4e28987740 10 client.4999 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-21T07:42:51.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.267+0000 7f4e28987740 20 client.4999 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:51.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.267+0000 7f4e28987740 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55c0b4b0c3b0 0x55c0b4b589b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.267+0000 7f4e28987740 4 client.4999 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:42:51.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.267+0000 7f4e28987740 1 -- 172.21.15.69:0/2320728436 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0b47426c0 con 0x55c0b4b0c3b0 2024-02-21T07:42:51.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.267+0000 7f4e16000640 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55c0b4b0c3b0 0x55c0b4b589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.268+0000 7f4e16000640 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55c0b4b0c3b0 0x55c0b4b589b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1c6aebbbed89b725 server_cookie=dd86f41497ecc0cb in_seq=0 out_seq=0 2024-02-21T07:42:51.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.268+0000 7f4e03e00640 10 client.4999 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:42:51.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.268+0000 7f4e03e00640 1 -- 172.21.15.69:0/2320728436 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c0b47426c0 con 0x55c0b4b0c3b0 2024-02-21T07:42:51.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.268+0000 7f4e03e00640 10 client.4999 handle_command_reply: tid=0 2024-02-21T07:42:51.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 client.4999 shutdown 2024-02-21T07:42:51.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 -- 172.21.15.69:0/2320728436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 msgr2=0x55c0b4b1d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b1d920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4e100958f0 tx=0x7f4e10021000 comp rx=0 tx=0).stop 2024-02-21T07:42:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 -- 172.21.15.69:0/2320728436 shutdown_connections 2024-02-21T07:42:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55c0b4b0c3b0 0x55c0b4b589b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 0x55c0b4b58470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4b15c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 --2- 172.21.15.69:0/2320728436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b1d920 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 -- 172.21.15.69:0/2320728436 >> 172.21.15.69:0/2320728436 conn(0x55c0b4b167e0 msgr2=0x55c0b4ada820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e03e00640 0 client.4999 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:42:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 -- 172.21.15.69:0/2320728436 shutdown_connections 2024-02-21T07:42:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 1 -- 172.21.15.69:0/2320728436 wait complete. 2024-02-21T07:42:51.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.269+0000 7f4e28987740 20 client.4999 trim_cache size 0 max 16384 2024-02-21T07:42:51.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.286+0000 7f4e28987740 1 Processor -- start 2024-02-21T07:42:51.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.286+0000 7f4e28987740 1 -- start start 2024-02-21T07:42:51.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.287+0000 7f4e28987740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b16bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.287+0000 7f4e28987740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4ae0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.287+0000 7f4e28987740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 0x55c0b4b1d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.287+0000 7f4e28987740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b4b1c330 con 0x55c0b4b590d0 2024-02-21T07:42:51.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.287+0000 7f4e28987740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b4b1c520 con 0x55c0b4b17100 2024-02-21T07:42:51.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.287+0000 7f4e28987740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b4b6b2a0 con 0x55c0b4b51eb0 2024-02-21T07:42:51.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e1f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 0x55c0b4b1d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e16000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4ae0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e16000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4ae0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:58686/0 (socket says 172.21.15.69:58686) 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e16000640 1 -- 172.21.15.69:0/2265385497 learned_addr learned my addr 172.21.15.69:0/2265385497 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/2265385497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b16bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e16000640 1 -- 172.21.15.69:0/2265385497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 msgr2=0x55c0b4b16bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e16000640 1 --2- 172.21.15.69:0/2265385497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b16bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e16000640 1 -- 172.21.15.69:0/2265385497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 msgr2=0x55c0b4b1d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e16000640 1 --2- 172.21.15.69:0/2265385497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 0x55c0b4b1d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e16000640 1 -- 172.21.15.69:0/2265385497 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0b4b162f0 con 0x55c0b4b51eb0 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/2265385497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b16bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e1f400640 1 --2- 172.21.15.69:0/2265385497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 0x55c0b4b1d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.288+0000 7f4e16000640 1 --2- 172.21.15.69:0/2265385497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4ae0420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e0802b970 tx=0x7f4e08030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaea996574520459 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e0ea00640 1 -- 172.21.15.69:0/2265385497 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08040040 con 0x55c0b4b51eb0 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e0ea00640 1 -- 172.21.15.69:0/2265385497 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e08041040 con 0x55c0b4b51eb0 2024-02-21T07:42:51.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e0ea00640 1 -- 172.21.15.69:0/2265385497 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0804b170 con 0x55c0b4b51eb0 2024-02-21T07:42:51.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e28987740 1 -- 172.21.15.69:0/2265385497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 msgr2=0x55c0b4ae0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e28987740 1 --2- 172.21.15.69:0/2265385497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4ae0420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e0802b970 tx=0x7f4e08030000 comp rx=0 tx=0).stop 2024-02-21T07:42:51.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e28987740 1 -- 172.21.15.69:0/2265385497 shutdown_connections 2024-02-21T07:42:51.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e28987740 1 --2- 172.21.15.69:0/2265385497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b590d0 0x55c0b4b1d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e28987740 1 --2- 172.21.15.69:0/2265385497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b51eb0 0x55c0b4ae0420 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e28987740 1 --2- 172.21.15.69:0/2265385497 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b17100 0x55c0b4b16bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e28987740 1 -- 172.21.15.69:0/2265385497 >> 172.21.15.69:0/2265385497 conn(0x55c0b4b167e0 msgr2=0x55c0b4ada820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e28987740 1 -- 172.21.15.69:0/2265385497 shutdown_connections 2024-02-21T07:42:51.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.289+0000 7f4e28987740 1 -- 172.21.15.69:0/2265385497 wait complete. 2024-02-21T07:42:51.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.290+0000 7f4e28987740 1 -- start start 2024-02-21T07:42:51.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.290+0000 7f4e28987740 1 Processor -- start 2024-02-21T07:42:51.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.291+0000 7f4e28987740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 0x55c0b4ad4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.291+0000 7f4e28987740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b51eb0 0x55c0b4bb5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e28987740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b590d0 0x55c0b4bb6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e28987740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b4ad78d0 con 0x55c0b4b17100 2024-02-21T07:42:51.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e28987740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b4ad82a0 con 0x55c0b4b51eb0 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e28987740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b4b21980 con 0x55c0b4b590d0 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e28987740 10 client.0 _ll_register_callbacks cb 0x7f4e100974a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e1ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 0x55c0b4ad4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e1ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 0x55c0b4ad4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53594/0 (socket says 172.21.15.69:53594) 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e1ea00640 1 -- 172.21.15.69:0/3963030398 learned_addr learned my addr 172.21.15.69:0/3963030398 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e1f400640 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b590d0 0x55c0b4bb6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e16000640 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b51eb0 0x55c0b4bb5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e1ea00640 1 -- 172.21.15.69:0/3963030398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b590d0 msgr2=0x55c0b4bb6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b590d0 0x55c0b4bb6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e1ea00640 1 -- 172.21.15.69:0/3963030398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b51eb0 msgr2=0x55c0b4bb5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b51eb0 0x55c0b4bb5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e1ea00640 1 -- 172.21.15.69:0/3963030398 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e18017580 con 0x55c0b4b17100 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.292+0000 7f4e16000640 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b51eb0 0x55c0b4bb5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:51.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e1ea00640 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 0x55c0b4ad4a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e10093ad0 tx=0x7f4e100ad070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e0df0a19234318 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e03e00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e03e00640 1 -- 172.21.15.69:0/3963030398 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1009ffb0 con 0x55c0b4b17100 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e03e00640 1 -- 172.21.15.69:0/3963030398 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4e1007c080 con 0x55c0b4b17100 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e28987740 1 -- 172.21.15.69:0/3963030398 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0b4b0ccb0 con 0x55c0b4b17100 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e03e00640 1 -- 172.21.15.69:0/3963030398 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e10093fc0 con 0x55c0b4b17100 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e28987740 10 client.4812 fetch_fsmap learned FSMap version 18 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e28987740 1 -- 172.21.15.69:0/3963030398 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x7f4e200f5bf0 con 0x55c0b4b17100 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e03e00640 1 -- 172.21.15.69:0/3963030398 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0b4b0ccb0 con 0x55c0b4b17100 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e03e00640 1 -- 172.21.15.69:0/3963030398 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 18) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4e10011050 con 0x55c0b4b17100 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e28987740 10 client.4812 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e28987740 10 client.4812 resolve_mds: resolved name 'b' to daemon mds.b 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e28987740 20 client.4812 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e28987740 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55c0b4bb67d0 0x55c0b4bc04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e28987740 4 client.4812 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.293+0000 7f4e28987740 1 -- 172.21.15.69:0/3963030398 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c0b4b5aa60 con 0x55c0b4bb67d0 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.294+0000 7f4e16000640 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55c0b4bb67d0 0x55c0b4bc04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.294+0000 7f4e16000640 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55c0b4bb67d0 0x55c0b4bc04e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=44cce7ad3dc9cc2d server_cookie=d95f7b2db1a594c2 in_seq=0 out_seq=0 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.294+0000 7f4e03e00640 10 client.4812 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e03e00640 1 -- 172.21.15.69:0/3963030398 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c0b4b5aa60 con 0x55c0b4bb67d0 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e03e00640 10 client.4812 handle_command_reply: tid=0 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 client.4812 shutdown 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 -- 172.21.15.69:0/3963030398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 msgr2=0x55c0b4ad4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 0x55c0b4ad4a20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4e10093ad0 tx=0x7f4e100ad070 comp rx=0 tx=0).stop 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 -- 172.21.15.69:0/3963030398 shutdown_connections 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55c0b4bb67d0 0x55c0b4bc04e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c0b4b590d0 0x55c0b4bb6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c0b4b51eb0 0x55c0b4bb5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 --2- 172.21.15.69:0/3963030398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c0b4b17100 0x55c0b4ad4a20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e03e00640 0 client.4812 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:42:51.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 -- 172.21.15.69:0/3963030398 >> 172.21.15.69:0/3963030398 conn(0x55c0b4b167e0 msgr2=0x55c0b4b58820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 -- 172.21.15.69:0/3963030398 shutdown_connections 2024-02-21T07:42:51.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 1 -- 172.21.15.69:0/3963030398 wait complete. 2024-02-21T07:42:51.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.295+0000 7f4e28987740 20 client.4812 trim_cache size 0 max 16384 2024-02-21T07:42:51.305 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:42:51.305 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "c8bdd735-83bd-400f-baca-e501b49b60ea", 2024-02-21T07:42:51.305 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 4, 2024-02-21T07:42:51.305 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4321, 2024-02-21T07:42:51.306 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-02-21T07:42:51.306 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-02-21T07:42:51.306 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-02-21T07:42:51.306 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 18.991436103000002, 2024-02-21T07:42:51.306 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 18, 2024-02-21T07:42:51.306 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 31, 2024-02-21T07:42:51.306 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 29, 2024-02-21T07:42:51.306 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 55.698682214000002 2024-02-21T07:42:51.306 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 -- 172.21.15.69:0/2357572523 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4dfc09f0b0 msgr2=0x7f4dfc0a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4dfc09f0b0 0x7f4dfc0a1570 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4e18011420 tx=0x7f4e1800b040 comp rx=0 tx=0).stop 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 -- 172.21.15.69:0/2357572523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e200f4e60 msgr2=0x7f4e20162300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e200f4e60 0x7f4e20162300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000e870 tx=0x7f4e1000ed30 comp rx=0 tx=0).stop 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 -- 172.21.15.69:0/2357572523 shutdown_connections 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4dfc09f0b0 0x7f4dfc0a1570 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e20185b00 0x7f4e2006b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4e20183310 0x7f4e2006ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 --2- 172.21.15.69:0/2357572523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4e200f4e60 0x7f4e20162300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 -- 172.21.15.69:0/2357572523 >> 172.21.15.69:0/2357572523 conn(0x7f4e200f69c0 msgr2=0x7f4e200d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 -- 172.21.15.69:0/2357572523 shutdown_connections 2024-02-21T07:42:51.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.296+0000 7f4e25c00640 1 -- 172.21.15.69:0/2357572523 wait complete. 2024-02-21T07:42:51.318 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-02-21T07:42:51.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.520+0000 7fdc8b600640 1 Processor -- start 2024-02-21T07:42:51.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.521+0000 7fdc8b600640 1 -- start start 2024-02-21T07:42:51.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.522+0000 7fdc8b600640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdc84183000 0x7fdc84183620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc8b600640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc841866a0 con 0x7fdc84183b60 2024-02-21T07:42:51.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc8b600640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8406dcd0 con 0x7fdc84186230 2024-02-21T07:42:51.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc8b600640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc841833e0 con 0x7fdc84183000 2024-02-21T07:42:51.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc88c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fdc84183000 0x7fdc84183620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc7be00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fdc84183b60 0x7fdc84185b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:41662/0 (socket says 172.21.15.69:41662) 2024-02-21T07:42:51.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc89600640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fdc84186230 0x7fdc840cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:59324/0 (socket says 172.21.15.69:59324) 2024-02-21T07:42:51.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc7be00640 1 -- 172.21.15.69:0/3354472061 learned_addr learned my addr 172.21.15.69:0/3354472061 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:51.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc88c00640 1 -- 172.21.15.69:0/3354472061 >> v1:172.21.15.184:6789/0 conn(0x7fdc84186230 legacy=0x7fdc840cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc88c00640 1 -- 172.21.15.69:0/3354472061 >> v1:172.21.15.69:6789/0 conn(0x7fdc84183b60 legacy=0x7fdc84185b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc88c00640 1 -- 172.21.15.69:0/3354472061 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84183ff0 con 0x7fdc84183000 2024-02-21T07:42:51.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.523+0000 7fdc83e00640 1 -- 172.21.15.69:0/3354472061 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271119922 0 0) 0x7fdc6c001110 con 0x7fdc84183b60 2024-02-21T07:42:51.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.525+0000 7fdc88c00640 1 --2- 172.21.15.69:0/3354472061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc84183000 0x7fdc84183620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdc740097a0 tx=0x7fdc7402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e926ab322eece87 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.525+0000 7fdc83e00640 1 -- 172.21.15.69:0/3354472061 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7402e070 con 0x7fdc84183000 2024-02-21T07:42:51.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.525+0000 7fdc83e00640 1 -- 172.21.15.69:0/3354472061 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc740315a0 con 0x7fdc84183000 2024-02-21T07:42:51.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.525+0000 7fdc83e00640 1 -- 172.21.15.69:0/3354472061 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74031930 con 0x7fdc84183000 2024-02-21T07:42:51.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.525+0000 7fdc8b600640 1 -- 172.21.15.69:0/3354472061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc84183000 msgr2=0x7fdc84183620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.525+0000 7fdc8b600640 1 --2- 172.21.15.69:0/3354472061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc84183000 0x7fdc84183620 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdc740097a0 tx=0x7fdc7402b840 comp rx=0 tx=0).stop 2024-02-21T07:42:51.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.526+0000 7fdc8b600640 1 -- 172.21.15.69:0/3354472061 shutdown_connections 2024-02-21T07:42:51.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.526+0000 7fdc8b600640 1 --2- 172.21.15.69:0/3354472061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc84183000 0x7fdc84183620 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.526+0000 7fdc8b600640 1 -- 172.21.15.69:0/3354472061 >> 172.21.15.69:0/3354472061 conn(0x7fdc840f69c0 msgr2=0x7fdc840f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.526+0000 7fdc8b600640 1 -- 172.21.15.69:0/3354472061 shutdown_connections 2024-02-21T07:42:51.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.526+0000 7fdc8b600640 1 -- 172.21.15.69:0/3354472061 wait complete. 2024-02-21T07:42:51.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.528+0000 7fdc8b600640 1 Processor -- start 2024-02-21T07:42:51.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.528+0000 7fdc8b600640 1 -- start start 2024-02-21T07:42:51.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc8b600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc84183000 0x7fdc84181640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc8b600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc84183b60 0x7fdc8406c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc8b600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc84186230 0x7fdc84222020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc8b600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840f62a0 con 0x7fdc84183000 2024-02-21T07:42:51.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc8b600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8421fac0 con 0x7fdc84183b60 2024-02-21T07:42:51.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc8b600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8421f630 con 0x7fdc84186230 2024-02-21T07:42:51.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc88c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc84183000 0x7fdc84181640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc88c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc84183000 0x7fdc84181640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53596/0 (socket says 172.21.15.69:53596) 2024-02-21T07:42:51.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc88c00640 1 -- 172.21.15.69:0/909933638 learned_addr learned my addr 172.21.15.69:0/909933638 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc7be00640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc84183b60 0x7fdc8406c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.529+0000 7fdc89600640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc84186230 0x7fdc84222020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.530+0000 7fdc88c00640 1 -- 172.21.15.69:0/909933638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc84186230 msgr2=0x7fdc84222020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.530+0000 7fdc88c00640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc84186230 0x7fdc84222020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.530+0000 7fdc88c00640 1 -- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc84183b60 msgr2=0x7fdc8406c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.530+0000 7fdc88c00640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc84183b60 0x7fdc8406c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.530+0000 7fdc88c00640 1 -- 172.21.15.69:0/909933638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc74009400 con 0x7fdc84183000 2024-02-21T07:42:51.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.530+0000 7fdc7be00640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc84183b60 0x7fdc8406c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:51.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.530+0000 7fdc88c00640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc84183000 0x7fdc84181640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdc74034040 tx=0x7fdc740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.530+0000 7fdc81600640 1 -- 172.21.15.69:0/909933638 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74032900 con 0x7fdc84183000 2024-02-21T07:42:51.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.531+0000 7fdc81600640 1 -- 172.21.15.69:0/909933638 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc74032a80 con 0x7fdc84183000 2024-02-21T07:42:51.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.531+0000 7fdc81600640 1 -- 172.21.15.69:0/909933638 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74032e30 con 0x7fdc84183000 2024-02-21T07:42:51.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.531+0000 7fdc8b600640 1 -- 172.21.15.69:0/909933638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8421ea80 con 0x7fdc84183000 2024-02-21T07:42:51.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.531+0000 7fdc8b600640 1 -- 172.21.15.69:0/909933638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8421ed00 con 0x7fdc84183000 2024-02-21T07:42:51.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.535+0000 7fdc81600640 1 -- 172.21.15.69:0/909933638 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fdc7403b3f0 con 0x7fdc84183000 2024-02-21T07:42:51.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.536+0000 7fdc8e3b7740 1 Processor -- start 2024-02-21T07:42:51.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.536+0000 7fdc8e3b7740 1 -- start start 2024-02-21T07:42:51.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.536+0000 7fdc81600640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc6009f130 0x7fdc600a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.537+0000 7fdc81600640 1 -- 172.21.15.69:0/909933638 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdc740ebc20 con 0x7fdc84183000 2024-02-21T07:42:51.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.537+0000 7fdc89600640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc6009f130 0x7fdc600a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.537+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fb7e0 0x55e1be4fbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.537+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4fc100 0x55e1be536970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.537+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 0x55e1be537c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.537+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be42eb30 con 0x55e1be536eb0 2024-02-21T07:42:51.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.537+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be42c060 con 0x55e1be4fb7e0 2024-02-21T07:42:51.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.537+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be427840 con 0x55e1be4fc100 2024-02-21T07:42:51.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.537+0000 7fdc88c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fb7e0 0x55e1be4fbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc88c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fb7e0 0x55e1be4fbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:50808/0 (socket says 172.21.15.69:50808) 2024-02-21T07:42:51.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc88c00640 1 -- 172.21.15.69:0/2384009795 learned_addr learned my addr 172.21.15.69:0/2384009795 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc7be00640 1 --2- 172.21.15.69:0/2384009795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4fc100 0x55e1be536970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc89600640 1 --2- 172.21.15.69:0/2384009795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 0x55e1be537c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc88c00640 1 -- 172.21.15.69:0/2384009795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4fc100 msgr2=0x55e1be536970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc88c00640 1 --2- 172.21.15.69:0/2384009795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4fc100 0x55e1be536970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc88c00640 1 -- 172.21.15.69:0/2384009795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 msgr2=0x55e1be537c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc88c00640 1 --2- 172.21.15.69:0/2384009795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 0x55e1be537c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc88c00640 1 -- 172.21.15.69:0/2384009795 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1be3ef4c0 con 0x55e1be4fb7e0 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc89600640 1 --2- 172.21.15.69:0/2384009795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 0x55e1be537c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc89600640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc6009f130 0x7fdc600a15f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0012e0 tx=0x7fdc7c001e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc88c00640 1 --2- 172.21.15.69:0/2384009795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fb7e0 0x55e1be4fbbc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdc740b9300 tx=0x7fdc740b59d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cfe2d9092caceb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc79200640 1 -- 172.21.15.69:0/2384009795 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc740c1da0 con 0x55e1be4fb7e0 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc79200640 1 -- 172.21.15.69:0/2384009795 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc740b7900 con 0x55e1be4fb7e0 2024-02-21T07:42:51.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.538+0000 7fdc79200640 1 -- 172.21.15.69:0/2384009795 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7403bd30 con 0x55e1be4fb7e0 2024-02-21T07:42:51.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.539+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/2384009795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fb7e0 msgr2=0x55e1be4fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.539+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/2384009795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fb7e0 0x55e1be4fbbc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fdc740b9300 tx=0x7fdc740b59d0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.539+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/2384009795 shutdown_connections 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.539+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/2384009795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 0x55e1be537c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.539+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/2384009795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4fc100 0x55e1be536970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.539+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/2384009795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fb7e0 0x55e1be4fbbc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.539+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/2384009795 >> 172.21.15.69:0/2384009795 conn(0x55e1be4bddb0 msgr2=0x55e1be4bee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.539+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/2384009795 shutdown_connections 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.539+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/2384009795 wait complete. 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.540+0000 7fdc8e3b7740 1 -- start start 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.540+0000 7fdc8e3b7740 1 Processor -- start 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.541+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fc100 0x55e1be541fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.541+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 0x55e1be505d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.541+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4efbc0 0x55e1be4b9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.541+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be3ccea0 con 0x55e1be536eb0 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.541+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be3ccb40 con 0x55e1be4fc100 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.541+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be16ff20 con 0x55e1be4efbc0 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc8e3b7740 10 client.0 _ll_register_callbacks cb 0x55e1be3e0950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc7be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 0x55e1be505d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc7be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 0x55e1be505d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53628/0 (socket says 172.21.15.69:53628) 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc7be00640 1 -- 172.21.15.69:0/1256841144 learned_addr learned my addr 172.21.15.69:0/1256841144 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc89600640 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4efbc0 0x55e1be4b9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc88c00640 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fc100 0x55e1be541fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc89600640 1 -- 172.21.15.69:0/1256841144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fc100 msgr2=0x55e1be541fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc89600640 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fc100 0x55e1be541fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc89600640 1 -- 172.21.15.69:0/1256841144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 msgr2=0x55e1be505d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc89600640 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 0x55e1be505d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc89600640 1 -- 172.21.15.69:0/1256841144 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8421ed00 con 0x55e1be4efbc0 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc89600640 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4efbc0 0x55e1be4b9580 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c017960 tx=0x7fdc7c001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb93fec9f42bd1fd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.542+0000 7fdc71600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.543+0000 7fdc71600640 1 -- 172.21.15.69:0/1256841144 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c017d60 con 0x55e1be4efbc0 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.543+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/1256841144 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e1be44bc40 con 0x55e1be4efbc0 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.543+0000 7fdc71600640 1 -- 172.21.15.69:0/1256841144 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdc7c017110 con 0x55e1be4efbc0 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.543+0000 7fdc71600640 1 -- 172.21.15.69:0/1256841144 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc7c0172d0 con 0x55e1be4efbc0 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.543+0000 7fdc8e3b7740 10 client.4991 fetch_fsmap learned FSMap version 18 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.543+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/1256841144 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55e1be425ec0 con 0x55e1be4efbc0 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.543+0000 7fdc71600640 1 -- 172.21.15.69:0/1256841144 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c02f020 con 0x55e1be4efbc0 2024-02-21T07:42:51.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.543+0000 7fdc71600640 1 -- 172.21.15.69:0/1256841144 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 18) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdc7c0148f0 con 0x55e1be4efbc0 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.543+0000 7fdc8e3b7740 10 client.4991 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.543+0000 7fdc8e3b7740 10 client.4991 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.544+0000 7fdc8e3b7740 20 client.4991 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.544+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55e1be4f0040 0x55e1be54cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.544+0000 7fdc8e3b7740 4 client.4991 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.544+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/1256841144 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e1be1276c0 con 0x55e1be4f0040 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.544+0000 7fdc88c00640 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55e1be4f0040 0x55e1be54cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.544+0000 7fdc88c00640 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55e1be4f0040 0x55e1be54cb20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1ea483740ad2fe43 server_cookie=6fc8b95486dd8ad5 in_seq=0 out_seq=0 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.544+0000 7fdc71600640 10 client.4991 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc71600640 1 -- 172.21.15.69:0/1256841144 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e1be1276c0 con 0x55e1be4f0040 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc71600640 10 client.4991 handle_command_reply: tid=0 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc8e3b7740 1 client.4991 shutdown 2024-02-21T07:42:51.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/1256841144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4efbc0 msgr2=0x55e1be4b9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4efbc0 0x55e1be4b9580 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c017960 tx=0x7fdc7c001250 comp rx=0 tx=0).stop 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/1256841144 shutdown_connections 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55e1be4f0040 0x55e1be54cb20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4efbc0 0x55e1be4b9580 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be536eb0 0x55e1be505d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/1256841144 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fc100 0x55e1be541fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc71600640 0 client.4991 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.545+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/1256841144 >> 172.21.15.69:0/1256841144 conn(0x55e1be4fb7e0 msgr2=0x55e1be4bf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.546+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/1256841144 shutdown_connections 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.546+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/1256841144 wait complete. 2024-02-21T07:42:51.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.546+0000 7fdc8e3b7740 20 client.4991 trim_cache size 0 max 16384 2024-02-21T07:42:51.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.563+0000 7fdc8e3b7740 1 Processor -- start 2024-02-21T07:42:51.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.563+0000 7fdc8e3b7740 1 -- start start 2024-02-21T07:42:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.564+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4bce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.564+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4fc100 0x55e1be4e9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.564+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be536eb0 0x55e1be524500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.564+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be543530 con 0x55e1be4efbc0 2024-02-21T07:42:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.564+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be543270 con 0x55e1be536eb0 2024-02-21T07:42:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.564+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be4f0dd0 con 0x55e1be4fc100 2024-02-21T07:42:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.564+0000 7fdc88c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4bce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.564+0000 7fdc89600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be536eb0 0x55e1be524500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.565+0000 7fdc89600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be536eb0 0x55e1be524500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:50832/0 (socket says 172.21.15.69:50832) 2024-02-21T07:42:51.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.565+0000 7fdc89600640 1 -- 172.21.15.69:0/2204310837 learned_addr learned my addr 172.21.15.69:0/2204310837 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.565+0000 7fdc7be00640 1 --2- 172.21.15.69:0/2204310837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4fc100 0x55e1be4e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.565+0000 7fdc89600640 1 -- 172.21.15.69:0/2204310837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4fc100 msgr2=0x55e1be4e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.565+0000 7fdc89600640 1 --2- 172.21.15.69:0/2204310837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4fc100 0x55e1be4e9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.565+0000 7fdc89600640 1 -- 172.21.15.69:0/2204310837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 msgr2=0x55e1be4bce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.565+0000 7fdc89600640 1 --2- 172.21.15.69:0/2204310837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4bce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.565+0000 7fdc89600640 1 -- 172.21.15.69:0/2204310837 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1be3c28b0 con 0x55e1be536eb0 2024-02-21T07:42:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.565+0000 7fdc88c00640 1 --2- 172.21.15.69:0/2204310837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4bce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:51.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.565+0000 7fdc89600640 1 --2- 172.21.15.69:0/2204310837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be536eb0 0x55e1be524500 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c007a70 tx=0x7fdc7c01f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc80e832f4190ce2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc73e00640 1 -- 172.21.15.69:0/2204310837 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c00e040 con 0x55e1be536eb0 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc73e00640 1 -- 172.21.15.69:0/2204310837 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c02f040 con 0x55e1be536eb0 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc73e00640 1 -- 172.21.15.69:0/2204310837 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c014740 con 0x55e1be536eb0 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/2204310837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be536eb0 msgr2=0x55e1be524500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/2204310837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be536eb0 0x55e1be524500 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c007a70 tx=0x7fdc7c01f000 comp rx=0 tx=0).stop 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/2204310837 shutdown_connections 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/2204310837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be536eb0 0x55e1be524500 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/2204310837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be4fc100 0x55e1be4e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/2204310837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4bce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/2204310837 >> 172.21.15.69:0/2204310837 conn(0x55e1be4fb7e0 msgr2=0x55e1be4bedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/2204310837 shutdown_connections 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.566+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/2204310837 wait complete. 2024-02-21T07:42:51.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.567+0000 7fdc8e3b7740 1 -- start start 2024-02-21T07:42:51.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.567+0000 7fdc8e3b7740 1 Processor -- start 2024-02-21T07:42:51.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.568+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.568+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fc100 0x55e1be527f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.568+0000 7fdc8e3b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be536eb0 0x55e1be5438b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be4ef600 con 0x55e1be4efbc0 2024-02-21T07:42:51.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be4efa20 con 0x55e1be4fc100 2024-02-21T07:42:51.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc8e3b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e1be4fedb0 con 0x55e1be536eb0 2024-02-21T07:42:51.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc8e3b7740 10 client.0 _ll_register_callbacks cb 0x7fdc7c004f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:51.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc88c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc88c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4f1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53658/0 (socket says 172.21.15.69:53658) 2024-02-21T07:42:51.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc88c00640 1 -- 172.21.15.69:0/4123493122 learned_addr learned my addr 172.21.15.69:0/4123493122 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc89600640 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be536eb0 0x55e1be5438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc7be00640 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fc100 0x55e1be527f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc88c00640 1 -- 172.21.15.69:0/4123493122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be536eb0 msgr2=0x55e1be5438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc88c00640 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be536eb0 0x55e1be5438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc88c00640 1 -- 172.21.15.69:0/4123493122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fc100 msgr2=0x55e1be527f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc88c00640 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fc100 0x55e1be527f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc88c00640 1 -- 172.21.15.69:0/4123493122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1be3ef4c0 con 0x55e1be4efbc0 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc88c00640 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4f1e50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdc740b9590 tx=0x7fdc740a4070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c89e89851e3a482 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.569+0000 7fdc71600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc71600640 1 -- 172.21.15.69:0/4123493122 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc740b9600 con 0x55e1be4efbc0 2024-02-21T07:42:51.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc71600640 1 -- 172.21.15.69:0/4123493122 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdc740a40e0 con 0x55e1be4efbc0 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/4123493122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc740b7900 con 0x55e1be4efbc0 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc71600640 1 -- 172.21.15.69:0/4123493122 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc740b5c70 con 0x55e1be4efbc0 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc8e3b7740 10 client.4830 fetch_fsmap learned FSMap version 18 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/4123493122 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55e1be425ec0 con 0x55e1be4efbc0 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc71600640 1 -- 172.21.15.69:0/4123493122 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc740b7900 con 0x55e1be4efbc0 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc71600640 1 -- 172.21.15.69:0/4123493122 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 18) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdc740b9860 con 0x55e1be4efbc0 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc8e3b7740 10 client.4830 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc8e3b7740 10 client.4830 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc8e3b7740 20 client.4830 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55e1be52f7a0 0x55e1be5a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc8e3b7740 4 client.4830 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.570+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/4123493122 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e1be178270 con 0x55e1be52f7a0 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.571+0000 7fdc7be00640 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55e1be52f7a0 0x55e1be5a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.571+0000 7fdc7be00640 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55e1be52f7a0 0x55e1be5a57c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dd6316ef3364a34f server_cookie=8f5381a8a97f12c4 in_seq=0 out_seq=0 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.571+0000 7fdc71600640 10 client.4830 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.571+0000 7fdc71600640 1 -- 172.21.15.69:0/4123493122 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e1be178270 con 0x55e1be52f7a0 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.571+0000 7fdc71600640 10 client.4830 handle_command_reply: tid=0 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 client.4830 shutdown 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/4123493122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 msgr2=0x55e1be4f1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4f1e50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdc740b9590 tx=0x7fdc740a4070 comp rx=0 tx=0).stop 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/4123493122 shutdown_connections 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55e1be52f7a0 0x55e1be5a57c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e1be536eb0 0x55e1be5438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e1be4fc100 0x55e1be527f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc71600640 0 client.4830 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:42:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 --2- 172.21.15.69:0/4123493122 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1be4efbc0 0x55e1be4f1e50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/4123493122 >> 172.21.15.69:0/4123493122 conn(0x55e1be4fb7e0 msgr2=0x55e1be4bf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/4123493122 shutdown_connections 2024-02-21T07:42:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 1 -- 172.21.15.69:0/4123493122 wait complete. 2024-02-21T07:42:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.572+0000 7fdc8e3b7740 20 client.4830 trim_cache size 0 max 16384 2024-02-21T07:42:51.583 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:42:51.583 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "c8bdd735-83bd-400f-baca-e501b49b60ea", 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 3, 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4360, 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 19.457913421000001, 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 18, 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 31, 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 29, 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 55.916491743000002 2024-02-21T07:42:51.584 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:42:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 -- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc6009f130 msgr2=0x7fdc600a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc6009f130 0x7fdc600a15f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0012e0 tx=0x7fdc7c001e40 comp rx=0 tx=0).stop 2024-02-21T07:42:51.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 -- 172.21.15.69:0/909933638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc84183000 msgr2=0x7fdc84181640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc84183000 0x7fdc84181640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdc74034040 tx=0x7fdc740046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 -- 172.21.15.69:0/909933638 shutdown_connections 2024-02-21T07:42:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc6009f130 0x7fdc600a15f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc84186230 0x7fdc84222020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc84183b60 0x7fdc8406c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 --2- 172.21.15.69:0/909933638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc84183000 0x7fdc84181640 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 -- 172.21.15.69:0/909933638 >> 172.21.15.69:0/909933638 conn(0x7fdc840f69c0 msgr2=0x7fdc840f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 -- 172.21.15.69:0/909933638 shutdown_connections 2024-02-21T07:42:51.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.573+0000 7fdc8b600640 1 -- 172.21.15.69:0/909933638 wait complete. 2024-02-21T07:42:51.595 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2024-02-21T07:42:51.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.778+0000 7fc00be00640 1 Processor -- start 2024-02-21T07:42:51.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.779+0000 7fc00be00640 1 -- start start 2024-02-21T07:42:51.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc00be00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc00406ef40 0x7fc00406f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc00be00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc00406f860 0x7fc00418b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc00be00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc004183030 con 0x7fc00418b560 2024-02-21T07:42:51.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc00be00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc004189f80 con 0x7fc00406ef40 2024-02-21T07:42:51.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc00be00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00418a260 con 0x7fc00406f860 2024-02-21T07:42:51.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc008a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc00406f860 0x7fc00418b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc009e00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc00418b560 0x7fc00408cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:59332/0 (socket says 172.21.15.69:59332) 2024-02-21T07:42:51.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc009400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc00406ef40 0x7fc00406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc009e00640 1 -- 172.21.15.69:0/1735939009 learned_addr learned my addr 172.21.15.69:0/1735939009 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:51.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc009400640 1 -- 172.21.15.69:0/1735939009 >> v2:172.21.15.184:3300/0 conn(0x7fc00406f860 msgr2=0x7fc00418b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.781+0000 7fc009400640 1 --2- 172.21.15.69:0/1735939009 >> v2:172.21.15.184:3300/0 conn(0x7fc00406f860 0x7fc00418b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.782+0000 7fc009400640 1 -- 172.21.15.69:0/1735939009 >> v1:172.21.15.184:6789/0 conn(0x7fc00418b560 legacy=0x7fc00408cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.782+0000 7fc009400640 1 -- 172.21.15.69:0/1735939009 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00418a540 con 0x7fc00406ef40 2024-02-21T07:42:51.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.783+0000 7fc009400640 1 --2- 172.21.15.69:0/1735939009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc00406ef40 0x7fc00406f320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc004090350 tx=0x7fbff402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19bef0c3a66640b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.783+0000 7fc003e00640 1 -- 172.21.15.69:0/1735939009 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4031830 con 0x7fc00406ef40 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.783+0000 7fc003e00640 1 -- 172.21.15.69:0/1735939009 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4031990 con 0x7fc00406ef40 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.783+0000 7fc003e00640 1 -- 172.21.15.69:0/1735939009 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4031d20 con 0x7fc00406ef40 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.783+0000 7fc00be00640 1 -- 172.21.15.69:0/1735939009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc00406ef40 msgr2=0x7fc00406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.783+0000 7fc00be00640 1 --2- 172.21.15.69:0/1735939009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc00406ef40 0x7fc00406f320 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc004090350 tx=0x7fbff402b8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.784+0000 7fc00be00640 1 -- 172.21.15.69:0/1735939009 shutdown_connections 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.784+0000 7fc00be00640 1 --2- 172.21.15.69:0/1735939009 >> v2:172.21.15.184:3300/0 conn(0x7fc00406f860 0x7fc00418b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.784+0000 7fc00be00640 1 --2- 172.21.15.69:0/1735939009 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc00406ef40 0x7fc00406f320 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.784+0000 7fc00be00640 1 -- 172.21.15.69:0/1735939009 >> 172.21.15.69:0/1735939009 conn(0x7fc0040f8b30 msgr2=0x7fc0040f8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.784+0000 7fc00be00640 1 -- 172.21.15.69:0/1735939009 shutdown_connections 2024-02-21T07:42:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.784+0000 7fc00be00640 1 -- 172.21.15.69:0/1735939009 wait complete. 2024-02-21T07:42:51.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.786+0000 7fc00be00640 1 Processor -- start 2024-02-21T07:42:51.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.786+0000 7fc00be00640 1 -- start start 2024-02-21T07:42:51.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.787+0000 7fc00be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc00406ef40 0x7fc004161f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.787+0000 7fc00be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00406f860 0x7fc00406cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.787+0000 7fc00be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc00418b560 0x7fc00406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.787+0000 7fc00be00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00421fac0 con 0x7fc00406f860 2024-02-21T07:42:51.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.787+0000 7fc00be00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc004220080 con 0x7fc00418b560 2024-02-21T07:42:51.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.787+0000 7fc00be00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00406d870 con 0x7fc00406ef40 2024-02-21T07:42:51.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.787+0000 7fc008a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00406f860 0x7fc00406cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.787+0000 7fc008a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00406f860 0x7fc00406cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53674/0 (socket says 172.21.15.69:53674) 2024-02-21T07:42:51.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.787+0000 7fc009400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc00406ef40 0x7fc004161f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.787+0000 7fc008a00640 1 -- 172.21.15.69:0/4020716150 learned_addr learned my addr 172.21.15.69:0/4020716150 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.788+0000 7fc009e00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc00418b560 0x7fc00406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.788+0000 7fc008a00640 1 -- 172.21.15.69:0/4020716150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc00406ef40 msgr2=0x7fc004161f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.788+0000 7fc008a00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc00406ef40 0x7fc004161f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.788+0000 7fc008a00640 1 -- 172.21.15.69:0/4020716150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc00418b560 msgr2=0x7fc00406d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.788+0000 7fc008a00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc00418b560 0x7fc00406d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.788+0000 7fc008a00640 1 -- 172.21.15.69:0/4020716150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff4009400 con 0x7fc00406f860 2024-02-21T07:42:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.788+0000 7fc009400640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc00406ef40 0x7fc004161f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.788+0000 7fc008a00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00406f860 0x7fc00406cd30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbff000efc0 tx=0x7fbff000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.789+0000 7fc001600640 1 -- 172.21.15.69:0/4020716150 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0014480 con 0x7fc00406f860 2024-02-21T07:42:51.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.789+0000 7fc001600640 1 -- 172.21.15.69:0/4020716150 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff000f040 con 0x7fc00406f860 2024-02-21T07:42:51.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.789+0000 7fc00be00640 1 -- 172.21.15.69:0/4020716150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc004189920 con 0x7fc00406f860 2024-02-21T07:42:51.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.789+0000 7fc001600640 1 -- 172.21.15.69:0/4020716150 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0014800 con 0x7fc00406f860 2024-02-21T07:42:51.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.789+0000 7fc00be00640 1 -- 172.21.15.69:0/4020716150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00406de30 con 0x7fc00406f860 2024-02-21T07:42:51.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.792+0000 7fc001600640 1 -- 172.21.15.69:0/4020716150 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fbff0014960 con 0x7fc00406f860 2024-02-21T07:42:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.793+0000 7fc00ebb3740 1 Processor -- start 2024-02-21T07:42:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.793+0000 7fc00ebb3740 1 -- start start 2024-02-21T07:42:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.793+0000 7fc001600640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbfe409f130 0x7fbfe40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.793+0000 7fc001600640 1 -- 172.21.15.69:0/4020716150 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbff00cac10 con 0x7fc00406f860 2024-02-21T07:42:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.793+0000 7fc009e00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbfe409f130 0x7fbfe40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896787e0 0x558589678bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x5585896b3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 0x5585896b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585895abb30 con 0x5585896b3eb0 2024-02-21T07:42:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585895a9060 con 0x5585896787e0 2024-02-21T07:42:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585895a4840 con 0x558589679100 2024-02-21T07:42:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc009e00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbfe409f130 0x7fbfe40a15f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbffc005880 tx=0x7fbffc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc009400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896787e0 0x558589678bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc009400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896787e0 0x558589678bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:50858/0 (socket says 172.21.15.69:50858) 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc009400640 1 -- 172.21.15.69:0/2125900618 learned_addr learned my addr 172.21.15.69:0/2125900618 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc009e00640 1 --2- 172.21.15.69:0/2125900618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 0x5585896b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.794+0000 7fc008a00640 1 --2- 172.21.15.69:0/2125900618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x5585896b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.795+0000 7fc009400640 1 -- 172.21.15.69:0/2125900618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 msgr2=0x5585896b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.795+0000 7fc009400640 1 --2- 172.21.15.69:0/2125900618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x5585896b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.795+0000 7fc009400640 1 -- 172.21.15.69:0/2125900618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 msgr2=0x5585896b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.795+0000 7fc009400640 1 --2- 172.21.15.69:0/2125900618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 0x5585896b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.795+0000 7fc009400640 1 -- 172.21.15.69:0/2125900618 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55858956c4c0 con 0x5585896787e0 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.795+0000 7fc009400640 1 --2- 172.21.15.69:0/2125900618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896787e0 0x558589678bc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009890 tx=0x7fbff4008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff9644524669cfa7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.795+0000 7fbff9c00640 1 -- 172.21.15.69:0/2125900618 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff403f040 con 0x5585896787e0 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fbff9c00640 1 -- 172.21.15.69:0/2125900618 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4031dc0 con 0x5585896787e0 2024-02-21T07:42:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fbff9c00640 1 -- 172.21.15.69:0/2125900618 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4044680 con 0x5585896787e0 2024-02-21T07:42:51.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fc00ebb3740 1 -- 172.21.15.69:0/2125900618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896787e0 msgr2=0x558589678bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/2125900618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896787e0 0x558589678bc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009890 tx=0x7fbff4008030 comp rx=0 tx=0).stop 2024-02-21T07:42:51.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fc00ebb3740 1 -- 172.21.15.69:0/2125900618 shutdown_connections 2024-02-21T07:42:51.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/2125900618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 0x5585896b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/2125900618 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x5585896b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/2125900618 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896787e0 0x558589678bc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fc00ebb3740 1 -- 172.21.15.69:0/2125900618 >> 172.21.15.69:0/2125900618 conn(0x55858963adb0 msgr2=0x55858963be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fc00ebb3740 1 -- 172.21.15.69:0/2125900618 shutdown_connections 2024-02-21T07:42:51.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.796+0000 7fc00ebb3740 1 -- 172.21.15.69:0/2125900618 wait complete. 2024-02-21T07:42:51.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.797+0000 7fc00ebb3740 1 -- start start 2024-02-21T07:42:51.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.797+0000 7fc00ebb3740 1 Processor -- start 2024-02-21T07:42:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x55858966ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 0x5585896a5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896a5f10 0x558589636be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x558589549ea0 con 0x5585896b3eb0 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x558589549b40 con 0x5585896a5f10 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585892ecf20 con 0x558589679100 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc00ebb3740 10 client.0 _ll_register_callbacks cb 0x55858955d950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc008a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 0x5585896a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc008a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 0x5585896a5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53698/0 (socket says 172.21.15.69:53698) 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc008a00640 1 -- 172.21.15.69:0/229462305 learned_addr learned my addr 172.21.15.69:0/229462305 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc009400640 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x55858966ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc009e00640 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896a5f10 0x558589636be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc008a00640 1 -- 172.21.15.69:0/229462305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 msgr2=0x55858966ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc008a00640 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x55858966ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc008a00640 1 -- 172.21.15.69:0/229462305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896a5f10 msgr2=0x558589636be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc008a00640 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896a5f10 0x558589636be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.799+0000 7fc008a00640 1 -- 172.21.15.69:0/229462305 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00418a540 con 0x5585896b3eb0 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.800+0000 7fc008a00640 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 0x5585896a5720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbff0098290 tx=0x7fbff0098d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f31174e8320469d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.800+0000 7fbfee000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.800+0000 7fbfee000640 1 -- 172.21.15.69:0/229462305 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff00b0170 con 0x5585896b3eb0 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.800+0000 7fbfee000640 1 -- 172.21.15.69:0/229462305 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbff00a0d30 con 0x5585896b3eb0 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.800+0000 7fc00ebb3740 1 -- 172.21.15.69:0/229462305 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585895c8c40 con 0x5585896b3eb0 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.800+0000 7fbfee000640 1 -- 172.21.15.69:0/229462305 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbff00b70b0 con 0x5585896b3eb0 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.800+0000 7fc00ebb3740 10 client.4839 fetch_fsmap learned FSMap version 18 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.800+0000 7fc00ebb3740 1 -- 172.21.15.69:0/229462305 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5585895a2ec0 con 0x5585896b3eb0 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.800+0000 7fbfee000640 1 -- 172.21.15.69:0/229462305 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5585895c8c40 con 0x5585896b3eb0 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.801+0000 7fbfee000640 1 -- 172.21.15.69:0/229462305 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 18) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbff0024020 con 0x5585896b3eb0 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.801+0000 7fc00ebb3740 10 client.4839 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.801+0000 7fc00ebb3740 10 client.4839 resolve_mds: resolved name 'g' to daemon mds.g 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.801+0000 7fc00ebb3740 20 client.4839 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.801+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x5585896399b0 0x5585896c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.801+0000 7fc00ebb3740 4 client.4839 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.801+0000 7fc00ebb3740 1 -- 172.21.15.69:0/229462305 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585892a46c0 con 0x5585896399b0 2024-02-21T07:42:51.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.801+0000 7fc009400640 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x5585896399b0 0x5585896c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.802+0000 7fc009400640 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x5585896399b0 0x5585896c9d50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d59ee3938e65aebf server_cookie=7ee2acdeabfddfdc in_seq=0 out_seq=0 2024-02-21T07:42:51.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.802+0000 7fbfee000640 10 client.4839 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.802+0000 7fbfee000640 1 -- 172.21.15.69:0/229462305 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5585892a46c0 con 0x5585896399b0 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.802+0000 7fbfee000640 10 client.4839 handle_command_reply: tid=0 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.802+0000 7fc00ebb3740 1 client.4839 shutdown 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.802+0000 7fc00ebb3740 1 -- 172.21.15.69:0/229462305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 msgr2=0x5585896a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 0x5585896a5720 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbff0098290 tx=0x7fbff0098d50 comp rx=0 tx=0).stop 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fc00ebb3740 1 -- 172.21.15.69:0/229462305 shutdown_connections 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x5585896399b0 0x5585896c9d50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896a5f10 0x558589636be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896b3eb0 0x5585896a5720 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/229462305 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x55858966ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fbfee000640 0 client.4839 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:42:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fc00ebb3740 1 -- 172.21.15.69:0/229462305 >> 172.21.15.69:0/229462305 conn(0x5585896787e0 msgr2=0x5585896b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fc00ebb3740 1 -- 172.21.15.69:0/229462305 shutdown_connections 2024-02-21T07:42:51.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fc00ebb3740 1 -- 172.21.15.69:0/229462305 wait complete. 2024-02-21T07:42:51.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.803+0000 7fc00ebb3740 20 client.4839 trim_cache size 0 max 16384 2024-02-21T07:42:51.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.820+0000 7fc00ebb3740 1 Processor -- start 2024-02-21T07:42:51.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.820+0000 7fc00ebb3740 1 -- start start 2024-02-21T07:42:51.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.821+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x5585896b3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.821+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896b3eb0 0x55858963a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.821+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896c5220 0x5585896abe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.821+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585896784b0 con 0x5585896c5220 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.821+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585896b32b0 con 0x5585896b3eb0 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.821+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858966c7c0 con 0x558589679100 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.821+0000 7fc009e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896c5220 0x5585896abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.821+0000 7fc009e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896c5220 0x5585896abe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53710/0 (socket says 172.21.15.69:53710) 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.821+0000 7fc009e00640 1 -- 172.21.15.69:0/264383969 learned_addr learned my addr 172.21.15.69:0/264383969 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fc009400640 1 --2- 172.21.15.69:0/264383969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x5585896b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fc008a00640 1 --2- 172.21.15.69:0/264383969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896b3eb0 0x55858963a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fc009e00640 1 -- 172.21.15.69:0/264383969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 msgr2=0x5585896b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fc009e00640 1 --2- 172.21.15.69:0/264383969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x5585896b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fc009e00640 1 -- 172.21.15.69:0/264383969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896b3eb0 msgr2=0x55858963a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fc009e00640 1 --2- 172.21.15.69:0/264383969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896b3eb0 0x55858963a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fc009e00640 1 -- 172.21.15.69:0/264383969 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55858953f8b0 con 0x5585896c5220 2024-02-21T07:42:51.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fc009e00640 1 --2- 172.21.15.69:0/264383969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896c5220 0x5585896abe70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbffc000f60 tx=0x7fbffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9018ec19e807ecde server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fbff9200640 1 -- 172.21.15.69:0/264383969 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc015bf0 con 0x5585896c5220 2024-02-21T07:42:51.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fbff9200640 1 -- 172.21.15.69:0/264383969 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc015d50 con 0x5585896c5220 2024-02-21T07:42:51.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.822+0000 7fbff9200640 1 -- 172.21.15.69:0/264383969 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc023440 con 0x5585896c5220 2024-02-21T07:42:51.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.823+0000 7fc00ebb3740 1 -- 172.21.15.69:0/264383969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896c5220 msgr2=0x5585896abe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.823+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/264383969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896c5220 0x5585896abe70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbffc000f60 tx=0x7fbffc0057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.823+0000 7fc00ebb3740 1 -- 172.21.15.69:0/264383969 shutdown_connections 2024-02-21T07:42:51.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.823+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/264383969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5585896c5220 0x5585896abe70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.823+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/264383969 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896b3eb0 0x55858963a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.823+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/264383969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x558589679100 0x5585896b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.823+0000 7fc00ebb3740 1 -- 172.21.15.69:0/264383969 >> 172.21.15.69:0/264383969 conn(0x5585896787e0 msgr2=0x55858963c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.823+0000 7fc00ebb3740 1 -- 172.21.15.69:0/264383969 shutdown_connections 2024-02-21T07:42:51.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.823+0000 7fc00ebb3740 1 -- 172.21.15.69:0/264383969 wait complete. 2024-02-21T07:42:51.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.824+0000 7fc00ebb3740 1 -- start start 2024-02-21T07:42:51.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.824+0000 7fc00ebb3740 1 Processor -- start 2024-02-21T07:42:51.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.825+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558589679100 0x5585896cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.825+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585896b3eb0 0x558589683290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.825+0000 7fc00ebb3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896c5220 0x5585896837d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.825+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585896bcfe0 con 0x558589679100 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.825+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585896bd400 con 0x5585896c5220 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.825+0000 7fc00ebb3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585896b4330 con 0x5585896b3eb0 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.825+0000 7fc00ebb3740 10 client.0 _ll_register_callbacks cb 0x7fbff0098150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc008a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585896b3eb0 0x558589683290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc009400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558589679100 0x5585896cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc008a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585896b3eb0 0x558589683290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:58794/0 (socket says 172.21.15.69:58794) 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc008a00640 1 -- 172.21.15.69:0/690315633 learned_addr learned my addr 172.21.15.69:0/690315633 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc009e00640 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896c5220 0x5585896837d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc009400640 1 -- 172.21.15.69:0/690315633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585896b3eb0 msgr2=0x558589683290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc009400640 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585896b3eb0 0x558589683290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc009400640 1 -- 172.21.15.69:0/690315633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896c5220 msgr2=0x5585896837d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc009400640 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896c5220 0x5585896837d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc009400640 1 -- 172.21.15.69:0/690315633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc004183030 con 0x558589679100 2024-02-21T07:42:51.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc009e00640 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896c5220 0x5585896837d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fc009400640 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558589679100 0x5585896cdd70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbff402b910 tx=0x7fbff402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ce9940d227a77b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.826+0000 7fbfee000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.827+0000 7fbfee000640 1 -- 172.21.15.69:0/690315633 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff403f040 con 0x558589679100 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.827+0000 7fbfee000640 1 -- 172.21.15.69:0/690315633 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbff4004250 con 0x558589679100 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.827+0000 7fc00ebb3740 1 -- 172.21.15.69:0/690315633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbff4031dc0 con 0x558589679100 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.827+0000 7fbfee000640 1 -- 172.21.15.69:0/690315633 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbff4004410 con 0x558589679100 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.827+0000 7fc00ebb3740 10 client.4845 fetch_fsmap learned FSMap version 18 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.827+0000 7fc00ebb3740 1 -- 172.21.15.69:0/690315633 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x558589565510 con 0x558589679100 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.827+0000 7fbfee000640 1 -- 172.21.15.69:0/690315633 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4031dc0 con 0x558589679100 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.827+0000 7fbfee000640 1 -- 172.21.15.69:0/690315633 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 18) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbff4003610 con 0x558589679100 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.827+0000 7fc00ebb3740 10 client.4845 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.828+0000 7fc00ebb3740 10 client.4845 resolve_mds: resolved name 'g' to daemon mds.g 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.828+0000 7fc00ebb3740 20 client.4845 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.828+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x558589729400 0x55858972b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:51.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.828+0000 7fc00ebb3740 4 client.4845 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T07:42:51.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.828+0000 7fc00ebb3740 1 -- 172.21.15.69:0/690315633 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5585892f5270 con 0x558589729400 2024-02-21T07:42:51.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.828+0000 7fc008a00640 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x558589729400 0x55858972b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.828+0000 7fc008a00640 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x558589729400 0x55858972b7f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f7c743429718b29 server_cookie=844e82d66ba7a71d in_seq=0 out_seq=0 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.828+0000 7fbfee000640 10 client.4845 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.828+0000 7fbfee000640 1 -- 172.21.15.69:0/690315633 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5585892f5270 con 0x558589729400 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.828+0000 7fbfee000640 10 client.4845 handle_command_reply: tid=0 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 client.4845 shutdown 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 -- 172.21.15.69:0/690315633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558589679100 msgr2=0x5585896cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558589679100 0x5585896cdd70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbff402b910 tx=0x7fbff402e000 comp rx=0 tx=0).stop 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 -- 172.21.15.69:0/690315633 shutdown_connections 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x558589729400 0x55858972b7f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5585896c5220 0x5585896837d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5585896b3eb0 0x558589683290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 --2- 172.21.15.69:0/690315633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558589679100 0x5585896cdd70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 -- 172.21.15.69:0/690315633 >> 172.21.15.69:0/690315633 conn(0x5585896787e0 msgr2=0x558589661ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fbfee000640 0 client.4845 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 -- 172.21.15.69:0/690315633 shutdown_connections 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 1 -- 172.21.15.69:0/690315633 wait complete. 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.829+0000 7fc00ebb3740 20 client.4845 trim_cache size 0 max 16384 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "c8bdd735-83bd-400f-baca-e501b49b60ea", 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 2, 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4363, 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-02-21T07:42:51.838 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-02-21T07:42:51.839 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-02-21T07:42:51.839 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 20.724118668999999, 2024-02-21T07:42:51.839 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 18, 2024-02-21T07:42:51.839 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 31, 2024-02-21T07:42:51.839 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 29, 2024-02-21T07:42:51.839 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 56.165066797000001 2024-02-21T07:42:51.839 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:42:51.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 -- 172.21.15.69:0/4020716150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbfe409f130 msgr2=0x7fbfe40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbfe409f130 0x7fbfe40a15f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbffc005880 tx=0x7fbffc009040 comp rx=0 tx=0).stop 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 -- 172.21.15.69:0/4020716150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00406f860 msgr2=0x7fc00406cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00406f860 0x7fc00406cd30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbff000efc0 tx=0x7fbff000c490 comp rx=0 tx=0).stop 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 -- 172.21.15.69:0/4020716150 shutdown_connections 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbfe409f130 0x7fbfe40a15f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc00418b560 0x7fc00406d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00406f860 0x7fc00406cd30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 --2- 172.21.15.69:0/4020716150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc00406ef40 0x7fc004161f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 -- 172.21.15.69:0/4020716150 >> 172.21.15.69:0/4020716150 conn(0x7fc0040f8b30 msgr2=0x7fc004164050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 -- 172.21.15.69:0/4020716150 shutdown_connections 2024-02-21T07:42:51.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:51.830+0000 7fc00be00640 1 -- 172.21.15.69:0/4020716150 wait complete. 2024-02-21T07:42:51.852 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.j status 2024-02-21T07:42:52.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.040+0000 7f3934400640 1 Processor -- start 2024-02-21T07:42:52.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.041+0000 7f3934400640 1 -- start start 2024-02-21T07:42:52.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f3934400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c187740 con 0x7f392c183fa0 2024-02-21T07:42:52.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f3934400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c0ce230 con 0x7f392c0cd090 2024-02-21T07:42:52.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f3934400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c184380 con 0x7f392c0f6310 2024-02-21T07:42:52.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f3931a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f392c183fa0 0x7f392c188270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:41666/0 (socket says 172.21.15.69:41666) 2024-02-21T07:42:52.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f3931a00640 1 -- 172.21.15.69:0/2115948461 learned_addr learned my addr 172.21.15.69:0/2115948461 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:52.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f3932400640 1 --1- 172.21.15.69:0/2115948461 >> v1:172.21.15.184:6789/0 conn(0x7f392c0f6310 0x7f392c06ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:59334/0 (socket says 172.21.15.69:59334) 2024-02-21T07:42:52.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634263849 0 0) 0x7f392c184380 con 0x7f392c0f6310 2024-02-21T07:42:52.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3914003520 con 0x7f392c0f6310 2024-02-21T07:42:52.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440493212 0 0) 0x7f392c187740 con 0x7f392c183fa0 2024-02-21T07:42:52.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f392c184380 con 0x7f392c183fa0 2024-02-21T07:42:52.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398517194 0 0) 0x7f392c0ce230 con 0x7f392c0cd090 2024-02-21T07:42:52.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.043+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f392c187740 con 0x7f392c0cd090 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4212793856 0 0) 0x7f3914003520 con 0x7f392c0f6310 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 >> v1:172.21.15.174:6789/0 conn(0x7f392c0cd090 legacy=0x7f392c188980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 >> v1:172.21.15.69:6789/0 conn(0x7f392c183fa0 legacy=0x7f392c188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c0cd6b0 con 0x7f392c0f6310 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f39240019f0 con 0x7f392c0f6310 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 >> v1:172.21.15.184:6789/0 conn(0x7f392c0f6310 legacy=0x7f392c06ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3914003d30 0x7f3914004110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3914004880 0x7f3914004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914009970 0x7f391400bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391400c350 con 0x7f3914009970 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391400c490 con 0x7f3914003d30 2024-02-21T07:42:52.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f391400c650 con 0x7f3914004880 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f3931a00640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3914003d30 0x7f3914004110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f3931000640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3914004880 0x7f3914004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f3932400640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914009970 0x7f391400bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f3931a00640 1 -- 172.21.15.69:0/2115948461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3914004880 msgr2=0x7f3914004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f3931a00640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3914004880 0x7f3914004d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f3931a00640 1 -- 172.21.15.69:0/2115948461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914009970 msgr2=0x7f391400bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f3931a00640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914009970 0x7f391400bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.044+0000 7f3931a00640 1 -- 172.21.15.69:0/2115948461 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3914003520 con 0x7f3914003d30 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.045+0000 7f3932400640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914009970 0x7f391400bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.045+0000 7f3932400640 1 -- 172.21.15.69:0/2115948461 reap_dead start 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.046+0000 7f3931a00640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3914003d30 0x7f3914004110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3920001960 tx=0x7f39140057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=995eb09cc9c1cd3f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.046+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920004aa0 con 0x7f3914003d30 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.046+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392002d040 con 0x7f3914003d30 2024-02-21T07:42:52.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.046+0000 7f392be00640 1 -- 172.21.15.69:0/2115948461 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920004e60 con 0x7f3914003d30 2024-02-21T07:42:52.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.047+0000 7f3934400640 1 -- 172.21.15.69:0/2115948461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3914003d30 msgr2=0x7f3914004110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.047+0000 7f3934400640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3914003d30 0x7f3914004110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3920001960 tx=0x7f39140057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.047+0000 7f3934400640 1 -- 172.21.15.69:0/2115948461 shutdown_connections 2024-02-21T07:42:52.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.047+0000 7f3934400640 1 --2- 172.21.15.69:0/2115948461 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f3914003d30 0x7f3914004110 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.047+0000 7f3934400640 1 -- 172.21.15.69:0/2115948461 >> 172.21.15.69:0/2115948461 conn(0x7f392c0f69c0 msgr2=0x7f392c0f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.047+0000 7f3934400640 1 -- 172.21.15.69:0/2115948461 shutdown_connections 2024-02-21T07:42:52.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.047+0000 7f3934400640 1 -- 172.21.15.69:0/2115948461 wait complete. 2024-02-21T07:42:52.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.049+0000 7f3934400640 1 Processor -- start 2024-02-21T07:42:52.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.050+0000 7f3934400640 1 -- start start 2024-02-21T07:42:52.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.051+0000 7f3934400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914003d30 0x7f392c1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.051+0000 7f3934400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f392c157be0 0x7f392c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.051+0000 7f3934400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f392c0d0d40 0x7f392c06b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.051+0000 7f3934400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c183780 con 0x7f3914003d30 2024-02-21T07:42:52.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.051+0000 7f3934400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c1825b0 con 0x7f392c157be0 2024-02-21T07:42:52.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.051+0000 7f3934400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c182890 con 0x7f392c0d0d40 2024-02-21T07:42:52.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.051+0000 7f3931a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914003d30 0x7f392c1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.051+0000 7f3931a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914003d30 0x7f392c1576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53748/0 (socket says 172.21.15.69:53748) 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.051+0000 7f3931a00640 1 -- 172.21.15.69:0/2813914734 learned_addr learned my addr 172.21.15.69:0/2813914734 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.052+0000 7f3931000640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f392c157be0 0x7f392c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.052+0000 7f3932400640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f392c0d0d40 0x7f392c06b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.052+0000 7f3931a00640 1 -- 172.21.15.69:0/2813914734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f392c0d0d40 msgr2=0x7f392c06b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.052+0000 7f3931a00640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f392c0d0d40 0x7f392c06b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.052+0000 7f3931a00640 1 -- 172.21.15.69:0/2813914734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f392c157be0 msgr2=0x7f392c0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.052+0000 7f3931a00640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f392c157be0 0x7f392c0d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.052+0000 7f3931a00640 1 -- 172.21.15.69:0/2813914734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c182b70 con 0x7f3914003d30 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.052+0000 7f3931a00640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914003d30 0x7f392c1576a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3920035040 tx=0x7f39200012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.052+0000 7f3929600640 1 -- 172.21.15.69:0/2813914734 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920007b00 con 0x7f3914003d30 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.053+0000 7f3929600640 1 -- 172.21.15.69:0/2813914734 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392003e430 con 0x7f3914003d30 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.053+0000 7f3934400640 1 -- 172.21.15.69:0/2813914734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c182e50 con 0x7f3914003d30 2024-02-21T07:42:52.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.053+0000 7f3929600640 1 -- 172.21.15.69:0/2813914734 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392003e7a0 con 0x7f3914003d30 2024-02-21T07:42:52.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.053+0000 7f3934400640 1 -- 172.21.15.69:0/2813914734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c183410 con 0x7f3914003d30 2024-02-21T07:42:52.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.056+0000 7f3929600640 1 -- 172.21.15.69:0/2813914734 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f392003e900 con 0x7f3914003d30 2024-02-21T07:42:52.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.057+0000 7f3937228740 1 Processor -- start 2024-02-21T07:42:52.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.057+0000 7f3937228740 1 -- start start 2024-02-21T07:42:52.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.058+0000 7f3929600640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f390c09f130 0x7f390c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.058+0000 7f3929600640 1 -- 172.21.15.69:0/2813914734 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f39200eb740 con 0x7f3914003d30 2024-02-21T07:42:52.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.058+0000 7f3932400640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f390c09f130 0x7f390c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.058+0000 7f3937228740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37df7e0 0x55bcd37dfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.058+0000 7f3937228740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 0x55bcd381a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.058+0000 7f3937228740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd381aeb0 0x55bcd381bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.058+0000 7f3937228740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd3712b30 con 0x55bcd381aeb0 2024-02-21T07:42:52.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.058+0000 7f3937228740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd3710060 con 0x55bcd37df7e0 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.058+0000 7f3937228740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd370b840 con 0x55bcd37e0100 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3932400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd381aeb0 0x55bcd381bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3931a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37df7e0 0x55bcd37dfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3932400640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f390c09f130 0x7f390c0a15f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f392c0f66f0 tx=0x7f3924001330 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3931a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37df7e0 0x55bcd37dfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:50920/0 (socket says 172.21.15.69:50920) 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3931a00640 1 -- 172.21.15.69:0/422535758 learned_addr learned my addr 172.21.15.69:0/422535758 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3931000640 1 --2- 172.21.15.69:0/422535758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 0x55bcd381a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3931a00640 1 -- 172.21.15.69:0/422535758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 msgr2=0x55bcd381a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3931a00640 1 --2- 172.21.15.69:0/422535758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 0x55bcd381a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3931a00640 1 -- 172.21.15.69:0/422535758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd381aeb0 msgr2=0x55bcd381bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3931a00640 1 --2- 172.21.15.69:0/422535758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd381aeb0 0x55bcd381bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3931a00640 1 -- 172.21.15.69:0/422535758 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcd36d34c0 con 0x55bcd37df7e0 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f3931a00640 1 --2- 172.21.15.69:0/422535758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37df7e0 0x55bcd37dfbc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f39200c1330 tx=0x7f39200b8c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41be329054db97a8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f391e000640 1 -- 172.21.15.69:0/422535758 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39200c1860 con 0x55bcd37df7e0 2024-02-21T07:42:52.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f391e000640 1 -- 172.21.15.69:0/422535758 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39200015b0 con 0x55bcd37df7e0 2024-02-21T07:42:52.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.059+0000 7f391e000640 1 -- 172.21.15.69:0/422535758 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39200b5870 con 0x55bcd37df7e0 2024-02-21T07:42:52.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.060+0000 7f3937228740 1 -- 172.21.15.69:0/422535758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37df7e0 msgr2=0x55bcd37dfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.060+0000 7f3937228740 1 --2- 172.21.15.69:0/422535758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37df7e0 0x55bcd37dfbc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f39200c1330 tx=0x7f39200b8c30 comp rx=0 tx=0).stop 2024-02-21T07:42:52.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.060+0000 7f3937228740 1 -- 172.21.15.69:0/422535758 shutdown_connections 2024-02-21T07:42:52.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.060+0000 7f3937228740 1 --2- 172.21.15.69:0/422535758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd381aeb0 0x55bcd381bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.060+0000 7f3937228740 1 --2- 172.21.15.69:0/422535758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 0x55bcd381a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.060+0000 7f3937228740 1 --2- 172.21.15.69:0/422535758 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37df7e0 0x55bcd37dfbc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.060+0000 7f3937228740 1 -- 172.21.15.69:0/422535758 >> 172.21.15.69:0/422535758 conn(0x55bcd37a1db0 msgr2=0x55bcd37a2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.060+0000 7f3937228740 1 -- 172.21.15.69:0/422535758 shutdown_connections 2024-02-21T07:42:52.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.060+0000 7f3937228740 1 -- 172.21.15.69:0/422535758 wait complete. 2024-02-21T07:42:52.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.061+0000 7f3937228740 1 -- start start 2024-02-21T07:42:52.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.061+0000 7f3937228740 1 Processor -- start 2024-02-21T07:42:52.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3937228740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 0x55bcd3824240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3937228740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd381aeb0 0x55bcd379d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3937228740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd380a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3937228740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd36b0ea0 con 0x55bcd37d5f20 2024-02-21T07:42:52.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3937228740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd36b0b40 con 0x55bcd381aeb0 2024-02-21T07:42:52.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3937228740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd3453f20 con 0x55bcd37e0100 2024-02-21T07:42:52.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3937228740 10 client.0 _ll_register_callbacks cb 0x55bcd36c4950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:52.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3932400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd380a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3931000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd381aeb0 0x55bcd379d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3931a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 0x55bcd3824240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3931000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd381aeb0 0x55bcd379d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:50932/0 (socket says 172.21.15.69:50932) 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3931000640 1 -- 172.21.15.69:0/3656330879 learned_addr learned my addr 172.21.15.69:0/3656330879 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3932400640 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd380a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53760/0 (socket says 172.21.15.69:53760) 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3931a00640 1 -- 172.21.15.69:0/3656330879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd381aeb0 msgr2=0x55bcd379d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3931a00640 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd381aeb0 0x55bcd379d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3931a00640 1 -- 172.21.15.69:0/3656330879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 msgr2=0x55bcd380a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3931a00640 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd380a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3931a00640 1 -- 172.21.15.69:0/3656330879 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c183410 con 0x55bcd37e0100 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.063+0000 7f3931000640 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd381aeb0 0x55bcd379d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.064+0000 7f3931a00640 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 0x55bcd3824240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3920001960 tx=0x7f3920006000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c978f662a30eff1f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.064+0000 7f3912a00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.064+0000 7f3912a00640 1 -- 172.21.15.69:0/3656330879 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392003edb0 con 0x55bcd37e0100 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.064+0000 7f3912a00640 1 -- 172.21.15.69:0/3656330879 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f39200c1860 con 0x55bcd37e0100 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.064+0000 7f3937228740 1 -- 172.21.15.69:0/3656330879 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bcd372fc40 con 0x55bcd37e0100 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.064+0000 7f3912a00640 1 -- 172.21.15.69:0/3656330879 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39200b8650 con 0x55bcd37e0100 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.064+0000 7f3937228740 10 client.5030 fetch_fsmap learned FSMap version 18 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.064+0000 7f3937228740 1 -- 172.21.15.69:0/3656330879 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55bcd3709ec0 con 0x55bcd37e0100 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.064+0000 7f3912a00640 1 -- 172.21.15.69:0/3656330879 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bcd372fc40 con 0x55bcd37e0100 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.064+0000 7f3912a00640 1 -- 172.21.15.69:0/3656330879 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 18) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f392009d080 con 0x55bcd37e0100 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.065+0000 7f3937228740 10 client.5030 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.065+0000 7f3937228740 10 client.5030 resolve_mds: resolved name 'j' to daemon mds.j 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.065+0000 7f3937228740 20 client.5030 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.065+0000 7f3937228740 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55bcd380c0c0 0x55bcd37e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.065+0000 7f3937228740 4 client.5030 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.065+0000 7f3937228740 1 -- 172.21.15.69:0/3656330879 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bcd340b6c0 con 0x55bcd380c0c0 2024-02-21T07:42:52.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.065+0000 7f3931000640 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55bcd380c0c0 0x55bcd37e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.065+0000 7f3931000640 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55bcd380c0c0 0x55bcd37e8aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb5f6ffc9fe730b server_cookie=df68c76732571012 in_seq=0 out_seq=0 2024-02-21T07:42:52.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.065+0000 7f3912a00640 10 client.5030 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:42:52.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.066+0000 7f3912a00640 1 -- 172.21.15.69:0/3656330879 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bcd340b6c0 con 0x55bcd380c0c0 2024-02-21T07:42:52.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.066+0000 7f3912a00640 10 client.5030 handle_command_reply: tid=0 2024-02-21T07:42:52.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.066+0000 7f3937228740 1 client.5030 shutdown 2024-02-21T07:42:52.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.066+0000 7f3937228740 1 -- 172.21.15.69:0/3656330879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 msgr2=0x55bcd3824240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.066+0000 7f3937228740 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 0x55bcd3824240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3920001960 tx=0x7f3920006000 comp rx=0 tx=0).stop 2024-02-21T07:42:52.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.066+0000 7f3937228740 1 -- 172.21.15.69:0/3656330879 shutdown_connections 2024-02-21T07:42:52.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.066+0000 7f3937228740 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd380a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.066+0000 7f3937228740 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd381aeb0 0x55bcd379d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.066+0000 7f3937228740 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55bcd380c0c0 0x55bcd37e8aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.066+0000 7f3937228740 1 --2- 172.21.15.69:0/3656330879 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd37e0100 0x55bcd3824240 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.067+0000 7f3912a00640 0 client.5030 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:42:52.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.067+0000 7f3937228740 1 -- 172.21.15.69:0/3656330879 >> 172.21.15.69:0/3656330879 conn(0x55bcd37df7e0 msgr2=0x55bcd37a3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.067+0000 7f3937228740 1 -- 172.21.15.69:0/3656330879 shutdown_connections 2024-02-21T07:42:52.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.067+0000 7f3937228740 1 -- 172.21.15.69:0/3656330879 wait complete. 2024-02-21T07:42:52.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.067+0000 7f3937228740 20 client.5030 trim_cache size 0 max 16384 2024-02-21T07:42:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.084+0000 7f3937228740 1 Processor -- start 2024-02-21T07:42:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.084+0000 7f3937228740 1 -- start start 2024-02-21T07:42:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3937228740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd379d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3937228740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37e0100 0x55bcd3871e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3937228740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd381aeb0 0x55bcd38723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3937228740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd381b6d0 con 0x55bcd37d5f20 2024-02-21T07:42:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3937228740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd37d59a0 con 0x55bcd37e0100 2024-02-21T07:42:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3937228740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd381b8e0 con 0x55bcd381aeb0 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3931a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd379d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3932400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd381aeb0 0x55bcd38723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3931a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd379d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53762/0 (socket says 172.21.15.69:53762) 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3931a00640 1 -- 172.21.15.69:0/1871181238 learned_addr learned my addr 172.21.15.69:0/1871181238 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.085+0000 7f3931000640 1 --2- 172.21.15.69:0/1871181238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37e0100 0x55bcd3871e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.086+0000 7f3931a00640 1 -- 172.21.15.69:0/1871181238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd381aeb0 msgr2=0x55bcd38723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.086+0000 7f3931a00640 1 --2- 172.21.15.69:0/1871181238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd381aeb0 0x55bcd38723b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.086+0000 7f3931a00640 1 -- 172.21.15.69:0/1871181238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37e0100 msgr2=0x55bcd3871e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.086+0000 7f3931a00640 1 --2- 172.21.15.69:0/1871181238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37e0100 0x55bcd3871e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.086+0000 7f3931a00640 1 -- 172.21.15.69:0/1871181238 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcd36a68b0 con 0x55bcd37d5f20 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.086+0000 7f3931a00640 1 --2- 172.21.15.69:0/1871181238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd379d580 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f39200b5b80 tx=0x7f39200d2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdee3c606fee7bf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.086+0000 7f391d600640 1 -- 172.21.15.69:0/1871181238 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39200a1070 con 0x55bcd37d5f20 2024-02-21T07:42:52.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.086+0000 7f391d600640 1 -- 172.21.15.69:0/1871181238 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39200da020 con 0x55bcd37d5f20 2024-02-21T07:42:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.086+0000 7f391d600640 1 -- 172.21.15.69:0/1871181238 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392003edb0 con 0x55bcd37d5f20 2024-02-21T07:42:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.087+0000 7f3937228740 1 -- 172.21.15.69:0/1871181238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 msgr2=0x55bcd379d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.087+0000 7f3937228740 1 --2- 172.21.15.69:0/1871181238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd379d580 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f39200b5b80 tx=0x7f39200d2040 comp rx=0 tx=0).stop 2024-02-21T07:42:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.087+0000 7f3937228740 1 -- 172.21.15.69:0/1871181238 shutdown_connections 2024-02-21T07:42:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.087+0000 7f3937228740 1 --2- 172.21.15.69:0/1871181238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd381aeb0 0x55bcd38723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.087+0000 7f3937228740 1 --2- 172.21.15.69:0/1871181238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37e0100 0x55bcd3871e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.087+0000 7f3937228740 1 --2- 172.21.15.69:0/1871181238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37d5f20 0x55bcd379d580 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.087+0000 7f3937228740 1 -- 172.21.15.69:0/1871181238 >> 172.21.15.69:0/1871181238 conn(0x55bcd37df7e0 msgr2=0x55bcd3819240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.087+0000 7f3937228740 1 -- 172.21.15.69:0/1871181238 shutdown_connections 2024-02-21T07:42:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.087+0000 7f3937228740 1 -- 172.21.15.69:0/1871181238 wait complete. 2024-02-21T07:42:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.088+0000 7f3937228740 1 -- start start 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.088+0000 7f3937228740 1 Processor -- start 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.089+0000 7f3937228740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37d5f20 0x55bcd37a3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.089+0000 7f3937228740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37e0100 0x55bcd380b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.089+0000 7f3937228740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd381aeb0 0x55bcd3799ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.089+0000 7f3937228740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd3817e50 con 0x55bcd37e0100 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.089+0000 7f3937228740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd379d580 con 0x55bcd37d5f20 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.089+0000 7f3937228740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcd387e210 con 0x55bcd381aeb0 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.089+0000 7f3937228740 10 client.0 _ll_register_callbacks cb 0x7f39240074f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.089+0000 7f3931000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37e0100 0x55bcd380b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.089+0000 7f3931a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37d5f20 0x55bcd37a3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3931a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37d5f20 0x55bcd37a3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:50958/0 (socket says 172.21.15.69:50958) 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3931000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37e0100 0x55bcd380b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53768/0 (socket says 172.21.15.69:53768) 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3931a00640 1 -- 172.21.15.69:0/1959863614 learned_addr learned my addr 172.21.15.69:0/1959863614 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3932400640 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd381aeb0 0x55bcd3799ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3931000640 1 -- 172.21.15.69:0/1959863614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd381aeb0 msgr2=0x55bcd3799ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3931000640 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd381aeb0 0x55bcd3799ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3931000640 1 -- 172.21.15.69:0/1959863614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37d5f20 msgr2=0x55bcd37a3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3931000640 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37d5f20 0x55bcd37a3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3931000640 1 -- 172.21.15.69:0/1959863614 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bcd3709ec0 con 0x55bcd37e0100 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3931a00640 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37d5f20 0x55bcd37a3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3931000640 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37e0100 0x55bcd380b0b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55bcd37df440 tx=0x7f39180205a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5928ef4bb881d62 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.090+0000 7f3912a00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3912a00640 1 -- 172.21.15.69:0/1959863614 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391801b040 con 0x55bcd37e0100 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3912a00640 1 -- 172.21.15.69:0/1959863614 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3918025070 con 0x55bcd37e0100 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3937228740 1 -- 172.21.15.69:0/1959863614 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39200015b0 con 0x55bcd37e0100 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3912a00640 1 -- 172.21.15.69:0/1959863614 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3918005110 con 0x55bcd37e0100 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3937228740 10 client.4863 fetch_fsmap learned FSMap version 18 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3937228740 1 -- 172.21.15.69:0/1959863614 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55bcd36cc510 con 0x55bcd37e0100 2024-02-21T07:42:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3912a00640 1 -- 172.21.15.69:0/1959863614 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39200015b0 con 0x55bcd37e0100 2024-02-21T07:42:52.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3912a00640 1 -- 172.21.15.69:0/1959863614 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 18) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3918012040 con 0x55bcd37e0100 2024-02-21T07:42:52.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3937228740 10 client.4863 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:42:52.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3937228740 10 client.4863 resolve_mds: resolved name 'j' to daemon mds.j 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3937228740 20 client.4863 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3937228740 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55bcd3882120 0x55bcd37cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3937228740 4 client.4863 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.091+0000 7f3937228740 1 -- 172.21.15.69:0/1959863614 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bcd345c270 con 0x55bcd3882120 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.092+0000 7f3931a00640 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55bcd3882120 0x55bcd37cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.092+0000 7f3931a00640 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55bcd3882120 0x55bcd37cfa80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d0d4e2724d6d734c server_cookie=ed2c9c0062bd1f10 in_seq=0 out_seq=0 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.092+0000 7f3912a00640 10 client.4863 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.092+0000 7f3912a00640 1 -- 172.21.15.69:0/1959863614 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55bcd345c270 con 0x55bcd3882120 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.092+0000 7f3912a00640 10 client.4863 handle_command_reply: tid=0 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.092+0000 7f3937228740 1 client.4863 shutdown 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 1 -- 172.21.15.69:0/1959863614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37e0100 msgr2=0x55bcd380b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37e0100 0x55bcd380b0b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x55bcd37df440 tx=0x7f39180205a0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 1 -- 172.21.15.69:0/1959863614 shutdown_connections 2024-02-21T07:42:52.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55bcd3882120 0x55bcd37cfa80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bcd381aeb0 0x55bcd3799ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bcd37e0100 0x55bcd380b0b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 1 --2- 172.21.15.69:0/1959863614 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bcd37d5f20 0x55bcd37a3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3912a00640 0 client.4863 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 1 -- 172.21.15.69:0/1959863614 >> 172.21.15.69:0/1959863614 conn(0x55bcd37df7e0 msgr2=0x55bcd37e3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 1 -- 172.21.15.69:0/1959863614 shutdown_connections 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 1 -- 172.21.15.69:0/1959863614 wait complete. 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.093+0000 7f3937228740 20 client.4863 trim_cache size 0 max 16384 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "c8bdd735-83bd-400f-baca-e501b49b60ea", 2024-02-21T07:42:52.102 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 1, 2024-02-21T07:42:52.103 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4375, 2024-02-21T07:42:52.103 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-02-21T07:42:52.103 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-02-21T07:42:52.103 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-02-21T07:42:52.103 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 21.999267759999999, 2024-02-21T07:42:52.103 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 18, 2024-02-21T07:42:52.103 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 31, 2024-02-21T07:42:52.103 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 29, 2024-02-21T07:42:52.103 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 56.408821574000001 2024-02-21T07:42:52.103 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 -- 172.21.15.69:0/2813914734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f390c09f130 msgr2=0x7f390c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f390c09f130 0x7f390c0a15f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f392c0f66f0 tx=0x7f3924001330 comp rx=0 tx=0).stop 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 -- 172.21.15.69:0/2813914734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914003d30 msgr2=0x7f392c1576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914003d30 0x7f392c1576a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3920035040 tx=0x7f39200012b0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 -- 172.21.15.69:0/2813914734 shutdown_connections 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f390c09f130 0x7f390c0a15f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f392c0d0d40 0x7f392c06b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f392c157be0 0x7f392c0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 --2- 172.21.15.69:0/2813914734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3914003d30 0x7f392c1576a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 -- 172.21.15.69:0/2813914734 >> 172.21.15.69:0/2813914734 conn(0x7f392c0f69c0 msgr2=0x7f392c0f5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 -- 172.21.15.69:0/2813914734 shutdown_connections 2024-02-21T07:42:52.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.094+0000 7f3934400640 1 -- 172.21.15.69:0/2813914734 wait complete. 2024-02-21T07:42:52.116 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-02-21T07:42:52.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.306+0000 7fc4e2200640 1 Processor -- start 2024-02-21T07:42:52.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.307+0000 7fc4e2200640 1 -- start start 2024-02-21T07:42:52.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4e2200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc4dc182ad0 0x7fc4dc0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4e2200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc4dc0fec10 0x7fc4dc18c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4e2200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4dc189a50 con 0x7fc4dc0fe780 2024-02-21T07:42:52.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4e2200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc0fe2f0 con 0x7fc4dc0fec10 2024-02-21T07:42:52.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4e2200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4dc0fd400 con 0x7fc4dc182ad0 2024-02-21T07:42:52.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4db400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc4dc182ad0 0x7fc4dc0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4daa00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc4dc0fe780 0x7fc4dc18c030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:41674/0 (socket says 172.21.15.69:41674) 2024-02-21T07:42:52.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4db400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc4dc182ad0 0x7fc4dc0cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:58848/0 (socket says 172.21.15.69:58848) 2024-02-21T07:42:52.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4daa00640 1 -- 172.21.15.69:0/258858811 learned_addr learned my addr 172.21.15.69:0/258858811 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:52.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4dbe00640 1 --2- 172.21.15.69:0/258858811 >> v2:172.21.15.174:3300/0 conn(0x7fc4dc0fec10 0x7fc4dc18c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4db400640 1 -- 172.21.15.69:0/258858811 >> v2:172.21.15.174:3300/0 conn(0x7fc4dc0fec10 msgr2=0x7fc4dc18c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4db400640 1 --2- 172.21.15.69:0/258858811 >> v2:172.21.15.174:3300/0 conn(0x7fc4dc0fec10 0x7fc4dc18c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4db400640 1 -- 172.21.15.69:0/258858811 >> v1:172.21.15.69:6789/0 conn(0x7fc4dc0fe780 legacy=0x7fc4dc18c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.309+0000 7fc4db400640 1 -- 172.21.15.69:0/258858811 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4dc0fd6e0 con 0x7fc4dc182ad0 2024-02-21T07:42:52.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.310+0000 7fc4db400640 1 --2- 172.21.15.69:0/258858811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc182ad0 0x7fc4dc0cf3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0ff2c0 tx=0x7fc4cc02be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=debf4929c5bf191d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.311+0000 7fc4da000640 1 -- 172.21.15.69:0/258858811 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc02cbe0 con 0x7fc4dc182ad0 2024-02-21T07:42:52.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.311+0000 7fc4da000640 1 -- 172.21.15.69:0/258858811 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc02cd40 con 0x7fc4dc182ad0 2024-02-21T07:42:52.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.311+0000 7fc4da000640 1 -- 172.21.15.69:0/258858811 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc034660 con 0x7fc4dc182ad0 2024-02-21T07:42:52.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.311+0000 7fc4e2200640 1 -- 172.21.15.69:0/258858811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc182ad0 msgr2=0x7fc4dc0cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.311+0000 7fc4e2200640 1 --2- 172.21.15.69:0/258858811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc182ad0 0x7fc4dc0cf3b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0ff2c0 tx=0x7fc4cc02be30 comp rx=0 tx=0).stop 2024-02-21T07:42:52.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.311+0000 7fc4e2200640 1 -- 172.21.15.69:0/258858811 shutdown_connections 2024-02-21T07:42:52.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.311+0000 7fc4e2200640 1 --2- 172.21.15.69:0/258858811 >> v2:172.21.15.174:3300/0 conn(0x7fc4dc0fec10 0x7fc4dc18c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.311+0000 7fc4e2200640 1 --2- 172.21.15.69:0/258858811 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc182ad0 0x7fc4dc0cf3b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.311+0000 7fc4e2200640 1 -- 172.21.15.69:0/258858811 >> 172.21.15.69:0/258858811 conn(0x7fc4dc071dd0 msgr2=0x7fc4dc0668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.312+0000 7fc4e2200640 1 -- 172.21.15.69:0/258858811 shutdown_connections 2024-02-21T07:42:52.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.312+0000 7fc4e2200640 1 -- 172.21.15.69:0/258858811 wait complete. 2024-02-21T07:42:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.314+0000 7fc4e2200640 1 Processor -- start 2024-02-21T07:42:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.314+0000 7fc4e2200640 1 -- start start 2024-02-21T07:42:52.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4e2200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4dc0fe780 0x7fc4dc2146a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4e2200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc0fec10 0x7fc4dc170f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4e2200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4dc182ad0 0x7fc4dc0d3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4e2200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc180df0 con 0x7fc4dc0fe780 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4e2200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc213e60 con 0x7fc4dc182ad0 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4e2200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4dc214be0 con 0x7fc4dc0fec10 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4db400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4dc0fe780 0x7fc4dc2146a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4daa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc0fec10 0x7fc4dc170f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4db400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4dc0fe780 0x7fc4dc2146a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53776/0 (socket says 172.21.15.69:53776) 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4daa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc0fec10 0x7fc4dc170f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:58856/0 (socket says 172.21.15.69:58856) 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4db400640 1 -- 172.21.15.69:0/3817082548 learned_addr learned my addr 172.21.15.69:0/3817082548 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.315+0000 7fc4dbe00640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4dc182ad0 0x7fc4dc0d3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4dbe00640 1 -- 172.21.15.69:0/3817082548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc0fec10 msgr2=0x7fc4dc170f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4dbe00640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc0fec10 0x7fc4dc170f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4dbe00640 1 -- 172.21.15.69:0/3817082548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4dc0fe780 msgr2=0x7fc4dc2146a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4dbe00640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4dc0fe780 0x7fc4dc2146a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4dbe00640 1 -- 172.21.15.69:0/3817082548 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc009a70 con 0x7fc4dc182ad0 2024-02-21T07:42:52.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4db400640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4dc0fe780 0x7fc4dc2146a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:52.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4daa00640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc0fec10 0x7fc4dc170f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:52.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4dbe00640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4dc182ad0 0x7fc4dc0d3b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400e7f0 tx=0x7fc4d400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4d3400640 1 -- 172.21.15.69:0/3817082548 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400c730 con 0x7fc4dc182ad0 2024-02-21T07:42:52.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4d3400640 1 -- 172.21.15.69:0/3817082548 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d400c890 con 0x7fc4dc182ad0 2024-02-21T07:42:52.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4e2200640 1 -- 172.21.15.69:0/3817082548 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4dc180490 con 0x7fc4dc182ad0 2024-02-21T07:42:52.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.316+0000 7fc4d3400640 1 -- 172.21.15.69:0/3817082548 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d400cc80 con 0x7fc4dc182ad0 2024-02-21T07:42:52.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.317+0000 7fc4e2200640 1 -- 172.21.15.69:0/3817082548 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc180730 con 0x7fc4dc182ad0 2024-02-21T07:42:52.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.320+0000 7fc4d3400640 1 -- 172.21.15.69:0/3817082548 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc4d4013470 con 0x7fc4dc182ad0 2024-02-21T07:42:52.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.320+0000 7fc4e4e2e740 1 Processor -- start 2024-02-21T07:42:52.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.321+0000 7fc4e4e2e740 1 -- start start 2024-02-21T07:42:52.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.321+0000 7fc4d3400640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc4b809f130 0x7fc4b80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.321+0000 7fc4d3400640 1 -- 172.21.15.69:0/3817082548 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc4d40c9c10 con 0x7fc4dc182ad0 2024-02-21T07:42:52.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.321+0000 7fc4daa00640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc4b809f130 0x7fc4b80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5857e0 0x55ccca585bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca5c0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca4b8b30 con 0x55ccca5c0eb0 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca4b6060 con 0x55ccca5857e0 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca4b1840 con 0x55ccca586100 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4daa00640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc4b809f130 0x7fc4b80a15f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc21c970 tx=0x7fc4c4007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4dbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4db400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5857e0 0x55ccca585bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4daa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca5c0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4dbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53782/0 (socket says 172.21.15.69:53782) 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.322+0000 7fc4dbe00640 1 -- 172.21.15.69:0/3133485680 learned_addr learned my addr 172.21.15.69:0/3133485680 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.323+0000 7fc4db400640 1 -- 172.21.15.69:0/3133485680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 msgr2=0x55ccca5c0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.323+0000 7fc4db400640 1 --2- 172.21.15.69:0/3133485680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca5c0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.323+0000 7fc4db400640 1 -- 172.21.15.69:0/3133485680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 msgr2=0x55ccca5c1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.323+0000 7fc4db400640 1 --2- 172.21.15.69:0/3133485680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5c1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.323+0000 7fc4db400640 1 -- 172.21.15.69:0/3133485680 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccca4794c0 con 0x55ccca5857e0 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.323+0000 7fc4dbe00640 1 --2- 172.21.15.69:0/3133485680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.323+0000 7fc4db400640 1 --2- 172.21.15.69:0/3133485680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5857e0 0x55ccca585bc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc037040 tx=0x7fc4cc02e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=436c7edb02480810 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.323+0000 7fc4cb400640 1 -- 172.21.15.69:0/3133485680 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0349f0 con 0x55ccca5857e0 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.323+0000 7fc4cb400640 1 -- 172.21.15.69:0/3133485680 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc034b50 con 0x55ccca5857e0 2024-02-21T07:42:52.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.323+0000 7fc4cb400640 1 -- 172.21.15.69:0/3133485680 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc049410 con 0x55ccca5857e0 2024-02-21T07:42:52.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.324+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/3133485680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5857e0 msgr2=0x55ccca585bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.324+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/3133485680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5857e0 0x55ccca585bc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc037040 tx=0x7fc4cc02e000 comp rx=0 tx=0).stop 2024-02-21T07:42:52.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.324+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/3133485680 shutdown_connections 2024-02-21T07:42:52.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.324+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/3133485680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5c1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.324+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/3133485680 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca5c0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.324+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/3133485680 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5857e0 0x55ccca585bc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.324+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/3133485680 >> 172.21.15.69:0/3133485680 conn(0x55ccca547db0 msgr2=0x55ccca548e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.324+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/3133485680 shutdown_connections 2024-02-21T07:42:52.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.324+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/3133485680 wait complete. 2024-02-21T07:42:52.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.325+0000 7fc4e4e2e740 1 -- start start 2024-02-21T07:42:52.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.325+0000 7fc4e4e2e740 1 Processor -- start 2024-02-21T07:42:52.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.326+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca545620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.326+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 0x55ccca579fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.326+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 0x55ccca5444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca456ea0 con 0x55ccca58e480 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca456b40 con 0x55ccca5c0eb0 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca1f9f20 con 0x55ccca586100 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4e4e2e740 10 client.0 _ll_register_callbacks cb 0x55ccca46a950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4db400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca545620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4db400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca545620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:58872/0 (socket says 172.21.15.69:58872) 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4dbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 0x55ccca5444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4db400640 1 -- 172.21.15.69:0/1161113335 learned_addr learned my addr 172.21.15.69:0/1161113335 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4daa00640 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 0x55ccca579fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4db400640 1 -- 172.21.15.69:0/1161113335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 msgr2=0x55ccca579fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4db400640 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 0x55ccca579fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4db400640 1 -- 172.21.15.69:0/1161113335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 msgr2=0x55ccca5444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4db400640 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 0x55ccca5444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.327+0000 7fc4db400640 1 -- 172.21.15.69:0/1161113335 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc0fd6e0 con 0x55ccca586100 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.328+0000 7fc4db400640 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca545620 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc037040 tx=0x7fc4cc004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f936dfa99e5476e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.328+0000 7fc4bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.328+0000 7fc4bfe00640 1 -- 172.21.15.69:0/1161113335 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc003da0 con 0x55ccca586100 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.328+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/1161113335 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ccca4d5c40 con 0x55ccca586100 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.328+0000 7fc4bfe00640 1 -- 172.21.15.69:0/1161113335 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc4cc004040 con 0x55ccca586100 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.328+0000 7fc4bfe00640 1 -- 172.21.15.69:0/1161113335 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4cc004200 con 0x55ccca586100 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.328+0000 7fc4e4e2e740 10 client.5048 fetch_fsmap learned FSMap version 18 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.328+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/1161113335 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55ccca4afec0 con 0x55ccca586100 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.328+0000 7fc4bfe00640 1 -- 172.21.15.69:0/1161113335 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc060020 con 0x55ccca586100 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.329+0000 7fc4bfe00640 1 -- 172.21.15.69:0/1161113335 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 18) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc4cc051030 con 0x55ccca586100 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.329+0000 7fc4e4e2e740 10 client.5048 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.329+0000 7fc4e4e2e740 10 client.5048 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.329+0000 7fc4e4e2e740 20 client.5048 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:52.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.329+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55ccca543750 0x55ccca543d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.329+0000 7fc4e4e2e740 4 client.5048 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:42:52.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.329+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/1161113335 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ccca1b16c0 con 0x55ccca543750 2024-02-21T07:42:52.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.329+0000 7fc4daa00640 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55ccca543750 0x55ccca543d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.330+0000 7fc4daa00640 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55ccca543750 0x55ccca543d90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12aaf1bb5f1d2780 server_cookie=58e6ddd3d640fd12 in_seq=0 out_seq=0 2024-02-21T07:42:52.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.330+0000 7fc4bfe00640 10 client.5048 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:42:52.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.330+0000 7fc4bfe00640 1 -- 172.21.15.69:0/1161113335 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ccca1b16c0 con 0x55ccca543750 2024-02-21T07:42:52.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.330+0000 7fc4bfe00640 10 client.5048 handle_command_reply: tid=0 2024-02-21T07:42:52.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.330+0000 7fc4e4e2e740 1 client.5048 shutdown 2024-02-21T07:42:52.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.330+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/1161113335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 msgr2=0x55ccca545620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.330+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca545620 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc037040 tx=0x7fc4cc004ab0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.331+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/1161113335 shutdown_connections 2024-02-21T07:42:52.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.331+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55ccca543750 0x55ccca543d90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.331+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 0x55ccca5444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.331+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 0x55ccca579fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.331+0000 7fc4bfe00640 0 client.5048 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:42:52.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.331+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/1161113335 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca545620 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.331+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/1161113335 >> 172.21.15.69:0/1161113335 conn(0x55ccca5857e0 msgr2=0x55ccca549820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.331+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/1161113335 shutdown_connections 2024-02-21T07:42:52.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.331+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/1161113335 wait complete. 2024-02-21T07:42:52.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.331+0000 7fc4e4e2e740 20 client.5048 trim_cache size 0 max 16384 2024-02-21T07:42:52.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.349+0000 7fc4e4e2e740 1 Processor -- start 2024-02-21T07:42:52.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.349+0000 7fc4e4e2e740 1 -- start start 2024-02-21T07:42:52.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.350+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca5aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.350+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 0x55ccca544480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.350+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 0x55ccca579f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.350+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca547be0 con 0x55ccca58e480 2024-02-21T07:42:52.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.350+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca58b460 con 0x55ccca5c0eb0 2024-02-21T07:42:52.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.350+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca57a4a0 con 0x55ccca586100 2024-02-21T07:42:52.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.350+0000 7fc4daa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 0x55ccca544480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.350+0000 7fc4daa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 0x55ccca544480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53796/0 (socket says 172.21.15.69:53796) 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.350+0000 7fc4daa00640 1 -- 172.21.15.69:0/710406035 learned_addr learned my addr 172.21.15.69:0/710406035 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4db400640 1 --2- 172.21.15.69:0/710406035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca5aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4dbe00640 1 --2- 172.21.15.69:0/710406035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 0x55ccca579f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4daa00640 1 -- 172.21.15.69:0/710406035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 msgr2=0x55ccca5aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4daa00640 1 --2- 172.21.15.69:0/710406035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca5aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4daa00640 1 -- 172.21.15.69:0/710406035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 msgr2=0x55ccca579f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4daa00640 1 --2- 172.21.15.69:0/710406035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 0x55ccca579f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4daa00640 1 -- 172.21.15.69:0/710406035 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccca44c8b0 con 0x55ccca58e480 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4dbe00640 1 --2- 172.21.15.69:0/710406035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 0x55ccca579f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4daa00640 1 --2- 172.21.15.69:0/710406035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 0x55ccca544480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc178e30 tx=0x7fc4c4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e557a5d028c44a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4caa00640 1 -- 172.21.15.69:0/710406035 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c402c030 con 0x55ccca58e480 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4caa00640 1 -- 172.21.15.69:0/710406035 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c40019f0 con 0x55ccca58e480 2024-02-21T07:42:52.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.351+0000 7fc4caa00640 1 -- 172.21.15.69:0/710406035 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4024860 con 0x55ccca58e480 2024-02-21T07:42:52.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.352+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/710406035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 msgr2=0x55ccca544480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.352+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/710406035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 0x55ccca544480 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc178e30 tx=0x7fc4c4013000 comp rx=0 tx=0).stop 2024-02-21T07:42:52.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.352+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/710406035 shutdown_connections 2024-02-21T07:42:52.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.352+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/710406035 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca5c0eb0 0x55ccca579f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.352+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/710406035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca58e480 0x55ccca544480 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.352+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/710406035 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca586100 0x55ccca5aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.352+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/710406035 >> 172.21.15.69:0/710406035 conn(0x55ccca5857e0 msgr2=0x55ccca5b28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.352+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/710406035 shutdown_connections 2024-02-21T07:42:52.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.352+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/710406035 wait complete. 2024-02-21T07:42:52.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.353+0000 7fc4e4e2e740 1 -- start start 2024-02-21T07:42:52.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.353+0000 7fc4e4e2e740 1 Processor -- start 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca586100 0x55ccca5aec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca58e480 0x55ccca620d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4e4e2e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca576200 con 0x55ccca5c0eb0 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca576920 con 0x55ccca586100 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4e4e2e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccca6208a0 con 0x55ccca58e480 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4e4e2e740 10 client.0 _ll_register_callbacks cb 0x55ccca5443d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4dbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4daa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca58e480 0x55ccca620d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4db400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca586100 0x55ccca5aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4daa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca58e480 0x55ccca620d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:58890/0 (socket says 172.21.15.69:58890) 2024-02-21T07:42:52.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4dbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53804/0 (socket says 172.21.15.69:53804) 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4db400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca586100 0x55ccca5aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:51014/0 (socket says 172.21.15.69:51014) 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4daa00640 1 -- 172.21.15.69:0/816495666 learned_addr learned my addr 172.21.15.69:0/816495666 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4daa00640 1 -- 172.21.15.69:0/816495666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca586100 msgr2=0x55ccca5aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4daa00640 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca586100 0x55ccca5aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4daa00640 1 -- 172.21.15.69:0/816495666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 msgr2=0x55ccca5cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4daa00640 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4daa00640 1 -- 172.21.15.69:0/816495666 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4dc189a50 con 0x55ccca58e480 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4db400640 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca586100 0x55ccca5aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.355+0000 7fc4dbe00640 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.356+0000 7fc4daa00640 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca58e480 0x55ccca620d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40049d0 tx=0x7fc4c4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38c7d781ad0c8f1f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.356+0000 7fc4bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.356+0000 7fc4bfe00640 1 -- 172.21.15.69:0/816495666 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4024af0 con 0x55ccca58e480 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.356+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/816495666 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4cc034b50 con 0x55ccca58e480 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.356+0000 7fc4bfe00640 1 -- 172.21.15.69:0/816495666 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc4c402d070 con 0x55ccca58e480 2024-02-21T07:42:52.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.356+0000 7fc4bfe00640 1 -- 172.21.15.69:0/816495666 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4c4024c50 con 0x55ccca58e480 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.356+0000 7fc4e4e2e740 10 client.5054 fetch_fsmap learned FSMap version 18 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.356+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/816495666 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55ccca472510 con 0x55ccca58e480 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.356+0000 7fc4bfe00640 1 -- 172.21.15.69:0/816495666 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc034b50 con 0x55ccca58e480 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.357+0000 7fc4bfe00640 1 -- 172.21.15.69:0/816495666 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 18) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc4c4012070 con 0x55ccca58e480 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.357+0000 7fc4e4e2e740 10 client.5054 fetch_fsmap finished waiting for FSMap version 18 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.357+0000 7fc4e4e2e740 10 client.5054 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.357+0000 7fc4e4e2e740 20 client.5054 populate_metadata read hostname 'smithi069' 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.357+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55ccca5bce40 0x55ccca6385e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.357+0000 7fc4e4e2e740 4 client.5054 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.357+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/816495666 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ccca202270 con 0x55ccca5bce40 2024-02-21T07:42:52.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.357+0000 7fc4db400640 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55ccca5bce40 0x55ccca6385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4bfe00640 10 client.5054 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4db400640 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55ccca5bce40 0x55ccca6385e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d60b7b45bf69e048 server_cookie=8fe48ae08b236589 in_seq=0 out_seq=0 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4bfe00640 1 -- 172.21.15.69:0/816495666 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ccca202270 con 0x55ccca5bce40 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4bfe00640 10 client.5054 handle_command_reply: tid=0 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 client.5054 shutdown 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/816495666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca58e480 msgr2=0x55ccca620d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca58e480 0x55ccca620d10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40049d0 tx=0x7fc4c4000bc0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/816495666 shutdown_connections 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55ccca5bce40 0x55ccca6385e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ccca5c0eb0 0x55ccca5cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55ccca58e480 0x55ccca620d10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 --2- 172.21.15.69:0/816495666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55ccca586100 0x55ccca5aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4bfe00640 0 client.5054 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:42:52.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/816495666 >> 172.21.15.69:0/816495666 conn(0x55ccca5857e0 msgr2=0x55ccca5c0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/816495666 shutdown_connections 2024-02-21T07:42:52.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 1 -- 172.21.15.69:0/816495666 wait complete. 2024-02-21T07:42:52.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.358+0000 7fc4e4e2e740 20 client.5054 trim_cache size 0 max 16384 2024-02-21T07:42:52.368 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:42:52.368 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "c8bdd735-83bd-400f-baca-e501b49b60ea", 2024-02-21T07:42:52.368 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2024-02-21T07:42:52.368 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4378, 2024-02-21T07:42:52.368 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-02-21T07:42:52.368 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-02-21T07:42:52.369 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-02-21T07:42:52.369 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 49.401491898000003, 2024-02-21T07:42:52.369 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 18, 2024-02-21T07:42:52.369 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 31, 2024-02-21T07:42:52.369 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 29, 2024-02-21T07:42:52.369 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 56.664229327000001 2024-02-21T07:42:52.369 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 -- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc4b809f130 msgr2=0x7fc4b80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc4b809f130 0x7fc4b80a15f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc21c970 tx=0x7fc4c4007e80 comp rx=0 tx=0).stop 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 -- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4dc182ad0 msgr2=0x7fc4dc0d3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4dc182ad0 0x7fc4dc0d3b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400e7f0 tx=0x7fc4d400ecb0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 -- 172.21.15.69:0/3817082548 shutdown_connections 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc4b809f130 0x7fc4b80a15f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc4dc182ad0 0x7fc4dc0d3b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc4dc0fec10 0x7fc4dc170f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 --2- 172.21.15.69:0/3817082548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4dc0fe780 0x7fc4dc2146a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 -- 172.21.15.69:0/3817082548 >> 172.21.15.69:0/3817082548 conn(0x7fc4dc071dd0 msgr2=0x7fc4dc0fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 -- 172.21.15.69:0/3817082548 shutdown_connections 2024-02-21T07:42:52.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.359+0000 7fc4e2200640 1 -- 172.21.15.69:0/3817082548 wait complete. 2024-02-21T07:42:52.382 INFO:teuthology.run_tasks:Running task kclient... 2024-02-21T07:42:52.397 INFO:tasks.kclient:Mounting kernel clients... 2024-02-21T07:42:52.397 INFO:tasks.kclient:config is {'client.0': {}} 2024-02-21T07:42:52.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:52.397 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-02-21T07:42:52.449 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-02-21T07:42:52.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:52.451 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T07:42:52.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:52.537 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2024-02-21T07:42:52.659 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-02-21T07:42:52.659 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-21T07:42:52.659 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-21T07:42:52.659 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T07:42:52.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.836+0000 7fe3d0200640 1 Processor -- start 2024-02-21T07:42:52.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.836+0000 7fe3d0200640 1 -- start start 2024-02-21T07:42:52.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3d0200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe3c817cfb0 0x7fe3c818a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3d0200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3c80f7fc0 0x7fe3c80f8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3d0200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe3c80f8960 0x7fe3c80f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3d0200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c8184720 con 0x7fe3c817cfb0 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3d0200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c8184a00 con 0x7fe3c80f7fc0 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3d0200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c8184ce0 con 0x7fe3c80f8960 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3cd800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe3c817cfb0 0x7fe3c818a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3cd800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe3c817cfb0 0x7fe3c818a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53820/0 (socket says 172.21.15.69:53820) 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3cce00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe3c80f7fc0 0x7fe3c80f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3cd800640 1 -- 172.21.15.69:0/3144374047 learned_addr learned my addr 172.21.15.69:0/3144374047 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3ce200640 1 --2- 172.21.15.69:0/3144374047 >> v2:172.21.15.184:3300/0 conn(0x7fe3c80f8960 0x7fe3c80f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3cd800640 1 -- 172.21.15.69:0/3144374047 >> v2:172.21.15.184:3300/0 conn(0x7fe3c80f8960 msgr2=0x7fe3c80f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3cd800640 1 --2- 172.21.15.69:0/3144374047 >> v2:172.21.15.184:3300/0 conn(0x7fe3c80f8960 0x7fe3c80f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3cd800640 1 -- 172.21.15.69:0/3144374047 >> v2:172.21.15.174:3300/0 conn(0x7fe3c80f7fc0 msgr2=0x7fe3c80f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:52.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3cd800640 1 --2- 172.21.15.69:0/3144374047 >> v2:172.21.15.174:3300/0 conn(0x7fe3c80f7fc0 0x7fe3c80f8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.838+0000 7fe3cd800640 1 -- 172.21.15.69:0/3144374047 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8184fc0 con 0x7fe3c817cfb0 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.840+0000 7fe3cd800640 1 --2- 172.21.15.69:0/3144374047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c817cfb0 0x7fe3c818a6a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80f9e80 tx=0x7fe3bc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d755d4cf2acb54f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.840+0000 7fe3c7e00640 1 -- 172.21.15.69:0/3144374047 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc02d040 con 0x7fe3c817cfb0 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.840+0000 7fe3c7e00640 1 -- 172.21.15.69:0/3144374047 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc031810 con 0x7fe3c817cfb0 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.840+0000 7fe3c7e00640 1 -- 172.21.15.69:0/3144374047 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc031ba0 con 0x7fe3c817cfb0 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.840+0000 7fe3d0200640 1 -- 172.21.15.69:0/3144374047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c817cfb0 msgr2=0x7fe3c818a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.840+0000 7fe3d0200640 1 --2- 172.21.15.69:0/3144374047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c817cfb0 0x7fe3c818a6a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80f9e80 tx=0x7fe3bc02b8b0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.841+0000 7fe3d0200640 1 -- 172.21.15.69:0/3144374047 shutdown_connections 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.841+0000 7fe3d0200640 1 --2- 172.21.15.69:0/3144374047 >> v2:172.21.15.184:3300/0 conn(0x7fe3c80f8960 0x7fe3c80f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.841+0000 7fe3d0200640 1 --2- 172.21.15.69:0/3144374047 >> v2:172.21.15.174:3300/0 conn(0x7fe3c80f7fc0 0x7fe3c80f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.841+0000 7fe3d0200640 1 --2- 172.21.15.69:0/3144374047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c817cfb0 0x7fe3c818a6a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.841+0000 7fe3d0200640 1 -- 172.21.15.69:0/3144374047 >> 172.21.15.69:0/3144374047 conn(0x7fe3c80ce380 msgr2=0x7fe3c80ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:52.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.841+0000 7fe3d0200640 1 -- 172.21.15.69:0/3144374047 shutdown_connections 2024-02-21T07:42:52.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.841+0000 7fe3d0200640 1 -- 172.21.15.69:0/3144374047 wait complete. 2024-02-21T07:42:52.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.843+0000 7fe3d0200640 1 Processor -- start 2024-02-21T07:42:52.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.843+0000 7fe3d0200640 1 -- start start 2024-02-21T07:42:52.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.844+0000 7fe3d0200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3c80f7fc0 0x7fe3c821f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.844+0000 7fe3d0200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c80f8960 0x7fe3c816f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.844+0000 7fe3d0200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3c817cfb0 0x7fe3c8187930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.844+0000 7fe3d0200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c817c5e0 con 0x7fe3c80f8960 2024-02-21T07:42:52.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.844+0000 7fe3d0200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c821f860 con 0x7fe3c817cfb0 2024-02-21T07:42:52.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.844+0000 7fe3d0200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c817b430 con 0x7fe3c80f7fc0 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3cce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c80f8960 0x7fe3c816f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3cce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c80f8960 0x7fe3c816f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53822/0 (socket says 172.21.15.69:53822) 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3cce00640 1 -- 172.21.15.69:0/1744638551 learned_addr learned my addr 172.21.15.69:0/1744638551 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3cd800640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3c80f7fc0 0x7fe3c821f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3ce200640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3c817cfb0 0x7fe3c8187930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3cce00640 1 -- 172.21.15.69:0/1744638551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3c80f7fc0 msgr2=0x7fe3c821f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3cce00640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3c80f7fc0 0x7fe3c821f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3cce00640 1 -- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3c817cfb0 msgr2=0x7fe3c8187930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3cce00640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3c817cfb0 0x7fe3c8187930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3cce00640 1 -- 172.21.15.69:0/1744638551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc0094d0 con 0x7fe3c80f8960 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3ce200640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3c817cfb0 0x7fe3c8187930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3cce00640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c80f8960 0x7fe3c816f3b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400e8a0 tx=0x7fe3b400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.845+0000 7fe3c5600640 1 -- 172.21.15.69:0/1744638551 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400ee90 con 0x7fe3c80f8960 2024-02-21T07:42:52.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.846+0000 7fe3c5600640 1 -- 172.21.15.69:0/1744638551 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b400c940 con 0x7fe3c80f8960 2024-02-21T07:42:52.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.846+0000 7fe3c5600640 1 -- 172.21.15.69:0/1744638551 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400ccf0 con 0x7fe3c80f8960 2024-02-21T07:42:52.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.846+0000 7fe3d0200640 1 -- 172.21.15.69:0/1744638551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c817b680 con 0x7fe3c80f8960 2024-02-21T07:42:52.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.846+0000 7fe3d0200640 1 -- 172.21.15.69:0/1744638551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c817bc40 con 0x7fe3c80f8960 2024-02-21T07:42:52.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.847+0000 7fe3d0200640 1 -- 172.21.15.69:0/1744638551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c817c720 con 0x7fe3c80f8960 2024-02-21T07:42:52.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.849+0000 7fe3c5600640 1 -- 172.21.15.69:0/1744638551 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe3b4013470 con 0x7fe3c80f8960 2024-02-21T07:42:52.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.850+0000 7fe3c5600640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3a809f160 0x7fe3a80a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:52.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.850+0000 7fe3c5600640 1 -- 172.21.15.69:0/1744638551 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe3b40c9cb0 con 0x7fe3c80f8960 2024-02-21T07:42:52.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.850+0000 7fe3cd800640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3a809f160 0x7fe3a80a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:52.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.851+0000 7fe3cd800640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3a809f160 0x7fe3a80a1620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc036000 tx=0x7fe3bc03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:52.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:52.854+0000 7fe3c5600640 1 -- 172.21.15.69:0/1744638551 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe3c817c720 con 0x7fe3c80f8960 2024-02-21T07:42:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.090+0000 7fe3d0200640 1 -- 172.21.15.69:0/1744638551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe3c817c720 con 0x7fe3c80f8960 2024-02-21T07:42:53.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.090+0000 7fe3c5600640 1 -- 172.21.15.69:0/1744638551 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe3c817c720 con 0x7fe3c80f8960 2024-02-21T07:42:53.096 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-21T07:42:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 -- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3a809f160 msgr2=0x7fe3a80a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3a809f160 0x7fe3a80a1620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc036000 tx=0x7fe3bc03c040 comp rx=0 tx=0).stop 2024-02-21T07:42:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 -- 172.21.15.69:0/1744638551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c80f8960 msgr2=0x7fe3c816f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c80f8960 0x7fe3c816f3b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe3b400e8a0 tx=0x7fe3b400ed60 comp rx=0 tx=0).stop 2024-02-21T07:42:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 -- 172.21.15.69:0/1744638551 shutdown_connections 2024-02-21T07:42:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe3a809f160 0x7fe3a80a1620 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe3c817cfb0 0x7fe3c8187930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c80f8960 0x7fe3c816f3b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 --2- 172.21.15.69:0/1744638551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe3c80f7fc0 0x7fe3c821f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:53.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 -- 172.21.15.69:0/1744638551 >> 172.21.15.69:0/1744638551 conn(0x7fe3c80ce380 msgr2=0x7fe3c80701a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:53.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 -- 172.21.15.69:0/1744638551 shutdown_connections 2024-02-21T07:42:53.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:53.093+0000 7fe3d0200640 1 -- 172.21.15.69:0/1744638551 wait complete. 2024-02-21T07:42:53.118 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-21T07:42:53.118 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T07:42:53.118 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2024-02-21T07:42:53.118 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-21T07:42:53.118 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-21T07:42:53.118 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-21T07:42:53.118 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-21T07:42:53.118 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T07:42:53.118 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-21T07:42:53.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:53.119 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2024-02-21T07:42:53.171 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T07:42:53.171 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T07:42:53.171 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T07:42:53.171 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:42:53.171 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2024-02-21T07:42:53.171 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:42:53.171 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:42:53.171 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:42:53.171 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42576sec preferred_lft 42576sec 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link proto kernel_ll 2024-02-21T07:42:53.172 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-02-21T07:42:53.173 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-21T07:42:53.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:53.174 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2024-02-21T07:42:53.174 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-02-21T07:42:53.174 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add name ceph-brx type bridge 2024-02-21T07:42:53.174 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr flush dev ceph-brx 2024-02-21T07:42:53.174 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set ceph-brx up 2024-02-21T07:42:53.174 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-21T07:42:53.174 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-02-21T07:42:53.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:53.388 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T07:42:53.461 INFO:teuthology.orchestra.run.smithi069.stdout:1 2024-02-21T07:42:53.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:53.465 DEBUG:teuthology.orchestra.run.smithi069:> route 2024-02-21T07:42:53.514 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2024-02-21T07:42:53.515 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T07:42:53.515 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T07:42:53.515 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T07:42:53.515 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T07:42:53.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:53.515 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2024-02-21T07:42:53.515 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-02-21T07:42:53.515 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T07:42:53.516 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T07:42:53.516 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T07:42:53.516 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-02-21T07:42:53.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:53.696 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-02-21T07:42:53.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:53.749 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2024-02-21T07:42:53.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:53.802 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2024-02-21T07:42:53.802 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-02-21T07:42:53.802 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-21T07:42:53.802 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-21T07:42:53.802 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-02-21T07:42:53.939 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-21T07:42:53.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:53.939 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2024-02-21T07:42:53.939 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-02-21T07:42:53.940 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-21T07:42:53.940 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-21T07:42:53.940 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-21T07:42:53.940 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-21T07:42:53.940 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-21T07:42:53.940 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-02-21T07:42:54.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:54.198 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2024-02-21T07:42:54.198 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-02-21T07:42:54.198 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2024-02-21T07:42:54.198 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.0 master ceph-brx 2024-02-21T07:42:54.198 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-02-21T07:42:54.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T07:42:54.362 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-21T07:42:54.408 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-21T07:42:54.408 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T07:42:54.408 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-21T07:42:54.502 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-02-21T07:42:54.502 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-02-21T07:42:54.502 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844 2024-02-21T07:42:54.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:54.503 DEBUG:teuthology.orchestra.run.smithi069:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-02-21T07:42:54.636 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-02-21T07:42:54.636 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-02-21T07:42:55.313 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-02-21T07:42:55.314 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-02-21T07:42:55.314 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.174:3300,172.21.15.184:3300" 2024-02-21T07:42:55.314 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with new device syntax: 0@c8bdd735-83bd-400f-baca-e501b49b60ea.cephfs=/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844 2024-02-21T07:42:55.314 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.69:3300/172.21.15.174:3300/172.21.15.184:3300" will pass to kernel 2024-02-21T07:42:55.317 INFO:teuthology.orchestra.run.smithi069.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-21T07:42:55.317 INFO:teuthology.orchestra.run.smithi069.stdout: You just mounted a file system that supports labels which does not 2024-02-21T07:42:55.317 INFO:teuthology.orchestra.run.smithi069.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-21T07:42:55.317 INFO:teuthology.orchestra.run.smithi069.stdout: applications will generate AVC messages and not be allowed access to 2024-02-21T07:42:55.317 INFO:teuthology.orchestra.run.smithi069.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-21T07:42:55.322 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-21T07:42:55.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:55.323 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-21T07:42:55.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:55.419 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T07:42:55.486 INFO:teuthology.orchestra.run.smithi069.stdout:client4890 2024-02-21T07:42:55.487 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:42:55.487 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:42:55.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:55.542 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T07:42:55.616 INFO:teuthology.orchestra.run.smithi069.stdout:client4890 2024-02-21T07:42:55.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:55.617 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T07:42:55.684 INFO:teuthology.orchestra.run.smithi069.stdout:client4890 2024-02-21T07:42:55.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:42:55.685 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/c8bdd735-83bd-400f-baca-e501b49b60ea.client4890/status') 2024-02-21T07:42:55.773 INFO:teuthology.orchestra.run.smithi069.stdout:instance: client.4890 (3)192.168.0.1:0/1173491632 2024-02-21T07:42:55.774 INFO:teuthology.orchestra.run.smithi069.stdout:blocklisted: false 2024-02-21T07:42:55.774 INFO:teuthology.orchestra.run.smithi069.stderr:0+1 records in 2024-02-21T07:42:55.774 INFO:teuthology.orchestra.run.smithi069.stderr:0+1 records out 2024-02-21T07:42:55.774 INFO:teuthology.orchestra.run.smithi069.stderr:69 bytes copied, 9.2522e-05 s, 746 kB/s 2024-02-21T07:42:55.778 INFO:teuthology.run_tasks:Running task exec... 2024-02-21T07:42:55.787 INFO:teuthology.task.exec:Executing custom commands... 2024-02-21T07:42:55.787 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:42:55.788 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-02-21T07:42:55.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.988+0000 7fbc41400640 1 Processor -- start 2024-02-21T07:42:55.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.989+0000 7fbc41400640 1 -- start start 2024-02-21T07:42:55.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc41400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fbc3c0f93a0 0x7fbc3c06f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:55.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc41400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c18b600 con 0x7fbc3c190240 2024-02-21T07:42:55.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc41400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c18b8e0 con 0x7fbc3c0f9800 2024-02-21T07:42:55.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc41400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c18bbc0 con 0x7fbc3c0f93a0 2024-02-21T07:42:55.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc3a800640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fbc3c190240 0x7fbc3c18abc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:41676/0 (socket says 172.21.15.69:41676) 2024-02-21T07:42:55.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc3a800640 1 -- 172.21.15.69:0/311335074 learned_addr learned my addr 172.21.15.69:0/311335074 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:55.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc39e00640 1 --2- 172.21.15.69:0/311335074 >> v2:172.21.15.184:3300/0 conn(0x7fbc3c0f93a0 0x7fbc3c06f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:55.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc39400640 1 -- 172.21.15.69:0/311335074 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307050818 0 0) 0x7fbc3c18b600 con 0x7fbc3c190240 2024-02-21T07:42:55.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc39400640 1 -- 172.21.15.69:0/311335074 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc1c003520 con 0x7fbc3c190240 2024-02-21T07:42:55.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc39e00640 1 -- 172.21.15.69:0/311335074 >> v1:172.21.15.174:6789/0 conn(0x7fbc3c0f9800 legacy=0x7fbc3c0f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:55.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.991+0000 7fbc39400640 1 -- 172.21.15.69:0/311335074 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99314695 0 0) 0x7fbc3c18b8e0 con 0x7fbc3c0f9800 2024-02-21T07:42:55.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.992+0000 7fbc39e00640 1 -- 172.21.15.69:0/311335074 >> v1:172.21.15.69:6789/0 conn(0x7fbc3c190240 legacy=0x7fbc3c18abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:55.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.992+0000 7fbc39e00640 1 -- 172.21.15.69:0/311335074 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c18bea0 con 0x7fbc3c0f93a0 2024-02-21T07:42:55.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.993+0000 7fbc39e00640 1 --2- 172.21.15.69:0/311335074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc3c0f93a0 0x7fbc3c06f150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbc240097a0 tx=0x7fbc2402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8df8fbf772ed69c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:56.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.993+0000 7fbc39400640 1 -- 172.21.15.69:0/311335074 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24031830 con 0x7fbc3c0f93a0 2024-02-21T07:42:56.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.993+0000 7fbc39400640 1 -- 172.21.15.69:0/311335074 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc24031990 con 0x7fbc3c0f93a0 2024-02-21T07:42:56.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.993+0000 7fbc39400640 1 -- 172.21.15.69:0/311335074 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24031d00 con 0x7fbc3c0f93a0 2024-02-21T07:42:56.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.994+0000 7fbc41400640 1 -- 172.21.15.69:0/311335074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc3c0f93a0 msgr2=0x7fbc3c06f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.994+0000 7fbc41400640 1 --2- 172.21.15.69:0/311335074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc3c0f93a0 0x7fbc3c06f150 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbc240097a0 tx=0x7fbc2402b8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.994+0000 7fbc41400640 1 -- 172.21.15.69:0/311335074 shutdown_connections 2024-02-21T07:42:56.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.994+0000 7fbc41400640 1 --2- 172.21.15.69:0/311335074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc3c0f93a0 0x7fbc3c06f150 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.994+0000 7fbc41400640 1 -- 172.21.15.69:0/311335074 >> 172.21.15.69:0/311335074 conn(0x7fbc3c0ce210 msgr2=0x7fbc3c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:56.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.994+0000 7fbc41400640 1 -- 172.21.15.69:0/311335074 shutdown_connections 2024-02-21T07:42:56.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.994+0000 7fbc41400640 1 -- 172.21.15.69:0/311335074 wait complete. 2024-02-21T07:42:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.996+0000 7fbc41400640 1 Processor -- start 2024-02-21T07:42:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.996+0000 7fbc41400640 1 -- start start 2024-02-21T07:42:56.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.997+0000 7fbc41400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc3c0f93a0 0x7fbc3c16e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:56.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.997+0000 7fbc41400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0f9800 0x7fbc3c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:56.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.997+0000 7fbc41400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c190240 0x7fbc3c06f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:56.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.997+0000 7fbc41400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c06eb60 con 0x7fbc3c0f9800 2024-02-21T07:42:56.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.997+0000 7fbc41400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0cc890 con 0x7fbc3c190240 2024-02-21T07:42:56.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.997+0000 7fbc41400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0ccb70 con 0x7fbc3c0f93a0 2024-02-21T07:42:56.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc39e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0f9800 0x7fbc3c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:56.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc39e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0f9800 0x7fbc3c0cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53824/0 (socket says 172.21.15.69:53824) 2024-02-21T07:42:56.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc39e00640 1 -- 172.21.15.69:0/2935078828 learned_addr learned my addr 172.21.15.69:0/2935078828 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:56.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc3a800640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc3c0f93a0 0x7fbc3c16e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:56.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc3b200640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c190240 0x7fbc3c06f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:56.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc39e00640 1 -- 172.21.15.69:0/2935078828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc3c0f93a0 msgr2=0x7fbc3c16e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc39e00640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc3c0f93a0 0x7fbc3c16e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc39e00640 1 -- 172.21.15.69:0/2935078828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c190240 msgr2=0x7fbc3c06f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc39e00640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c190240 0x7fbc3c06f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc39e00640 1 -- 172.21.15.69:0/2935078828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc24009400 con 0x7fbc3c0f9800 2024-02-21T07:42:56.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.998+0000 7fbc39e00640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0f9800 0x7fbc3c0cbde0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbc24034040 tx=0x7fbc240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:56.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.999+0000 7fbc32a00640 1 -- 172.21.15.69:0/2935078828 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc240317b0 con 0x7fbc3c0f9800 2024-02-21T07:42:56.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.999+0000 7fbc32a00640 1 -- 172.21.15.69:0/2935078828 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2403f070 con 0x7fbc3c0f9800 2024-02-21T07:42:56.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.999+0000 7fbc32a00640 1 -- 172.21.15.69:0/2935078828 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24003850 con 0x7fbc3c0f9800 2024-02-21T07:42:56.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.999+0000 7fbc41400640 1 -- 172.21.15.69:0/2935078828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c0cce50 con 0x7fbc3c0f9800 2024-02-21T07:42:56.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:55.999+0000 7fbc41400640 1 -- 172.21.15.69:0/2935078828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c06edb0 con 0x7fbc3c0f9800 2024-02-21T07:42:56.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.000+0000 7fbc41400640 1 -- 172.21.15.69:0/2935078828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c069e60 con 0x7fbc3c0f9800 2024-02-21T07:42:56.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.003+0000 7fbc32a00640 1 -- 172.21.15.69:0/2935078828 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fbc240039b0 con 0x7fbc3c0f9800 2024-02-21T07:42:56.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.005+0000 7fbc32a00640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbc1809f130 0x7fbc180a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:56.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.005+0000 7fbc32a00640 1 -- 172.21.15.69:0/2935078828 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fbc24041070 con 0x7fbc3c0f9800 2024-02-21T07:42:56.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.005+0000 7fbc3a800640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbc1809f130 0x7fbc180a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:56.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.006+0000 7fbc3a800640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbc1809f130 0x7fbc180a15f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0011e0 tx=0x7fbc2c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:56.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.007+0000 7fbc32a00640 1 -- 172.21.15.69:0/2935078828 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbc240b5fb0 con 0x7fbc3c0f9800 2024-02-21T07:42:56.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.242+0000 7fbc41400640 1 -- 172.21.15.69:0/2935078828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7fbc3c1727a0 con 0x7fbc3c0f9800 2024-02-21T07:42:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.502+0000 7fbc32a00640 1 -- 172.21.15.69:0/2935078828 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v19) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbc240b9670 con 0x7fbc3c0f9800 2024-02-21T07:42:56.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.505+0000 7fbc41400640 1 -- 172.21.15.69:0/2935078828 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbc1809f130 msgr2=0x7fbc180a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.505+0000 7fbc41400640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbc1809f130 0x7fbc180a15f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0011e0 tx=0x7fbc2c007d30 comp rx=0 tx=0).stop 2024-02-21T07:42:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.505+0000 7fbc41400640 1 -- 172.21.15.69:0/2935078828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0f9800 msgr2=0x7fbc3c0cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.505+0000 7fbc41400640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0f9800 0x7fbc3c0cbde0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbc24034040 tx=0x7fbc240046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.506+0000 7fbc41400640 1 -- 172.21.15.69:0/2935078828 shutdown_connections 2024-02-21T07:42:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.506+0000 7fbc41400640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fbc1809f130 0x7fbc180a15f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.506+0000 7fbc41400640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fbc3c190240 0x7fbc3c06f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.506+0000 7fbc41400640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0f9800 0x7fbc3c0cbde0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.506+0000 7fbc41400640 1 --2- 172.21.15.69:0/2935078828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc3c0f93a0 0x7fbc3c16e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.506+0000 7fbc41400640 1 -- 172.21.15.69:0/2935078828 >> 172.21.15.69:0/2935078828 conn(0x7fbc3c0ce210 msgr2=0x7fbc3c18ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.506+0000 7fbc41400640 1 -- 172.21.15.69:0/2935078828 shutdown_connections 2024-02-21T07:42:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.506+0000 7fbc41400640 1 -- 172.21.15.69:0/2935078828 wait complete. 2024-02-21T07:42:56.533 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-02-21T07:42:56.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.734+0000 7fb139400640 1 Processor -- start 2024-02-21T07:42:56.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.734+0000 7fb139400640 1 -- start start 2024-02-21T07:42:56.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.736+0000 7fb139400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1340d1f90 0x7fb1340f7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:56.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.736+0000 7fb139400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1340f8110 0x7fb1340f8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:56.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.736+0000 7fb139400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1340f90d0 con 0x7fb134182e80 2024-02-21T07:42:56.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.736+0000 7fb139400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb134183260 con 0x7fb1340d1f90 2024-02-21T07:42:56.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.736+0000 7fb139400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1340d0ac0 con 0x7fb1340f8110 2024-02-21T07:42:56.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb132800640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb134182e80 0x7fb1340d1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:59340/0 (socket says 172.21.15.69:59340) 2024-02-21T07:42:56.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb132800640 1 -- 172.21.15.69:0/3268046608 learned_addr learned my addr 172.21.15.69:0/3268046608 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:56.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb133200640 1 --2- 172.21.15.69:0/3268046608 >> v2:172.21.15.184:3300/0 conn(0x7fb1340f8110 0x7fb1340f8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:56.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb131e00640 1 --2- 172.21.15.69:0/3268046608 >> v2:172.21.15.174:3300/0 conn(0x7fb1340d1f90 0x7fb1340f7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:56.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb131400640 1 -- 172.21.15.69:0/3268046608 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460951213 0 0) 0x7fb1340f90d0 con 0x7fb134182e80 2024-02-21T07:42:56.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb131400640 1 -- 172.21.15.69:0/3268046608 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb118003520 con 0x7fb134182e80 2024-02-21T07:42:56.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb133200640 1 -- 172.21.15.69:0/3268046608 >> v2:172.21.15.174:3300/0 conn(0x7fb1340d1f90 msgr2=0x7fb1340f7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:56.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb133200640 1 --2- 172.21.15.69:0/3268046608 >> v2:172.21.15.174:3300/0 conn(0x7fb1340d1f90 0x7fb1340f7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb133200640 1 -- 172.21.15.69:0/3268046608 >> v1:172.21.15.184:6789/0 conn(0x7fb134182e80 legacy=0x7fb1340d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb133200640 1 -- 172.21.15.69:0/3268046608 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1340d0da0 con 0x7fb1340f8110 2024-02-21T07:42:56.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.737+0000 7fb131e00640 1 --2- 172.21.15.69:0/3268046608 >> v2:172.21.15.174:3300/0 conn(0x7fb1340d1f90 0x7fb1340f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:56.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.738+0000 7fb133200640 1 --2- 172.21.15.69:0/3268046608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1340f8110 0x7fb1340f8520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb1340f42b0 tx=0x7fb12c02bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba0d7deaaf58f65 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:56.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.739+0000 7fb131400640 1 -- 172.21.15.69:0/3268046608 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c02cb50 con 0x7fb1340f8110 2024-02-21T07:42:56.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.739+0000 7fb131400640 1 -- 172.21.15.69:0/3268046608 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c02ccb0 con 0x7fb1340f8110 2024-02-21T07:42:56.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.739+0000 7fb131400640 1 -- 172.21.15.69:0/3268046608 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c034660 con 0x7fb1340f8110 2024-02-21T07:42:56.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.739+0000 7fb139400640 1 -- 172.21.15.69:0/3268046608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1340f8110 msgr2=0x7fb1340f8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.739+0000 7fb139400640 1 --2- 172.21.15.69:0/3268046608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1340f8110 0x7fb1340f8520 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb1340f42b0 tx=0x7fb12c02bda0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.739+0000 7fb139400640 1 -- 172.21.15.69:0/3268046608 shutdown_connections 2024-02-21T07:42:56.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.739+0000 7fb139400640 1 --2- 172.21.15.69:0/3268046608 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb1340f8110 0x7fb1340f8520 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.739+0000 7fb139400640 1 --2- 172.21.15.69:0/3268046608 >> v2:172.21.15.174:3300/0 conn(0x7fb1340d1f90 0x7fb1340f7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.739+0000 7fb139400640 1 -- 172.21.15.69:0/3268046608 >> 172.21.15.69:0/3268046608 conn(0x7fb1340ce1a0 msgr2=0x7fb1340ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:56.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.740+0000 7fb139400640 1 -- 172.21.15.69:0/3268046608 shutdown_connections 2024-02-21T07:42:56.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.740+0000 7fb139400640 1 -- 172.21.15.69:0/3268046608 wait complete. 2024-02-21T07:42:56.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.741+0000 7fb139400640 1 Processor -- start 2024-02-21T07:42:56.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.742+0000 7fb139400640 1 -- start start 2024-02-21T07:42:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb139400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1340d1f90 0x7fb1342225a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb139400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1340f8110 0x7fb134222ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb139400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb134182e80 0x7fb13415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb139400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13416ceb0 con 0x7fb1340d1f90 2024-02-21T07:42:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb139400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13415e330 con 0x7fb1340f8110 2024-02-21T07:42:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb139400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13416c8f0 con 0x7fb134182e80 2024-02-21T07:42:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb132800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1340d1f90 0x7fb1342225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb131e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1340f8110 0x7fb134222ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb132800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1340d1f90 0x7fb1342225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53838/0 (socket says 172.21.15.69:53838) 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb132800640 1 -- 172.21.15.69:0/3548917574 learned_addr learned my addr 172.21.15.69:0/3548917574 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.743+0000 7fb133200640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb134182e80 0x7fb13415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb132800640 1 -- 172.21.15.69:0/3548917574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb134182e80 msgr2=0x7fb13415c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb132800640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb134182e80 0x7fb13415c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb132800640 1 -- 172.21.15.69:0/3548917574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1340f8110 msgr2=0x7fb134222ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb132800640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1340f8110 0x7fb134222ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb132800640 1 -- 172.21.15.69:0/3548917574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120009400 con 0x7fb1340d1f90 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb131e00640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1340f8110 0x7fb134222ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb132800640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1340d1f90 0x7fb1342225a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb12400c460 tx=0x7fb12400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb12aa00640 1 -- 172.21.15.69:0/3548917574 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124005ce0 con 0x7fb1340d1f90 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb12aa00640 1 -- 172.21.15.69:0/3548917574 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb124005e40 con 0x7fb1340d1f90 2024-02-21T07:42:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb139400640 1 -- 172.21.15.69:0/3548917574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c009a70 con 0x7fb1340d1f90 2024-02-21T07:42:56.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb12aa00640 1 -- 172.21.15.69:0/3548917574 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124007290 con 0x7fb1340d1f90 2024-02-21T07:42:56.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.744+0000 7fb139400640 1 -- 172.21.15.69:0/3548917574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13415dce0 con 0x7fb1340d1f90 2024-02-21T07:42:56.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.746+0000 7fb139400640 1 -- 172.21.15.69:0/3548917574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1340d0790 con 0x7fb1340d1f90 2024-02-21T07:42:56.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.748+0000 7fb12aa00640 1 -- 172.21.15.69:0/3548917574 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fb1240073f0 con 0x7fb1340d1f90 2024-02-21T07:42:56.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.749+0000 7fb12aa00640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb11409f160 0x7fb1140a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:56.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.749+0000 7fb12aa00640 1 -- 172.21.15.69:0/3548917574 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb1240c8fe0 con 0x7fb1340d1f90 2024-02-21T07:42:56.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.750+0000 7fb131e00640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb11409f160 0x7fb1140a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:56.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.750+0000 7fb131e00640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb11409f160 0x7fb1140a1620 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb120009fd0 tx=0x7fb120009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:56.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.753+0000 7fb12aa00640 1 -- 172.21.15.69:0/3548917574 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb1340d0790 con 0x7fb1340d1f90 2024-02-21T07:42:56.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.979+0000 7fb139400640 1 -- 172.21.15.69:0/3548917574 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1340d1360 con 0x7fb11409f160 2024-02-21T07:42:56.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.986+0000 7fb12aa00640 1 -- 172.21.15.69:0/3548917574 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7fb120009c70 con 0x7fb11409f160 2024-02-21T07:42:56.992 INFO:teuthology.orchestra.run.smithi069.stdout:{} 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 -- 172.21.15.69:0/3548917574 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb11409f160 msgr2=0x7fb1140a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb11409f160 0x7fb1140a1620 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb120009fd0 tx=0x7fb120009190 comp rx=0 tx=0).stop 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 -- 172.21.15.69:0/3548917574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1340d1f90 msgr2=0x7fb1342225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1340d1f90 0x7fb1342225a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb12400c460 tx=0x7fb12400c920 comp rx=0 tx=0).stop 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 -- 172.21.15.69:0/3548917574 shutdown_connections 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb11409f160 0x7fb1140a1620 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb134182e80 0x7fb13415c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb1340f8110 0x7fb134222ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 --2- 172.21.15.69:0/3548917574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1340d1f90 0x7fb1342225a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 -- 172.21.15.69:0/3548917574 >> 172.21.15.69:0/3548917574 conn(0x7fb1340ce1a0 msgr2=0x7fb1340ce580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 -- 172.21.15.69:0/3548917574 shutdown_connections 2024-02-21T07:42:56.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:56.989+0000 7fb139400640 1 -- 172.21.15.69:0/3548917574 wait complete. 2024-02-21T07:42:57.013 INFO:teuthology.run_tasks:Running task check-counter... 2024-02-21T07:42:57.024 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-02-21T07:42:57.065 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:57.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.275+0000 7f75dce00640 1 Processor -- start 2024-02-21T07:42:57.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.276+0000 7f75dce00640 1 -- start start 2024-02-21T07:42:57.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.277+0000 7f75dce00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d8187740 con 0x7f75d80f6310 2024-02-21T07:42:57.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.277+0000 7f75dce00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d80ce230 con 0x7f75d8183fa0 2024-02-21T07:42:57.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.277+0000 7f75dce00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d8184380 con 0x7f75d80cd090 2024-02-21T07:42:57.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d5e00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f75d8183fa0 0x7f75d8188270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:42856/0 (socket says 172.21.15.69:42856) 2024-02-21T07:42:57.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d5e00640 1 -- 172.21.15.69:0/841127393 learned_addr learned my addr 172.21.15.69:0/841127393 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226386393 0 0) 0x7f75d8184380 con 0x7f75d80cd090 2024-02-21T07:42:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75bc003520 con 0x7f75d80cd090 2024-02-21T07:42:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568122289 0 0) 0x7f75d8187740 con 0x7f75d80f6310 2024-02-21T07:42:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d8184380 con 0x7f75d80f6310 2024-02-21T07:42:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334197495 0 0) 0x7f75d80ce230 con 0x7f75d8183fa0 2024-02-21T07:42:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d8187740 con 0x7f75d8183fa0 2024-02-21T07:42:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 <== mon.2 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1316454592 0 0) 0x7f75bc003520 con 0x7f75d80cd090 2024-02-21T07:42:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 >> v1:172.21.15.174:6789/0 conn(0x7f75d8183fa0 legacy=0x7f75d8188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 >> v1:172.21.15.69:6789/0 conn(0x7f75d80f6310 legacy=0x7f75d806ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.278+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d80cd6b0 con 0x7f75d80cd090 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 <== mon.2 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f75c40015a0 con 0x7f75d80cd090 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 >> v1:172.21.15.184:6789/0 conn(0x7f75d80cd090 legacy=0x7f75d8188980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d4a00640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc004dc0 0x7f75bc0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d4a00640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc003870 0x7f75bc003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d4a00640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75bc009970 0x7f75bc00bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0001590 con 0x7f75bc004dc0 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc00c380 con 0x7f75bc009970 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc00c540 con 0x7f75bc003870 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d5400640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc003870 0x7f75bc003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d5e00640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc004dc0 0x7f75bc0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d6800640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75bc009970 0x7f75bc00bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d5400640 1 -- 172.21.15.69:0/841127393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75bc009970 msgr2=0x7f75bc00bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d5400640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75bc009970 0x7f75bc00bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d5400640 1 -- 172.21.15.69:0/841127393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc004dc0 msgr2=0x7f75bc0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:57.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d5400640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc004dc0 0x7f75bc0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d5400640 1 -- 172.21.15.69:0/841127393 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc003520 con 0x7f75bc003870 2024-02-21T07:42:57.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d5e00640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc004dc0 0x7f75bc0051a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:57.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.279+0000 7f75d6800640 1 -- 172.21.15.69:0/841127393 reap_dead start 2024-02-21T07:42:57.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.280+0000 7f75d5400640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc003870 0x7f75bc003cf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f75c4007e00 tx=0x7f75bc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7b60ef7444cca45 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:57.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.281+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4007230 con 0x7f75bc003870 2024-02-21T07:42:57.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.281+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c40073b0 con 0x7f75bc003870 2024-02-21T07:42:57.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.281+0000 7f75d4a00640 1 -- 172.21.15.69:0/841127393 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40067d0 con 0x7f75bc003870 2024-02-21T07:42:57.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.281+0000 7f75dce00640 1 -- 172.21.15.69:0/841127393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc003870 msgr2=0x7f75bc003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.281+0000 7f75dce00640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc003870 0x7f75bc003cf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f75c4007e00 tx=0x7f75bc0057f0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.281+0000 7f75dce00640 1 -- 172.21.15.69:0/841127393 shutdown_connections 2024-02-21T07:42:57.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.281+0000 7f75dce00640 1 --2- 172.21.15.69:0/841127393 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75bc003870 0x7f75bc003cf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.281+0000 7f75dce00640 1 -- 172.21.15.69:0/841127393 >> 172.21.15.69:0/841127393 conn(0x7f75d80f69c0 msgr2=0x7f75d80f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:57.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.282+0000 7f75dce00640 1 -- 172.21.15.69:0/841127393 shutdown_connections 2024-02-21T07:42:57.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.282+0000 7f75dce00640 1 -- 172.21.15.69:0/841127393 wait complete. 2024-02-21T07:42:57.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.284+0000 7f75dce00640 1 Processor -- start 2024-02-21T07:42:57.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.284+0000 7f75dce00640 1 -- start start 2024-02-21T07:42:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75dce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc003870 0x7f75d821e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75dce00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d81830b0 0x7f75d8179b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75dce00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d82200c0 0x7f75d8220540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75dce00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d821fc30 con 0x7f75bc003870 2024-02-21T07:42:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75dce00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d821f2d0 con 0x7f75d82200c0 2024-02-21T07:42:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75dce00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d821f900 con 0x7f75d81830b0 2024-02-21T07:42:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75d5e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc003870 0x7f75d821e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75d5e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc003870 0x7f75d821e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53850/0 (socket says 172.21.15.69:53850) 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75d5e00640 1 -- 172.21.15.69:0/2183575816 learned_addr learned my addr 172.21.15.69:0/2183575816 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75d6800640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d82200c0 0x7f75d8220540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.285+0000 7f75d5400640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d81830b0 0x7f75d8179b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75d5e00640 1 -- 172.21.15.69:0/2183575816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d81830b0 msgr2=0x7f75d8179b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75d5e00640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d81830b0 0x7f75d8179b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75d5e00640 1 -- 172.21.15.69:0/2183575816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d82200c0 msgr2=0x7f75d8220540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75d5e00640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d82200c0 0x7f75d8220540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75d5e00640 1 -- 172.21.15.69:0/2183575816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d821ea30 con 0x7f75bc003870 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75d5e00640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc003870 0x7f75d821e360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f75c8007290 tx=0x7f75c8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75ce000640 1 -- 172.21.15.69:0/2183575816 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8004e40 con 0x7f75bc003870 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75ce000640 1 -- 172.21.15.69:0/2183575816 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c800f940 con 0x7f75bc003870 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75ce000640 1 -- 172.21.15.69:0/2183575816 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800fcb0 con 0x7f75bc003870 2024-02-21T07:42:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75dce00640 1 -- 172.21.15.69:0/2183575816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d821ed10 con 0x7f75bc003870 2024-02-21T07:42:57.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.286+0000 7f75dce00640 1 -- 172.21.15.69:0/2183575816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d8183530 con 0x7f75bc003870 2024-02-21T07:42:57.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.288+0000 7f75dce00640 1 -- 172.21.15.69:0/2183575816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d821fa70 con 0x7f75bc003870 2024-02-21T07:42:57.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.290+0000 7f75ce000640 1 -- 172.21.15.69:0/2183575816 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f75c801d460 con 0x7f75bc003870 2024-02-21T07:42:57.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.292+0000 7f75ce000640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f75b809f160 0x7f75b80a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.292+0000 7f75ce000640 1 -- 172.21.15.69:0/2183575816 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f75c80c9970 con 0x7f75bc003870 2024-02-21T07:42:57.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.292+0000 7f75d5400640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f75b809f160 0x7f75b80a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.293+0000 7f75d5400640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f75b809f160 0x7f75b80a1620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f75c4035000 tx=0x7f75c4009070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:57.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.296+0000 7f75ce000640 1 -- 172.21.15.69:0/2183575816 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f75d821fa70 con 0x7f75bc003870 2024-02-21T07:42:57.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.494+0000 7f75dce00640 1 -- 172.21.15.69:0/2183575816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75d821fa70 con 0x7f75bc003870 2024-02-21T07:42:57.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.496+0000 7f75ce000640 1 -- 172.21.15.69:0/2183575816 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23736 (secure 0 0 0) 0x7f75d821fa70 con 0x7f75bc003870 2024-02-21T07:42:57.503 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:57.503 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":31,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:48.463144+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:57.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 -- 172.21.15.69:0/2183575816 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f75b809f160 msgr2=0x7f75b80a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f75b809f160 0x7f75b80a1620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f75c4035000 tx=0x7f75c4009070 comp rx=0 tx=0).stop 2024-02-21T07:42:57.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 -- 172.21.15.69:0/2183575816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc003870 msgr2=0x7f75d821e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc003870 0x7f75d821e360 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f75c8007290 tx=0x7f75c8007750 comp rx=0 tx=0).stop 2024-02-21T07:42:57.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 -- 172.21.15.69:0/2183575816 shutdown_connections 2024-02-21T07:42:57.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f75b809f160 0x7f75b80a1620 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f75d82200c0 0x7f75d8220540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f75d81830b0 0x7f75d8179b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 --2- 172.21.15.69:0/2183575816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75bc003870 0x7f75d821e360 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 -- 172.21.15.69:0/2183575816 >> 172.21.15.69:0/2183575816 conn(0x7f75d80f69c0 msgr2=0x7f75d80d1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:57.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 -- 172.21.15.69:0/2183575816 shutdown_connections 2024-02-21T07:42:57.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.499+0000 7f75dce00640 1 -- 172.21.15.69:0/2183575816 wait complete. 2024-02-21T07:42:57.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:41:56.520105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:42:00.759386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:42:01.409274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:42:05.025537+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:42:57.527 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:42:57.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.727+0000 7f88e7200640 1 Processor -- start 2024-02-21T07:42:57.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.728+0000 7f88e7200640 1 -- start start 2024-02-21T07:42:57.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88e7200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f88e018b8d0 0x7f88e0189df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88e7200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f88e0188d50 0x7f88e01891e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88e7200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e0186f80 con 0x7f88e0188970 2024-02-21T07:42:57.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88e7200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e018bd30 con 0x7f88e0188d50 2024-02-21T07:42:57.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88e7200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e018a330 con 0x7f88e018b8d0 2024-02-21T07:42:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88dfe00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f88e0188970 0x7f88e0186870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:41690/0 (socket says 172.21.15.69:41690) 2024-02-21T07:42:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88dfe00640 1 -- 172.21.15.69:0/2474817461 learned_addr learned my addr 172.21.15.69:0/2474817461 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88e5200640 1 --2- 172.21.15.69:0/2474817461 >> v2:172.21.15.69:3300/0 conn(0x7f88e0188d50 0x7f88e01891e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88df400640 1 --2- 172.21.15.69:0/2474817461 >> v2:172.21.15.174:3300/0 conn(0x7f88e018b8d0 0x7f88e0189df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88dea00640 1 -- 172.21.15.69:0/2474817461 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931732291 0 0) 0x7f88d0001110 con 0x7f88e0188970 2024-02-21T07:42:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88dea00640 1 -- 172.21.15.69:0/2474817461 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88c0003520 con 0x7f88e0188970 2024-02-21T07:42:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88e5200640 1 -- 172.21.15.69:0/2474817461 >> v2:172.21.15.174:3300/0 conn(0x7f88e018b8d0 msgr2=0x7f88e0189df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.730+0000 7f88e5200640 1 --2- 172.21.15.69:0/2474817461 >> v2:172.21.15.174:3300/0 conn(0x7f88e018b8d0 0x7f88e0189df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.731+0000 7f88e5200640 1 -- 172.21.15.69:0/2474817461 >> v1:172.21.15.69:6789/0 conn(0x7f88e0188970 legacy=0x7f88e0186870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.731+0000 7f88e5200640 1 -- 172.21.15.69:0/2474817461 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e018b440 con 0x7f88e0188d50 2024-02-21T07:42:57.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.732+0000 7f88e5200640 1 --2- 172.21.15.69:0/2474817461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 0x7f88e01891e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f88e00d0500 tx=0x7f88d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea3b337600b0be0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:57.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.732+0000 7f88dea00640 1 -- 172.21.15.69:0/2474817461 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8031830 con 0x7f88e0188d50 2024-02-21T07:42:57.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.732+0000 7f88dea00640 1 -- 172.21.15.69:0/2474817461 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8031990 con 0x7f88e0188d50 2024-02-21T07:42:57.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.732+0000 7f88dea00640 1 -- 172.21.15.69:0/2474817461 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d8031d20 con 0x7f88e0188d50 2024-02-21T07:42:57.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.732+0000 7f88e7200640 1 -- 172.21.15.69:0/2474817461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 msgr2=0x7f88e01891e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.732+0000 7f88e7200640 1 --2- 172.21.15.69:0/2474817461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 0x7f88e01891e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f88e00d0500 tx=0x7f88d802b8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.733+0000 7f88e7200640 1 -- 172.21.15.69:0/2474817461 shutdown_connections 2024-02-21T07:42:57.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.733+0000 7f88e7200640 1 --2- 172.21.15.69:0/2474817461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 0x7f88e01891e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.733+0000 7f88e7200640 1 --2- 172.21.15.69:0/2474817461 >> v2:172.21.15.174:3300/0 conn(0x7f88e018b8d0 0x7f88e0189df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.733+0000 7f88e7200640 1 -- 172.21.15.69:0/2474817461 >> 172.21.15.69:0/2474817461 conn(0x7f88e00d2940 msgr2=0x7f88e00d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:57.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.733+0000 7f88e7200640 1 -- 172.21.15.69:0/2474817461 shutdown_connections 2024-02-21T07:42:57.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.733+0000 7f88e7200640 1 -- 172.21.15.69:0/2474817461 wait complete. 2024-02-21T07:42:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.735+0000 7f88e7200640 1 Processor -- start 2024-02-21T07:42:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.735+0000 7f88e7200640 1 -- start start 2024-02-21T07:42:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.736+0000 7f88e7200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88e0188970 0x7f88e021f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.736+0000 7f88e7200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 0x7f88e015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.736+0000 7f88e7200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e018b8d0 0x7f88e01846a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.736+0000 7f88e7200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e021fd80 con 0x7f88e0188d50 2024-02-21T07:42:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.736+0000 7f88e7200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e0184210 con 0x7f88e0188970 2024-02-21T07:42:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.736+0000 7f88e7200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00fe2a0 con 0x7f88e018b8d0 2024-02-21T07:42:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.736+0000 7f88df400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 0x7f88e015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.736+0000 7f88df400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 0x7f88e015a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53858/0 (socket says 172.21.15.69:53858) 2024-02-21T07:42:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.736+0000 7f88df400640 1 -- 172.21.15.69:0/3181686949 learned_addr learned my addr 172.21.15.69:0/3181686949 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88e5200640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e018b8d0 0x7f88e01846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88df400640 1 -- 172.21.15.69:0/3181686949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e018b8d0 msgr2=0x7f88e01846a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88df400640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e018b8d0 0x7f88e01846a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88df400640 1 -- 172.21.15.69:0/3181686949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88e0188970 msgr2=0x7f88e021f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88df400640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88e0188970 0x7f88e021f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88df400640 1 -- 172.21.15.69:0/3181686949 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8009400 con 0x7f88e0188d50 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88df400640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 0x7f88e015a6b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88c800efc0 tx=0x7f88c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88d7e00640 1 -- 172.21.15.69:0/3181686949 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8014480 con 0x7f88e0188d50 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88d7e00640 1 -- 172.21.15.69:0/3181686949 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c800f040 con 0x7f88e0188d50 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88d7e00640 1 -- 172.21.15.69:0/3181686949 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8014800 con 0x7f88e0188d50 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88e7200640 1 -- 172.21.15.69:0/3181686949 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e0183600 con 0x7f88e0188d50 2024-02-21T07:42:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.737+0000 7f88e7200640 1 -- 172.21.15.69:0/3181686949 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e0183bc0 con 0x7f88e0188d50 2024-02-21T07:42:57.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.739+0000 7f88e7200640 1 -- 172.21.15.69:0/3181686949 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e0069d50 con 0x7f88e0188d50 2024-02-21T07:42:57.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.740+0000 7f88d7e00640 1 -- 172.21.15.69:0/3181686949 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f88c8014960 con 0x7f88e0188d50 2024-02-21T07:42:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.742+0000 7f88d7e00640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f88bc09f130 0x7f88bc0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.742+0000 7f88d7e00640 1 -- 172.21.15.69:0/3181686949 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f88c80cace0 con 0x7f88e0188d50 2024-02-21T07:42:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.742+0000 7f88dfe00640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f88bc09f130 0x7f88bc0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.743+0000 7f88dfe00640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f88bc09f130 0x7f88bc0a15f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f88d0000f60 tx=0x7f88d0001110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.746+0000 7f88d7e00640 1 -- 172.21.15.69:0/3181686949 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f88c8094900 con 0x7f88e0188d50 2024-02-21T07:42:57.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.940+0000 7f88e7200640 1 -- 172.21.15.69:0/3181686949 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88e00d32a0 con 0x7f88e0188d50 2024-02-21T07:42:57.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.941+0000 7f88d7e00640 1 -- 172.21.15.69:0/3181686949 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88c8097fc0 con 0x7f88e0188d50 2024-02-21T07:42:57.947 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-02-21T07:42:57.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 -- 172.21.15.69:0/3181686949 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f88bc09f130 msgr2=0x7f88bc0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f88bc09f130 0x7f88bc0a15f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f88d0000f60 tx=0x7f88d0001110 comp rx=0 tx=0).stop 2024-02-21T07:42:57.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 -- 172.21.15.69:0/3181686949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 msgr2=0x7f88e015a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:57.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 0x7f88e015a6b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88c800efc0 tx=0x7f88c800c490 comp rx=0 tx=0).stop 2024-02-21T07:42:57.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 -- 172.21.15.69:0/3181686949 shutdown_connections 2024-02-21T07:42:57.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f88bc09f130 0x7f88bc0a15f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f88e018b8d0 0x7f88e01846a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88e0188d50 0x7f88e015a6b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 --2- 172.21.15.69:0/3181686949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f88e0188970 0x7f88e021f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:57.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 -- 172.21.15.69:0/3181686949 >> 172.21.15.69:0/3181686949 conn(0x7f88e00d2940 msgr2=0x7f88e00d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:57.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 -- 172.21.15.69:0/3181686949 shutdown_connections 2024-02-21T07:42:57.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:57.944+0000 7f88e7200640 1 -- 172.21.15.69:0/3181686949 wait complete. 2024-02-21T07:42:57.969 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:42:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.176+0000 7f546b400640 1 Processor -- start 2024-02-21T07:42:58.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.177+0000 7f546b400640 1 -- start start 2024-02-21T07:42:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.179+0000 7f546b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5464183ea0 0x7f54641846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.179+0000 7f546b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54641850b0 con 0x7f54640eed50 2024-02-21T07:42:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.179+0000 7f546b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5464185390 con 0x7f5464184c20 2024-02-21T07:42:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.179+0000 7f546b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5464186010 con 0x7f5464183ea0 2024-02-21T07:42:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.179+0000 7f5463e00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f5464184c20 0x7f54640ee640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:59354/0 (socket says 172.21.15.69:59354) 2024-02-21T07:42:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.179+0000 7f5463e00640 1 -- 172.21.15.69:0/1358579384 learned_addr learned my addr 172.21.15.69:0/1358579384 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.179+0000 7f5469400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f54640eed50 0x7f5464186bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:41706/0 (socket says 172.21.15.69:41706) 2024-02-21T07:42:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.179+0000 7f5468a00640 1 --2- 172.21.15.69:0/1358579384 >> v2:172.21.15.69:3300/0 conn(0x7f5464183ea0 0x7f54641846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.180+0000 7f5463400640 1 -- 172.21.15.69:0/1358579384 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369998558 0 0) 0x7f54641850b0 con 0x7f54640eed50 2024-02-21T07:42:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.180+0000 7f5463400640 1 -- 172.21.15.69:0/1358579384 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f544c003520 con 0x7f54640eed50 2024-02-21T07:42:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.180+0000 7f5463400640 1 -- 172.21.15.69:0/1358579384 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506473906 0 0) 0x7f5464185390 con 0x7f5464184c20 2024-02-21T07:42:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.180+0000 7f5468a00640 1 -- 172.21.15.69:0/1358579384 >> v1:172.21.15.184:6789/0 conn(0x7f5464184c20 legacy=0x7f54640ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.180+0000 7f5468a00640 1 -- 172.21.15.69:0/1358579384 >> v1:172.21.15.69:6789/0 conn(0x7f54640eed50 legacy=0x7f5464186bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.180+0000 7f5468a00640 1 -- 172.21.15.69:0/1358579384 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464185670 con 0x7f5464183ea0 2024-02-21T07:42:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.181+0000 7f5468a00640 1 --2- 172.21.15.69:0/1358579384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5464183ea0 0x7f54641846e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54580097a0 tx=0x7f545802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608de92d87595af0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.181+0000 7f5463400640 1 -- 172.21.15.69:0/1358579384 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458031830 con 0x7f5464183ea0 2024-02-21T07:42:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.181+0000 7f5463400640 1 -- 172.21.15.69:0/1358579384 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5458031990 con 0x7f5464183ea0 2024-02-21T07:42:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.181+0000 7f5463400640 1 -- 172.21.15.69:0/1358579384 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458031d20 con 0x7f5464183ea0 2024-02-21T07:42:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.182+0000 7f546b400640 1 -- 172.21.15.69:0/1358579384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5464183ea0 msgr2=0x7f54641846e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.182+0000 7f546b400640 1 --2- 172.21.15.69:0/1358579384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5464183ea0 0x7f54641846e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54580097a0 tx=0x7f545802b8d0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.182+0000 7f546b400640 1 -- 172.21.15.69:0/1358579384 shutdown_connections 2024-02-21T07:42:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.182+0000 7f546b400640 1 --2- 172.21.15.69:0/1358579384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5464183ea0 0x7f54641846e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.182+0000 7f546b400640 1 -- 172.21.15.69:0/1358579384 >> 172.21.15.69:0/1358579384 conn(0x7f54640ce3d0 msgr2=0x7f54640ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.182+0000 7f546b400640 1 -- 172.21.15.69:0/1358579384 shutdown_connections 2024-02-21T07:42:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.182+0000 7f546b400640 1 -- 172.21.15.69:0/1358579384 wait complete. 2024-02-21T07:42:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.184+0000 7f546b400640 1 Processor -- start 2024-02-21T07:42:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.184+0000 7f546b400640 1 -- start start 2024-02-21T07:42:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.185+0000 7f546b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54640eed50 0x7f546421c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.185+0000 7f546b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464183ea0 0x7f546421db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.185+0000 7f546b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f546421ebe0 0x7f5464156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.185+0000 7f546b400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546421c7b0 con 0x7f54640eed50 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.185+0000 7f546b400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546421ca90 con 0x7f546421ebe0 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.185+0000 7f546b400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546421cd70 con 0x7f5464183ea0 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5463e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464183ea0 0x7f546421db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5468a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54640eed50 0x7f546421c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5463e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464183ea0 0x7f546421db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:58970/0 (socket says 172.21.15.69:58970) 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5463e00640 1 -- 172.21.15.69:0/852171254 learned_addr learned my addr 172.21.15.69:0/852171254 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5469400640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f546421ebe0 0x7f5464156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5463e00640 1 -- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f546421ebe0 msgr2=0x7f5464156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5463e00640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f546421ebe0 0x7f5464156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5463e00640 1 -- 172.21.15.69:0/852171254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54640eed50 msgr2=0x7f546421c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5463e00640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54640eed50 0x7f546421c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5463e00640 1 -- 172.21.15.69:0/852171254 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5458009400 con 0x7f5464183ea0 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5469400640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f546421ebe0 0x7f5464156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5463e00640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464183ea0 0x7f546421db30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f545000c4a0 tx=0x7f545000c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:58.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.186+0000 7f5460c00640 1 -- 172.21.15.69:0/852171254 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500074e0 con 0x7f5464183ea0 2024-02-21T07:42:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.187+0000 7f5460c00640 1 -- 172.21.15.69:0/852171254 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450007640 con 0x7f5464183ea0 2024-02-21T07:42:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.187+0000 7f5460c00640 1 -- 172.21.15.69:0/852171254 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450004a00 con 0x7f5464183ea0 2024-02-21T07:42:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.187+0000 7f546b400640 1 -- 172.21.15.69:0/852171254 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54641865b0 con 0x7f5464183ea0 2024-02-21T07:42:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.187+0000 7f546b400640 1 -- 172.21.15.69:0/852171254 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546421d330 con 0x7f5464183ea0 2024-02-21T07:42:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.188+0000 7f546b400640 1 -- 172.21.15.69:0/852171254 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5464186410 con 0x7f5464183ea0 2024-02-21T07:42:58.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.190+0000 7f5460c00640 1 -- 172.21.15.69:0/852171254 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5450004b60 con 0x7f5464183ea0 2024-02-21T07:42:58.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.191+0000 7f5460c00640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f544409f0e0 0x7f54440a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.191+0000 7f5460c00640 1 -- 172.21.15.69:0/852171254 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f54500c9000 con 0x7f5464183ea0 2024-02-21T07:42:58.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.191+0000 7f5468a00640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f544409f0e0 0x7f54440a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.192+0000 7f5468a00640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f544409f0e0 0x7f54440a15a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5458036000 tx=0x7f545803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:58.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.193+0000 7f5460c00640 1 -- 172.21.15.69:0/852171254 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5450092d00 con 0x7f5464183ea0 2024-02-21T07:42:58.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.389+0000 7f546b400640 1 -- 172.21.15.69:0/852171254 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5464186410 con 0x7f5464183ea0 2024-02-21T07:42:58.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.390+0000 7f5460c00640 1 -- 172.21.15.69:0/852171254 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5464186410 con 0x7f5464183ea0 2024-02-21T07:42:58.396 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:42:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 -- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f544409f0e0 msgr2=0x7f54440a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f544409f0e0 0x7f54440a15a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5458036000 tx=0x7f545803d040 comp rx=0 tx=0).stop 2024-02-21T07:42:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 -- 172.21.15.69:0/852171254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464183ea0 msgr2=0x7f546421db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464183ea0 0x7f546421db30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f545000c4a0 tx=0x7f545000c960 comp rx=0 tx=0).stop 2024-02-21T07:42:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 -- 172.21.15.69:0/852171254 shutdown_connections 2024-02-21T07:42:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f544409f0e0 0x7f54440a15a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f546421ebe0 0x7f5464156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5464183ea0 0x7f546421db30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 --2- 172.21.15.69:0/852171254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54640eed50 0x7f546421c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 -- 172.21.15.69:0/852171254 >> 172.21.15.69:0/852171254 conn(0x7f54640ce3d0 msgr2=0x7f54640ee590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 -- 172.21.15.69:0/852171254 shutdown_connections 2024-02-21T07:42:58.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.393+0000 7f546b400640 1 -- 172.21.15.69:0/852171254 wait complete. 2024-02-21T07:42:58.417 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:42:58.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.628+0000 7f2f34800640 1 Processor -- start 2024-02-21T07:42:58.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.628+0000 7f2f34800640 1 -- start start 2024-02-21T07:42:58.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.630+0000 7f2f34800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2f2c183ea0 0x7f2f2c1846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.630+0000 7f2f34800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2f2c0eed50 0x7f2f2c186bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.630+0000 7f2f34800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c1850b0 con 0x7f2f2c184c20 2024-02-21T07:42:58.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.630+0000 7f2f34800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c186010 con 0x7f2f2c0eed50 2024-02-21T07:42:58.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.630+0000 7f2f34800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c185390 con 0x7f2f2c183ea0 2024-02-21T07:42:58.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.631+0000 7f2f31e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f2f2c183ea0 0x7f2f2c1846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.631+0000 7f2f31400640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2f2c184c20 0x7f2f2c0ee640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:59360/0 (socket says 172.21.15.69:59360) 2024-02-21T07:42:58.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.631+0000 7f2f31400640 1 -- 172.21.15.69:0/2833329759 learned_addr learned my addr 172.21.15.69:0/2833329759 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:58.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.631+0000 7f2f32800640 1 --2- 172.21.15.69:0/2833329759 >> v2:172.21.15.69:3300/0 conn(0x7f2f2c0eed50 0x7f2f2c186bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.631+0000 7f2f30a00640 1 -- 172.21.15.69:0/2833329759 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324698391 0 0) 0x7f2f2c1850b0 con 0x7f2f2c184c20 2024-02-21T07:42:58.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.631+0000 7f2f31e00640 1 -- 172.21.15.69:0/2833329759 >> v2:172.21.15.69:3300/0 conn(0x7f2f2c0eed50 msgr2=0x7f2f2c186bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:58.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.631+0000 7f2f31e00640 1 --2- 172.21.15.69:0/2833329759 >> v2:172.21.15.69:3300/0 conn(0x7f2f2c0eed50 0x7f2f2c186bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.631+0000 7f2f31e00640 1 -- 172.21.15.69:0/2833329759 >> v1:172.21.15.184:6789/0 conn(0x7f2f2c184c20 legacy=0x7f2f2c0ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.631+0000 7f2f31e00640 1 -- 172.21.15.69:0/2833329759 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c185670 con 0x7f2f2c183ea0 2024-02-21T07:42:58.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.632+0000 7f2f31e00640 1 --2- 172.21.15.69:0/2833329759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2c183ea0 0x7f2f2c1846e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0742d0 tx=0x7f2f2002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca9f31e0088d6b14 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:58.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f30a00640 1 -- 172.21.15.69:0/2833329759 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2002e070 con 0x7f2f2c183ea0 2024-02-21T07:42:58.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f30a00640 1 -- 172.21.15.69:0/2833329759 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f200315a0 con 0x7f2f2c183ea0 2024-02-21T07:42:58.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f30a00640 1 -- 172.21.15.69:0/2833329759 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f20031930 con 0x7f2f2c183ea0 2024-02-21T07:42:58.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f34800640 1 -- 172.21.15.69:0/2833329759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2c183ea0 msgr2=0x7f2f2c1846e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f34800640 1 --2- 172.21.15.69:0/2833329759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2c183ea0 0x7f2f2c1846e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0742d0 tx=0x7f2f2002b840 comp rx=0 tx=0).stop 2024-02-21T07:42:58.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f34800640 1 -- 172.21.15.69:0/2833329759 shutdown_connections 2024-02-21T07:42:58.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f34800640 1 --2- 172.21.15.69:0/2833329759 >> v2:172.21.15.69:3300/0 conn(0x7f2f2c0eed50 0x7f2f2c186bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f34800640 1 --2- 172.21.15.69:0/2833329759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2c183ea0 0x7f2f2c1846e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f34800640 1 -- 172.21.15.69:0/2833329759 >> 172.21.15.69:0/2833329759 conn(0x7f2f2c0ce3d0 msgr2=0x7f2f2c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:58.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f34800640 1 -- 172.21.15.69:0/2833329759 shutdown_connections 2024-02-21T07:42:58.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.633+0000 7f2f34800640 1 -- 172.21.15.69:0/2833329759 wait complete. 2024-02-21T07:42:58.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.635+0000 7f2f34800640 1 Processor -- start 2024-02-21T07:42:58.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.635+0000 7f2f34800640 1 -- start start 2024-02-21T07:42:58.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f34800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2c0eed50 0x7f2f2c1727f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f34800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f2c183ea0 0x7f2f2c0f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f34800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f2c0f4cc0 0x7f2f2c179be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f34800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c17ada0 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f34800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0ed7d0 con 0x7f2f2c183ea0 2024-02-21T07:42:58.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f34800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c17aac0 con 0x7f2f2c0eed50 2024-02-21T07:42:58.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f31e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2c0eed50 0x7f2f2c1727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f32800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f2c0f4cc0 0x7f2f2c179be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f32800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f2c0f4cc0 0x7f2f2c179be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53904/0 (socket says 172.21.15.69:53904) 2024-02-21T07:42:58.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f32800640 1 -- 172.21.15.69:0/3848129968 learned_addr learned my addr 172.21.15.69:0/3848129968 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:58.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f31400640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f2c183ea0 0x7f2f2c0f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f32800640 1 -- 172.21.15.69:0/3848129968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2c0eed50 msgr2=0x7f2f2c1727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f32800640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2c0eed50 0x7f2f2c1727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f32800640 1 -- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f2c183ea0 msgr2=0x7f2f2c0f4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f32800640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f2c183ea0 0x7f2f2c0f4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f32800640 1 -- 172.21.15.69:0/3848129968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f20009400 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.637+0000 7f2f31400640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f2c183ea0 0x7f2f2c0f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:58.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.638+0000 7f2f32800640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f2c0f4cc0 0x7f2f2c179be0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800efc0 tx=0x7f2f2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:58.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.638+0000 7f2f26000640 1 -- 172.21.15.69:0/3848129968 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28009ba0 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.638+0000 7f2f26000640 1 -- 172.21.15.69:0/3848129968 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2800f040 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.638+0000 7f2f26000640 1 -- 172.21.15.69:0/3848129968 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f280146c0 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.638+0000 7f2f34800640 1 -- 172.21.15.69:0/3848129968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c1865b0 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.638+0000 7f2f34800640 1 -- 172.21.15.69:0/3848129968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c224220 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.639+0000 7f2f34800640 1 -- 172.21.15.69:0/3848129968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c186410 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.641+0000 7f2f26000640 1 -- 172.21.15.69:0/3848129968 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f2f28014820 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.643+0000 7f2f26000640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2f1009f160 0x7f2f100a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:58.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.643+0000 7f2f26000640 1 -- 172.21.15.69:0/3848129968 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2f280ca760 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.643+0000 7f2f31e00640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2f1009f160 0x7f2f100a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:58.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.644+0000 7f2f31e00640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2f1009f160 0x7f2f100a1620 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2f20036000 tx=0x7f2f2003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:58.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.647+0000 7f2f26000640 1 -- 172.21.15.69:0/3848129968 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2f2c186410 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.838+0000 7f2f34800640 1 -- 172.21.15.69:0/3848129968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f2c186410 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.838+0000 7f2f26000640 1 -- 172.21.15.69:0/3848129968 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f2c186410 con 0x7f2f2c0f4cc0 2024-02-21T07:42:58.844 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 -- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2f1009f160 msgr2=0x7f2f100a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2f1009f160 0x7f2f100a1620 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2f20036000 tx=0x7f2f2003d040 comp rx=0 tx=0).stop 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 -- 172.21.15.69:0/3848129968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f2c0f4cc0 msgr2=0x7f2f2c179be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f2c0f4cc0 0x7f2f2c179be0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800efc0 tx=0x7f2f2800c490 comp rx=0 tx=0).stop 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 -- 172.21.15.69:0/3848129968 shutdown_connections 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2f1009f160 0x7f2f100a1620 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f2c0f4cc0 0x7f2f2c179be0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2f2c183ea0 0x7f2f2c0f4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 --2- 172.21.15.69:0/3848129968 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2f2c0eed50 0x7f2f2c1727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 -- 172.21.15.69:0/3848129968 >> 172.21.15.69:0/3848129968 conn(0x7f2f2c0ce3d0 msgr2=0x7f2f2c0f06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:58.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 -- 172.21.15.69:0/3848129968 shutdown_connections 2024-02-21T07:42:58.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:58.841+0000 7f2f34800640 1 -- 172.21.15.69:0/3848129968 wait complete. 2024-02-21T07:42:58.866 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:42:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.068+0000 7f7a79600640 1 Processor -- start 2024-02-21T07:42:59.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.069+0000 7f7a79600640 1 -- start start 2024-02-21T07:42:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.070+0000 7f7a79600640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f7a74183670 0x7f7a741850e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.070+0000 7f7a79600640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a74184c50 con 0x7f7a7417f700 2024-02-21T07:42:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.071+0000 7f7a79600640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a74183af0 con 0x7f7a74185cc0 2024-02-21T07:42:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.071+0000 7f7a79600640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a74185620 con 0x7f7a74183670 2024-02-21T07:42:59.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.071+0000 7f7a72a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7a7417f700 0x7f7a740cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:57254/0 (socket says 172.21.15.69:57254) 2024-02-21T07:42:59.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.071+0000 7f7a72a00640 1 -- 172.21.15.69:0/3382039371 learned_addr learned my addr 172.21.15.69:0/3382039371 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:59.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.071+0000 7f7a6a000640 1 --2- 172.21.15.69:0/3382039371 >> v2:172.21.15.174:3300/0 conn(0x7f7a74183670 0x7f7a741850e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.071+0000 7f7a72000640 1 -- 172.21.15.69:0/3382039371 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389480774 0 0) 0x7f7a74183af0 con 0x7f7a74185cc0 2024-02-21T07:42:59.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.071+0000 7f7a72000640 1 -- 172.21.15.69:0/3382039371 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a58005730 con 0x7f7a74185cc0 2024-02-21T07:42:59.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.071+0000 7f7a72000640 1 -- 172.21.15.69:0/3382039371 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512500150 0 0) 0x7f7a74184c50 con 0x7f7a7417f700 2024-02-21T07:42:59.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.071+0000 7f7a72000640 1 -- 172.21.15.69:0/3382039371 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a74183af0 con 0x7f7a7417f700 2024-02-21T07:42:59.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.072+0000 7f7a6a000640 1 -- 172.21.15.69:0/3382039371 >> v1:172.21.15.184:6789/0 conn(0x7f7a74185cc0 legacy=0x7f7a74186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.072+0000 7f7a72000640 1 -- 172.21.15.69:0/3382039371 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1578500844 0 0) 0x7f7a74183af0 con 0x7f7a7417f700 2024-02-21T07:42:59.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.072+0000 7f7a6a000640 1 -- 172.21.15.69:0/3382039371 >> v1:172.21.15.69:6789/0 conn(0x7f7a7417f700 legacy=0x7f7a740cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.072+0000 7f7a6a000640 1 -- 172.21.15.69:0/3382039371 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a74183d60 con 0x7f7a74183670 2024-02-21T07:42:59.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.073+0000 7f7a6a000640 1 --2- 172.21.15.69:0/3382039371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a74183670 0x7f7a741850e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009720 tx=0x7f7a5c02b600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dead20ad75c7af8d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:59.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.073+0000 7f7a72000640 1 -- 172.21.15.69:0/3382039371 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64001670 con 0x7f7a74183670 2024-02-21T07:42:59.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.073+0000 7f7a72000640 1 -- 172.21.15.69:0/3382039371 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c02e050 con 0x7f7a74183670 2024-02-21T07:42:59.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.073+0000 7f7a72000640 1 -- 172.21.15.69:0/3382039371 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c001970 con 0x7f7a74183670 2024-02-21T07:42:59.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.074+0000 7f7a79600640 1 -- 172.21.15.69:0/3382039371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a74183670 msgr2=0x7f7a741850e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.074+0000 7f7a79600640 1 --2- 172.21.15.69:0/3382039371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a74183670 0x7f7a741850e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009720 tx=0x7f7a5c02b600 comp rx=0 tx=0).stop 2024-02-21T07:42:59.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.074+0000 7f7a79600640 1 -- 172.21.15.69:0/3382039371 shutdown_connections 2024-02-21T07:42:59.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.074+0000 7f7a79600640 1 --2- 172.21.15.69:0/3382039371 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a74183670 0x7f7a741850e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.074+0000 7f7a79600640 1 -- 172.21.15.69:0/3382039371 >> 172.21.15.69:0/3382039371 conn(0x7f7a740ce3d0 msgr2=0x7f7a740ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:59.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.074+0000 7f7a79600640 1 -- 172.21.15.69:0/3382039371 shutdown_connections 2024-02-21T07:42:59.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.074+0000 7f7a79600640 1 -- 172.21.15.69:0/3382039371 wait complete. 2024-02-21T07:42:59.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.076+0000 7f7a79600640 1 Processor -- start 2024-02-21T07:42:59.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.076+0000 7f7a79600640 1 -- start start 2024-02-21T07:42:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a79600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a7417f700 0x7f7a74188310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a79600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a74183670 0x7f7a7421f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a79600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74185cc0 0x7f7a74221d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a79600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a74169ef0 con 0x7f7a74183670 2024-02-21T07:42:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a79600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a742215c0 con 0x7f7a7417f700 2024-02-21T07:42:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a79600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a74220240 con 0x7f7a74185cc0 2024-02-21T07:42:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a6a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a74183670 0x7f7a7421f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a6a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a74183670 0x7f7a7421f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36630/0 (socket says 172.21.15.69:36630) 2024-02-21T07:42:59.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a6a000640 1 -- 172.21.15.69:0/1145636677 learned_addr learned my addr 172.21.15.69:0/1145636677 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a73400640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74185cc0 0x7f7a74221d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.077+0000 7f7a72a00640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a7417f700 0x7f7a74188310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a6a000640 1 -- 172.21.15.69:0/1145636677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74185cc0 msgr2=0x7f7a74221d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a6a000640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74185cc0 0x7f7a74221d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a6a000640 1 -- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a7417f700 msgr2=0x7f7a74188310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a6a000640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a7417f700 0x7f7a74188310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a6a000640 1 -- 172.21.15.69:0/1145636677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c009400 con 0x7f7a74183670 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a72a00640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a7417f700 0x7f7a74188310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a6a000640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a74183670 0x7f7a7421f750 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009720 tx=0x7f7a5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a6b400640 1 -- 172.21.15.69:0/1145636677 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c03c470 con 0x7f7a74183670 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a6b400640 1 -- 172.21.15.69:0/1145636677 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5c03c5d0 con 0x7f7a74183670 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a6b400640 1 -- 172.21.15.69:0/1145636677 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5c03c980 con 0x7f7a74183670 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a79600640 1 -- 172.21.15.69:0/1145636677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a74220520 con 0x7f7a74183670 2024-02-21T07:42:59.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.078+0000 7f7a79600640 1 -- 172.21.15.69:0/1145636677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a74220ae0 con 0x7f7a74183670 2024-02-21T07:42:59.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.080+0000 7f7a79600640 1 -- 172.21.15.69:0/1145636677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a74069d50 con 0x7f7a74183670 2024-02-21T07:42:59.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.081+0000 7f7a6b400640 1 -- 172.21.15.69:0/1145636677 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f7a5c039040 con 0x7f7a74183670 2024-02-21T07:42:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.083+0000 7f7a6b400640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7a5009f130 0x7f7a500a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.084+0000 7f7a6b400640 1 -- 172.21.15.69:0/1145636677 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7a5c0eb4d0 con 0x7f7a74183670 2024-02-21T07:42:59.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.084+0000 7f7a72a00640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7a5009f130 0x7f7a500a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.085+0000 7f7a72a00640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7a5009f130 0x7f7a500a15f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7a64000f60 tx=0x7f7a64000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:59.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.088+0000 7f7a6b400640 1 -- 172.21.15.69:0/1145636677 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f7a5c0b50c0 con 0x7f7a74183670 2024-02-21T07:42:59.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.273+0000 7f7a79600640 1 -- 172.21.15.69:0/1145636677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7a74072de0 con 0x7f7a74183670 2024-02-21T07:42:59.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.274+0000 7f7a6b400640 1 -- 172.21.15.69:0/1145636677 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7a5c0370a0 con 0x7f7a74183670 2024-02-21T07:42:59.280 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:42:59.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.276+0000 7f7a79600640 1 -- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7a5009f130 msgr2=0x7f7a500a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.276+0000 7f7a79600640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7a5009f130 0x7f7a500a15f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7a64000f60 tx=0x7f7a64000ed0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.276+0000 7f7a79600640 1 -- 172.21.15.69:0/1145636677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a74183670 msgr2=0x7f7a7421f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.276+0000 7f7a79600640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a74183670 0x7f7a7421f750 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c009720 tx=0x7f7a5c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.276+0000 7f7a79600640 1 -- 172.21.15.69:0/1145636677 shutdown_connections 2024-02-21T07:42:59.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.276+0000 7f7a79600640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f7a5009f130 0x7f7a500a15f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.276+0000 7f7a79600640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a74185cc0 0x7f7a74221d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.276+0000 7f7a79600640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a74183670 0x7f7a7421f750 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.276+0000 7f7a79600640 1 --2- 172.21.15.69:0/1145636677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a7417f700 0x7f7a74188310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.276+0000 7f7a79600640 1 -- 172.21.15.69:0/1145636677 >> 172.21.15.69:0/1145636677 conn(0x7f7a740ce3d0 msgr2=0x7f7a740f2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:59.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.277+0000 7f7a79600640 1 -- 172.21.15.69:0/1145636677 shutdown_connections 2024-02-21T07:42:59.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.277+0000 7f7a79600640 1 -- 172.21.15.69:0/1145636677 wait complete. 2024-02-21T07:42:59.301 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:42:59.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.494+0000 7f5b43400640 1 Processor -- start 2024-02-21T07:42:59.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.494+0000 7f5b43400640 1 -- start start 2024-02-21T07:42:59.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.496+0000 7f5b43400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5b3c189dd0 0x7f5b3c18a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.496+0000 7f5b43400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c06d5c0 con 0x7f5b3c18bed0 2024-02-21T07:42:59.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.497+0000 7f5b43400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3c1896e0 con 0x7f5b3c18c2b0 2024-02-21T07:42:59.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.497+0000 7f5b43400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3c06d810 con 0x7f5b3c189dd0 2024-02-21T07:42:59.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.497+0000 7f5b33e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5b3c189dd0 0x7f5b3c18a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.497+0000 7f5b40a00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f5b3c18bed0 0x7f5b3c0f9450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:40002/0 (socket says 172.21.15.69:40002) 2024-02-21T07:42:59.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.497+0000 7f5b40a00640 1 -- 172.21.15.69:0/2022982114 learned_addr learned my addr 172.21.15.69:0/2022982114 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:59.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.497+0000 7f5b33e00640 1 -- 172.21.15.69:0/2022982114 >> v1:172.21.15.184:6789/0 conn(0x7f5b3c18c2b0 legacy=0x7f5b3c18c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.497+0000 7f5b33e00640 1 -- 172.21.15.69:0/2022982114 >> v1:172.21.15.174:6789/0 conn(0x7f5b3c18bed0 legacy=0x7f5b3c0f9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.497+0000 7f5b3be00640 1 -- 172.21.15.69:0/2022982114 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654123054 0 0) 0x7f5b3c06d5c0 con 0x7f5b3c18bed0 2024-02-21T07:42:59.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.497+0000 7f5b33e00640 1 -- 172.21.15.69:0/2022982114 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c06daf0 con 0x7f5b3c189dd0 2024-02-21T07:42:59.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.498+0000 7f5b33e00640 1 --2- 172.21.15.69:0/2022982114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c189dd0 0x7f5b3c18a230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009720 tx=0x7f5b2402b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a1e299e5c0575f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:59.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.499+0000 7f5b3be00640 1 -- 172.21.15.69:0/2022982114 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24030710 con 0x7f5b3c189dd0 2024-02-21T07:42:59.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.499+0000 7f5b3be00640 1 -- 172.21.15.69:0/2022982114 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2402e050 con 0x7f5b3c189dd0 2024-02-21T07:42:59.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.499+0000 7f5b3be00640 1 -- 172.21.15.69:0/2022982114 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24030a90 con 0x7f5b3c189dd0 2024-02-21T07:42:59.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.499+0000 7f5b43400640 1 -- 172.21.15.69:0/2022982114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c189dd0 msgr2=0x7f5b3c18a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.499+0000 7f5b43400640 1 --2- 172.21.15.69:0/2022982114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c189dd0 0x7f5b3c18a230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009720 tx=0x7f5b2402b6a0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.499+0000 7f5b43400640 1 -- 172.21.15.69:0/2022982114 shutdown_connections 2024-02-21T07:42:59.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.499+0000 7f5b43400640 1 --2- 172.21.15.69:0/2022982114 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c189dd0 0x7f5b3c18a230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.499+0000 7f5b43400640 1 -- 172.21.15.69:0/2022982114 >> 172.21.15.69:0/2022982114 conn(0x7f5b3c0f71f0 msgr2=0x7f5b3c0f7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:59.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.499+0000 7f5b43400640 1 -- 172.21.15.69:0/2022982114 shutdown_connections 2024-02-21T07:42:59.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.500+0000 7f5b43400640 1 -- 172.21.15.69:0/2022982114 wait complete. 2024-02-21T07:42:59.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.501+0000 7f5b43400640 1 Processor -- start 2024-02-21T07:42:59.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.502+0000 7f5b43400640 1 -- start start 2024-02-21T07:42:59.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b43400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b3c189dd0 0x7f5b3c1890d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b43400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c18bed0 0x7f5b3c180850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b43400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b3c18c2b0 0x7f5b3c06b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b43400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c16b2d0 con 0x7f5b3c189dd0 2024-02-21T07:42:59.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b43400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c06b160 con 0x7f5b3c18bed0 2024-02-21T07:42:59.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b43400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c212990 con 0x7f5b3c18c2b0 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b40a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b3c189dd0 0x7f5b3c1890d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b33e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c18bed0 0x7f5b3c180850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b40a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b3c189dd0 0x7f5b3c1890d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36644/0 (socket says 172.21.15.69:36644) 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b33e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c18bed0 0x7f5b3c180850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38210/0 (socket says 172.21.15.69:38210) 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b40a00640 1 -- 172.21.15.69:0/1613337162 learned_addr learned my addr 172.21.15.69:0/1613337162 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.503+0000 7f5b41400640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b3c18c2b0 0x7f5b3c06b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b40a00640 1 -- 172.21.15.69:0/1613337162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b3c18c2b0 msgr2=0x7f5b3c06b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b40a00640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b3c18c2b0 0x7f5b3c06b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b40a00640 1 -- 172.21.15.69:0/1613337162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c18bed0 msgr2=0x7f5b3c180850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b40a00640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c18bed0 0x7f5b3c180850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b40a00640 1 -- 172.21.15.69:0/1613337162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24009400 con 0x7f5b3c189dd0 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b33e00640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c18bed0 0x7f5b3c180850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b40a00640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b3c189dd0 0x7f5b3c1890d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00c4a0 tx=0x7f5b2c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b39600640 1 -- 172.21.15.69:0/1613337162 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0074e0 con 0x7f5b3c189dd0 2024-02-21T07:42:59.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b39600640 1 -- 172.21.15.69:0/1613337162 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c007640 con 0x7f5b3c189dd0 2024-02-21T07:42:59.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b39600640 1 -- 172.21.15.69:0/1613337162 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c004a00 con 0x7f5b3c189dd0 2024-02-21T07:42:59.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b43400640 1 -- 172.21.15.69:0/1613337162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c212c70 con 0x7f5b3c189dd0 2024-02-21T07:42:59.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.504+0000 7f5b43400640 1 -- 172.21.15.69:0/1613337162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c213230 con 0x7f5b3c189dd0 2024-02-21T07:42:59.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.506+0000 7f5b43400640 1 -- 172.21.15.69:0/1613337162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c069d50 con 0x7f5b3c189dd0 2024-02-21T07:42:59.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.508+0000 7f5b39600640 1 -- 172.21.15.69:0/1613337162 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5b2c004b60 con 0x7f5b3c189dd0 2024-02-21T07:42:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.510+0000 7f5b39600640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b1809f130 0x7f5b180a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.510+0000 7f5b39600640 1 -- 172.21.15.69:0/1613337162 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5b2c0c9140 con 0x7f5b3c189dd0 2024-02-21T07:42:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.510+0000 7f5b33e00640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b1809f130 0x7f5b180a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.511+0000 7f5b33e00640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b1809f130 0x7f5b180a15f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b24034000 tx=0x7f5b24008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:59.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.514+0000 7f5b39600640 1 -- 172.21.15.69:0/1613337162 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5b2c092e90 con 0x7f5b3c189dd0 2024-02-21T07:42:59.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.712+0000 7f5b43400640 1 -- 172.21.15.69:0/1613337162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b3c0cc5f0 con 0x7f5b3c189dd0 2024-02-21T07:42:59.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.713+0000 7f5b39600640 1 -- 172.21.15.69:0/1613337162 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23736 (secure 0 0 0) 0x7f5b2c094dc0 con 0x7f5b3c189dd0 2024-02-21T07:42:59.720 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:42:59.720 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":31,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:48.463144+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:42:59.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 -- 172.21.15.69:0/1613337162 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b1809f130 msgr2=0x7f5b180a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b1809f130 0x7f5b180a15f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b24034000 tx=0x7f5b24008030 comp rx=0 tx=0).stop 2024-02-21T07:42:59.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 -- 172.21.15.69:0/1613337162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b3c189dd0 msgr2=0x7f5b3c1890d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b3c189dd0 0x7f5b3c1890d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00c4a0 tx=0x7f5b2c00c960 comp rx=0 tx=0).stop 2024-02-21T07:42:59.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 -- 172.21.15.69:0/1613337162 shutdown_connections 2024-02-21T07:42:59.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5b1809f130 0x7f5b180a15f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b3c18c2b0 0x7f5b3c06b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5b3c18bed0 0x7f5b3c180850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 --2- 172.21.15.69:0/1613337162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b3c189dd0 0x7f5b3c1890d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 -- 172.21.15.69:0/1613337162 >> 172.21.15.69:0/1613337162 conn(0x7f5b3c0f71f0 msgr2=0x7f5b3c179130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:59.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 -- 172.21.15.69:0/1613337162 shutdown_connections 2024-02-21T07:42:59.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.716+0000 7f5b43400640 1 -- 172.21.15.69:0/1613337162 wait complete. 2024-02-21T07:42:59.740 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:41:56.520105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:42:00.759386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:42:01.409274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:42:05.025537+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:42:59.741 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:42:59.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.948+0000 7f421ec00640 1 Processor -- start 2024-02-21T07:42:59.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.948+0000 7f421ec00640 1 -- start start 2024-02-21T07:42:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.950+0000 7f421ec00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4218180690 0x7f4218184570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.950+0000 7f421ec00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4218184ab0 0x7f421818a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421ec00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42181863e0 con 0x7f421818a5f0 2024-02-21T07:42:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421ec00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4218185060 con 0x7f4218184ab0 2024-02-21T07:42:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421ec00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4218185340 con 0x7f4218180690 2024-02-21T07:42:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421ce00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4218184ab0 0x7f421818a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421d800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f4218180690 0x7f4218184570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421e200640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f421818a5f0 0x7f42180f1930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:40004/0 (socket says 172.21.15.69:40004) 2024-02-21T07:42:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421e200640 1 -- 172.21.15.69:0/332279238 learned_addr learned my addr 172.21.15.69:0/332279238 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:42:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421ce00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4218184ab0 0x7f421818a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36652/0 (socket says 172.21.15.69:36652) 2024-02-21T07:42:59.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421d800640 1 -- 172.21.15.69:0/332279238 >> v2:172.21.15.69:3300/0 conn(0x7f4218184ab0 msgr2=0x7f421818a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:42:59.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421d800640 1 --2- 172.21.15.69:0/332279238 >> v2:172.21.15.69:3300/0 conn(0x7f4218184ab0 0x7f421818a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421d800640 1 -- 172.21.15.69:0/332279238 >> v1:172.21.15.174:6789/0 conn(0x7f421818a5f0 legacy=0x7f42180f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f421d800640 1 -- 172.21.15.69:0/332279238 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218185620 con 0x7f4218180690 2024-02-21T07:42:59.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.951+0000 7f4217e00640 1 -- 172.21.15.69:0/332279238 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908174434 0 0) 0x7f42181863e0 con 0x7f421818a5f0 2024-02-21T07:42:59.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.953+0000 7f421d800640 1 --2- 172.21.15.69:0/332279238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4218180690 0x7f4218184570 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42180cf2d0 tx=0x7f420c02b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7da6e794bac1f934 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.953+0000 7f4217e00640 1 -- 172.21.15.69:0/332279238 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c031710 con 0x7f4218180690 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.953+0000 7f4217e00640 1 -- 172.21.15.69:0/332279238 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c02f050 con 0x7f4218180690 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.953+0000 7f4217e00640 1 -- 172.21.15.69:0/332279238 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c031a90 con 0x7f4218180690 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.953+0000 7f421ec00640 1 -- 172.21.15.69:0/332279238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4218180690 msgr2=0x7f4218184570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.953+0000 7f421ec00640 1 --2- 172.21.15.69:0/332279238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4218180690 0x7f4218184570 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42180cf2d0 tx=0x7f420c02b7b0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.954+0000 7f421ec00640 1 -- 172.21.15.69:0/332279238 shutdown_connections 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.954+0000 7f421ec00640 1 --2- 172.21.15.69:0/332279238 >> v2:172.21.15.69:3300/0 conn(0x7f4218184ab0 0x7f421818a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.954+0000 7f421ec00640 1 --2- 172.21.15.69:0/332279238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f4218180690 0x7f4218184570 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.954+0000 7f421ec00640 1 -- 172.21.15.69:0/332279238 >> 172.21.15.69:0/332279238 conn(0x7f42180ce1b0 msgr2=0x7f42180ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.954+0000 7f421ec00640 1 -- 172.21.15.69:0/332279238 shutdown_connections 2024-02-21T07:42:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.954+0000 7f421ec00640 1 -- 172.21.15.69:0/332279238 wait complete. 2024-02-21T07:42:59.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.956+0000 7f421ec00640 1 Processor -- start 2024-02-21T07:42:59.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.956+0000 7f421ec00640 1 -- start start 2024-02-21T07:42:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421ec00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4218180690 0x7f421816d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421ec00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4218184ab0 0x7f421821e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421ec00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f421818a5f0 0x7f421821ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421ec00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421821f790 con 0x7f4218184ab0 2024-02-21T07:42:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421ec00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42181834a0 con 0x7f421818a5f0 2024-02-21T07:42:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421ec00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4218183780 con 0x7f4218180690 2024-02-21T07:42:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421ce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4218184ab0 0x7f421821e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421ce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4218184ab0 0x7f421821e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36654/0 (socket says 172.21.15.69:36654) 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421ce00640 1 -- 172.21.15.69:0/330880418 learned_addr learned my addr 172.21.15.69:0/330880418 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421d800640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4218180690 0x7f421816d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.957+0000 7f421e200640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f421818a5f0 0x7f421821ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f421d800640 1 -- 172.21.15.69:0/330880418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f421818a5f0 msgr2=0x7f421821ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f421d800640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f421818a5f0 0x7f421821ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f421d800640 1 -- 172.21.15.69:0/330880418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4218184ab0 msgr2=0x7f421821e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f421d800640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4218184ab0 0x7f421821e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f421d800640 1 -- 172.21.15.69:0/330880418 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c009400 con 0x7f4218180690 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f421ce00640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4218184ab0 0x7f421821e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f421d800640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4218180690 0x7f421816d710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42180c8b90 tx=0x7f420c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f4215600640 1 -- 172.21.15.69:0/330880418 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c03c8d0 con 0x7f4218180690 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f4215600640 1 -- 172.21.15.69:0/330880418 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c03ca50 con 0x7f4218180690 2024-02-21T07:42:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f4215600640 1 -- 172.21.15.69:0/330880418 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c03ce00 con 0x7f4218180690 2024-02-21T07:42:59.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.958+0000 7f421ec00640 1 -- 172.21.15.69:0/330880418 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4218183a60 con 0x7f4218180690 2024-02-21T07:42:59.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.959+0000 7f421ec00640 1 -- 172.21.15.69:0/330880418 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42180c8f40 con 0x7f4218180690 2024-02-21T07:42:59.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.960+0000 7f421ec00640 1 -- 172.21.15.69:0/330880418 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42180cb0a0 con 0x7f4218180690 2024-02-21T07:42:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.962+0000 7f4215600640 1 -- 172.21.15.69:0/330880418 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f420c03a040 con 0x7f4218180690 2024-02-21T07:42:59.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.963+0000 7f4215600640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41f809f130 0x7f41f80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:42:59.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.964+0000 7f4215600640 1 -- 172.21.15.69:0/330880418 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f420c0eb510 con 0x7f4218180690 2024-02-21T07:42:59.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.964+0000 7f421ce00640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41f809f130 0x7f41f80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:42:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.964+0000 7f421ce00640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41f809f130 0x7f41f80a15f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f42180f89b0 tx=0x7f4204009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:42:59.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:42:59.965+0000 7f4215600640 1 -- 172.21.15.69:0/330880418 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f420c0b5150 con 0x7f4218180690 2024-02-21T07:43:00.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.163+0000 7f421ec00640 1 -- 172.21.15.69:0/330880418 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4218069c10 con 0x7f4218180690 2024-02-21T07:43:00.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.164+0000 7f4215600640 1 -- 172.21.15.69:0/330880418 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f420c038020 con 0x7f4218180690 2024-02-21T07:43:00.170 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-02-21T07:43:00.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.166+0000 7f421ec00640 1 -- 172.21.15.69:0/330880418 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41f809f130 msgr2=0x7f41f80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.166+0000 7f421ec00640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41f809f130 0x7f41f80a15f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f42180f89b0 tx=0x7f4204009190 comp rx=0 tx=0).stop 2024-02-21T07:43:00.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.167+0000 7f421ec00640 1 -- 172.21.15.69:0/330880418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4218180690 msgr2=0x7f421816d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.167+0000 7f421ec00640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4218180690 0x7f421816d710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f42180c8b90 tx=0x7f420c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.167+0000 7f421ec00640 1 -- 172.21.15.69:0/330880418 shutdown_connections 2024-02-21T07:43:00.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.167+0000 7f421ec00640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41f809f130 0x7f41f80a15f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.167+0000 7f421ec00640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f421818a5f0 0x7f421821ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.167+0000 7f421ec00640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4218184ab0 0x7f421821e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.167+0000 7f421ec00640 1 --2- 172.21.15.69:0/330880418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4218180690 0x7f421816d710 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.167+0000 7f421ec00640 1 -- 172.21.15.69:0/330880418 >> 172.21.15.69:0/330880418 conn(0x7f42180ce1b0 msgr2=0x7f4218175640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:00.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.167+0000 7f421ec00640 1 -- 172.21.15.69:0/330880418 shutdown_connections 2024-02-21T07:43:00.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.167+0000 7f421ec00640 1 -- 172.21.15.69:0/330880418 wait complete. 2024-02-21T07:43:00.193 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:43:00.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.403+0000 7f5a8a600640 1 Processor -- start 2024-02-21T07:43:00.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.403+0000 7f5a8a600640 1 -- start start 2024-02-21T07:43:00.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.405+0000 7f5a8a600640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a840f4d70 0x7f5a8418a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:00.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.405+0000 7f5a8a600640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8418a160 con 0x7f5a84185dc0 2024-02-21T07:43:00.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.405+0000 7f5a8a600640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a840f5540 con 0x7f5a8418ab30 2024-02-21T07:43:00.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.405+0000 7f5a8a600640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8418cf00 con 0x7f5a840f4d70 2024-02-21T07:43:00.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.405+0000 7f5a83e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f5a840f4d70 0x7f5a8418a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:00.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.405+0000 7f5a89c00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f5a8418ab30 0x7f5a84188ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:40010/0 (socket says 172.21.15.69:40010) 2024-02-21T07:43:00.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.405+0000 7f5a89c00640 1 -- 172.21.15.69:0/2872725449 learned_addr learned my addr 172.21.15.69:0/2872725449 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:00.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.405+0000 7f5a83e00640 1 -- 172.21.15.69:0/2872725449 >> v1:172.21.15.174:6789/0 conn(0x7f5a8418ab30 legacy=0x7f5a84188ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.405+0000 7f5a83e00640 1 -- 172.21.15.69:0/2872725449 >> v1:172.21.15.69:6789/0 conn(0x7f5a84185dc0 legacy=0x7f5a840f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.405+0000 7f5a83e00640 1 -- 172.21.15.69:0/2872725449 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840f5820 con 0x7f5a840f4d70 2024-02-21T07:43:00.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.407+0000 7f5a83e00640 1 --2- 172.21.15.69:0/2872725449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 0x7f5a8418a5f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a700097a0 tx=0x7f5a7002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f656a5988bccb666 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:00.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.407+0000 7f5a83400640 1 -- 172.21.15.69:0/2872725449 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7002e070 con 0x7f5a840f4d70 2024-02-21T07:43:00.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.407+0000 7f5a83400640 1 -- 172.21.15.69:0/2872725449 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a700315a0 con 0x7f5a840f4d70 2024-02-21T07:43:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.407+0000 7f5a83400640 1 -- 172.21.15.69:0/2872725449 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70031930 con 0x7f5a840f4d70 2024-02-21T07:43:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.408+0000 7f5a8a600640 1 -- 172.21.15.69:0/2872725449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 msgr2=0x7f5a8418a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.408+0000 7f5a8a600640 1 --2- 172.21.15.69:0/2872725449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 0x7f5a8418a5f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a700097a0 tx=0x7f5a7002b840 comp rx=0 tx=0).stop 2024-02-21T07:43:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.408+0000 7f5a8a600640 1 -- 172.21.15.69:0/2872725449 shutdown_connections 2024-02-21T07:43:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.408+0000 7f5a8a600640 1 --2- 172.21.15.69:0/2872725449 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 0x7f5a8418a5f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.408+0000 7f5a8a600640 1 -- 172.21.15.69:0/2872725449 >> 172.21.15.69:0/2872725449 conn(0x7f5a840ce1b0 msgr2=0x7f5a840ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.408+0000 7f5a8a600640 1 -- 172.21.15.69:0/2872725449 shutdown_connections 2024-02-21T07:43:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.408+0000 7f5a8a600640 1 -- 172.21.15.69:0/2872725449 wait complete. 2024-02-21T07:43:00.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.410+0000 7f5a8a600640 1 Processor -- start 2024-02-21T07:43:00.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.410+0000 7f5a8a600640 1 -- start start 2024-02-21T07:43:00.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a8a600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 0x7f5a8417ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a8a600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a84185dc0 0x7f5a8421daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a8a600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a8418ab30 0x7f5a8421dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a8a600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a840d01f0 con 0x7f5a8418ab30 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a8a600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8421c720 con 0x7f5a840f4d70 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a8a600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8421ca00 con 0x7f5a84185dc0 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a89c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a8418ab30 0x7f5a8421dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a89200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 0x7f5a8417ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a89200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 0x7f5a8417ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38228/0 (socket says 172.21.15.69:38228) 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a89200640 1 -- 172.21.15.69:0/4205429801 learned_addr learned my addr 172.21.15.69:0/4205429801 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.411+0000 7f5a83e00640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a84185dc0 0x7f5a8421daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.412+0000 7f5a89200640 1 -- 172.21.15.69:0/4205429801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a84185dc0 msgr2=0x7f5a8421daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.412+0000 7f5a89200640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a84185dc0 0x7f5a8421daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.412+0000 7f5a89200640 1 -- 172.21.15.69:0/4205429801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a8418ab30 msgr2=0x7f5a8421dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.412+0000 7f5a89200640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a8418ab30 0x7f5a8421dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.412+0000 7f5a89200640 1 -- 172.21.15.69:0/4205429801 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70009400 con 0x7f5a840f4d70 2024-02-21T07:43:00.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.412+0000 7f5a89200640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 0x7f5a8417ed10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800c3c0 tx=0x7f5a7800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:00.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.412+0000 7f5a80c00640 1 -- 172.21.15.69:0/4205429801 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a780052d0 con 0x7f5a840f4d70 2024-02-21T07:43:00.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.412+0000 7f5a80c00640 1 -- 172.21.15.69:0/4205429801 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a78005450 con 0x7f5a840f4d70 2024-02-21T07:43:00.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.412+0000 7f5a80c00640 1 -- 172.21.15.69:0/4205429801 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78007260 con 0x7f5a840f4d70 2024-02-21T07:43:00.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.413+0000 7f5a8a600640 1 -- 172.21.15.69:0/4205429801 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8421cce0 con 0x7f5a840f4d70 2024-02-21T07:43:00.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.413+0000 7f5a8a600640 1 -- 172.21.15.69:0/4205429801 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8421d2a0 con 0x7f5a840f4d70 2024-02-21T07:43:00.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.414+0000 7f5a8a600640 1 -- 172.21.15.69:0/4205429801 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a84069c10 con 0x7f5a840f4d70 2024-02-21T07:43:00.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.416+0000 7f5a80c00640 1 -- 172.21.15.69:0/4205429801 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5a780073c0 con 0x7f5a840f4d70 2024-02-21T07:43:00.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.417+0000 7f5a80c00640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5a6409f130 0x7f5a640a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:00.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.417+0000 7f5a80c00640 1 -- 172.21.15.69:0/4205429801 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5a780c9470 con 0x7f5a840f4d70 2024-02-21T07:43:00.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.417+0000 7f5a83e00640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5a6409f130 0x7f5a640a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:00.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.418+0000 7f5a83e00640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5a6409f130 0x7f5a640a15f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5a70036000 tx=0x7f5a7003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:00.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.419+0000 7f5a80c00640 1 -- 172.21.15.69:0/4205429801 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5a780931c0 con 0x7f5a840f4d70 2024-02-21T07:43:00.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.620+0000 7f5a8a600640 1 -- 172.21.15.69:0/4205429801 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a840f60c0 con 0x7f5a840f4d70 2024-02-21T07:43:00.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.621+0000 7f5a80c00640 1 -- 172.21.15.69:0/4205429801 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a780200a0 con 0x7f5a840f4d70 2024-02-21T07:43:00.627 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.623+0000 7f5a8a600640 1 -- 172.21.15.69:0/4205429801 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5a6409f130 msgr2=0x7f5a640a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.623+0000 7f5a8a600640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5a6409f130 0x7f5a640a15f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5a70036000 tx=0x7f5a7003d040 comp rx=0 tx=0).stop 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.623+0000 7f5a8a600640 1 -- 172.21.15.69:0/4205429801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 msgr2=0x7f5a8417ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.623+0000 7f5a8a600640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 0x7f5a8417ed10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800c3c0 tx=0x7f5a7800c880 comp rx=0 tx=0).stop 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.624+0000 7f5a8a600640 1 -- 172.21.15.69:0/4205429801 shutdown_connections 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.624+0000 7f5a8a600640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5a6409f130 0x7f5a640a15f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.624+0000 7f5a8a600640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a8418ab30 0x7f5a8421dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.624+0000 7f5a8a600640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5a84185dc0 0x7f5a8421daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.624+0000 7f5a8a600640 1 --2- 172.21.15.69:0/4205429801 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5a840f4d70 0x7f5a8417ed10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.624+0000 7f5a8a600640 1 -- 172.21.15.69:0/4205429801 >> 172.21.15.69:0/4205429801 conn(0x7f5a840ce1b0 msgr2=0x7f5a840ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.624+0000 7f5a8a600640 1 -- 172.21.15.69:0/4205429801 shutdown_connections 2024-02-21T07:43:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.624+0000 7f5a8a600640 1 -- 172.21.15.69:0/4205429801 wait complete. 2024-02-21T07:43:00.647 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:43:00.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.855+0000 7f5286200640 1 Processor -- start 2024-02-21T07:43:00.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.856+0000 7f5286200640 1 -- start start 2024-02-21T07:43:00.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.858+0000 7f5286200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5280183ea0 0x7f52801846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:00.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.858+0000 7f5286200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52801850b0 con 0x7f52800eed50 2024-02-21T07:43:00.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.858+0000 7f5286200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5280185390 con 0x7f5280184c20 2024-02-21T07:43:00.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.858+0000 7f5286200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5280186010 con 0x7f5280183ea0 2024-02-21T07:43:00.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.858+0000 7f527f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5280183ea0 0x7f52801846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:00.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.858+0000 7f527f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5280183ea0 0x7f52801846e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36668/0 (socket says 172.21.15.69:36668) 2024-02-21T07:43:00.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.858+0000 7f527fe00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f52800eed50 0x7f5280186bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:57262/0 (socket says 172.21.15.69:57262) 2024-02-21T07:43:00.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.858+0000 7f527f400640 1 -- 172.21.15.69:0/4001187734 learned_addr learned my addr 172.21.15.69:0/4001187734 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:00.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.859+0000 7f527f400640 1 -- 172.21.15.69:0/4001187734 >> v1:172.21.15.184:6789/0 conn(0x7f5280184c20 legacy=0x7f52800ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.859+0000 7f527f400640 1 -- 172.21.15.69:0/4001187734 >> v1:172.21.15.69:6789/0 conn(0x7f52800eed50 legacy=0x7f5280186bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.859+0000 7f527f400640 1 -- 172.21.15.69:0/4001187734 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280185670 con 0x7f5280183ea0 2024-02-21T07:43:00.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.860+0000 7f527f400640 1 --2- 172.21.15.69:0/4001187734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5280183ea0 0x7f52801846e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5270009e50 tx=0x7f527002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9287755a2c375bdc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:00.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.860+0000 7f527e000640 1 -- 172.21.15.69:0/4001187734 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527002cb10 con 0x7f5280183ea0 2024-02-21T07:43:00.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.860+0000 7f527e000640 1 -- 172.21.15.69:0/4001187734 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527002cc70 con 0x7f5280183ea0 2024-02-21T07:43:00.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.860+0000 7f527e000640 1 -- 172.21.15.69:0/4001187734 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52700343f0 con 0x7f5280183ea0 2024-02-21T07:43:00.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.861+0000 7f5286200640 1 -- 172.21.15.69:0/4001187734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5280183ea0 msgr2=0x7f52801846e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.861+0000 7f5286200640 1 --2- 172.21.15.69:0/4001187734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5280183ea0 0x7f52801846e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5270009e50 tx=0x7f527002bf70 comp rx=0 tx=0).stop 2024-02-21T07:43:00.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.861+0000 7f5286200640 1 -- 172.21.15.69:0/4001187734 shutdown_connections 2024-02-21T07:43:00.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.861+0000 7f5286200640 1 --2- 172.21.15.69:0/4001187734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5280183ea0 0x7f52801846e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.861+0000 7f5286200640 1 -- 172.21.15.69:0/4001187734 >> 172.21.15.69:0/4001187734 conn(0x7f52800ce3d0 msgr2=0x7f52800ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:00.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.861+0000 7f5286200640 1 -- 172.21.15.69:0/4001187734 shutdown_connections 2024-02-21T07:43:00.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.861+0000 7f5286200640 1 -- 172.21.15.69:0/4001187734 wait complete. 2024-02-21T07:43:00.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.863+0000 7f5286200640 1 Processor -- start 2024-02-21T07:43:00.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.863+0000 7f5286200640 1 -- start start 2024-02-21T07:43:00.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.864+0000 7f5286200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52800eed50 0x7f528021f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:00.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.864+0000 7f5286200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5280183ea0 0x7f5280170c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:00.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.864+0000 7f5286200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52802203d0 0x7f5280220860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.864+0000 7f5286200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280189860 con 0x7f52800eed50 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.864+0000 7f5286200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280188fc0 con 0x7f52802203d0 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.864+0000 7f5286200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52801892a0 con 0x7f5280183ea0 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.864+0000 7f527f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52800eed50 0x7f528021f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.864+0000 7f527f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52800eed50 0x7f528021f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36676/0 (socket says 172.21.15.69:36676) 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.864+0000 7f527f400640 1 -- 172.21.15.69:0/1861959228 learned_addr learned my addr 172.21.15.69:0/1861959228 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.864+0000 7f527ea00640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5280183ea0 0x7f5280170c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f527fe00640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52802203d0 0x7f5280220860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f527f400640 1 -- 172.21.15.69:0/1861959228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5280183ea0 msgr2=0x7f5280170c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f527f400640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5280183ea0 0x7f5280170c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f527f400640 1 -- 172.21.15.69:0/1861959228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52802203d0 msgr2=0x7f5280220860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f527f400640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52802203d0 0x7f5280220860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:00.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f527f400640 1 -- 172.21.15.69:0/1861959228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5270009b30 con 0x7f52800eed50 2024-02-21T07:43:00.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f527f400640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52800eed50 0x7f528021f1d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5270000f80 tx=0x7f5270004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:00.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f5277400640 1 -- 172.21.15.69:0/1861959228 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527003e450 con 0x7f52800eed50 2024-02-21T07:43:00.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f5277400640 1 -- 172.21.15.69:0/1861959228 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527003e5f0 con 0x7f52800eed50 2024-02-21T07:43:00.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f5277400640 1 -- 172.21.15.69:0/1861959228 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527003e9a0 con 0x7f52800eed50 2024-02-21T07:43:00.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.865+0000 7f5286200640 1 -- 172.21.15.69:0/1861959228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52801865b0 con 0x7f52800eed50 2024-02-21T07:43:00.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.866+0000 7f5286200640 1 -- 172.21.15.69:0/1861959228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528021fbd0 con 0x7f52800eed50 2024-02-21T07:43:00.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.867+0000 7f5286200640 1 -- 172.21.15.69:0/1861959228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5280069d50 con 0x7f52800eed50 2024-02-21T07:43:00.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.869+0000 7f5277400640 1 -- 172.21.15.69:0/1861959228 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f527003eb00 con 0x7f52800eed50 2024-02-21T07:43:00.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.870+0000 7f5277400640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f525c09f130 0x7f525c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:00.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.870+0000 7f5277400640 1 -- 172.21.15.69:0/1861959228 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f52700ecac0 con 0x7f52800eed50 2024-02-21T07:43:00.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.870+0000 7f527ea00640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f525c09f130 0x7f525c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:00.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.871+0000 7f527ea00640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f525c09f130 0x7f525c0a15f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f52800c8a40 tx=0x7f5268009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:00.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:00.874+0000 7f5277400640 1 -- 172.21.15.69:0/1861959228 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f52700b69a0 con 0x7f52800eed50 2024-02-21T07:43:01.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.069+0000 7f5286200640 1 -- 172.21.15.69:0/1861959228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f52800f6000 con 0x7f52800eed50 2024-02-21T07:43:01.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.070+0000 7f5277400640 1 -- 172.21.15.69:0/1861959228 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f52700ba060 con 0x7f52800eed50 2024-02-21T07:43:01.076 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.072+0000 7f5286200640 1 -- 172.21.15.69:0/1861959228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f525c09f130 msgr2=0x7f525c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.072+0000 7f5286200640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f525c09f130 0x7f525c0a15f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f52800c8a40 tx=0x7f5268009040 comp rx=0 tx=0).stop 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.073+0000 7f5286200640 1 -- 172.21.15.69:0/1861959228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52800eed50 msgr2=0x7f528021f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.073+0000 7f5286200640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52800eed50 0x7f528021f1d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5270000f80 tx=0x7f5270004a40 comp rx=0 tx=0).stop 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.073+0000 7f5286200640 1 -- 172.21.15.69:0/1861959228 shutdown_connections 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.073+0000 7f5286200640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f525c09f130 0x7f525c0a15f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.073+0000 7f5286200640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f52802203d0 0x7f5280220860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.073+0000 7f5286200640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5280183ea0 0x7f5280170c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.073+0000 7f5286200640 1 --2- 172.21.15.69:0/1861959228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52800eed50 0x7f528021f1d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.073+0000 7f5286200640 1 -- 172.21.15.69:0/1861959228 >> 172.21.15.69:0/1861959228 conn(0x7f52800ce3d0 msgr2=0x7f52800d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.073+0000 7f5286200640 1 -- 172.21.15.69:0/1861959228 shutdown_connections 2024-02-21T07:43:01.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.073+0000 7f5286200640 1 -- 172.21.15.69:0/1861959228 wait complete. 2024-02-21T07:43:01.098 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:43:01.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.306+0000 7f9b7ea00640 1 Processor -- start 2024-02-21T07:43:01.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.306+0000 7f9b7ea00640 1 -- start start 2024-02-21T07:43:01.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.308+0000 7f9b7ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9b78183ea0 0x7f9b781846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.308+0000 7f9b7ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9b78184c20 0x7f9b780ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b7ea00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b781850b0 con 0x7f9b780eeb80 2024-02-21T07:43:01.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b7ea00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b78186010 con 0x7f9b78184c20 2024-02-21T07:43:01.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b7ea00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b78185390 con 0x7f9b78183ea0 2024-02-21T07:43:01.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b6fe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9b78184c20 0x7f9b780ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b77e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9b78183ea0 0x7f9b781846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b6fe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9b78184c20 0x7f9b780ee640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36678/0 (socket says 172.21.15.69:36678) 2024-02-21T07:43:01.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b6fe00640 1 -- 172.21.15.69:0/2576559406 learned_addr learned my addr 172.21.15.69:0/2576559406 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:01.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b77400640 1 -- 172.21.15.69:0/2576559406 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536053561 0 0) 0x7f9b781850b0 con 0x7f9b780eeb80 2024-02-21T07:43:01.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b6fe00640 1 -- 172.21.15.69:0/2576559406 >> v2:172.21.15.174:3300/0 conn(0x7f9b78183ea0 msgr2=0x7f9b781846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:01.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b6fe00640 1 --2- 172.21.15.69:0/2576559406 >> v2:172.21.15.174:3300/0 conn(0x7f9b78183ea0 0x7f9b781846e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b6fe00640 1 -- 172.21.15.69:0/2576559406 >> v1:172.21.15.184:6789/0 conn(0x7f9b780eeb80 legacy=0x7f9b78186bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.309+0000 7f9b6fe00640 1 -- 172.21.15.69:0/2576559406 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78185670 con 0x7f9b78184c20 2024-02-21T07:43:01.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.311+0000 7f9b6fe00640 1 --2- 172.21.15.69:0/2576559406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b78184c20 0x7f9b780ee640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9b780742d0 tx=0x7f9b6002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804667ce1b7abaab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:01.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.311+0000 7f9b77400640 1 -- 172.21.15.69:0/2576559406 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60031870 con 0x7f9b78184c20 2024-02-21T07:43:01.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.311+0000 7f9b77400640 1 -- 172.21.15.69:0/2576559406 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b600319d0 con 0x7f9b78184c20 2024-02-21T07:43:01.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.311+0000 7f9b77400640 1 -- 172.21.15.69:0/2576559406 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60031d60 con 0x7f9b78184c20 2024-02-21T07:43:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.312+0000 7f9b7ea00640 1 -- 172.21.15.69:0/2576559406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b78184c20 msgr2=0x7f9b780ee640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.312+0000 7f9b7ea00640 1 --2- 172.21.15.69:0/2576559406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b78184c20 0x7f9b780ee640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9b780742d0 tx=0x7f9b6002b910 comp rx=0 tx=0).stop 2024-02-21T07:43:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.312+0000 7f9b7ea00640 1 -- 172.21.15.69:0/2576559406 shutdown_connections 2024-02-21T07:43:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.312+0000 7f9b7ea00640 1 --2- 172.21.15.69:0/2576559406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b78184c20 0x7f9b780ee640 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.312+0000 7f9b7ea00640 1 --2- 172.21.15.69:0/2576559406 >> v2:172.21.15.174:3300/0 conn(0x7f9b78183ea0 0x7f9b781846e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.312+0000 7f9b7ea00640 1 -- 172.21.15.69:0/2576559406 >> 172.21.15.69:0/2576559406 conn(0x7f9b780ce3d0 msgr2=0x7f9b780ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.312+0000 7f9b7ea00640 1 -- 172.21.15.69:0/2576559406 shutdown_connections 2024-02-21T07:43:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.312+0000 7f9b7ea00640 1 -- 172.21.15.69:0/2576559406 wait complete. 2024-02-21T07:43:01.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.314+0000 7f9b7ea00640 1 Processor -- start 2024-02-21T07:43:01.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.314+0000 7f9b7ea00640 1 -- start start 2024-02-21T07:43:01.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.315+0000 7f9b7ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b780eeb80 0x7f9b7816f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.315+0000 7f9b7ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b78183ea0 0x7f9b781830a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.315+0000 7f9b7ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b7821fcf0 0x7f9b780d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.315+0000 7f9b7ea00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b780cf5d0 con 0x7f9b780eeb80 2024-02-21T07:43:01.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.315+0000 7f9b7ea00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7816f5f0 con 0x7f9b7821fcf0 2024-02-21T07:43:01.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.315+0000 7f9b7ea00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b780cf800 con 0x7f9b78183ea0 2024-02-21T07:43:01.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.315+0000 7f9b77e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b780eeb80 0x7f9b7816f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.315+0000 7f9b6fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b78183ea0 0x7f9b781830a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.316+0000 7f9b6fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b78183ea0 0x7f9b781830a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:33166/0 (socket says 172.21.15.69:33166) 2024-02-21T07:43:01.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.316+0000 7f9b6fe00640 1 -- 172.21.15.69:0/1270540440 learned_addr learned my addr 172.21.15.69:0/1270540440 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:01.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.316+0000 7f9b7ca00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b7821fcf0 0x7f9b780d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.316+0000 7f9b6fe00640 1 -- 172.21.15.69:0/1270540440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b7821fcf0 msgr2=0x7f9b780d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.316+0000 7f9b6fe00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b7821fcf0 0x7f9b780d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.316+0000 7f9b6fe00640 1 -- 172.21.15.69:0/1270540440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b780eeb80 msgr2=0x7f9b7816f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.316+0000 7f9b6fe00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b780eeb80 0x7f9b7816f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.316+0000 7f9b6fe00640 1 -- 172.21.15.69:0/1270540440 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b600094d0 con 0x7f9b78183ea0 2024-02-21T07:43:01.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.316+0000 7f9b77e00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b780eeb80 0x7f9b7816f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:01.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.316+0000 7f9b6fe00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b78183ea0 0x7f9b781830a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9b60000c00 tx=0x7f9b600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:01.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.317+0000 7f9b74c00640 1 -- 172.21.15.69:0/1270540440 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6003abe0 con 0x7f9b78183ea0 2024-02-21T07:43:01.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.317+0000 7f9b74c00640 1 -- 172.21.15.69:0/1270540440 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6003ad60 con 0x7f9b78183ea0 2024-02-21T07:43:01.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.317+0000 7f9b7ea00640 1 -- 172.21.15.69:0/1270540440 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b780cfae0 con 0x7f9b78183ea0 2024-02-21T07:43:01.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.317+0000 7f9b74c00640 1 -- 172.21.15.69:0/1270540440 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60044630 con 0x7f9b78183ea0 2024-02-21T07:43:01.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.317+0000 7f9b7ea00640 1 -- 172.21.15.69:0/1270540440 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b780d00a0 con 0x7f9b78183ea0 2024-02-21T07:43:01.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.318+0000 7f9b7ea00640 1 -- 172.21.15.69:0/1270540440 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b78069d50 con 0x7f9b78183ea0 2024-02-21T07:43:01.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.320+0000 7f9b74c00640 1 -- 172.21.15.69:0/1270540440 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f9b60044790 con 0x7f9b78183ea0 2024-02-21T07:43:01.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.321+0000 7f9b74c00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9b5409f160 0x7f9b540a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.321+0000 7f9b74c00640 1 -- 172.21.15.69:0/1270540440 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9b6002d040 con 0x7f9b78183ea0 2024-02-21T07:43:01.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.322+0000 7f9b77e00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9b5409f160 0x7f9b540a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.322+0000 7f9b77e00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9b5409f160 0x7f9b540a1620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009e90 tx=0x7f9b68009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:01.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.323+0000 7f9b74c00640 1 -- 172.21.15.69:0/1270540440 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9b600b6390 con 0x7f9b78183ea0 2024-02-21T07:43:01.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.519+0000 7f9b7ea00640 1 -- 172.21.15.69:0/1270540440 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9b780d1f70 con 0x7f9b78183ea0 2024-02-21T07:43:01.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.520+0000 7f9b74c00640 1 -- 172.21.15.69:0/1270540440 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9b600350a0 con 0x7f9b78183ea0 2024-02-21T07:43:01.526 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:43:01.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.522+0000 7f9b7ea00640 1 -- 172.21.15.69:0/1270540440 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9b5409f160 msgr2=0x7f9b540a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.522+0000 7f9b7ea00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9b5409f160 0x7f9b540a1620 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9b68009e90 tx=0x7f9b68009190 comp rx=0 tx=0).stop 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.522+0000 7f9b7ea00640 1 -- 172.21.15.69:0/1270540440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b78183ea0 msgr2=0x7f9b781830a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.522+0000 7f9b7ea00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b78183ea0 0x7f9b781830a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9b60000c00 tx=0x7f9b600046c0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.523+0000 7f9b7ea00640 1 -- 172.21.15.69:0/1270540440 shutdown_connections 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.523+0000 7f9b7ea00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9b5409f160 0x7f9b540a1620 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.523+0000 7f9b7ea00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9b7821fcf0 0x7f9b780d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.523+0000 7f9b7ea00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9b78183ea0 0x7f9b781830a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.523+0000 7f9b7ea00640 1 --2- 172.21.15.69:0/1270540440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b780eeb80 0x7f9b7816f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.523+0000 7f9b7ea00640 1 -- 172.21.15.69:0/1270540440 >> 172.21.15.69:0/1270540440 conn(0x7f9b780ce3d0 msgr2=0x7f9b780d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.523+0000 7f9b7ea00640 1 -- 172.21.15.69:0/1270540440 shutdown_connections 2024-02-21T07:43:01.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.523+0000 7f9b7ea00640 1 -- 172.21.15.69:0/1270540440 wait complete. 2024-02-21T07:43:01.550 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-02-21T07:43:01.550 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:43:01.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.754+0000 7f6b8d200640 1 Processor -- start 2024-02-21T07:43:01.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.754+0000 7f6b8d200640 1 -- start start 2024-02-21T07:43:01.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.756+0000 7f6b8d200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6b88180900 0x7f6b8806e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.756+0000 7f6b8d200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6b880f81f0 0x7f6b880f8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.756+0000 7f6b8d200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8806eba0 con 0x7f6b88184680 2024-02-21T07:43:01.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.756+0000 7f6b8d200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8806fb00 con 0x7f6b880f81f0 2024-02-21T07:43:01.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.756+0000 7f6b8d200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8806ee80 con 0x7f6b88180900 2024-02-21T07:43:01.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.756+0000 7f6b7fe00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6b88184680 0x7f6b88184b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:57270/0 (socket says 172.21.15.69:57270) 2024-02-21T07:43:01.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.756+0000 7f6b7fe00640 1 -- 172.21.15.69:0/1421233665 learned_addr learned my addr 172.21.15.69:0/1421233665 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:01.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.756+0000 7f6b87e00640 1 --2- 172.21.15.69:0/1421233665 >> v2:172.21.15.174:3300/0 conn(0x7f6b880f81f0 0x7f6b880f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.756+0000 7f6b87400640 1 --2- 172.21.15.69:0/1421233665 >> v2:172.21.15.184:3300/0 conn(0x7f6b88180900 0x7f6b8806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.757+0000 7f6b86a00640 1 -- 172.21.15.69:0/1421233665 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884634706 0 0) 0x7f6b8806eba0 con 0x7f6b88184680 2024-02-21T07:43:01.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.757+0000 7f6b86a00640 1 -- 172.21.15.69:0/1421233665 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b6c003520 con 0x7f6b88184680 2024-02-21T07:43:01.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.757+0000 7f6b87400640 1 -- 172.21.15.69:0/1421233665 >> v2:172.21.15.174:3300/0 conn(0x7f6b880f81f0 msgr2=0x7f6b880f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:01.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.757+0000 7f6b87400640 1 --2- 172.21.15.69:0/1421233665 >> v2:172.21.15.174:3300/0 conn(0x7f6b880f81f0 0x7f6b880f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.757+0000 7f6b87400640 1 -- 172.21.15.69:0/1421233665 >> v1:172.21.15.69:6789/0 conn(0x7f6b88184680 legacy=0x7f6b88184b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.757+0000 7f6b87400640 1 -- 172.21.15.69:0/1421233665 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8806f160 con 0x7f6b88180900 2024-02-21T07:43:01.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.758+0000 7f6b87400640 1 --2- 172.21.15.69:0/1421233665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 0x7f6b8806e260 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b8804f800 tx=0x7f6b7802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d84eef2c6b3856bb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:01.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.758+0000 7f6b86a00640 1 -- 172.21.15.69:0/1421233665 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7802e070 con 0x7f6b88180900 2024-02-21T07:43:01.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.758+0000 7f6b86a00640 1 -- 172.21.15.69:0/1421233665 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b780315a0 con 0x7f6b88180900 2024-02-21T07:43:01.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.758+0000 7f6b86a00640 1 -- 172.21.15.69:0/1421233665 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b78031930 con 0x7f6b88180900 2024-02-21T07:43:01.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.759+0000 7f6b8d200640 1 -- 172.21.15.69:0/1421233665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 msgr2=0x7f6b8806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.759+0000 7f6b8d200640 1 --2- 172.21.15.69:0/1421233665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 0x7f6b8806e260 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6b8804f800 tx=0x7f6b7802b840 comp rx=0 tx=0).stop 2024-02-21T07:43:01.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.759+0000 7f6b8d200640 1 -- 172.21.15.69:0/1421233665 shutdown_connections 2024-02-21T07:43:01.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.759+0000 7f6b8d200640 1 --2- 172.21.15.69:0/1421233665 >> v2:172.21.15.174:3300/0 conn(0x7f6b880f81f0 0x7f6b880f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.759+0000 7f6b8d200640 1 --2- 172.21.15.69:0/1421233665 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 0x7f6b8806e260 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.759+0000 7f6b8d200640 1 -- 172.21.15.69:0/1421233665 >> 172.21.15.69:0/1421233665 conn(0x7f6b880ce290 msgr2=0x7f6b880ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:01.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.759+0000 7f6b8d200640 1 -- 172.21.15.69:0/1421233665 shutdown_connections 2024-02-21T07:43:01.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.759+0000 7f6b8d200640 1 -- 172.21.15.69:0/1421233665 wait complete. 2024-02-21T07:43:01.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.761+0000 7f6b8d200640 1 Processor -- start 2024-02-21T07:43:01.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.761+0000 7f6b8d200640 1 -- start start 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.762+0000 7f6b8d200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b880f81f0 0x7f6b8821d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.762+0000 7f6b8d200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 0x7f6b88182b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.762+0000 7f6b8d200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b88184680 0x7f6b8816c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.762+0000 7f6b8d200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b881817d0 con 0x7f6b88184680 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.762+0000 7f6b8d200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b88181ab0 con 0x7f6b880f81f0 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.762+0000 7f6b8d200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b88181d90 con 0x7f6b88180900 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b7fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 0x7f6b88182b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b7fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 0x7f6b88182b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:33186/0 (socket says 172.21.15.69:33186) 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b7fe00640 1 -- 172.21.15.69:0/2244323088 learned_addr learned my addr 172.21.15.69:0/2244323088 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b87400640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b880f81f0 0x7f6b8821d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b87e00640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b88184680 0x7f6b8816c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b7fe00640 1 -- 172.21.15.69:0/2244323088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b880f81f0 msgr2=0x7f6b8821d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b7fe00640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b880f81f0 0x7f6b8821d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b7fe00640 1 -- 172.21.15.69:0/2244323088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b88184680 msgr2=0x7f6b8816c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:01.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b7fe00640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b88184680 0x7f6b8816c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:01.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b7fe00640 1 -- 172.21.15.69:0/2244323088 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b78009400 con 0x7f6b88180900 2024-02-21T07:43:01.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.763+0000 7f6b7fe00640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 0x7f6b88182b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c390 tx=0x7f6b7000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:01.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.764+0000 7f6b7f400640 1 -- 172.21.15.69:0/2244323088 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70005ce0 con 0x7f6b88180900 2024-02-21T07:43:01.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.764+0000 7f6b7f400640 1 -- 172.21.15.69:0/2244323088 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70005e40 con 0x7f6b88180900 2024-02-21T07:43:01.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.764+0000 7f6b7f400640 1 -- 172.21.15.69:0/2244323088 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b700072f0 con 0x7f6b88180900 2024-02-21T07:43:01.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.764+0000 7f6b8d200640 1 -- 172.21.15.69:0/2244323088 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b88182070 con 0x7f6b88180900 2024-02-21T07:43:01.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.764+0000 7f6b8d200640 1 -- 172.21.15.69:0/2244323088 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b88182630 con 0x7f6b88180900 2024-02-21T07:43:01.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.765+0000 7f6b8d200640 1 -- 172.21.15.69:0/2244323088 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b88069c10 con 0x7f6b88180900 2024-02-21T07:43:01.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.767+0000 7f6b7f400640 1 -- 172.21.15.69:0/2244323088 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f6b70007450 con 0x7f6b88180900 2024-02-21T07:43:01.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.768+0000 7f6b7f400640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6b6409f130 0x7f6b640a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:01.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.768+0000 7f6b7f400640 1 -- 172.21.15.69:0/2244323088 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6b700c9230 con 0x7f6b88180900 2024-02-21T07:43:01.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.769+0000 7f6b87400640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6b6409f130 0x7f6b640a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:01.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.770+0000 7f6b87400640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6b6409f130 0x7f6b640a15f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b78036000 tx=0x7f6b7803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:01.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:01.771+0000 7f6b7f400640 1 -- 172.21.15.69:0/2244323088 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6b70092f80 con 0x7f6b88180900 2024-02-21T07:43:02.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.008+0000 7f6b8d200640 1 -- 172.21.15.69:0/2244323088 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b88072670 con 0x7f6b88180900 2024-02-21T07:43:02.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.010+0000 7f6b7f400640 1 -- 172.21.15.69:0/2244323088 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f6b70017030 con 0x7f6b88180900 2024-02-21T07:43:02.016 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:43:02.016 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:56.243830+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:43:02.016 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 19 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.012+0000 7f6b8d200640 1 -- 172.21.15.69:0/2244323088 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6b6409f130 msgr2=0x7f6b640a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.012+0000 7f6b8d200640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6b6409f130 0x7f6b640a15f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6b78036000 tx=0x7f6b7803d040 comp rx=0 tx=0).stop 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.012+0000 7f6b8d200640 1 -- 172.21.15.69:0/2244323088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 msgr2=0x7f6b88182b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.012+0000 7f6b8d200640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 0x7f6b88182b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c390 tx=0x7f6b7000c850 comp rx=0 tx=0).stop 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.012+0000 7f6b8d200640 1 -- 172.21.15.69:0/2244323088 shutdown_connections 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.012+0000 7f6b8d200640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6b6409f130 0x7f6b640a15f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.012+0000 7f6b8d200640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b88184680 0x7f6b8816c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.012+0000 7f6b8d200640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6b88180900 0x7f6b88182b50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.012+0000 7f6b8d200640 1 --2- 172.21.15.69:0/2244323088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6b880f81f0 0x7f6b8821d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.012+0000 7f6b8d200640 1 -- 172.21.15.69:0/2244323088 >> 172.21.15.69:0/2244323088 conn(0x7f6b880ce290 msgr2=0x7f6b880f4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.013+0000 7f6b8d200640 1 -- 172.21.15.69:0/2244323088 shutdown_connections 2024-02-21T07:43:02.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.013+0000 7f6b8d200640 1 -- 172.21.15.69:0/2244323088 wait complete. 2024-02-21T07:43:02.037 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-02-21T07:43:02.037 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-02-21T07:43:02.037 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:43:02.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.247+0000 7fe152000640 1 Processor -- start 2024-02-21T07:43:02.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.248+0000 7fe152000640 1 -- start start 2024-02-21T07:43:02.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.250+0000 7fe152000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe14c18da00 0x7fe14c0f48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:02.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.250+0000 7fe152000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c18aa40 con 0x7fe14c0cd9c0 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.250+0000 7fe152000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14c0f5b90 con 0x7fe14c18a660 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.250+0000 7fe152000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14c0cce20 con 0x7fe14c18da00 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.250+0000 7fe14aa00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe14c0cd9c0 0x7fe14c18d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:57274/0 (socket says 172.21.15.69:57274) 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.250+0000 7fe14aa00640 1 -- 172.21.15.69:0/2660267142 learned_addr learned my addr 172.21.15.69:0/2660267142 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.250+0000 7fe14be00640 1 --2- 172.21.15.69:0/2660267142 >> v2:172.21.15.174:3300/0 conn(0x7fe14c18da00 0x7fe14c0f48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.250+0000 7fe14a000640 1 -- 172.21.15.69:0/2660267142 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469808524 0 0) 0x7fe14c0f5b90 con 0x7fe14c18a660 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.250+0000 7fe14a000640 1 -- 172.21.15.69:0/2660267142 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe12c003520 con 0x7fe14c18a660 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.250+0000 7fe14a000640 1 -- 172.21.15.69:0/2660267142 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245653991 0 0) 0x7fe14c18aa40 con 0x7fe14c0cd9c0 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.251+0000 7fe14a000640 1 -- 172.21.15.69:0/2660267142 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe14c0f5b90 con 0x7fe14c0cd9c0 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.251+0000 7fe14be00640 1 -- 172.21.15.69:0/2660267142 >> v1:172.21.15.174:6789/0 conn(0x7fe14c18a660 legacy=0x7fe14c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.251+0000 7fe14be00640 1 -- 172.21.15.69:0/2660267142 >> v1:172.21.15.69:6789/0 conn(0x7fe14c0cd9c0 legacy=0x7fe14c18d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.251+0000 7fe14be00640 1 -- 172.21.15.69:0/2660267142 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c06dcd0 con 0x7fe14c18da00 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.252+0000 7fe14be00640 1 --2- 172.21.15.69:0/2660267142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c18da00 0x7fe14c0f48c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe144009d90 tx=0x7fe14402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7123dc038df51fcf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.252+0000 7fe14a000640 1 -- 172.21.15.69:0/2660267142 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14402cbd0 con 0x7fe14c18da00 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.252+0000 7fe14a000640 1 -- 172.21.15.69:0/2660267142 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14402cd30 con 0x7fe14c18da00 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.252+0000 7fe14a000640 1 -- 172.21.15.69:0/2660267142 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14402cea0 con 0x7fe14c18da00 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.253+0000 7fe152000640 1 -- 172.21.15.69:0/2660267142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c18da00 msgr2=0x7fe14c0f48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.253+0000 7fe152000640 1 --2- 172.21.15.69:0/2660267142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c18da00 0x7fe14c0f48c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe144009d90 tx=0x7fe14402be20 comp rx=0 tx=0).stop 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.253+0000 7fe152000640 1 -- 172.21.15.69:0/2660267142 shutdown_connections 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.253+0000 7fe152000640 1 --2- 172.21.15.69:0/2660267142 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c18da00 0x7fe14c0f48c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.253+0000 7fe152000640 1 -- 172.21.15.69:0/2660267142 >> 172.21.15.69:0/2660267142 conn(0x7fe14c0f69c0 msgr2=0x7fe14c0f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.253+0000 7fe152000640 1 -- 172.21.15.69:0/2660267142 shutdown_connections 2024-02-21T07:43:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.253+0000 7fe152000640 1 -- 172.21.15.69:0/2660267142 wait complete. 2024-02-21T07:43:02.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.255+0000 7fe152000640 1 Processor -- start 2024-02-21T07:43:02.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.255+0000 7fe152000640 1 -- start start 2024-02-21T07:43:02.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe152000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c0cd9c0 0x7fe14c0f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:02.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe152000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe14c18a660 0x7fe14c176590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:02.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe152000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe14c18da00 0x7fe14c179010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe152000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c225a20 con 0x7fe14c18da00 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe152000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c224b30 con 0x7fe14c0cd9c0 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe152000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14c224e10 con 0x7fe14c18a660 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe14be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe14c18da00 0x7fe14c179010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe14be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe14c18da00 0x7fe14c179010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36712/0 (socket says 172.21.15.69:36712) 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe14be00640 1 -- 172.21.15.69:0/1383219279 learned_addr learned my addr 172.21.15.69:0/1383219279 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe14aa00640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe14c18a660 0x7fe14c176590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.256+0000 7fe14b400640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c0cd9c0 0x7fe14c0f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.257+0000 7fe14be00640 1 -- 172.21.15.69:0/1383219279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe14c18a660 msgr2=0x7fe14c176590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.257+0000 7fe14be00640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe14c18a660 0x7fe14c176590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.257+0000 7fe14be00640 1 -- 172.21.15.69:0/1383219279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c0cd9c0 msgr2=0x7fe14c0f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.257+0000 7fe14be00640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c0cd9c0 0x7fe14c0f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.257+0000 7fe14be00640 1 -- 172.21.15.69:0/1383219279 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe144009a70 con 0x7fe14c18da00 2024-02-21T07:43:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.257+0000 7fe14be00640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe14c18da00 0x7fe14c179010 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe144009d90 tx=0x7fe144004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:02.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.257+0000 7fe143400640 1 -- 172.21.15.69:0/1383219279 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14402cea0 con 0x7fe14c18da00 2024-02-21T07:43:02.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.257+0000 7fe143400640 1 -- 172.21.15.69:0/1383219279 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe144040650 con 0x7fe14c18da00 2024-02-21T07:43:02.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.257+0000 7fe143400640 1 -- 172.21.15.69:0/1383219279 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144040a00 con 0x7fe14c18da00 2024-02-21T07:43:02.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.257+0000 7fe152000640 1 -- 172.21.15.69:0/1383219279 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14c2250f0 con 0x7fe14c18da00 2024-02-21T07:43:02.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.258+0000 7fe152000640 1 -- 172.21.15.69:0/1383219279 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14c2256b0 con 0x7fe14c18da00 2024-02-21T07:43:02.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.259+0000 7fe152000640 1 -- 172.21.15.69:0/1383219279 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14c225840 con 0x7fe14c18da00 2024-02-21T07:43:02.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.260+0000 7fe143400640 1 -- 172.21.15.69:0/1383219279 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe144040b60 con 0x7fe14c18da00 2024-02-21T07:43:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.262+0000 7fe143400640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe12809f160 0x7fe1280a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:02.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.262+0000 7fe143400640 1 -- 172.21.15.69:0/1383219279 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe1440ec4f0 con 0x7fe14c18da00 2024-02-21T07:43:02.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.262+0000 7fe14b400640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe12809f160 0x7fe1280a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:02.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.263+0000 7fe14b400640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe12809f160 0x7fe1280a1620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe13c001010 tx=0x7fe13c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:02.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.266+0000 7fe143400640 1 -- 172.21.15.69:0/1383219279 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe1440b6220 con 0x7fe14c18da00 2024-02-21T07:43:02.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.459+0000 7fe152000640 1 -- 172.21.15.69:0/1383219279 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe14c0cc7d0 con 0x7fe12809f160 2024-02-21T07:43:02.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.472+0000 7fe143400640 1 -- 172.21.15.69:0/1383219279 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+413586 (secure 0 0 0) 0x7fe13c0014c0 con 0x7fe12809f160 2024-02-21T07:43:02.486 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:43:02.488 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-02-21T07:43:02.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 -- 172.21.15.69:0/1383219279 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe12809f160 msgr2=0x7fe1280a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe12809f160 0x7fe1280a1620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe13c001010 tx=0x7fe13c009040 comp rx=0 tx=0).stop 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 -- 172.21.15.69:0/1383219279 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe14c18da00 msgr2=0x7fe14c179010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe14c18da00 0x7fe14c179010 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe144009d90 tx=0x7fe144004a40 comp rx=0 tx=0).stop 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 -- 172.21.15.69:0/1383219279 shutdown_connections 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe12809f160 0x7fe1280a1620 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe14c18da00 0x7fe14c179010 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe14c18a660 0x7fe14c176590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 --2- 172.21.15.69:0/1383219279 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe14c0cd9c0 0x7fe14c0f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 -- 172.21.15.69:0/1383219279 >> 172.21.15.69:0/1383219279 conn(0x7fe14c0f69c0 msgr2=0x7fe14c0f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 -- 172.21.15.69:0/1383219279 shutdown_connections 2024-02-21T07:43:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.481+0000 7fe152000640 1 -- 172.21.15.69:0/1383219279 wait complete. 2024-02-21T07:43:02.506 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-02-21T07:43:02.457991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664851,"num_objects":102,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":457,"num_read_kb":357,"num_write":433,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":356,"ondisk_log_size":356,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":329896,"kb_used_data":5656,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132132184,"statfs":{"total":1159641169920,"available":1159303356416,"internally_reserved":0,"allocated":5791744,"data_stored":3266318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":331855161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":86,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003263"},"pg_stats":[{"pgid":"2.1f","version":"29'13","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.392964+0000","last_change":"2024-02-21T07:42:01.938302+0000","last_active":"2024-02-21T07:42:59.392964+0000","last_peered":"2024-02-21T07:42:59.392964+0000","last_clean":"2024-02-21T07:42:59.392964+0000","last_became_active":"2024-02-21T07:42:01.935737+0000","last_became_peered":"2024-02-21T07:42:01.935737+0000","last_unstale":"2024-02-21T07:42:59.392964+0000","last_undegraded":"2024-02-21T07:42:59.392964+0000","last_fullsized":"2024-02-21T07:42:59.392964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271108+0000","last_change":"2024-02-21T07:42:02.963926+0000","last_active":"2024-02-21T07:42:49.271108+0000","last_peered":"2024-02-21T07:42:49.271108+0000","last_clean":"2024-02-21T07:42:49.271108+0000","last_became_active":"2024-02-21T07:42:02.963585+0000","last_became_peered":"2024-02-21T07:42:02.963585+0000","last_unstale":"2024-02-21T07:42:49.271108+0000","last_undegraded":"2024-02-21T07:42:49.271108+0000","last_fullsized":"2024-02-21T07:42:49.271108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083699+0000","last_change":"2024-02-21T07:42:07.017236+0000","last_active":"2024-02-21T07:42:49.083699+0000","last_peered":"2024-02-21T07:42:49.083699+0000","last_clean":"2024-02-21T07:42:49.083699+0000","last_became_active":"2024-02-21T07:42:07.016750+0000","last_became_peered":"2024-02-21T07:42:07.016750+0000","last_unstale":"2024-02-21T07:42:49.083699+0000","last_undegraded":"2024-02-21T07:42:49.083699+0000","last_fullsized":"2024-02-21T07:42:49.083699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271355+0000","last_change":"2024-02-21T07:42:01.947176+0000","last_active":"2024-02-21T07:42:49.271355+0000","last_peered":"2024-02-21T07:42:49.271355+0000","last_clean":"2024-02-21T07:42:49.271355+0000","last_became_active":"2024-02-21T07:42:01.946831+0000","last_became_peered":"2024-02-21T07:42:01.946831+0000","last_unstale":"2024-02-21T07:42:49.271355+0000","last_undegraded":"2024-02-21T07:42:49.271355+0000","last_fullsized":"2024-02-21T07:42:49.271355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268284+0000","last_change":"2024-02-21T07:42:02.970038+0000","last_active":"2024-02-21T07:42:49.268284+0000","last_peered":"2024-02-21T07:42:49.268284+0000","last_clean":"2024-02-21T07:42:49.268284+0000","last_became_active":"2024-02-21T07:42:02.969433+0000","last_became_peered":"2024-02-21T07:42:02.969433+0000","last_unstale":"2024-02-21T07:42:49.268284+0000","last_undegraded":"2024-02-21T07:42:49.268284+0000","last_fullsized":"2024-02-21T07:42:49.268284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474778+0000","last_change":"2024-02-21T07:42:07.009585+0000","last_active":"2024-02-21T07:42:48.474778+0000","last_peered":"2024-02-21T07:42:48.474778+0000","last_clean":"2024-02-21T07:42:48.474778+0000","last_became_active":"2024-02-21T07:42:07.009264+0000","last_became_peered":"2024-02-21T07:42:07.009264+0000","last_unstale":"2024-02-21T07:42:48.474778+0000","last_undegraded":"2024-02-21T07:42:48.474778+0000","last_fullsized":"2024-02-21T07:42:48.474778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'12","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477868+0000","last_change":"2024-02-21T07:42:01.930474+0000","last_active":"2024-02-21T07:42:48.477868+0000","last_peered":"2024-02-21T07:42:48.477868+0000","last_clean":"2024-02-21T07:42:48.477868+0000","last_became_active":"2024-02-21T07:42:01.930173+0000","last_became_peered":"2024-02-21T07:42:01.930173+0000","last_unstale":"2024-02-21T07:42:48.477868+0000","last_undegraded":"2024-02-21T07:42:48.477868+0000","last_fullsized":"2024-02-21T07:42:48.477868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:42.554637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479544+0000","last_change":"2024-02-21T07:42:02.955640+0000","last_active":"2024-02-21T07:42:48.479544+0000","last_peered":"2024-02-21T07:42:48.479544+0000","last_clean":"2024-02-21T07:42:48.479544+0000","last_became_active":"2024-02-21T07:42:02.955341+0000","last_became_peered":"2024-02-21T07:42:02.955341+0000","last_unstale":"2024-02-21T07:42:48.479544+0000","last_undegraded":"2024-02-21T07:42:48.479544+0000","last_fullsized":"2024-02-21T07:42:48.479544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475209+0000","last_change":"2024-02-21T07:42:07.013240+0000","last_active":"2024-02-21T07:42:48.475209+0000","last_peered":"2024-02-21T07:42:48.475209+0000","last_clean":"2024-02-21T07:42:48.475209+0000","last_became_active":"2024-02-21T07:42:07.012852+0000","last_became_peered":"2024-02-21T07:42:07.012852+0000","last_unstale":"2024-02-21T07:42:48.475209+0000","last_undegraded":"2024-02-21T07:42:48.475209+0000","last_fullsized":"2024-02-21T07:42:48.475209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477876+0000","last_change":"2024-02-21T07:42:01.933225+0000","last_active":"2024-02-21T07:42:48.477876+0000","last_peered":"2024-02-21T07:42:48.477876+0000","last_clean":"2024-02-21T07:42:48.477876+0000","last_became_active":"2024-02-21T07:42:01.932908+0000","last_became_peered":"2024-02-21T07:42:01.932908+0000","last_unstale":"2024-02-21T07:42:48.477876+0000","last_undegraded":"2024-02-21T07:42:48.477876+0000","last_fullsized":"2024-02-21T07:42:48.477876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255552+0000","last_change":"2024-02-21T07:42:02.965143+0000","last_active":"2024-02-21T07:42:49.255552+0000","last_peered":"2024-02-21T07:42:49.255552+0000","last_clean":"2024-02-21T07:42:49.255552+0000","last_became_active":"2024-02-21T07:42:02.964614+0000","last_became_peered":"2024-02-21T07:42:02.964614+0000","last_unstale":"2024-02-21T07:42:49.255552+0000","last_undegraded":"2024-02-21T07:42:49.255552+0000","last_fullsized":"2024-02-21T07:42:49.255552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474912+0000","last_change":"2024-02-21T07:42:07.017243+0000","last_active":"2024-02-21T07:42:48.474912+0000","last_peered":"2024-02-21T07:42:48.474912+0000","last_clean":"2024-02-21T07:42:48.474912+0000","last_became_active":"2024-02-21T07:42:07.016898+0000","last_became_peered":"2024-02-21T07:42:07.016898+0000","last_unstale":"2024-02-21T07:42:48.474912+0000","last_undegraded":"2024-02-21T07:42:48.474912+0000","last_fullsized":"2024-02-21T07:42:48.474912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730392+0000","last_change":"2024-02-21T07:42:02.961021+0000","last_active":"2024-02-21T07:42:48.730392+0000","last_peered":"2024-02-21T07:42:48.730392+0000","last_clean":"2024-02-21T07:42:48.730392+0000","last_became_active":"2024-02-21T07:42:02.960723+0000","last_became_peered":"2024-02-21T07:42:02.960723+0000","last_unstale":"2024-02-21T07:42:48.730392+0000","last_undegraded":"2024-02-21T07:42:48.730392+0000","last_fullsized":"2024-02-21T07:42:48.730392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477604+0000","last_change":"2024-02-21T07:42:01.928055+0000","last_active":"2024-02-21T07:42:48.477604+0000","last_peered":"2024-02-21T07:42:48.477604+0000","last_clean":"2024-02-21T07:42:48.477604+0000","last_became_active":"2024-02-21T07:42:01.927733+0000","last_became_peered":"2024-02-21T07:42:01.927733+0000","last_unstale":"2024-02-21T07:42:48.477604+0000","last_undegraded":"2024-02-21T07:42:48.477604+0000","last_fullsized":"2024-02-21T07:42:48.477604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475734+0000","last_change":"2024-02-21T07:42:07.124695+0000","last_active":"2024-02-21T07:42:48.475734+0000","last_peered":"2024-02-21T07:42:48.475734+0000","last_clean":"2024-02-21T07:42:48.475734+0000","last_became_active":"2024-02-21T07:42:07.123973+0000","last_became_peered":"2024-02-21T07:42:07.123973+0000","last_unstale":"2024-02-21T07:42:48.475734+0000","last_undegraded":"2024-02-21T07:42:48.475734+0000","last_fullsized":"2024-02-21T07:42:48.475734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270778+0000","last_change":"2024-02-21T07:42:02.982537+0000","last_active":"2024-02-21T07:42:49.270778+0000","last_peered":"2024-02-21T07:42:49.270778+0000","last_clean":"2024-02-21T07:42:49.270778+0000","last_became_active":"2024-02-21T07:42:02.982222+0000","last_became_peered":"2024-02-21T07:42:02.982222+0000","last_unstale":"2024-02-21T07:42:49.270778+0000","last_undegraded":"2024-02-21T07:42:49.270778+0000","last_fullsized":"2024-02-21T07:42:49.270778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083823+0000","last_change":"2024-02-21T07:42:01.942392+0000","last_active":"2024-02-21T07:42:49.083823+0000","last_peered":"2024-02-21T07:42:49.083823+0000","last_clean":"2024-02-21T07:42:49.083823+0000","last_became_active":"2024-02-21T07:42:01.942152+0000","last_became_peered":"2024-02-21T07:42:01.942152+0000","last_unstale":"2024-02-21T07:42:49.083823+0000","last_undegraded":"2024-02-21T07:42:49.083823+0000","last_fullsized":"2024-02-21T07:42:49.083823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475048+0000","last_change":"2024-02-21T07:42:07.015054+0000","last_active":"2024-02-21T07:42:48.475048+0000","last_peered":"2024-02-21T07:42:48.475048+0000","last_clean":"2024-02-21T07:42:48.475048+0000","last_became_active":"2024-02-21T07:42:07.014713+0000","last_became_peered":"2024-02-21T07:42:07.014713+0000","last_unstale":"2024-02-21T07:42:48.475048+0000","last_undegraded":"2024-02-21T07:42:48.475048+0000","last_fullsized":"2024-02-21T07:42:48.475048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472769+0000","last_change":"2024-02-21T07:42:02.970973+0000","last_active":"2024-02-21T07:42:48.472769+0000","last_peered":"2024-02-21T07:42:48.472769+0000","last_clean":"2024-02-21T07:42:48.472769+0000","last_became_active":"2024-02-21T07:42:02.970644+0000","last_became_peered":"2024-02-21T07:42:02.970644+0000","last_unstale":"2024-02-21T07:42:48.472769+0000","last_undegraded":"2024-02-21T07:42:48.472769+0000","last_fullsized":"2024-02-21T07:42:48.472769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'7","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270271+0000","last_change":"2024-02-21T07:42:01.947758+0000","last_active":"2024-02-21T07:42:49.270271+0000","last_peered":"2024-02-21T07:42:49.270271+0000","last_clean":"2024-02-21T07:42:49.270271+0000","last_became_active":"2024-02-21T07:42:01.947407+0000","last_became_peered":"2024-02-21T07:42:01.947407+0000","last_unstale":"2024-02-21T07:42:49.270271+0000","last_undegraded":"2024-02-21T07:42:49.270271+0000","last_fullsized":"2024-02-21T07:42:49.270271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766823+0000","last_change":"2024-02-21T07:42:07.023243+0000","last_active":"2024-02-21T07:42:48.766823+0000","last_peered":"2024-02-21T07:42:48.766823+0000","last_clean":"2024-02-21T07:42:48.766823+0000","last_became_active":"2024-02-21T07:42:07.022308+0000","last_became_peered":"2024-02-21T07:42:07.022308+0000","last_unstale":"2024-02-21T07:42:48.766823+0000","last_undegraded":"2024-02-21T07:42:48.766823+0000","last_fullsized":"2024-02-21T07:42:48.766823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:24.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477347+0000","last_change":"2024-02-21T07:42:02.963456+0000","last_active":"2024-02-21T07:42:48.477347+0000","last_peered":"2024-02-21T07:42:48.477347+0000","last_clean":"2024-02-21T07:42:48.477347+0000","last_became_active":"2024-02-21T07:42:02.963049+0000","last_became_peered":"2024-02-21T07:42:02.963049+0000","last_unstale":"2024-02-21T07:42:48.477347+0000","last_undegraded":"2024-02-21T07:42:48.477347+0000","last_fullsized":"2024-02-21T07:42:48.477347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479529+0000","last_change":"2024-02-21T07:42:01.930737+0000","last_active":"2024-02-21T07:42:48.479529+0000","last_peered":"2024-02-21T07:42:48.479529+0000","last_clean":"2024-02-21T07:42:48.479529+0000","last_became_active":"2024-02-21T07:42:01.930465+0000","last_became_peered":"2024-02-21T07:42:01.930465+0000","last_unstale":"2024-02-21T07:42:48.479529+0000","last_undegraded":"2024-02-21T07:42:48.479529+0000","last_fullsized":"2024-02-21T07:42:48.479529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:08:11.073826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475484+0000","last_change":"2024-02-21T07:42:07.124659+0000","last_active":"2024-02-21T07:42:48.475484+0000","last_peered":"2024-02-21T07:42:48.475484+0000","last_clean":"2024-02-21T07:42:48.475484+0000","last_became_active":"2024-02-21T07:42:07.124217+0000","last_became_peered":"2024-02-21T07:42:07.124217+0000","last_unstale":"2024-02-21T07:42:48.475484+0000","last_undegraded":"2024-02-21T07:42:48.475484+0000","last_fullsized":"2024-02-21T07:42:48.475484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268590+0000","last_change":"2024-02-21T07:42:02.980306+0000","last_active":"2024-02-21T07:42:49.268590+0000","last_peered":"2024-02-21T07:42:49.268590+0000","last_clean":"2024-02-21T07:42:49.268590+0000","last_became_active":"2024-02-21T07:42:02.978879+0000","last_became_peered":"2024-02-21T07:42:02.978879+0000","last_unstale":"2024-02-21T07:42:49.268590+0000","last_undegraded":"2024-02-21T07:42:49.268590+0000","last_fullsized":"2024-02-21T07:42:49.268590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475670+0000","last_change":"2024-02-21T07:42:01.931986+0000","last_active":"2024-02-21T07:42:48.475670+0000","last_peered":"2024-02-21T07:42:48.475670+0000","last_clean":"2024-02-21T07:42:48.475670+0000","last_became_active":"2024-02-21T07:42:01.931671+0000","last_became_peered":"2024-02-21T07:42:01.931671+0000","last_unstale":"2024-02-21T07:42:48.475670+0000","last_undegraded":"2024-02-21T07:42:48.475670+0000","last_fullsized":"2024-02-21T07:42:48.475670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083685+0000","last_change":"2024-02-21T07:42:06.999795+0000","last_active":"2024-02-21T07:42:49.083685+0000","last_peered":"2024-02-21T07:42:49.083685+0000","last_clean":"2024-02-21T07:42:49.083685+0000","last_became_active":"2024-02-21T07:42:06.999315+0000","last_became_peered":"2024-02-21T07:42:06.999315+0000","last_unstale":"2024-02-21T07:42:49.083685+0000","last_undegraded":"2024-02-21T07:42:49.083685+0000","last_fullsized":"2024-02-21T07:42:49.083685+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271316+0000","last_change":"2024-02-21T07:42:02.968914+0000","last_active":"2024-02-21T07:42:49.271316+0000","last_peered":"2024-02-21T07:42:49.271316+0000","last_clean":"2024-02-21T07:42:49.271316+0000","last_became_active":"2024-02-21T07:42:02.961877+0000","last_became_peered":"2024-02-21T07:42:02.961877+0000","last_unstale":"2024-02-21T07:42:49.271316+0000","last_undegraded":"2024-02-21T07:42:49.271316+0000","last_fullsized":"2024-02-21T07:42:49.271316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'14","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766760+0000","last_change":"2024-02-21T07:42:01.937837+0000","last_active":"2024-02-21T07:42:48.766760+0000","last_peered":"2024-02-21T07:42:48.766760+0000","last_clean":"2024-02-21T07:42:48.766760+0000","last_became_active":"2024-02-21T07:42:01.937536+0000","last_became_peered":"2024-02-21T07:42:01.937536+0000","last_unstale":"2024-02-21T07:42:48.766760+0000","last_undegraded":"2024-02-21T07:42:48.766760+0000","last_fullsized":"2024-02-21T07:42:48.766760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269091+0000","last_change":"2024-02-21T07:42:07.125588+0000","last_active":"2024-02-21T07:42:49.269091+0000","last_peered":"2024-02-21T07:42:49.269091+0000","last_clean":"2024-02-21T07:42:49.269091+0000","last_became_active":"2024-02-21T07:42:07.124044+0000","last_became_peered":"2024-02-21T07:42:07.124044+0000","last_unstale":"2024-02-21T07:42:49.269091+0000","last_undegraded":"2024-02-21T07:42:49.269091+0000","last_fullsized":"2024-02-21T07:42:49.269091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475318+0000","last_change":"2024-02-21T07:42:02.961820+0000","last_active":"2024-02-21T07:42:48.475318+0000","last_peered":"2024-02-21T07:42:48.475318+0000","last_clean":"2024-02-21T07:42:48.475318+0000","last_became_active":"2024-02-21T07:42:02.961478+0000","last_became_peered":"2024-02-21T07:42:02.961478+0000","last_unstale":"2024-02-21T07:42:48.475318+0000","last_undegraded":"2024-02-21T07:42:48.475318+0000","last_fullsized":"2024-02-21T07:42:48.475318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477899+0000","last_change":"2024-02-21T07:42:01.947736+0000","last_active":"2024-02-21T07:42:48.477899+0000","last_peered":"2024-02-21T07:42:48.477899+0000","last_clean":"2024-02-21T07:42:48.477899+0000","last_became_active":"2024-02-21T07:42:01.947443+0000","last_became_peered":"2024-02-21T07:42:01.947443+0000","last_unstale":"2024-02-21T07:42:48.477899+0000","last_undegraded":"2024-02-21T07:42:48.477899+0000","last_fullsized":"2024-02-21T07:42:48.477899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:17.915214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472688+0000","last_change":"2024-02-21T07:42:07.008819+0000","last_active":"2024-02-21T07:42:48.472688+0000","last_peered":"2024-02-21T07:42:48.472688+0000","last_clean":"2024-02-21T07:42:48.472688+0000","last_became_active":"2024-02-21T07:42:07.008423+0000","last_became_peered":"2024-02-21T07:42:07.008423+0000","last_unstale":"2024-02-21T07:42:48.472688+0000","last_undegraded":"2024-02-21T07:42:48.472688+0000","last_fullsized":"2024-02-21T07:42:48.472688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979420+0000","last_change":"2024-02-21T07:42:02.975343+0000","last_active":"2024-02-21T07:42:48.979420+0000","last_peered":"2024-02-21T07:42:48.979420+0000","last_clean":"2024-02-21T07:42:48.979420+0000","last_became_active":"2024-02-21T07:42:02.975041+0000","last_became_peered":"2024-02-21T07:42:02.975041+0000","last_unstale":"2024-02-21T07:42:48.979420+0000","last_undegraded":"2024-02-21T07:42:48.979420+0000","last_fullsized":"2024-02-21T07:42:48.979420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766490+0000","last_change":"2024-02-21T07:42:01.935020+0000","last_active":"2024-02-21T07:42:48.766490+0000","last_peered":"2024-02-21T07:42:48.766490+0000","last_clean":"2024-02-21T07:42:48.766490+0000","last_became_active":"2024-02-21T07:42:01.934752+0000","last_became_peered":"2024-02-21T07:42:01.934752+0000","last_unstale":"2024-02-21T07:42:48.766490+0000","last_undegraded":"2024-02-21T07:42:48.766490+0000","last_fullsized":"2024-02-21T07:42:48.766490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477397+0000","last_change":"2024-02-21T07:42:07.124477+0000","last_active":"2024-02-21T07:42:48.477397+0000","last_peered":"2024-02-21T07:42:48.477397+0000","last_clean":"2024-02-21T07:42:48.477397+0000","last_became_active":"2024-02-21T07:42:07.123915+0000","last_became_peered":"2024-02-21T07:42:07.123915+0000","last_unstale":"2024-02-21T07:42:48.477397+0000","last_undegraded":"2024-02-21T07:42:48.477397+0000","last_fullsized":"2024-02-21T07:42:48.477397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979201+0000","last_change":"2024-02-21T07:42:02.964531+0000","last_active":"2024-02-21T07:42:48.979201+0000","last_peered":"2024-02-21T07:42:48.979201+0000","last_clean":"2024-02-21T07:42:48.979201+0000","last_became_active":"2024-02-21T07:42:02.964185+0000","last_became_peered":"2024-02-21T07:42:02.964185+0000","last_unstale":"2024-02-21T07:42:48.979201+0000","last_undegraded":"2024-02-21T07:42:48.979201+0000","last_fullsized":"2024-02-21T07:42:48.979201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.393673+0000","last_change":"2024-02-21T07:42:01.934093+0000","last_active":"2024-02-21T07:42:59.393673+0000","last_peered":"2024-02-21T07:42:59.393673+0000","last_clean":"2024-02-21T07:42:59.393673+0000","last_became_active":"2024-02-21T07:42:01.933841+0000","last_became_peered":"2024-02-21T07:42:01.933841+0000","last_unstale":"2024-02-21T07:42:59.393673+0000","last_undegraded":"2024-02-21T07:42:59.393673+0000","last_fullsized":"2024-02-21T07:42:59.393673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475132+0000","last_change":"2024-02-21T07:42:07.018134+0000","last_active":"2024-02-21T07:42:48.475132+0000","last_peered":"2024-02-21T07:42:48.475132+0000","last_clean":"2024-02-21T07:42:48.475132+0000","last_became_active":"2024-02-21T07:42:07.017670+0000","last_became_peered":"2024-02-21T07:42:07.017670+0000","last_unstale":"2024-02-21T07:42:48.475132+0000","last_undegraded":"2024-02-21T07:42:48.475132+0000","last_fullsized":"2024-02-21T07:42:48.475132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255349+0000","last_change":"2024-02-21T07:42:02.962279+0000","last_active":"2024-02-21T07:42:49.255349+0000","last_peered":"2024-02-21T07:42:49.255349+0000","last_clean":"2024-02-21T07:42:49.255349+0000","last_became_active":"2024-02-21T07:42:02.961965+0000","last_became_peered":"2024-02-21T07:42:02.961965+0000","last_unstale":"2024-02-21T07:42:49.255349+0000","last_undegraded":"2024-02-21T07:42:49.255349+0000","last_fullsized":"2024-02-21T07:42:49.255349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'5","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.362529+0000","last_change":"2024-02-21T07:42:01.948478+0000","last_active":"2024-02-21T07:42:59.362529+0000","last_peered":"2024-02-21T07:42:59.362529+0000","last_clean":"2024-02-21T07:42:59.362529+0000","last_became_active":"2024-02-21T07:42:01.948184+0000","last_became_peered":"2024-02-21T07:42:01.948184+0000","last_unstale":"2024-02-21T07:42:59.362529+0000","last_undegraded":"2024-02-21T07:42:59.362529+0000","last_fullsized":"2024-02-21T07:42:59.362529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475526+0000","last_change":"2024-02-21T07:42:07.124759+0000","last_active":"2024-02-21T07:42:48.475526+0000","last_peered":"2024-02-21T07:42:48.475526+0000","last_clean":"2024-02-21T07:42:48.475526+0000","last_became_active":"2024-02-21T07:42:07.124275+0000","last_became_peered":"2024-02-21T07:42:07.124275+0000","last_unstale":"2024-02-21T07:42:48.475526+0000","last_undegraded":"2024-02-21T07:42:48.475526+0000","last_fullsized":"2024-02-21T07:42:48.475526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474564+0000","last_change":"2024-02-21T07:42:02.961213+0000","last_active":"2024-02-21T07:42:48.474564+0000","last_peered":"2024-02-21T07:42:48.474564+0000","last_clean":"2024-02-21T07:42:48.474564+0000","last_became_active":"2024-02-21T07:42:02.960477+0000","last_became_peered":"2024-02-21T07:42:02.960477+0000","last_unstale":"2024-02-21T07:42:48.474564+0000","last_undegraded":"2024-02-21T07:42:48.474564+0000","last_fullsized":"2024-02-21T07:42:48.474564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.729819+0000","last_change":"2024-02-21T07:42:01.928302+0000","last_active":"2024-02-21T07:42:48.729819+0000","last_peered":"2024-02-21T07:42:48.729819+0000","last_clean":"2024-02-21T07:42:48.729819+0000","last_became_active":"2024-02-21T07:42:01.927234+0000","last_became_peered":"2024-02-21T07:42:01.927234+0000","last_unstale":"2024-02-21T07:42:48.729819+0000","last_undegraded":"2024-02-21T07:42:48.729819+0000","last_fullsized":"2024-02-21T07:42:48.729819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255689+0000","last_change":"2024-02-21T07:42:07.124715+0000","last_active":"2024-02-21T07:42:49.255689+0000","last_peered":"2024-02-21T07:42:49.255689+0000","last_clean":"2024-02-21T07:42:49.255689+0000","last_became_active":"2024-02-21T07:42:07.124248+0000","last_became_peered":"2024-02-21T07:42:07.124248+0000","last_unstale":"2024-02-21T07:42:49.255689+0000","last_undegraded":"2024-02-21T07:42:49.255689+0000","last_fullsized":"2024-02-21T07:42:49.255689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:17:21.721728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270752+0000","last_change":"2024-02-21T07:42:02.971762+0000","last_active":"2024-02-21T07:42:49.270752+0000","last_peered":"2024-02-21T07:42:49.270752+0000","last_clean":"2024-02-21T07:42:49.270752+0000","last_became_active":"2024-02-21T07:42:02.970032+0000","last_became_peered":"2024-02-21T07:42:02.970032+0000","last_unstale":"2024-02-21T07:42:49.270752+0000","last_undegraded":"2024-02-21T07:42:49.270752+0000","last_fullsized":"2024-02-21T07:42:49.270752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475449+0000","last_change":"2024-02-21T07:42:01.932968+0000","last_active":"2024-02-21T07:42:48.475449+0000","last_peered":"2024-02-21T07:42:48.475449+0000","last_clean":"2024-02-21T07:42:48.475449+0000","last_became_active":"2024-02-21T07:42:01.932620+0000","last_became_peered":"2024-02-21T07:42:01.932620+0000","last_unstale":"2024-02-21T07:42:48.475449+0000","last_undegraded":"2024-02-21T07:42:48.475449+0000","last_fullsized":"2024-02-21T07:42:48.475449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730104+0000","last_change":"2024-02-21T07:41:57.883808+0000","last_active":"2024-02-21T07:42:48.730104+0000","last_peered":"2024-02-21T07:42:48.730104+0000","last_clean":"2024-02-21T07:42:48.730104+0000","last_became_active":"2024-02-21T07:41:57.883530+0000","last_became_peered":"2024-02-21T07:41:57.883530+0000","last_unstale":"2024-02-21T07:42:48.730104+0000","last_undegraded":"2024-02-21T07:42:48.730104+0000","last_fullsized":"2024-02-21T07:42:48.730104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_clean_scrub_stamp":"2024-02-21T07:41:56.862963+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:09:51.756066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730094+0000","last_change":"2024-02-21T07:42:07.011954+0000","last_active":"2024-02-21T07:42:48.730094+0000","last_peered":"2024-02-21T07:42:48.730094+0000","last_clean":"2024-02-21T07:42:48.730094+0000","last_became_active":"2024-02-21T07:42:07.011654+0000","last_became_peered":"2024-02-21T07:42:07.011654+0000","last_unstale":"2024-02-21T07:42:48.730094+0000","last_undegraded":"2024-02-21T07:42:48.730094+0000","last_fullsized":"2024-02-21T07:42:48.730094+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730347+0000","last_change":"2024-02-21T07:42:02.956569+0000","last_active":"2024-02-21T07:42:48.730347+0000","last_peered":"2024-02-21T07:42:48.730347+0000","last_clean":"2024-02-21T07:42:48.730347+0000","last_became_active":"2024-02-21T07:42:02.956232+0000","last_became_peered":"2024-02-21T07:42:02.956232+0000","last_unstale":"2024-02-21T07:42:48.730347+0000","last_undegraded":"2024-02-21T07:42:48.730347+0000","last_fullsized":"2024-02-21T07:42:48.730347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.346411+0000","last_change":"2024-02-21T07:42:01.926736+0000","last_active":"2024-02-21T07:42:59.346411+0000","last_peered":"2024-02-21T07:42:59.346411+0000","last_clean":"2024-02-21T07:42:59.346411+0000","last_became_active":"2024-02-21T07:42:01.926454+0000","last_became_peered":"2024-02-21T07:42:01.926454+0000","last_unstale":"2024-02-21T07:42:59.346411+0000","last_undegraded":"2024-02-21T07:42:59.346411+0000","last_fullsized":"2024-02-21T07:42:59.346411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.731511+0000","last_change":"2024-02-21T07:42:48.731511+0000","last_active":"2024-02-21T07:42:48.731511+0000","last_peered":"2024-02-21T07:42:48.731511+0000","last_clean":"2024-02-21T07:42:48.731511+0000","last_became_active":"2024-02-21T07:42:48.731074+0000","last_became_peered":"2024-02-21T07:42:48.731074+0000","last_unstale":"2024-02-21T07:42:48.731511+0000","last_undegraded":"2024-02-21T07:42:48.731511+0000","last_fullsized":"2024-02-21T07:42:48.731511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:49:35.717727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730270+0000","last_change":"2024-02-21T07:42:02.976255+0000","last_active":"2024-02-21T07:42:48.730270+0000","last_peered":"2024-02-21T07:42:48.730270+0000","last_clean":"2024-02-21T07:42:48.730270+0000","last_became_active":"2024-02-21T07:42:02.975927+0000","last_became_peered":"2024-02-21T07:42:02.975927+0000","last_unstale":"2024-02-21T07:42:48.730270+0000","last_undegraded":"2024-02-21T07:42:48.730270+0000","last_fullsized":"2024-02-21T07:42:48.730270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255791+0000","last_change":"2024-02-21T07:42:01.932488+0000","last_active":"2024-02-21T07:42:49.255791+0000","last_peered":"2024-02-21T07:42:49.255791+0000","last_clean":"2024-02-21T07:42:49.255791+0000","last_became_active":"2024-02-21T07:42:01.932131+0000","last_became_peered":"2024-02-21T07:42:01.932131+0000","last_unstale":"2024-02-21T07:42:49.255791+0000","last_undegraded":"2024-02-21T07:42:49.255791+0000","last_fullsized":"2024-02-21T07:42:49.255791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267461+0000","last_change":"2024-02-21T07:42:07.017329+0000","last_active":"2024-02-21T07:42:49.267461+0000","last_peered":"2024-02-21T07:42:49.267461+0000","last_clean":"2024-02-21T07:42:49.267461+0000","last_became_active":"2024-02-21T07:42:07.016916+0000","last_became_peered":"2024-02-21T07:42:07.016916+0000","last_unstale":"2024-02-21T07:42:49.267461+0000","last_undegraded":"2024-02-21T07:42:49.267461+0000","last_fullsized":"2024-02-21T07:42:49.267461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730155+0000","last_change":"2024-02-21T07:42:02.959157+0000","last_active":"2024-02-21T07:42:48.730155+0000","last_peered":"2024-02-21T07:42:48.730155+0000","last_clean":"2024-02-21T07:42:48.730155+0000","last_became_active":"2024-02-21T07:42:02.958593+0000","last_became_peered":"2024-02-21T07:42:02.958593+0000","last_unstale":"2024-02-21T07:42:48.730155+0000","last_undegraded":"2024-02-21T07:42:48.730155+0000","last_fullsized":"2024-02-21T07:42:48.730155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:55.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475193+0000","last_change":"2024-02-21T07:42:01.949434+0000","last_active":"2024-02-21T07:42:48.475193+0000","last_peered":"2024-02-21T07:42:48.475193+0000","last_clean":"2024-02-21T07:42:48.475193+0000","last_became_active":"2024-02-21T07:42:01.948805+0000","last_became_peered":"2024-02-21T07:42:01.948805+0000","last_unstale":"2024-02-21T07:42:48.475193+0000","last_undegraded":"2024-02-21T07:42:48.475193+0000","last_fullsized":"2024-02-21T07:42:48.475193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255139+0000","last_change":"2024-02-21T07:42:07.003190+0000","last_active":"2024-02-21T07:42:49.255139+0000","last_peered":"2024-02-21T07:42:49.255139+0000","last_clean":"2024-02-21T07:42:49.255139+0000","last_became_active":"2024-02-21T07:42:07.002780+0000","last_became_peered":"2024-02-21T07:42:07.002780+0000","last_unstale":"2024-02-21T07:42:49.255139+0000","last_undegraded":"2024-02-21T07:42:49.255139+0000","last_fullsized":"2024-02-21T07:42:49.255139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473048+0000","last_change":"2024-02-21T07:42:02.959569+0000","last_active":"2024-02-21T07:42:48.473048+0000","last_peered":"2024-02-21T07:42:48.473048+0000","last_clean":"2024-02-21T07:42:48.473048+0000","last_became_active":"2024-02-21T07:42:02.959146+0000","last_became_peered":"2024-02-21T07:42:02.959146+0000","last_unstale":"2024-02-21T07:42:48.473048+0000","last_undegraded":"2024-02-21T07:42:48.473048+0000","last_fullsized":"2024-02-21T07:42:48.473048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477817+0000","last_change":"2024-02-21T07:42:01.926878+0000","last_active":"2024-02-21T07:42:48.477817+0000","last_peered":"2024-02-21T07:42:48.477817+0000","last_clean":"2024-02-21T07:42:48.477817+0000","last_became_active":"2024-02-21T07:42:01.926212+0000","last_became_peered":"2024-02-21T07:42:01.926212+0000","last_unstale":"2024-02-21T07:42:48.477817+0000","last_undegraded":"2024-02-21T07:42:48.477817+0000","last_fullsized":"2024-02-21T07:42:48.477817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255229+0000","last_change":"2024-02-21T07:42:07.017443+0000","last_active":"2024-02-21T07:42:49.255229+0000","last_peered":"2024-02-21T07:42:49.255229+0000","last_clean":"2024-02-21T07:42:49.255229+0000","last_became_active":"2024-02-21T07:42:07.016918+0000","last_became_peered":"2024-02-21T07:42:07.016918+0000","last_unstale":"2024-02-21T07:42:49.255229+0000","last_undegraded":"2024-02-21T07:42:49.255229+0000","last_fullsized":"2024-02-21T07:42:49.255229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:49:35.717727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255615+0000","last_change":"2024-02-21T07:42:02.965178+0000","last_active":"2024-02-21T07:42:49.255615+0000","last_peered":"2024-02-21T07:42:49.255615+0000","last_clean":"2024-02-21T07:42:49.255615+0000","last_became_active":"2024-02-21T07:42:02.964846+0000","last_became_peered":"2024-02-21T07:42:02.964846+0000","last_unstale":"2024-02-21T07:42:49.255615+0000","last_undegraded":"2024-02-21T07:42:49.255615+0000","last_fullsized":"2024-02-21T07:42:49.255615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'17","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477336+0000","last_change":"2024-02-21T07:42:01.946183+0000","last_active":"2024-02-21T07:42:48.477336+0000","last_peered":"2024-02-21T07:42:48.477336+0000","last_clean":"2024-02-21T07:42:48.477336+0000","last_became_active":"2024-02-21T07:42:01.945960+0000","last_became_peered":"2024-02-21T07:42:01.945960+0000","last_unstale":"2024-02-21T07:42:48.477336+0000","last_undegraded":"2024-02-21T07:42:48.477336+0000","last_fullsized":"2024-02-21T07:42:48.477336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.275007+0000","last_change":"2024-02-21T07:42:49.275007+0000","last_active":"2024-02-21T07:42:49.275007+0000","last_peered":"2024-02-21T07:42:49.275007+0000","last_clean":"2024-02-21T07:42:49.275007+0000","last_became_active":"2024-02-21T07:42:49.273404+0000","last_became_peered":"2024-02-21T07:42:49.273404+0000","last_unstale":"2024-02-21T07:42:49.275007+0000","last_undegraded":"2024-02-21T07:42:49.275007+0000","last_fullsized":"2024-02-21T07:42:49.275007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:38:24.009546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.729810+0000","last_change":"2024-02-21T07:42:02.960144+0000","last_active":"2024-02-21T07:42:48.729810+0000","last_peered":"2024-02-21T07:42:48.729810+0000","last_clean":"2024-02-21T07:42:48.729810+0000","last_became_active":"2024-02-21T07:42:02.959714+0000","last_became_peered":"2024-02-21T07:42:02.959714+0000","last_unstale":"2024-02-21T07:42:48.729810+0000","last_undegraded":"2024-02-21T07:42:48.729810+0000","last_fullsized":"2024-02-21T07:42:48.729810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.363160+0000","last_change":"2024-02-21T07:42:01.930429+0000","last_active":"2024-02-21T07:42:59.363160+0000","last_peered":"2024-02-21T07:42:59.363160+0000","last_clean":"2024-02-21T07:42:59.363160+0000","last_became_active":"2024-02-21T07:42:01.930076+0000","last_became_peered":"2024-02-21T07:42:01.930076+0000","last_unstale":"2024-02-21T07:42:59.363160+0000","last_undegraded":"2024-02-21T07:42:59.363160+0000","last_fullsized":"2024-02-21T07:42:59.363160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766660+0000","last_change":"2024-02-21T07:42:07.025234+0000","last_active":"2024-02-21T07:42:48.766660+0000","last_peered":"2024-02-21T07:42:48.766660+0000","last_clean":"2024-02-21T07:42:48.766660+0000","last_became_active":"2024-02-21T07:42:07.024452+0000","last_became_peered":"2024-02-21T07:42:07.024452+0000","last_unstale":"2024-02-21T07:42:48.766660+0000","last_undegraded":"2024-02-21T07:42:48.766660+0000","last_fullsized":"2024-02-21T07:42:48.766660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730040+0000","last_change":"2024-02-21T07:42:02.958015+0000","last_active":"2024-02-21T07:42:48.730040+0000","last_peered":"2024-02-21T07:42:48.730040+0000","last_clean":"2024-02-21T07:42:48.730040+0000","last_became_active":"2024-02-21T07:42:02.956436+0000","last_became_peered":"2024-02-21T07:42:02.956436+0000","last_unstale":"2024-02-21T07:42:48.730040+0000","last_undegraded":"2024-02-21T07:42:48.730040+0000","last_fullsized":"2024-02-21T07:42:48.730040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:39.265082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255581+0000","last_change":"2024-02-21T07:42:01.943079+0000","last_active":"2024-02-21T07:42:49.255581+0000","last_peered":"2024-02-21T07:42:49.255581+0000","last_clean":"2024-02-21T07:42:49.255581+0000","last_became_active":"2024-02-21T07:42:01.942831+0000","last_became_peered":"2024-02-21T07:42:01.942831+0000","last_unstale":"2024-02-21T07:42:49.255581+0000","last_undegraded":"2024-02-21T07:42:49.255581+0000","last_fullsized":"2024-02-21T07:42:49.255581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472680+0000","last_change":"2024-02-21T07:42:07.015228+0000","last_active":"2024-02-21T07:42:48.472680+0000","last_peered":"2024-02-21T07:42:48.472680+0000","last_clean":"2024-02-21T07:42:48.472680+0000","last_became_active":"2024-02-21T07:42:07.014798+0000","last_became_peered":"2024-02-21T07:42:07.014798+0000","last_unstale":"2024-02-21T07:42:48.472680+0000","last_undegraded":"2024-02-21T07:42:48.472680+0000","last_fullsized":"2024-02-21T07:42:48.472680+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474857+0000","last_change":"2024-02-21T07:42:02.965287+0000","last_active":"2024-02-21T07:42:48.474857+0000","last_peered":"2024-02-21T07:42:48.474857+0000","last_clean":"2024-02-21T07:42:48.474857+0000","last_became_active":"2024-02-21T07:42:02.960780+0000","last_became_peered":"2024-02-21T07:42:02.960780+0000","last_unstale":"2024-02-21T07:42:48.474857+0000","last_undegraded":"2024-02-21T07:42:48.474857+0000","last_fullsized":"2024-02-21T07:42:48.474857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084260+0000","last_change":"2024-02-21T07:42:01.932401+0000","last_active":"2024-02-21T07:42:49.084260+0000","last_peered":"2024-02-21T07:42:49.084260+0000","last_clean":"2024-02-21T07:42:49.084260+0000","last_became_active":"2024-02-21T07:42:01.932108+0000","last_became_peered":"2024-02-21T07:42:01.932108+0000","last_unstale":"2024-02-21T07:42:49.084260+0000","last_undegraded":"2024-02-21T07:42:49.084260+0000","last_fullsized":"2024-02-21T07:42:49.084260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255518+0000","last_change":"2024-02-21T07:42:07.018725+0000","last_active":"2024-02-21T07:42:49.255518+0000","last_peered":"2024-02-21T07:42:49.255518+0000","last_clean":"2024-02-21T07:42:49.255518+0000","last_became_active":"2024-02-21T07:42:07.018322+0000","last_became_peered":"2024-02-21T07:42:07.018322+0000","last_unstale":"2024-02-21T07:42:49.255518+0000","last_undegraded":"2024-02-21T07:42:49.255518+0000","last_fullsized":"2024-02-21T07:42:49.255518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:04:05.896966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477711+0000","last_change":"2024-02-21T07:42:02.963384+0000","last_active":"2024-02-21T07:42:48.477711+0000","last_peered":"2024-02-21T07:42:48.477711+0000","last_clean":"2024-02-21T07:42:48.477711+0000","last_became_active":"2024-02-21T07:42:02.963098+0000","last_became_peered":"2024-02-21T07:42:02.963098+0000","last_unstale":"2024-02-21T07:42:48.477711+0000","last_undegraded":"2024-02-21T07:42:48.477711+0000","last_fullsized":"2024-02-21T07:42:48.477711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"31'36","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:43:00.352806+0000","last_change":"2024-02-21T07:42:01.936472+0000","last_active":"2024-02-21T07:43:00.352806+0000","last_peered":"2024-02-21T07:43:00.352806+0000","last_clean":"2024-02-21T07:43:00.352806+0000","last_became_active":"2024-02-21T07:42:01.936181+0000","last_became_peered":"2024-02-21T07:42:01.936181+0000","last_unstale":"2024-02-21T07:43:00.352806+0000","last_undegraded":"2024-02-21T07:43:00.352806+0000","last_fullsized":"2024-02-21T07:43:00.352806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66332,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":99,"num_write":38,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.765829+0000","last_change":"2024-02-21T07:42:07.013938+0000","last_active":"2024-02-21T07:42:48.765829+0000","last_peered":"2024-02-21T07:42:48.765829+0000","last_clean":"2024-02-21T07:42:48.765829+0000","last_became_active":"2024-02-21T07:42:07.013409+0000","last_became_peered":"2024-02-21T07:42:07.013409+0000","last_unstale":"2024-02-21T07:42:48.765829+0000","last_undegraded":"2024-02-21T07:42:48.765829+0000","last_fullsized":"2024-02-21T07:42:48.765829+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:52:00.302670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479660+0000","last_change":"2024-02-21T07:42:02.960084+0000","last_active":"2024-02-21T07:42:48.479660+0000","last_peered":"2024-02-21T07:42:48.479660+0000","last_clean":"2024-02-21T07:42:48.479660+0000","last_became_active":"2024-02-21T07:42:02.959610+0000","last_became_peered":"2024-02-21T07:42:02.959610+0000","last_unstale":"2024-02-21T07:42:48.479660+0000","last_undegraded":"2024-02-21T07:42:48.479660+0000","last_fullsized":"2024-02-21T07:42:48.479660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255791+0000","last_change":"2024-02-21T07:42:01.946668+0000","last_active":"2024-02-21T07:42:49.255791+0000","last_peered":"2024-02-21T07:42:49.255791+0000","last_clean":"2024-02-21T07:42:49.255791+0000","last_became_active":"2024-02-21T07:42:01.946454+0000","last_became_peered":"2024-02-21T07:42:01.946454+0000","last_unstale":"2024-02-21T07:42:49.255791+0000","last_undegraded":"2024-02-21T07:42:49.255791+0000","last_fullsized":"2024-02-21T07:42:49.255791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.085966+0000","last_change":"2024-02-21T07:42:49.085966+0000","last_active":"2024-02-21T07:42:49.085966+0000","last_peered":"2024-02-21T07:42:49.085966+0000","last_clean":"2024-02-21T07:42:49.085966+0000","last_became_active":"2024-02-21T07:42:49.085400+0000","last_became_peered":"2024-02-21T07:42:49.085400+0000","last_unstale":"2024-02-21T07:42:49.085966+0000","last_undegraded":"2024-02-21T07:42:49.085966+0000","last_fullsized":"2024-02-21T07:42:49.085966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:38:24.009546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268377+0000","last_change":"2024-02-21T07:42:02.969725+0000","last_active":"2024-02-21T07:42:49.268377+0000","last_peered":"2024-02-21T07:42:49.268377+0000","last_clean":"2024-02-21T07:42:49.268377+0000","last_became_active":"2024-02-21T07:42:02.969125+0000","last_became_peered":"2024-02-21T07:42:02.969125+0000","last_unstale":"2024-02-21T07:42:49.268377+0000","last_undegraded":"2024-02-21T07:42:49.268377+0000","last_fullsized":"2024-02-21T07:42:49.268377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730160+0000","last_change":"2024-02-21T07:42:01.931035+0000","last_active":"2024-02-21T07:42:48.730160+0000","last_peered":"2024-02-21T07:42:48.730160+0000","last_clean":"2024-02-21T07:42:48.730160+0000","last_became_active":"2024-02-21T07:42:01.930665+0000","last_became_peered":"2024-02-21T07:42:01.930665+0000","last_unstale":"2024-02-21T07:42:48.730160+0000","last_undegraded":"2024-02-21T07:42:48.730160+0000","last_fullsized":"2024-02-21T07:42:48.730160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.275276+0000","last_change":"2024-02-21T07:42:49.272248+0000","last_active":"2024-02-21T07:42:49.275276+0000","last_peered":"2024-02-21T07:42:49.275276+0000","last_clean":"2024-02-21T07:42:49.275276+0000","last_became_active":"2024-02-21T07:42:49.271686+0000","last_became_peered":"2024-02-21T07:42:49.271686+0000","last_unstale":"2024-02-21T07:42:49.275276+0000","last_undegraded":"2024-02-21T07:42:49.275276+0000","last_fullsized":"2024-02-21T07:42:49.275276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:59:54.935538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479700+0000","last_change":"2024-02-21T07:42:02.956416+0000","last_active":"2024-02-21T07:42:48.479700+0000","last_peered":"2024-02-21T07:42:48.479700+0000","last_clean":"2024-02-21T07:42:48.479700+0000","last_became_active":"2024-02-21T07:42:02.956098+0000","last_became_peered":"2024-02-21T07:42:02.956098+0000","last_unstale":"2024-02-21T07:42:48.479700+0000","last_undegraded":"2024-02-21T07:42:48.479700+0000","last_fullsized":"2024-02-21T07:42:48.479700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"31'5","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:43:00.347206+0000","last_change":"2024-02-21T07:42:01.937810+0000","last_active":"2024-02-21T07:43:00.347206+0000","last_peered":"2024-02-21T07:43:00.347206+0000","last_clean":"2024-02-21T07:43:00.347206+0000","last_became_active":"2024-02-21T07:42:01.937555+0000","last_became_peered":"2024-02-21T07:42:01.937555+0000","last_unstale":"2024-02-21T07:43:00.347206+0000","last_undegraded":"2024-02-21T07:43:00.347206+0000","last_fullsized":"2024-02-21T07:43:00.347206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269724+0000","last_change":"2024-02-21T07:42:07.013284+0000","last_active":"2024-02-21T07:42:49.269724+0000","last_peered":"2024-02-21T07:42:49.269724+0000","last_clean":"2024-02-21T07:42:49.269724+0000","last_became_active":"2024-02-21T07:42:07.012412+0000","last_became_peered":"2024-02-21T07:42:07.012412+0000","last_unstale":"2024-02-21T07:42:49.269724+0000","last_undegraded":"2024-02-21T07:42:49.269724+0000","last_fullsized":"2024-02-21T07:42:49.269724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268227+0000","last_change":"2024-02-21T07:42:07.016945+0000","last_active":"2024-02-21T07:42:49.268227+0000","last_peered":"2024-02-21T07:42:49.268227+0000","last_clean":"2024-02-21T07:42:49.268227+0000","last_became_active":"2024-02-21T07:42:07.016572+0000","last_became_peered":"2024-02-21T07:42:07.016572+0000","last_unstale":"2024-02-21T07:42:49.268227+0000","last_undegraded":"2024-02-21T07:42:49.268227+0000","last_fullsized":"2024-02-21T07:42:49.268227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.765761+0000","last_change":"2024-02-21T07:42:02.977972+0000","last_active":"2024-02-21T07:42:48.765761+0000","last_peered":"2024-02-21T07:42:48.765761+0000","last_clean":"2024-02-21T07:42:48.765761+0000","last_became_active":"2024-02-21T07:42:02.977632+0000","last_became_peered":"2024-02-21T07:42:02.977632+0000","last_unstale":"2024-02-21T07:42:48.765761+0000","last_undegraded":"2024-02-21T07:42:48.765761+0000","last_fullsized":"2024-02-21T07:42:48.765761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255507+0000","last_change":"2024-02-21T07:42:01.930402+0000","last_active":"2024-02-21T07:42:49.255507+0000","last_peered":"2024-02-21T07:42:49.255507+0000","last_clean":"2024-02-21T07:42:49.255507+0000","last_became_active":"2024-02-21T07:42:01.930084+0000","last_became_peered":"2024-02-21T07:42:01.930084+0000","last_unstale":"2024-02-21T07:42:49.255507+0000","last_undegraded":"2024-02-21T07:42:49.255507+0000","last_fullsized":"2024-02-21T07:42:49.255507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472910+0000","last_change":"2024-02-21T07:42:07.016859+0000","last_active":"2024-02-21T07:42:48.472910+0000","last_peered":"2024-02-21T07:42:48.472910+0000","last_clean":"2024-02-21T07:42:48.472910+0000","last_became_active":"2024-02-21T07:42:07.016372+0000","last_became_peered":"2024-02-21T07:42:07.016372+0000","last_unstale":"2024-02-21T07:42:48.472910+0000","last_undegraded":"2024-02-21T07:42:48.472910+0000","last_fullsized":"2024-02-21T07:42:48.472910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269340+0000","last_change":"2024-02-21T07:42:02.948576+0000","last_active":"2024-02-21T07:42:49.269340+0000","last_peered":"2024-02-21T07:42:49.269340+0000","last_clean":"2024-02-21T07:42:49.269340+0000","last_became_active":"2024-02-21T07:42:02.947666+0000","last_became_peered":"2024-02-21T07:42:02.947666+0000","last_unstale":"2024-02-21T07:42:49.269340+0000","last_undegraded":"2024-02-21T07:42:49.269340+0000","last_fullsized":"2024-02-21T07:42:49.269340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474551+0000","last_change":"2024-02-21T07:42:01.929126+0000","last_active":"2024-02-21T07:42:48.474551+0000","last_peered":"2024-02-21T07:42:48.474551+0000","last_clean":"2024-02-21T07:42:48.474551+0000","last_became_active":"2024-02-21T07:42:01.928667+0000","last_became_peered":"2024-02-21T07:42:01.928667+0000","last_unstale":"2024-02-21T07:42:48.474551+0000","last_undegraded":"2024-02-21T07:42:48.474551+0000","last_fullsized":"2024-02-21T07:42:48.474551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979178+0000","last_change":"2024-02-21T07:42:01.933903+0000","last_active":"2024-02-21T07:42:48.979178+0000","last_peered":"2024-02-21T07:42:48.979178+0000","last_clean":"2024-02-21T07:42:48.979178+0000","last_became_active":"2024-02-21T07:42:01.933578+0000","last_became_peered":"2024-02-21T07:42:01.933578+0000","last_unstale":"2024-02-21T07:42:48.979178+0000","last_undegraded":"2024-02-21T07:42:48.979178+0000","last_fullsized":"2024-02-21T07:42:48.979178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255429+0000","last_change":"2024-02-21T07:42:02.964660+0000","last_active":"2024-02-21T07:42:49.255429+0000","last_peered":"2024-02-21T07:42:49.255429+0000","last_clean":"2024-02-21T07:42:49.255429+0000","last_became_active":"2024-02-21T07:42:02.964389+0000","last_became_peered":"2024-02-21T07:42:02.964389+0000","last_unstale":"2024-02-21T07:42:49.255429+0000","last_undegraded":"2024-02-21T07:42:49.255429+0000","last_fullsized":"2024-02-21T07:42:49.255429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083837+0000","last_change":"2024-02-21T07:42:07.015720+0000","last_active":"2024-02-21T07:42:49.083837+0000","last_peered":"2024-02-21T07:42:49.083837+0000","last_clean":"2024-02-21T07:42:49.083837+0000","last_became_active":"2024-02-21T07:42:07.015315+0000","last_became_peered":"2024-02-21T07:42:07.015315+0000","last_unstale":"2024-02-21T07:42:49.083837+0000","last_undegraded":"2024-02-21T07:42:49.083837+0000","last_fullsized":"2024-02-21T07:42:49.083837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'7","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.346579+0000","last_change":"2024-02-21T07:42:01.927978+0000","last_active":"2024-02-21T07:42:59.346579+0000","last_peered":"2024-02-21T07:42:59.346579+0000","last_clean":"2024-02-21T07:42:59.346579+0000","last_became_active":"2024-02-21T07:42:01.927661+0000","last_became_peered":"2024-02-21T07:42:01.927661+0000","last_unstale":"2024-02-21T07:42:59.346579+0000","last_undegraded":"2024-02-21T07:42:59.346579+0000","last_fullsized":"2024-02-21T07:42:59.346579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477603+0000","last_change":"2024-02-21T07:42:02.971175+0000","last_active":"2024-02-21T07:42:48.477603+0000","last_peered":"2024-02-21T07:42:48.477603+0000","last_clean":"2024-02-21T07:42:48.477603+0000","last_became_active":"2024-02-21T07:42:02.970886+0000","last_became_peered":"2024-02-21T07:42:02.970886+0000","last_unstale":"2024-02-21T07:42:48.477603+0000","last_undegraded":"2024-02-21T07:42:48.477603+0000","last_fullsized":"2024-02-21T07:42:48.477603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084180+0000","last_change":"2024-02-21T07:42:07.003267+0000","last_active":"2024-02-21T07:42:49.084180+0000","last_peered":"2024-02-21T07:42:49.084180+0000","last_clean":"2024-02-21T07:42:49.084180+0000","last_became_active":"2024-02-21T07:42:07.002824+0000","last_became_peered":"2024-02-21T07:42:07.002824+0000","last_unstale":"2024-02-21T07:42:49.084180+0000","last_undegraded":"2024-02-21T07:42:49.084180+0000","last_fullsized":"2024-02-21T07:42:49.084180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472669+0000","last_change":"2024-02-21T07:42:02.960884+0000","last_active":"2024-02-21T07:42:48.472669+0000","last_peered":"2024-02-21T07:42:48.472669+0000","last_clean":"2024-02-21T07:42:48.472669+0000","last_became_active":"2024-02-21T07:42:02.960515+0000","last_became_peered":"2024-02-21T07:42:02.960515+0000","last_unstale":"2024-02-21T07:42:48.472669+0000","last_undegraded":"2024-02-21T07:42:48.472669+0000","last_fullsized":"2024-02-21T07:42:48.472669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083874+0000","last_change":"2024-02-21T07:42:02.960807+0000","last_active":"2024-02-21T07:42:49.083874+0000","last_peered":"2024-02-21T07:42:49.083874+0000","last_clean":"2024-02-21T07:42:49.083874+0000","last_became_active":"2024-02-21T07:42:02.960478+0000","last_became_peered":"2024-02-21T07:42:02.960478+0000","last_unstale":"2024-02-21T07:42:49.083874+0000","last_undegraded":"2024-02-21T07:42:49.083874+0000","last_fullsized":"2024-02-21T07:42:49.083874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083754+0000","last_change":"2024-02-21T07:42:02.966666+0000","last_active":"2024-02-21T07:42:49.083754+0000","last_peered":"2024-02-21T07:42:49.083754+0000","last_clean":"2024-02-21T07:42:49.083754+0000","last_became_active":"2024-02-21T07:42:02.966350+0000","last_became_peered":"2024-02-21T07:42:02.966350+0000","last_unstale":"2024-02-21T07:42:49.083754+0000","last_undegraded":"2024-02-21T07:42:49.083754+0000","last_fullsized":"2024-02-21T07:42:49.083754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267525+0000","last_change":"2024-02-21T07:42:02.973149+0000","last_active":"2024-02-21T07:42:49.267525+0000","last_peered":"2024-02-21T07:42:49.267525+0000","last_clean":"2024-02-21T07:42:49.267525+0000","last_became_active":"2024-02-21T07:42:02.972869+0000","last_became_peered":"2024-02-21T07:42:02.972869+0000","last_unstale":"2024-02-21T07:42:49.267525+0000","last_undegraded":"2024-02-21T07:42:49.267525+0000","last_fullsized":"2024-02-21T07:42:49.267525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475249+0000","last_change":"2024-02-21T07:42:02.957623+0000","last_active":"2024-02-21T07:42:48.475249+0000","last_peered":"2024-02-21T07:42:48.475249+0000","last_clean":"2024-02-21T07:42:48.475249+0000","last_became_active":"2024-02-21T07:42:02.956527+0000","last_became_peered":"2024-02-21T07:42:02.956527+0000","last_unstale":"2024-02-21T07:42:48.475249+0000","last_undegraded":"2024-02-21T07:42:48.475249+0000","last_fullsized":"2024-02-21T07:42:48.475249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473016+0000","last_change":"2024-02-21T07:42:02.961369+0000","last_active":"2024-02-21T07:42:48.473016+0000","last_peered":"2024-02-21T07:42:48.473016+0000","last_clean":"2024-02-21T07:42:48.473016+0000","last_became_active":"2024-02-21T07:42:02.961075+0000","last_became_peered":"2024-02-21T07:42:02.961075+0000","last_unstale":"2024-02-21T07:42:48.473016+0000","last_undegraded":"2024-02-21T07:42:48.473016+0000","last_fullsized":"2024-02-21T07:42:48.473016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084324+0000","last_change":"2024-02-21T07:42:02.960461+0000","last_active":"2024-02-21T07:42:49.084324+0000","last_peered":"2024-02-21T07:42:49.084324+0000","last_clean":"2024-02-21T07:42:49.084324+0000","last_became_active":"2024-02-21T07:42:02.960168+0000","last_became_peered":"2024-02-21T07:42:02.960168+0000","last_unstale":"2024-02-21T07:42:49.084324+0000","last_undegraded":"2024-02-21T07:42:49.084324+0000","last_fullsized":"2024-02-21T07:42:49.084324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271234+0000","last_change":"2024-02-21T07:42:02.966173+0000","last_active":"2024-02-21T07:42:49.271234+0000","last_peered":"2024-02-21T07:42:49.271234+0000","last_clean":"2024-02-21T07:42:49.271234+0000","last_became_active":"2024-02-21T07:42:02.964280+0000","last_became_peered":"2024-02-21T07:42:02.964280+0000","last_unstale":"2024-02-21T07:42:49.271234+0000","last_undegraded":"2024-02-21T07:42:49.271234+0000","last_fullsized":"2024-02-21T07:42:49.271234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255281+0000","last_change":"2024-02-21T07:42:02.975012+0000","last_active":"2024-02-21T07:42:49.255281+0000","last_peered":"2024-02-21T07:42:49.255281+0000","last_clean":"2024-02-21T07:42:49.255281+0000","last_became_active":"2024-02-21T07:42:02.974682+0000","last_became_peered":"2024-02-21T07:42:02.974682+0000","last_unstale":"2024-02-21T07:42:49.255281+0000","last_undegraded":"2024-02-21T07:42:49.255281+0000","last_fullsized":"2024-02-21T07:42:49.255281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270290+0000","last_change":"2024-02-21T07:42:02.966976+0000","last_active":"2024-02-21T07:42:49.270290+0000","last_peered":"2024-02-21T07:42:49.270290+0000","last_clean":"2024-02-21T07:42:49.270290+0000","last_became_active":"2024-02-21T07:42:02.966422+0000","last_became_peered":"2024-02-21T07:42:02.966422+0000","last_unstale":"2024-02-21T07:42:49.270290+0000","last_undegraded":"2024-02-21T07:42:49.270290+0000","last_fullsized":"2024-02-21T07:42:49.270290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.480003+0000","last_change":"2024-02-21T07:42:02.957398+0000","last_active":"2024-02-21T07:42:48.480003+0000","last_peered":"2024-02-21T07:42:48.480003+0000","last_clean":"2024-02-21T07:42:48.480003+0000","last_became_active":"2024-02-21T07:42:02.957115+0000","last_became_peered":"2024-02-21T07:42:02.957115+0000","last_unstale":"2024-02-21T07:42:48.480003+0000","last_undegraded":"2024-02-21T07:42:48.480003+0000","last_fullsized":"2024-02-21T07:42:48.480003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475295+0000","last_change":"2024-02-21T07:42:02.956114+0000","last_active":"2024-02-21T07:42:48.475295+0000","last_peered":"2024-02-21T07:42:48.475295+0000","last_clean":"2024-02-21T07:42:48.475295+0000","last_became_active":"2024-02-21T07:42:02.955476+0000","last_became_peered":"2024-02-21T07:42:02.955476+0000","last_unstale":"2024-02-21T07:42:48.475295+0000","last_undegraded":"2024-02-21T07:42:48.475295+0000","last_fullsized":"2024-02-21T07:42:48.475295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473015+0000","last_change":"2024-02-21T07:42:02.955604+0000","last_active":"2024-02-21T07:42:48.473015+0000","last_peered":"2024-02-21T07:42:48.473015+0000","last_clean":"2024-02-21T07:42:48.473015+0000","last_became_active":"2024-02-21T07:42:02.955327+0000","last_became_peered":"2024-02-21T07:42:02.955327+0000","last_unstale":"2024-02-21T07:42:48.473015+0000","last_undegraded":"2024-02-21T07:42:48.473015+0000","last_fullsized":"2024-02-21T07:42:48.473015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084361+0000","last_change":"2024-02-21T07:42:02.967092+0000","last_active":"2024-02-21T07:42:49.084361+0000","last_peered":"2024-02-21T07:42:49.084361+0000","last_clean":"2024-02-21T07:42:49.084361+0000","last_became_active":"2024-02-21T07:42:02.966845+0000","last_became_peered":"2024-02-21T07:42:02.966845+0000","last_unstale":"2024-02-21T07:42:49.084361+0000","last_undegraded":"2024-02-21T07:42:49.084361+0000","last_fullsized":"2024-02-21T07:42:49.084361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766655+0000","last_change":"2024-02-21T07:42:02.973535+0000","last_active":"2024-02-21T07:42:48.766655+0000","last_peered":"2024-02-21T07:42:48.766655+0000","last_clean":"2024-02-21T07:42:48.766655+0000","last_became_active":"2024-02-21T07:42:02.973202+0000","last_became_peered":"2024-02-21T07:42:02.973202+0000","last_unstale":"2024-02-21T07:42:48.766655+0000","last_undegraded":"2024-02-21T07:42:48.766655+0000","last_fullsized":"2024-02-21T07:42:48.766655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473283+0000","last_change":"2024-02-21T07:42:02.954398+0000","last_active":"2024-02-21T07:42:48.473283+0000","last_peered":"2024-02-21T07:42:48.473283+0000","last_clean":"2024-02-21T07:42:48.473283+0000","last_became_active":"2024-02-21T07:42:02.954099+0000","last_became_peered":"2024-02-21T07:42:02.954099+0000","last_unstale":"2024-02-21T07:42:48.473283+0000","last_undegraded":"2024-02-21T07:42:48.473283+0000","last_fullsized":"2024-02-21T07:42:48.473283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479373+0000","last_change":"2024-02-21T07:42:02.958214+0000","last_active":"2024-02-21T07:42:48.479373+0000","last_peered":"2024-02-21T07:42:48.479373+0000","last_clean":"2024-02-21T07:42:48.479373+0000","last_became_active":"2024-02-21T07:42:02.957885+0000","last_became_peered":"2024-02-21T07:42:02.957885+0000","last_unstale":"2024-02-21T07:42:48.479373+0000","last_undegraded":"2024-02-21T07:42:48.479373+0000","last_fullsized":"2024-02-21T07:42:48.479373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.266995+0000","last_change":"2024-02-21T07:42:02.980607+0000","last_active":"2024-02-21T07:42:49.266995+0000","last_peered":"2024-02-21T07:42:49.266995+0000","last_clean":"2024-02-21T07:42:49.266995+0000","last_became_active":"2024-02-21T07:42:02.980239+0000","last_became_peered":"2024-02-21T07:42:02.980239+0000","last_unstale":"2024-02-21T07:42:49.266995+0000","last_undegraded":"2024-02-21T07:42:49.266995+0000","last_fullsized":"2024-02-21T07:42:49.266995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267159+0000","last_change":"2024-02-21T07:42:02.972536+0000","last_active":"2024-02-21T07:42:49.267159+0000","last_peered":"2024-02-21T07:42:49.267159+0000","last_clean":"2024-02-21T07:42:49.267159+0000","last_became_active":"2024-02-21T07:42:02.972216+0000","last_became_peered":"2024-02-21T07:42:02.972216+0000","last_unstale":"2024-02-21T07:42:49.267159+0000","last_undegraded":"2024-02-21T07:42:49.267159+0000","last_fullsized":"2024-02-21T07:42:49.267159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474978+0000","last_change":"2024-02-21T07:42:02.958082+0000","last_active":"2024-02-21T07:42:48.474978+0000","last_peered":"2024-02-21T07:42:48.474978+0000","last_clean":"2024-02-21T07:42:48.474978+0000","last_became_active":"2024-02-21T07:42:02.957711+0000","last_became_peered":"2024-02-21T07:42:02.957711+0000","last_unstale":"2024-02-21T07:42:48.474978+0000","last_undegraded":"2024-02-21T07:42:48.474978+0000","last_fullsized":"2024-02-21T07:42:48.474978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475415+0000","last_change":"2024-02-21T07:42:02.957799+0000","last_active":"2024-02-21T07:42:48.475415+0000","last_peered":"2024-02-21T07:42:48.475415+0000","last_clean":"2024-02-21T07:42:48.475415+0000","last_became_active":"2024-02-21T07:42:02.957510+0000","last_became_peered":"2024-02-21T07:42:02.957510+0000","last_unstale":"2024-02-21T07:42:48.475415+0000","last_undegraded":"2024-02-21T07:42:48.475415+0000","last_fullsized":"2024-02-21T07:42:48.475415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730379+0000","last_change":"2024-02-21T07:42:02.962565+0000","last_active":"2024-02-21T07:42:48.730379+0000","last_peered":"2024-02-21T07:42:48.730379+0000","last_clean":"2024-02-21T07:42:48.730379+0000","last_became_active":"2024-02-21T07:42:02.962298+0000","last_became_peered":"2024-02-21T07:42:02.962298+0000","last_unstale":"2024-02-21T07:42:48.730379+0000","last_undegraded":"2024-02-21T07:42:48.730379+0000","last_fullsized":"2024-02-21T07:42:48.730379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979764+0000","last_change":"2024-02-21T07:42:02.961018+0000","last_active":"2024-02-21T07:42:48.979764+0000","last_peered":"2024-02-21T07:42:48.979764+0000","last_clean":"2024-02-21T07:42:48.979764+0000","last_became_active":"2024-02-21T07:42:02.960634+0000","last_became_peered":"2024-02-21T07:42:02.960634+0000","last_unstale":"2024-02-21T07:42:48.979764+0000","last_undegraded":"2024-02-21T07:42:48.979764+0000","last_fullsized":"2024-02-21T07:42:48.979764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479750+0000","last_change":"2024-02-21T07:42:02.959426+0000","last_active":"2024-02-21T07:42:48.479750+0000","last_peered":"2024-02-21T07:42:48.479750+0000","last_clean":"2024-02-21T07:42:48.479750+0000","last_became_active":"2024-02-21T07:42:02.959021+0000","last_became_peered":"2024-02-21T07:42:02.959021+0000","last_unstale":"2024-02-21T07:42:48.479750+0000","last_undegraded":"2024-02-21T07:42:48.479750+0000","last_fullsized":"2024-02-21T07:42:48.479750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269079+0000","last_change":"2024-02-21T07:42:02.971151+0000","last_active":"2024-02-21T07:42:49.269079+0000","last_peered":"2024-02-21T07:42:49.269079+0000","last_clean":"2024-02-21T07:42:49.269079+0000","last_became_active":"2024-02-21T07:42:02.967323+0000","last_became_peered":"2024-02-21T07:42:02.967323+0000","last_unstale":"2024-02-21T07:42:49.269079+0000","last_undegraded":"2024-02-21T07:42:49.269079+0000","last_fullsized":"2024-02-21T07:42:49.269079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730044+0000","last_change":"2024-02-21T07:42:02.974767+0000","last_active":"2024-02-21T07:42:48.730044+0000","last_peered":"2024-02-21T07:42:48.730044+0000","last_clean":"2024-02-21T07:42:48.730044+0000","last_became_active":"2024-02-21T07:42:02.974292+0000","last_became_peered":"2024-02-21T07:42:02.974292+0000","last_unstale":"2024-02-21T07:42:48.730044+0000","last_undegraded":"2024-02-21T07:42:48.730044+0000","last_fullsized":"2024-02-21T07:42:48.730044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979118+0000","last_change":"2024-02-21T07:42:02.968079+0000","last_active":"2024-02-21T07:42:48.979118+0000","last_peered":"2024-02-21T07:42:48.979118+0000","last_clean":"2024-02-21T07:42:48.979118+0000","last_became_active":"2024-02-21T07:42:02.967767+0000","last_became_peered":"2024-02-21T07:42:02.967767+0000","last_unstale":"2024-02-21T07:42:48.979118+0000","last_undegraded":"2024-02-21T07:42:48.979118+0000","last_fullsized":"2024-02-21T07:42:48.979118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477567+0000","last_change":"2024-02-21T07:42:02.978031+0000","last_active":"2024-02-21T07:42:48.477567+0000","last_peered":"2024-02-21T07:42:48.477567+0000","last_clean":"2024-02-21T07:42:48.477567+0000","last_became_active":"2024-02-21T07:42:02.977704+0000","last_became_peered":"2024-02-21T07:42:02.977704+0000","last_unstale":"2024-02-21T07:42:48.477567+0000","last_undegraded":"2024-02-21T07:42:48.477567+0000","last_fullsized":"2024-02-21T07:42:48.477567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475325+0000","last_change":"2024-02-21T07:42:02.959959+0000","last_active":"2024-02-21T07:42:48.475325+0000","last_peered":"2024-02-21T07:42:48.475325+0000","last_clean":"2024-02-21T07:42:48.475325+0000","last_became_active":"2024-02-21T07:42:02.959655+0000","last_became_peered":"2024-02-21T07:42:02.959655+0000","last_unstale":"2024-02-21T07:42:48.475325+0000","last_undegraded":"2024-02-21T07:42:48.475325+0000","last_fullsized":"2024-02-21T07:42:48.475325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267187+0000","last_change":"2024-02-21T07:42:02.975851+0000","last_active":"2024-02-21T07:42:49.267187+0000","last_peered":"2024-02-21T07:42:49.267187+0000","last_clean":"2024-02-21T07:42:49.267187+0000","last_became_active":"2024-02-21T07:42:02.973848+0000","last_became_peered":"2024-02-21T07:42:02.973848+0000","last_unstale":"2024-02-21T07:42:49.267187+0000","last_undegraded":"2024-02-21T07:42:49.267187+0000","last_fullsized":"2024-02-21T07:42:49.267187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268544+0000","last_change":"2024-02-21T07:42:02.981681+0000","last_active":"2024-02-21T07:42:49.268544+0000","last_peered":"2024-02-21T07:42:49.268544+0000","last_clean":"2024-02-21T07:42:49.268544+0000","last_became_active":"2024-02-21T07:42:02.981324+0000","last_became_peered":"2024-02-21T07:42:02.981324+0000","last_unstale":"2024-02-21T07:42:49.268544+0000","last_undegraded":"2024-02-21T07:42:49.268544+0000","last_fullsized":"2024-02-21T07:42:49.268544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473173+0000","last_change":"2024-02-21T07:42:02.954466+0000","last_active":"2024-02-21T07:42:48.473173+0000","last_peered":"2024-02-21T07:42:48.473173+0000","last_clean":"2024-02-21T07:42:48.473173+0000","last_became_active":"2024-02-21T07:42:02.954168+0000","last_became_peered":"2024-02-21T07:42:02.954168+0000","last_unstale":"2024-02-21T07:42:48.473173+0000","last_undegraded":"2024-02-21T07:42:48.473173+0000","last_fullsized":"2024-02-21T07:42:48.473173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74249,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":331,"num_read_kb":248,"num_write":250,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":148498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444049,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":164376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.503},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44900000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38500000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.79200000000000004}]},{"osd":7,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.60699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":9,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.67800000000000005}]},{"osd":10,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71299999999999997}]}]},{"osd":10,"up_from":17,"seq":73014444049,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":454656,"data_stored":225411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":0.81499999999999995}]},{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.5990000000000002,"5min":4.5990000000000002,"15min":4.5990000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.69799999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.63800000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66000000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":9,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.2610000000000001,"5min":3.2610000000000001,"15min":3.2610000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.3130000000000002,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.996}]},{"osd":11,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.748}]}]},{"osd":9,"up_from":17,"seq":73014444049,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":167647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.038},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.93999999999999995}]},{"osd":2,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.226},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.52},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"min":{"1min":1.208,"5min":1.208,"15min":1.208},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":1.2969999999999999}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.097},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.6040000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":1.655,"15min":1.655},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.369},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.716}]},{"osd":8,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.74,"15min":1.74},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.403},{"interface":"front","average":{"1min":1.839,"5min":1.839,"15min":1.839},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":3.5209999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":1.8420000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.893,"5min":1.893,"15min":1.893},"min":{"1min":1.353,"5min":1.353,"15min":1.353},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"min":{"1min":1.05,"5min":1.05,"15min":1.05},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.4470000000000001}]},{"osd":11,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":1.843,"15min":1.843},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.79},{"interface":"front","average":{"1min":1.946,"5min":1.946,"15min":1.946},"min":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.7}]}]},{"osd":8,"up_from":17,"seq":73014444048,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":163617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.80900000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41399999999999998}]},{"osd":7,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.62},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69199999999999995}]},{"osd":9,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72699999999999998}]},{"osd":10,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.747}]},{"osd":11,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.77300000000000002}]}]},{"osd":7,"up_from":17,"seq":73014444049,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":759496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48099999999999998}]},{"osd":2,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63700000000000001}]},{"osd":3,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.69999999999999996}]},{"osd":6,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.73399999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71299999999999997}]},{"osd":9,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.81399999999999995}]},{"osd":10,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.77100000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.80300000000000005}]}]},{"osd":6,"up_from":17,"seq":73014444049,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":159393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.75600000000000001}]},{"osd":3,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.65700000000000003}]},{"osd":8,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.0939999999999999,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":0.78700000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":10,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.754,"15min":1.754},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.171},{"interface":"front","average":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.875}]},{"osd":11,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.873,"15min":1.873},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.819,"5min":2.819,"15min":2.819},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.861,"5min":1.861,"15min":1.861},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":3.5659999999999998,"5min":3.5659999999999998,"15min":3.5659999999999998},"last":0.80700000000000005}]}]},{"osd":5,"up_from":17,"seq":73014444049,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":987136,"data_stored":756100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.629}]},{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54800000000000004}]},{"osd":6,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46500000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2,"5min":2,"15min":2},"last":0.72799999999999998}]},{"osd":10,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.505}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444049,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":163862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.875},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.76300000000000001}]},{"osd":1,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.81100000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53900000000000003}]},{"osd":8,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.79700000000000004}]},{"osd":9,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.89100000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.78000000000000003}]},{"osd":11,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.90500000000000003}]}]},{"osd":3,"up_from":17,"seq":73014444049,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":158985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.91000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.595},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2470000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.7669999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":2.0230000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.9319999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":2.5209999999999999},"last":2.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]},{"osd":7,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":2.1429999999999998},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.653}]},{"osd":8,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":2.0870000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":2.2530000000000001},{"interface":"front","average":{"1min":1.708,"5min":1.708,"15min":1.708},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.294,"5min":3.294,"15min":3.294},"last":2.383}]},{"osd":10,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":2.3239999999999998},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.825}]},{"osd":11,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.9260000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":1.988},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":2.1840000000000002}]}]},{"osd":2,"up_from":17,"seq":73014444049,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":161653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.622},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91800000000000004}]},{"osd":4,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.55800000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46700000000000003}]},{"osd":6,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.4299999999999997,"5min":4.4299999999999997,"15min":4.4299999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.749},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.89900000000000002}]},{"osd":8,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67500000000000004}]},{"osd":9,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.876},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69899999999999995}]},{"osd":10,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76300000000000001}]},{"osd":11,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59699999999999998}]}]},{"osd":1,"up_from":17,"seq":73014444049,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":434176,"data_stored":226189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.53200000000000003}]},{"osd":3,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.79800000000000004}]},{"osd":7,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.42599999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.624},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66800000000000004}]},{"osd":9,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.747},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68700000000000006}]}]},{"osd":0,"up_from":17,"seq":73014444050,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":159589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.89500000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.0029999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":1.649}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.125},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7450000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":1.325},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.2189999999999999,"5min":3.2189999999999999,"15min":3.2189999999999999},"last":1.387}]},{"osd":7,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.6190000000000002,"5min":3.6190000000000002,"15min":3.6190000000000002},"last":1.1659999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":1.498},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.4450000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.851}]},{"osd":10,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":1.722,"15min":1.722},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.6600000000000001,"5min":3.6600000000000001,"15min":3.6600000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":7.016,"5min":7.016,"15min":7.016},"last":1.762}]},{"osd":11,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":3.7639999999999998,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":1.5369999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:43:02.518 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:43:02.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.757+0000 7fd92fc00640 1 Processor -- start 2024-02-21T07:43:02.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.757+0000 7fd92fc00640 1 -- start start 2024-02-21T07:43:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.759+0000 7fd92fc00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd92818a660 0x7fd9280cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.759+0000 7fd92fc00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9280cdc50 con 0x7fd9280cd7f0 2024-02-21T07:43:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.759+0000 7fd92fc00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92818aa40 con 0x7fd92818da00 2024-02-21T07:43:02.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.759+0000 7fd92fc00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9280f5b90 con 0x7fd92818a660 2024-02-21T07:43:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.760+0000 7fd92dc00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd92818da00 0x7fd9280f48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:51578/0 (socket says 172.21.15.69:51578) 2024-02-21T07:43:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.760+0000 7fd92dc00640 1 -- 172.21.15.69:0/1680738999 learned_addr learned my addr 172.21.15.69:0/1680738999 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.760+0000 7fd91fe00640 1 --1- 172.21.15.69:0/1680738999 >> v1:172.21.15.174:6789/0 conn(0x7fd9280cd7f0 0x7fd92818d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:40030/0 (socket says 172.21.15.69:40030) 2024-02-21T07:43:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.760+0000 7fd92d200640 1 --2- 172.21.15.69:0/1680738999 >> v2:172.21.15.174:3300/0 conn(0x7fd92818a660 0x7fd9280cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.760+0000 7fd927e00640 1 -- 172.21.15.69:0/1680738999 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433464090 0 0) 0x7fd92818aa40 con 0x7fd92818da00 2024-02-21T07:43:02.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.760+0000 7fd927e00640 1 -- 172.21.15.69:0/1680738999 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd908003520 con 0x7fd92818da00 2024-02-21T07:43:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.760+0000 7fd927e00640 1 -- 172.21.15.69:0/1680738999 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763439280 0 0) 0x7fd918001110 con 0x7fd9280cd7f0 2024-02-21T07:43:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.760+0000 7fd927e00640 1 -- 172.21.15.69:0/1680738999 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd92818aa40 con 0x7fd9280cd7f0 2024-02-21T07:43:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.760+0000 7fd92d200640 1 -- 172.21.15.69:0/1680738999 >> v1:172.21.15.184:6789/0 conn(0x7fd92818da00 legacy=0x7fd9280f48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.761+0000 7fd92d200640 1 -- 172.21.15.69:0/1680738999 >> v1:172.21.15.174:6789/0 conn(0x7fd9280cd7f0 legacy=0x7fd92818d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.761+0000 7fd92d200640 1 -- 172.21.15.69:0/1680738999 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9280cce20 con 0x7fd92818a660 2024-02-21T07:43:02.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.762+0000 7fd92d200640 1 --2- 172.21.15.69:0/1680738999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92818a660 0x7fd9280cd2b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd9100097a0 tx=0x7fd91002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=499746372ea9c2fb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:02.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.762+0000 7fd927e00640 1 -- 172.21.15.69:0/1680738999 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91002e070 con 0x7fd92818a660 2024-02-21T07:43:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.762+0000 7fd927e00640 1 -- 172.21.15.69:0/1680738999 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9100315a0 con 0x7fd92818a660 2024-02-21T07:43:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.762+0000 7fd927e00640 1 -- 172.21.15.69:0/1680738999 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910031910 con 0x7fd92818a660 2024-02-21T07:43:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.763+0000 7fd92fc00640 1 -- 172.21.15.69:0/1680738999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92818a660 msgr2=0x7fd9280cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.763+0000 7fd92fc00640 1 --2- 172.21.15.69:0/1680738999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92818a660 0x7fd9280cd2b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd9100097a0 tx=0x7fd91002b840 comp rx=0 tx=0).stop 2024-02-21T07:43:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.763+0000 7fd92fc00640 1 -- 172.21.15.69:0/1680738999 shutdown_connections 2024-02-21T07:43:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.763+0000 7fd92fc00640 1 --2- 172.21.15.69:0/1680738999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92818a660 0x7fd9280cd2b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.763+0000 7fd92fc00640 1 -- 172.21.15.69:0/1680738999 >> 172.21.15.69:0/1680738999 conn(0x7fd9280f69c0 msgr2=0x7fd9280f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.763+0000 7fd92fc00640 1 -- 172.21.15.69:0/1680738999 shutdown_connections 2024-02-21T07:43:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.763+0000 7fd92fc00640 1 -- 172.21.15.69:0/1680738999 wait complete. 2024-02-21T07:43:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.765+0000 7fd92fc00640 1 Processor -- start 2024-02-21T07:43:02.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.765+0000 7fd92fc00640 1 -- start start 2024-02-21T07:43:02.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.766+0000 7fd92fc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9280cd7f0 0x7fd928173580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:02.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.766+0000 7fd92fc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd92818a660 0x7fd9282235f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:02.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.766+0000 7fd92fc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92818da00 0x7fd928223b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:02.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.766+0000 7fd92fc00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd928224070 con 0x7fd92818a660 2024-02-21T07:43:02.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.766+0000 7fd92fc00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9280efd70 con 0x7fd92818da00 2024-02-21T07:43:02.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.766+0000 7fd92fc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9280f0050 con 0x7fd9280cd7f0 2024-02-21T07:43:02.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.767+0000 7fd91fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd92818a660 0x7fd9282235f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:02.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.767+0000 7fd92d200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9280cd7f0 0x7fd928173580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:02.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.767+0000 7fd91fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd92818a660 0x7fd9282235f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36718/0 (socket says 172.21.15.69:36718) 2024-02-21T07:43:02.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.767+0000 7fd91fe00640 1 -- 172.21.15.69:0/3336103150 learned_addr learned my addr 172.21.15.69:0/3336103150 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:02.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.767+0000 7fd92dc00640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92818da00 0x7fd928223b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:02.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.767+0000 7fd91fe00640 1 -- 172.21.15.69:0/3336103150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9280cd7f0 msgr2=0x7fd928173580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.767+0000 7fd91fe00640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9280cd7f0 0x7fd928173580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.767+0000 7fd91fe00640 1 -- 172.21.15.69:0/3336103150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92818da00 msgr2=0x7fd928223b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.767+0000 7fd91fe00640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92818da00 0x7fd928223b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.767+0000 7fd91fe00640 1 -- 172.21.15.69:0/3336103150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910009400 con 0x7fd92818a660 2024-02-21T07:43:02.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.768+0000 7fd91fe00640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd92818a660 0x7fd9282235f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c3c0 tx=0x7fd91800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:02.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.768+0000 7fd925600640 1 -- 172.21.15.69:0/3336103150 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9180074e0 con 0x7fd92818a660 2024-02-21T07:43:02.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.768+0000 7fd925600640 1 -- 172.21.15.69:0/3336103150 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd918007640 con 0x7fd92818a660 2024-02-21T07:43:02.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.768+0000 7fd92fc00640 1 -- 172.21.15.69:0/3336103150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9280f0330 con 0x7fd92818a660 2024-02-21T07:43:02.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.768+0000 7fd925600640 1 -- 172.21.15.69:0/3336103150 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918004a20 con 0x7fd92818a660 2024-02-21T07:43:02.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.768+0000 7fd92fc00640 1 -- 172.21.15.69:0/3336103150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9280f08f0 con 0x7fd92818a660 2024-02-21T07:43:02.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.769+0000 7fd92fc00640 1 -- 172.21.15.69:0/3336103150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9280cf470 con 0x7fd92818a660 2024-02-21T07:43:02.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.771+0000 7fd925600640 1 -- 172.21.15.69:0/3336103150 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fd918004b80 con 0x7fd92818a660 2024-02-21T07:43:02.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.772+0000 7fd925600640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd90409f130 0x7fd9040a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:02.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.772+0000 7fd925600640 1 -- 172.21.15.69:0/3336103150 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd9180c9450 con 0x7fd92818a660 2024-02-21T07:43:02.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.773+0000 7fd92d200640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd90409f130 0x7fd9040a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:02.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.773+0000 7fd92d200640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd90409f130 0x7fd9040a15f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd910036000 tx=0x7fd91003d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:02.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.777+0000 7fd925600640 1 -- 172.21.15.69:0/3336103150 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd9180930f0 con 0x7fd92818a660 2024-02-21T07:43:02.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.969+0000 7fd92fc00640 1 -- 172.21.15.69:0/3336103150 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd92806dcd0 con 0x7fd90409f130 2024-02-21T07:43:02.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.981+0000 7fd925600640 1 -- 172.21.15.69:0/3336103150 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+413586 (secure 0 0 0) 0x7fd910031a00 con 0x7fd90409f130 2024-02-21T07:43:02.993 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:43:02.996 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-02-21T07:43:02.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.989+0000 7fd92fc00640 1 -- 172.21.15.69:0/3336103150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd90409f130 msgr2=0x7fd9040a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.989+0000 7fd92fc00640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd90409f130 0x7fd9040a15f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd910036000 tx=0x7fd91003d040 comp rx=0 tx=0).stop 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.989+0000 7fd92fc00640 1 -- 172.21.15.69:0/3336103150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd92818a660 msgr2=0x7fd9282235f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.989+0000 7fd92fc00640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd92818a660 0x7fd9282235f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd91800c3c0 tx=0x7fd91800c880 comp rx=0 tx=0).stop 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.990+0000 7fd92fc00640 1 -- 172.21.15.69:0/3336103150 shutdown_connections 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.990+0000 7fd92fc00640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd90409f130 0x7fd9040a15f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.990+0000 7fd92fc00640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd92818da00 0x7fd928223b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.990+0000 7fd92fc00640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd92818a660 0x7fd9282235f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.990+0000 7fd92fc00640 1 --2- 172.21.15.69:0/3336103150 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9280cd7f0 0x7fd928173580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.990+0000 7fd92fc00640 1 -- 172.21.15.69:0/3336103150 >> 172.21.15.69:0/3336103150 conn(0x7fd9280f69c0 msgr2=0x7fd928183700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.990+0000 7fd92fc00640 1 -- 172.21.15.69:0/3336103150 shutdown_connections 2024-02-21T07:43:02.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:02.990+0000 7fd92fc00640 1 -- 172.21.15.69:0/3336103150 wait complete. 2024-02-21T07:43:03.014 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-02-21T07:43:02.457991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664851,"num_objects":102,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":457,"num_read_kb":357,"num_write":433,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":356,"ondisk_log_size":356,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":329896,"kb_used_data":5656,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132132184,"statfs":{"total":1159641169920,"available":1159303356416,"internally_reserved":0,"allocated":5791744,"data_stored":3266318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":331855161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":86,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003263"},"pg_stats":[{"pgid":"2.1f","version":"29'13","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.392964+0000","last_change":"2024-02-21T07:42:01.938302+0000","last_active":"2024-02-21T07:42:59.392964+0000","last_peered":"2024-02-21T07:42:59.392964+0000","last_clean":"2024-02-21T07:42:59.392964+0000","last_became_active":"2024-02-21T07:42:01.935737+0000","last_became_peered":"2024-02-21T07:42:01.935737+0000","last_unstale":"2024-02-21T07:42:59.392964+0000","last_undegraded":"2024-02-21T07:42:59.392964+0000","last_fullsized":"2024-02-21T07:42:59.392964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271108+0000","last_change":"2024-02-21T07:42:02.963926+0000","last_active":"2024-02-21T07:42:49.271108+0000","last_peered":"2024-02-21T07:42:49.271108+0000","last_clean":"2024-02-21T07:42:49.271108+0000","last_became_active":"2024-02-21T07:42:02.963585+0000","last_became_peered":"2024-02-21T07:42:02.963585+0000","last_unstale":"2024-02-21T07:42:49.271108+0000","last_undegraded":"2024-02-21T07:42:49.271108+0000","last_fullsized":"2024-02-21T07:42:49.271108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083699+0000","last_change":"2024-02-21T07:42:07.017236+0000","last_active":"2024-02-21T07:42:49.083699+0000","last_peered":"2024-02-21T07:42:49.083699+0000","last_clean":"2024-02-21T07:42:49.083699+0000","last_became_active":"2024-02-21T07:42:07.016750+0000","last_became_peered":"2024-02-21T07:42:07.016750+0000","last_unstale":"2024-02-21T07:42:49.083699+0000","last_undegraded":"2024-02-21T07:42:49.083699+0000","last_fullsized":"2024-02-21T07:42:49.083699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271355+0000","last_change":"2024-02-21T07:42:01.947176+0000","last_active":"2024-02-21T07:42:49.271355+0000","last_peered":"2024-02-21T07:42:49.271355+0000","last_clean":"2024-02-21T07:42:49.271355+0000","last_became_active":"2024-02-21T07:42:01.946831+0000","last_became_peered":"2024-02-21T07:42:01.946831+0000","last_unstale":"2024-02-21T07:42:49.271355+0000","last_undegraded":"2024-02-21T07:42:49.271355+0000","last_fullsized":"2024-02-21T07:42:49.271355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268284+0000","last_change":"2024-02-21T07:42:02.970038+0000","last_active":"2024-02-21T07:42:49.268284+0000","last_peered":"2024-02-21T07:42:49.268284+0000","last_clean":"2024-02-21T07:42:49.268284+0000","last_became_active":"2024-02-21T07:42:02.969433+0000","last_became_peered":"2024-02-21T07:42:02.969433+0000","last_unstale":"2024-02-21T07:42:49.268284+0000","last_undegraded":"2024-02-21T07:42:49.268284+0000","last_fullsized":"2024-02-21T07:42:49.268284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474778+0000","last_change":"2024-02-21T07:42:07.009585+0000","last_active":"2024-02-21T07:42:48.474778+0000","last_peered":"2024-02-21T07:42:48.474778+0000","last_clean":"2024-02-21T07:42:48.474778+0000","last_became_active":"2024-02-21T07:42:07.009264+0000","last_became_peered":"2024-02-21T07:42:07.009264+0000","last_unstale":"2024-02-21T07:42:48.474778+0000","last_undegraded":"2024-02-21T07:42:48.474778+0000","last_fullsized":"2024-02-21T07:42:48.474778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'12","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477868+0000","last_change":"2024-02-21T07:42:01.930474+0000","last_active":"2024-02-21T07:42:48.477868+0000","last_peered":"2024-02-21T07:42:48.477868+0000","last_clean":"2024-02-21T07:42:48.477868+0000","last_became_active":"2024-02-21T07:42:01.930173+0000","last_became_peered":"2024-02-21T07:42:01.930173+0000","last_unstale":"2024-02-21T07:42:48.477868+0000","last_undegraded":"2024-02-21T07:42:48.477868+0000","last_fullsized":"2024-02-21T07:42:48.477868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:42.554637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479544+0000","last_change":"2024-02-21T07:42:02.955640+0000","last_active":"2024-02-21T07:42:48.479544+0000","last_peered":"2024-02-21T07:42:48.479544+0000","last_clean":"2024-02-21T07:42:48.479544+0000","last_became_active":"2024-02-21T07:42:02.955341+0000","last_became_peered":"2024-02-21T07:42:02.955341+0000","last_unstale":"2024-02-21T07:42:48.479544+0000","last_undegraded":"2024-02-21T07:42:48.479544+0000","last_fullsized":"2024-02-21T07:42:48.479544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475209+0000","last_change":"2024-02-21T07:42:07.013240+0000","last_active":"2024-02-21T07:42:48.475209+0000","last_peered":"2024-02-21T07:42:48.475209+0000","last_clean":"2024-02-21T07:42:48.475209+0000","last_became_active":"2024-02-21T07:42:07.012852+0000","last_became_peered":"2024-02-21T07:42:07.012852+0000","last_unstale":"2024-02-21T07:42:48.475209+0000","last_undegraded":"2024-02-21T07:42:48.475209+0000","last_fullsized":"2024-02-21T07:42:48.475209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477876+0000","last_change":"2024-02-21T07:42:01.933225+0000","last_active":"2024-02-21T07:42:48.477876+0000","last_peered":"2024-02-21T07:42:48.477876+0000","last_clean":"2024-02-21T07:42:48.477876+0000","last_became_active":"2024-02-21T07:42:01.932908+0000","last_became_peered":"2024-02-21T07:42:01.932908+0000","last_unstale":"2024-02-21T07:42:48.477876+0000","last_undegraded":"2024-02-21T07:42:48.477876+0000","last_fullsized":"2024-02-21T07:42:48.477876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255552+0000","last_change":"2024-02-21T07:42:02.965143+0000","last_active":"2024-02-21T07:42:49.255552+0000","last_peered":"2024-02-21T07:42:49.255552+0000","last_clean":"2024-02-21T07:42:49.255552+0000","last_became_active":"2024-02-21T07:42:02.964614+0000","last_became_peered":"2024-02-21T07:42:02.964614+0000","last_unstale":"2024-02-21T07:42:49.255552+0000","last_undegraded":"2024-02-21T07:42:49.255552+0000","last_fullsized":"2024-02-21T07:42:49.255552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474912+0000","last_change":"2024-02-21T07:42:07.017243+0000","last_active":"2024-02-21T07:42:48.474912+0000","last_peered":"2024-02-21T07:42:48.474912+0000","last_clean":"2024-02-21T07:42:48.474912+0000","last_became_active":"2024-02-21T07:42:07.016898+0000","last_became_peered":"2024-02-21T07:42:07.016898+0000","last_unstale":"2024-02-21T07:42:48.474912+0000","last_undegraded":"2024-02-21T07:42:48.474912+0000","last_fullsized":"2024-02-21T07:42:48.474912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730392+0000","last_change":"2024-02-21T07:42:02.961021+0000","last_active":"2024-02-21T07:42:48.730392+0000","last_peered":"2024-02-21T07:42:48.730392+0000","last_clean":"2024-02-21T07:42:48.730392+0000","last_became_active":"2024-02-21T07:42:02.960723+0000","last_became_peered":"2024-02-21T07:42:02.960723+0000","last_unstale":"2024-02-21T07:42:48.730392+0000","last_undegraded":"2024-02-21T07:42:48.730392+0000","last_fullsized":"2024-02-21T07:42:48.730392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477604+0000","last_change":"2024-02-21T07:42:01.928055+0000","last_active":"2024-02-21T07:42:48.477604+0000","last_peered":"2024-02-21T07:42:48.477604+0000","last_clean":"2024-02-21T07:42:48.477604+0000","last_became_active":"2024-02-21T07:42:01.927733+0000","last_became_peered":"2024-02-21T07:42:01.927733+0000","last_unstale":"2024-02-21T07:42:48.477604+0000","last_undegraded":"2024-02-21T07:42:48.477604+0000","last_fullsized":"2024-02-21T07:42:48.477604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475734+0000","last_change":"2024-02-21T07:42:07.124695+0000","last_active":"2024-02-21T07:42:48.475734+0000","last_peered":"2024-02-21T07:42:48.475734+0000","last_clean":"2024-02-21T07:42:48.475734+0000","last_became_active":"2024-02-21T07:42:07.123973+0000","last_became_peered":"2024-02-21T07:42:07.123973+0000","last_unstale":"2024-02-21T07:42:48.475734+0000","last_undegraded":"2024-02-21T07:42:48.475734+0000","last_fullsized":"2024-02-21T07:42:48.475734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270778+0000","last_change":"2024-02-21T07:42:02.982537+0000","last_active":"2024-02-21T07:42:49.270778+0000","last_peered":"2024-02-21T07:42:49.270778+0000","last_clean":"2024-02-21T07:42:49.270778+0000","last_became_active":"2024-02-21T07:42:02.982222+0000","last_became_peered":"2024-02-21T07:42:02.982222+0000","last_unstale":"2024-02-21T07:42:49.270778+0000","last_undegraded":"2024-02-21T07:42:49.270778+0000","last_fullsized":"2024-02-21T07:42:49.270778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083823+0000","last_change":"2024-02-21T07:42:01.942392+0000","last_active":"2024-02-21T07:42:49.083823+0000","last_peered":"2024-02-21T07:42:49.083823+0000","last_clean":"2024-02-21T07:42:49.083823+0000","last_became_active":"2024-02-21T07:42:01.942152+0000","last_became_peered":"2024-02-21T07:42:01.942152+0000","last_unstale":"2024-02-21T07:42:49.083823+0000","last_undegraded":"2024-02-21T07:42:49.083823+0000","last_fullsized":"2024-02-21T07:42:49.083823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475048+0000","last_change":"2024-02-21T07:42:07.015054+0000","last_active":"2024-02-21T07:42:48.475048+0000","last_peered":"2024-02-21T07:42:48.475048+0000","last_clean":"2024-02-21T07:42:48.475048+0000","last_became_active":"2024-02-21T07:42:07.014713+0000","last_became_peered":"2024-02-21T07:42:07.014713+0000","last_unstale":"2024-02-21T07:42:48.475048+0000","last_undegraded":"2024-02-21T07:42:48.475048+0000","last_fullsized":"2024-02-21T07:42:48.475048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472769+0000","last_change":"2024-02-21T07:42:02.970973+0000","last_active":"2024-02-21T07:42:48.472769+0000","last_peered":"2024-02-21T07:42:48.472769+0000","last_clean":"2024-02-21T07:42:48.472769+0000","last_became_active":"2024-02-21T07:42:02.970644+0000","last_became_peered":"2024-02-21T07:42:02.970644+0000","last_unstale":"2024-02-21T07:42:48.472769+0000","last_undegraded":"2024-02-21T07:42:48.472769+0000","last_fullsized":"2024-02-21T07:42:48.472769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'7","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270271+0000","last_change":"2024-02-21T07:42:01.947758+0000","last_active":"2024-02-21T07:42:49.270271+0000","last_peered":"2024-02-21T07:42:49.270271+0000","last_clean":"2024-02-21T07:42:49.270271+0000","last_became_active":"2024-02-21T07:42:01.947407+0000","last_became_peered":"2024-02-21T07:42:01.947407+0000","last_unstale":"2024-02-21T07:42:49.270271+0000","last_undegraded":"2024-02-21T07:42:49.270271+0000","last_fullsized":"2024-02-21T07:42:49.270271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766823+0000","last_change":"2024-02-21T07:42:07.023243+0000","last_active":"2024-02-21T07:42:48.766823+0000","last_peered":"2024-02-21T07:42:48.766823+0000","last_clean":"2024-02-21T07:42:48.766823+0000","last_became_active":"2024-02-21T07:42:07.022308+0000","last_became_peered":"2024-02-21T07:42:07.022308+0000","last_unstale":"2024-02-21T07:42:48.766823+0000","last_undegraded":"2024-02-21T07:42:48.766823+0000","last_fullsized":"2024-02-21T07:42:48.766823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:24.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477347+0000","last_change":"2024-02-21T07:42:02.963456+0000","last_active":"2024-02-21T07:42:48.477347+0000","last_peered":"2024-02-21T07:42:48.477347+0000","last_clean":"2024-02-21T07:42:48.477347+0000","last_became_active":"2024-02-21T07:42:02.963049+0000","last_became_peered":"2024-02-21T07:42:02.963049+0000","last_unstale":"2024-02-21T07:42:48.477347+0000","last_undegraded":"2024-02-21T07:42:48.477347+0000","last_fullsized":"2024-02-21T07:42:48.477347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479529+0000","last_change":"2024-02-21T07:42:01.930737+0000","last_active":"2024-02-21T07:42:48.479529+0000","last_peered":"2024-02-21T07:42:48.479529+0000","last_clean":"2024-02-21T07:42:48.479529+0000","last_became_active":"2024-02-21T07:42:01.930465+0000","last_became_peered":"2024-02-21T07:42:01.930465+0000","last_unstale":"2024-02-21T07:42:48.479529+0000","last_undegraded":"2024-02-21T07:42:48.479529+0000","last_fullsized":"2024-02-21T07:42:48.479529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:08:11.073826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475484+0000","last_change":"2024-02-21T07:42:07.124659+0000","last_active":"2024-02-21T07:42:48.475484+0000","last_peered":"2024-02-21T07:42:48.475484+0000","last_clean":"2024-02-21T07:42:48.475484+0000","last_became_active":"2024-02-21T07:42:07.124217+0000","last_became_peered":"2024-02-21T07:42:07.124217+0000","last_unstale":"2024-02-21T07:42:48.475484+0000","last_undegraded":"2024-02-21T07:42:48.475484+0000","last_fullsized":"2024-02-21T07:42:48.475484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268590+0000","last_change":"2024-02-21T07:42:02.980306+0000","last_active":"2024-02-21T07:42:49.268590+0000","last_peered":"2024-02-21T07:42:49.268590+0000","last_clean":"2024-02-21T07:42:49.268590+0000","last_became_active":"2024-02-21T07:42:02.978879+0000","last_became_peered":"2024-02-21T07:42:02.978879+0000","last_unstale":"2024-02-21T07:42:49.268590+0000","last_undegraded":"2024-02-21T07:42:49.268590+0000","last_fullsized":"2024-02-21T07:42:49.268590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475670+0000","last_change":"2024-02-21T07:42:01.931986+0000","last_active":"2024-02-21T07:42:48.475670+0000","last_peered":"2024-02-21T07:42:48.475670+0000","last_clean":"2024-02-21T07:42:48.475670+0000","last_became_active":"2024-02-21T07:42:01.931671+0000","last_became_peered":"2024-02-21T07:42:01.931671+0000","last_unstale":"2024-02-21T07:42:48.475670+0000","last_undegraded":"2024-02-21T07:42:48.475670+0000","last_fullsized":"2024-02-21T07:42:48.475670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083685+0000","last_change":"2024-02-21T07:42:06.999795+0000","last_active":"2024-02-21T07:42:49.083685+0000","last_peered":"2024-02-21T07:42:49.083685+0000","last_clean":"2024-02-21T07:42:49.083685+0000","last_became_active":"2024-02-21T07:42:06.999315+0000","last_became_peered":"2024-02-21T07:42:06.999315+0000","last_unstale":"2024-02-21T07:42:49.083685+0000","last_undegraded":"2024-02-21T07:42:49.083685+0000","last_fullsized":"2024-02-21T07:42:49.083685+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271316+0000","last_change":"2024-02-21T07:42:02.968914+0000","last_active":"2024-02-21T07:42:49.271316+0000","last_peered":"2024-02-21T07:42:49.271316+0000","last_clean":"2024-02-21T07:42:49.271316+0000","last_became_active":"2024-02-21T07:42:02.961877+0000","last_became_peered":"2024-02-21T07:42:02.961877+0000","last_unstale":"2024-02-21T07:42:49.271316+0000","last_undegraded":"2024-02-21T07:42:49.271316+0000","last_fullsized":"2024-02-21T07:42:49.271316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'14","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766760+0000","last_change":"2024-02-21T07:42:01.937837+0000","last_active":"2024-02-21T07:42:48.766760+0000","last_peered":"2024-02-21T07:42:48.766760+0000","last_clean":"2024-02-21T07:42:48.766760+0000","last_became_active":"2024-02-21T07:42:01.937536+0000","last_became_peered":"2024-02-21T07:42:01.937536+0000","last_unstale":"2024-02-21T07:42:48.766760+0000","last_undegraded":"2024-02-21T07:42:48.766760+0000","last_fullsized":"2024-02-21T07:42:48.766760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269091+0000","last_change":"2024-02-21T07:42:07.125588+0000","last_active":"2024-02-21T07:42:49.269091+0000","last_peered":"2024-02-21T07:42:49.269091+0000","last_clean":"2024-02-21T07:42:49.269091+0000","last_became_active":"2024-02-21T07:42:07.124044+0000","last_became_peered":"2024-02-21T07:42:07.124044+0000","last_unstale":"2024-02-21T07:42:49.269091+0000","last_undegraded":"2024-02-21T07:42:49.269091+0000","last_fullsized":"2024-02-21T07:42:49.269091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475318+0000","last_change":"2024-02-21T07:42:02.961820+0000","last_active":"2024-02-21T07:42:48.475318+0000","last_peered":"2024-02-21T07:42:48.475318+0000","last_clean":"2024-02-21T07:42:48.475318+0000","last_became_active":"2024-02-21T07:42:02.961478+0000","last_became_peered":"2024-02-21T07:42:02.961478+0000","last_unstale":"2024-02-21T07:42:48.475318+0000","last_undegraded":"2024-02-21T07:42:48.475318+0000","last_fullsized":"2024-02-21T07:42:48.475318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477899+0000","last_change":"2024-02-21T07:42:01.947736+0000","last_active":"2024-02-21T07:42:48.477899+0000","last_peered":"2024-02-21T07:42:48.477899+0000","last_clean":"2024-02-21T07:42:48.477899+0000","last_became_active":"2024-02-21T07:42:01.947443+0000","last_became_peered":"2024-02-21T07:42:01.947443+0000","last_unstale":"2024-02-21T07:42:48.477899+0000","last_undegraded":"2024-02-21T07:42:48.477899+0000","last_fullsized":"2024-02-21T07:42:48.477899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:17.915214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472688+0000","last_change":"2024-02-21T07:42:07.008819+0000","last_active":"2024-02-21T07:42:48.472688+0000","last_peered":"2024-02-21T07:42:48.472688+0000","last_clean":"2024-02-21T07:42:48.472688+0000","last_became_active":"2024-02-21T07:42:07.008423+0000","last_became_peered":"2024-02-21T07:42:07.008423+0000","last_unstale":"2024-02-21T07:42:48.472688+0000","last_undegraded":"2024-02-21T07:42:48.472688+0000","last_fullsized":"2024-02-21T07:42:48.472688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979420+0000","last_change":"2024-02-21T07:42:02.975343+0000","last_active":"2024-02-21T07:42:48.979420+0000","last_peered":"2024-02-21T07:42:48.979420+0000","last_clean":"2024-02-21T07:42:48.979420+0000","last_became_active":"2024-02-21T07:42:02.975041+0000","last_became_peered":"2024-02-21T07:42:02.975041+0000","last_unstale":"2024-02-21T07:42:48.979420+0000","last_undegraded":"2024-02-21T07:42:48.979420+0000","last_fullsized":"2024-02-21T07:42:48.979420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766490+0000","last_change":"2024-02-21T07:42:01.935020+0000","last_active":"2024-02-21T07:42:48.766490+0000","last_peered":"2024-02-21T07:42:48.766490+0000","last_clean":"2024-02-21T07:42:48.766490+0000","last_became_active":"2024-02-21T07:42:01.934752+0000","last_became_peered":"2024-02-21T07:42:01.934752+0000","last_unstale":"2024-02-21T07:42:48.766490+0000","last_undegraded":"2024-02-21T07:42:48.766490+0000","last_fullsized":"2024-02-21T07:42:48.766490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477397+0000","last_change":"2024-02-21T07:42:07.124477+0000","last_active":"2024-02-21T07:42:48.477397+0000","last_peered":"2024-02-21T07:42:48.477397+0000","last_clean":"2024-02-21T07:42:48.477397+0000","last_became_active":"2024-02-21T07:42:07.123915+0000","last_became_peered":"2024-02-21T07:42:07.123915+0000","last_unstale":"2024-02-21T07:42:48.477397+0000","last_undegraded":"2024-02-21T07:42:48.477397+0000","last_fullsized":"2024-02-21T07:42:48.477397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979201+0000","last_change":"2024-02-21T07:42:02.964531+0000","last_active":"2024-02-21T07:42:48.979201+0000","last_peered":"2024-02-21T07:42:48.979201+0000","last_clean":"2024-02-21T07:42:48.979201+0000","last_became_active":"2024-02-21T07:42:02.964185+0000","last_became_peered":"2024-02-21T07:42:02.964185+0000","last_unstale":"2024-02-21T07:42:48.979201+0000","last_undegraded":"2024-02-21T07:42:48.979201+0000","last_fullsized":"2024-02-21T07:42:48.979201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.393673+0000","last_change":"2024-02-21T07:42:01.934093+0000","last_active":"2024-02-21T07:42:59.393673+0000","last_peered":"2024-02-21T07:42:59.393673+0000","last_clean":"2024-02-21T07:42:59.393673+0000","last_became_active":"2024-02-21T07:42:01.933841+0000","last_became_peered":"2024-02-21T07:42:01.933841+0000","last_unstale":"2024-02-21T07:42:59.393673+0000","last_undegraded":"2024-02-21T07:42:59.393673+0000","last_fullsized":"2024-02-21T07:42:59.393673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475132+0000","last_change":"2024-02-21T07:42:07.018134+0000","last_active":"2024-02-21T07:42:48.475132+0000","last_peered":"2024-02-21T07:42:48.475132+0000","last_clean":"2024-02-21T07:42:48.475132+0000","last_became_active":"2024-02-21T07:42:07.017670+0000","last_became_peered":"2024-02-21T07:42:07.017670+0000","last_unstale":"2024-02-21T07:42:48.475132+0000","last_undegraded":"2024-02-21T07:42:48.475132+0000","last_fullsized":"2024-02-21T07:42:48.475132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255349+0000","last_change":"2024-02-21T07:42:02.962279+0000","last_active":"2024-02-21T07:42:49.255349+0000","last_peered":"2024-02-21T07:42:49.255349+0000","last_clean":"2024-02-21T07:42:49.255349+0000","last_became_active":"2024-02-21T07:42:02.961965+0000","last_became_peered":"2024-02-21T07:42:02.961965+0000","last_unstale":"2024-02-21T07:42:49.255349+0000","last_undegraded":"2024-02-21T07:42:49.255349+0000","last_fullsized":"2024-02-21T07:42:49.255349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'5","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.362529+0000","last_change":"2024-02-21T07:42:01.948478+0000","last_active":"2024-02-21T07:42:59.362529+0000","last_peered":"2024-02-21T07:42:59.362529+0000","last_clean":"2024-02-21T07:42:59.362529+0000","last_became_active":"2024-02-21T07:42:01.948184+0000","last_became_peered":"2024-02-21T07:42:01.948184+0000","last_unstale":"2024-02-21T07:42:59.362529+0000","last_undegraded":"2024-02-21T07:42:59.362529+0000","last_fullsized":"2024-02-21T07:42:59.362529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475526+0000","last_change":"2024-02-21T07:42:07.124759+0000","last_active":"2024-02-21T07:42:48.475526+0000","last_peered":"2024-02-21T07:42:48.475526+0000","last_clean":"2024-02-21T07:42:48.475526+0000","last_became_active":"2024-02-21T07:42:07.124275+0000","last_became_peered":"2024-02-21T07:42:07.124275+0000","last_unstale":"2024-02-21T07:42:48.475526+0000","last_undegraded":"2024-02-21T07:42:48.475526+0000","last_fullsized":"2024-02-21T07:42:48.475526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474564+0000","last_change":"2024-02-21T07:42:02.961213+0000","last_active":"2024-02-21T07:42:48.474564+0000","last_peered":"2024-02-21T07:42:48.474564+0000","last_clean":"2024-02-21T07:42:48.474564+0000","last_became_active":"2024-02-21T07:42:02.960477+0000","last_became_peered":"2024-02-21T07:42:02.960477+0000","last_unstale":"2024-02-21T07:42:48.474564+0000","last_undegraded":"2024-02-21T07:42:48.474564+0000","last_fullsized":"2024-02-21T07:42:48.474564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.729819+0000","last_change":"2024-02-21T07:42:01.928302+0000","last_active":"2024-02-21T07:42:48.729819+0000","last_peered":"2024-02-21T07:42:48.729819+0000","last_clean":"2024-02-21T07:42:48.729819+0000","last_became_active":"2024-02-21T07:42:01.927234+0000","last_became_peered":"2024-02-21T07:42:01.927234+0000","last_unstale":"2024-02-21T07:42:48.729819+0000","last_undegraded":"2024-02-21T07:42:48.729819+0000","last_fullsized":"2024-02-21T07:42:48.729819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255689+0000","last_change":"2024-02-21T07:42:07.124715+0000","last_active":"2024-02-21T07:42:49.255689+0000","last_peered":"2024-02-21T07:42:49.255689+0000","last_clean":"2024-02-21T07:42:49.255689+0000","last_became_active":"2024-02-21T07:42:07.124248+0000","last_became_peered":"2024-02-21T07:42:07.124248+0000","last_unstale":"2024-02-21T07:42:49.255689+0000","last_undegraded":"2024-02-21T07:42:49.255689+0000","last_fullsized":"2024-02-21T07:42:49.255689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:17:21.721728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270752+0000","last_change":"2024-02-21T07:42:02.971762+0000","last_active":"2024-02-21T07:42:49.270752+0000","last_peered":"2024-02-21T07:42:49.270752+0000","last_clean":"2024-02-21T07:42:49.270752+0000","last_became_active":"2024-02-21T07:42:02.970032+0000","last_became_peered":"2024-02-21T07:42:02.970032+0000","last_unstale":"2024-02-21T07:42:49.270752+0000","last_undegraded":"2024-02-21T07:42:49.270752+0000","last_fullsized":"2024-02-21T07:42:49.270752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475449+0000","last_change":"2024-02-21T07:42:01.932968+0000","last_active":"2024-02-21T07:42:48.475449+0000","last_peered":"2024-02-21T07:42:48.475449+0000","last_clean":"2024-02-21T07:42:48.475449+0000","last_became_active":"2024-02-21T07:42:01.932620+0000","last_became_peered":"2024-02-21T07:42:01.932620+0000","last_unstale":"2024-02-21T07:42:48.475449+0000","last_undegraded":"2024-02-21T07:42:48.475449+0000","last_fullsized":"2024-02-21T07:42:48.475449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730104+0000","last_change":"2024-02-21T07:41:57.883808+0000","last_active":"2024-02-21T07:42:48.730104+0000","last_peered":"2024-02-21T07:42:48.730104+0000","last_clean":"2024-02-21T07:42:48.730104+0000","last_became_active":"2024-02-21T07:41:57.883530+0000","last_became_peered":"2024-02-21T07:41:57.883530+0000","last_unstale":"2024-02-21T07:42:48.730104+0000","last_undegraded":"2024-02-21T07:42:48.730104+0000","last_fullsized":"2024-02-21T07:42:48.730104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_clean_scrub_stamp":"2024-02-21T07:41:56.862963+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:09:51.756066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730094+0000","last_change":"2024-02-21T07:42:07.011954+0000","last_active":"2024-02-21T07:42:48.730094+0000","last_peered":"2024-02-21T07:42:48.730094+0000","last_clean":"2024-02-21T07:42:48.730094+0000","last_became_active":"2024-02-21T07:42:07.011654+0000","last_became_peered":"2024-02-21T07:42:07.011654+0000","last_unstale":"2024-02-21T07:42:48.730094+0000","last_undegraded":"2024-02-21T07:42:48.730094+0000","last_fullsized":"2024-02-21T07:42:48.730094+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730347+0000","last_change":"2024-02-21T07:42:02.956569+0000","last_active":"2024-02-21T07:42:48.730347+0000","last_peered":"2024-02-21T07:42:48.730347+0000","last_clean":"2024-02-21T07:42:48.730347+0000","last_became_active":"2024-02-21T07:42:02.956232+0000","last_became_peered":"2024-02-21T07:42:02.956232+0000","last_unstale":"2024-02-21T07:42:48.730347+0000","last_undegraded":"2024-02-21T07:42:48.730347+0000","last_fullsized":"2024-02-21T07:42:48.730347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.346411+0000","last_change":"2024-02-21T07:42:01.926736+0000","last_active":"2024-02-21T07:42:59.346411+0000","last_peered":"2024-02-21T07:42:59.346411+0000","last_clean":"2024-02-21T07:42:59.346411+0000","last_became_active":"2024-02-21T07:42:01.926454+0000","last_became_peered":"2024-02-21T07:42:01.926454+0000","last_unstale":"2024-02-21T07:42:59.346411+0000","last_undegraded":"2024-02-21T07:42:59.346411+0000","last_fullsized":"2024-02-21T07:42:59.346411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.731511+0000","last_change":"2024-02-21T07:42:48.731511+0000","last_active":"2024-02-21T07:42:48.731511+0000","last_peered":"2024-02-21T07:42:48.731511+0000","last_clean":"2024-02-21T07:42:48.731511+0000","last_became_active":"2024-02-21T07:42:48.731074+0000","last_became_peered":"2024-02-21T07:42:48.731074+0000","last_unstale":"2024-02-21T07:42:48.731511+0000","last_undegraded":"2024-02-21T07:42:48.731511+0000","last_fullsized":"2024-02-21T07:42:48.731511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:49:35.717727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730270+0000","last_change":"2024-02-21T07:42:02.976255+0000","last_active":"2024-02-21T07:42:48.730270+0000","last_peered":"2024-02-21T07:42:48.730270+0000","last_clean":"2024-02-21T07:42:48.730270+0000","last_became_active":"2024-02-21T07:42:02.975927+0000","last_became_peered":"2024-02-21T07:42:02.975927+0000","last_unstale":"2024-02-21T07:42:48.730270+0000","last_undegraded":"2024-02-21T07:42:48.730270+0000","last_fullsized":"2024-02-21T07:42:48.730270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255791+0000","last_change":"2024-02-21T07:42:01.932488+0000","last_active":"2024-02-21T07:42:49.255791+0000","last_peered":"2024-02-21T07:42:49.255791+0000","last_clean":"2024-02-21T07:42:49.255791+0000","last_became_active":"2024-02-21T07:42:01.932131+0000","last_became_peered":"2024-02-21T07:42:01.932131+0000","last_unstale":"2024-02-21T07:42:49.255791+0000","last_undegraded":"2024-02-21T07:42:49.255791+0000","last_fullsized":"2024-02-21T07:42:49.255791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267461+0000","last_change":"2024-02-21T07:42:07.017329+0000","last_active":"2024-02-21T07:42:49.267461+0000","last_peered":"2024-02-21T07:42:49.267461+0000","last_clean":"2024-02-21T07:42:49.267461+0000","last_became_active":"2024-02-21T07:42:07.016916+0000","last_became_peered":"2024-02-21T07:42:07.016916+0000","last_unstale":"2024-02-21T07:42:49.267461+0000","last_undegraded":"2024-02-21T07:42:49.267461+0000","last_fullsized":"2024-02-21T07:42:49.267461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730155+0000","last_change":"2024-02-21T07:42:02.959157+0000","last_active":"2024-02-21T07:42:48.730155+0000","last_peered":"2024-02-21T07:42:48.730155+0000","last_clean":"2024-02-21T07:42:48.730155+0000","last_became_active":"2024-02-21T07:42:02.958593+0000","last_became_peered":"2024-02-21T07:42:02.958593+0000","last_unstale":"2024-02-21T07:42:48.730155+0000","last_undegraded":"2024-02-21T07:42:48.730155+0000","last_fullsized":"2024-02-21T07:42:48.730155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:55.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475193+0000","last_change":"2024-02-21T07:42:01.949434+0000","last_active":"2024-02-21T07:42:48.475193+0000","last_peered":"2024-02-21T07:42:48.475193+0000","last_clean":"2024-02-21T07:42:48.475193+0000","last_became_active":"2024-02-21T07:42:01.948805+0000","last_became_peered":"2024-02-21T07:42:01.948805+0000","last_unstale":"2024-02-21T07:42:48.475193+0000","last_undegraded":"2024-02-21T07:42:48.475193+0000","last_fullsized":"2024-02-21T07:42:48.475193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255139+0000","last_change":"2024-02-21T07:42:07.003190+0000","last_active":"2024-02-21T07:42:49.255139+0000","last_peered":"2024-02-21T07:42:49.255139+0000","last_clean":"2024-02-21T07:42:49.255139+0000","last_became_active":"2024-02-21T07:42:07.002780+0000","last_became_peered":"2024-02-21T07:42:07.002780+0000","last_unstale":"2024-02-21T07:42:49.255139+0000","last_undegraded":"2024-02-21T07:42:49.255139+0000","last_fullsized":"2024-02-21T07:42:49.255139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473048+0000","last_change":"2024-02-21T07:42:02.959569+0000","last_active":"2024-02-21T07:42:48.473048+0000","last_peered":"2024-02-21T07:42:48.473048+0000","last_clean":"2024-02-21T07:42:48.473048+0000","last_became_active":"2024-02-21T07:42:02.959146+0000","last_became_peered":"2024-02-21T07:42:02.959146+0000","last_unstale":"2024-02-21T07:42:48.473048+0000","last_undegraded":"2024-02-21T07:42:48.473048+0000","last_fullsized":"2024-02-21T07:42:48.473048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477817+0000","last_change":"2024-02-21T07:42:01.926878+0000","last_active":"2024-02-21T07:42:48.477817+0000","last_peered":"2024-02-21T07:42:48.477817+0000","last_clean":"2024-02-21T07:42:48.477817+0000","last_became_active":"2024-02-21T07:42:01.926212+0000","last_became_peered":"2024-02-21T07:42:01.926212+0000","last_unstale":"2024-02-21T07:42:48.477817+0000","last_undegraded":"2024-02-21T07:42:48.477817+0000","last_fullsized":"2024-02-21T07:42:48.477817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255229+0000","last_change":"2024-02-21T07:42:07.017443+0000","last_active":"2024-02-21T07:42:49.255229+0000","last_peered":"2024-02-21T07:42:49.255229+0000","last_clean":"2024-02-21T07:42:49.255229+0000","last_became_active":"2024-02-21T07:42:07.016918+0000","last_became_peered":"2024-02-21T07:42:07.016918+0000","last_unstale":"2024-02-21T07:42:49.255229+0000","last_undegraded":"2024-02-21T07:42:49.255229+0000","last_fullsized":"2024-02-21T07:42:49.255229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:49:35.717727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255615+0000","last_change":"2024-02-21T07:42:02.965178+0000","last_active":"2024-02-21T07:42:49.255615+0000","last_peered":"2024-02-21T07:42:49.255615+0000","last_clean":"2024-02-21T07:42:49.255615+0000","last_became_active":"2024-02-21T07:42:02.964846+0000","last_became_peered":"2024-02-21T07:42:02.964846+0000","last_unstale":"2024-02-21T07:42:49.255615+0000","last_undegraded":"2024-02-21T07:42:49.255615+0000","last_fullsized":"2024-02-21T07:42:49.255615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'17","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477336+0000","last_change":"2024-02-21T07:42:01.946183+0000","last_active":"2024-02-21T07:42:48.477336+0000","last_peered":"2024-02-21T07:42:48.477336+0000","last_clean":"2024-02-21T07:42:48.477336+0000","last_became_active":"2024-02-21T07:42:01.945960+0000","last_became_peered":"2024-02-21T07:42:01.945960+0000","last_unstale":"2024-02-21T07:42:48.477336+0000","last_undegraded":"2024-02-21T07:42:48.477336+0000","last_fullsized":"2024-02-21T07:42:48.477336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.275007+0000","last_change":"2024-02-21T07:42:49.275007+0000","last_active":"2024-02-21T07:42:49.275007+0000","last_peered":"2024-02-21T07:42:49.275007+0000","last_clean":"2024-02-21T07:42:49.275007+0000","last_became_active":"2024-02-21T07:42:49.273404+0000","last_became_peered":"2024-02-21T07:42:49.273404+0000","last_unstale":"2024-02-21T07:42:49.275007+0000","last_undegraded":"2024-02-21T07:42:49.275007+0000","last_fullsized":"2024-02-21T07:42:49.275007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:38:24.009546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.729810+0000","last_change":"2024-02-21T07:42:02.960144+0000","last_active":"2024-02-21T07:42:48.729810+0000","last_peered":"2024-02-21T07:42:48.729810+0000","last_clean":"2024-02-21T07:42:48.729810+0000","last_became_active":"2024-02-21T07:42:02.959714+0000","last_became_peered":"2024-02-21T07:42:02.959714+0000","last_unstale":"2024-02-21T07:42:48.729810+0000","last_undegraded":"2024-02-21T07:42:48.729810+0000","last_fullsized":"2024-02-21T07:42:48.729810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.363160+0000","last_change":"2024-02-21T07:42:01.930429+0000","last_active":"2024-02-21T07:42:59.363160+0000","last_peered":"2024-02-21T07:42:59.363160+0000","last_clean":"2024-02-21T07:42:59.363160+0000","last_became_active":"2024-02-21T07:42:01.930076+0000","last_became_peered":"2024-02-21T07:42:01.930076+0000","last_unstale":"2024-02-21T07:42:59.363160+0000","last_undegraded":"2024-02-21T07:42:59.363160+0000","last_fullsized":"2024-02-21T07:42:59.363160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766660+0000","last_change":"2024-02-21T07:42:07.025234+0000","last_active":"2024-02-21T07:42:48.766660+0000","last_peered":"2024-02-21T07:42:48.766660+0000","last_clean":"2024-02-21T07:42:48.766660+0000","last_became_active":"2024-02-21T07:42:07.024452+0000","last_became_peered":"2024-02-21T07:42:07.024452+0000","last_unstale":"2024-02-21T07:42:48.766660+0000","last_undegraded":"2024-02-21T07:42:48.766660+0000","last_fullsized":"2024-02-21T07:42:48.766660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730040+0000","last_change":"2024-02-21T07:42:02.958015+0000","last_active":"2024-02-21T07:42:48.730040+0000","last_peered":"2024-02-21T07:42:48.730040+0000","last_clean":"2024-02-21T07:42:48.730040+0000","last_became_active":"2024-02-21T07:42:02.956436+0000","last_became_peered":"2024-02-21T07:42:02.956436+0000","last_unstale":"2024-02-21T07:42:48.730040+0000","last_undegraded":"2024-02-21T07:42:48.730040+0000","last_fullsized":"2024-02-21T07:42:48.730040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:39.265082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255581+0000","last_change":"2024-02-21T07:42:01.943079+0000","last_active":"2024-02-21T07:42:49.255581+0000","last_peered":"2024-02-21T07:42:49.255581+0000","last_clean":"2024-02-21T07:42:49.255581+0000","last_became_active":"2024-02-21T07:42:01.942831+0000","last_became_peered":"2024-02-21T07:42:01.942831+0000","last_unstale":"2024-02-21T07:42:49.255581+0000","last_undegraded":"2024-02-21T07:42:49.255581+0000","last_fullsized":"2024-02-21T07:42:49.255581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472680+0000","last_change":"2024-02-21T07:42:07.015228+0000","last_active":"2024-02-21T07:42:48.472680+0000","last_peered":"2024-02-21T07:42:48.472680+0000","last_clean":"2024-02-21T07:42:48.472680+0000","last_became_active":"2024-02-21T07:42:07.014798+0000","last_became_peered":"2024-02-21T07:42:07.014798+0000","last_unstale":"2024-02-21T07:42:48.472680+0000","last_undegraded":"2024-02-21T07:42:48.472680+0000","last_fullsized":"2024-02-21T07:42:48.472680+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474857+0000","last_change":"2024-02-21T07:42:02.965287+0000","last_active":"2024-02-21T07:42:48.474857+0000","last_peered":"2024-02-21T07:42:48.474857+0000","last_clean":"2024-02-21T07:42:48.474857+0000","last_became_active":"2024-02-21T07:42:02.960780+0000","last_became_peered":"2024-02-21T07:42:02.960780+0000","last_unstale":"2024-02-21T07:42:48.474857+0000","last_undegraded":"2024-02-21T07:42:48.474857+0000","last_fullsized":"2024-02-21T07:42:48.474857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084260+0000","last_change":"2024-02-21T07:42:01.932401+0000","last_active":"2024-02-21T07:42:49.084260+0000","last_peered":"2024-02-21T07:42:49.084260+0000","last_clean":"2024-02-21T07:42:49.084260+0000","last_became_active":"2024-02-21T07:42:01.932108+0000","last_became_peered":"2024-02-21T07:42:01.932108+0000","last_unstale":"2024-02-21T07:42:49.084260+0000","last_undegraded":"2024-02-21T07:42:49.084260+0000","last_fullsized":"2024-02-21T07:42:49.084260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255518+0000","last_change":"2024-02-21T07:42:07.018725+0000","last_active":"2024-02-21T07:42:49.255518+0000","last_peered":"2024-02-21T07:42:49.255518+0000","last_clean":"2024-02-21T07:42:49.255518+0000","last_became_active":"2024-02-21T07:42:07.018322+0000","last_became_peered":"2024-02-21T07:42:07.018322+0000","last_unstale":"2024-02-21T07:42:49.255518+0000","last_undegraded":"2024-02-21T07:42:49.255518+0000","last_fullsized":"2024-02-21T07:42:49.255518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:04:05.896966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477711+0000","last_change":"2024-02-21T07:42:02.963384+0000","last_active":"2024-02-21T07:42:48.477711+0000","last_peered":"2024-02-21T07:42:48.477711+0000","last_clean":"2024-02-21T07:42:48.477711+0000","last_became_active":"2024-02-21T07:42:02.963098+0000","last_became_peered":"2024-02-21T07:42:02.963098+0000","last_unstale":"2024-02-21T07:42:48.477711+0000","last_undegraded":"2024-02-21T07:42:48.477711+0000","last_fullsized":"2024-02-21T07:42:48.477711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"31'36","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:43:00.352806+0000","last_change":"2024-02-21T07:42:01.936472+0000","last_active":"2024-02-21T07:43:00.352806+0000","last_peered":"2024-02-21T07:43:00.352806+0000","last_clean":"2024-02-21T07:43:00.352806+0000","last_became_active":"2024-02-21T07:42:01.936181+0000","last_became_peered":"2024-02-21T07:42:01.936181+0000","last_unstale":"2024-02-21T07:43:00.352806+0000","last_undegraded":"2024-02-21T07:43:00.352806+0000","last_fullsized":"2024-02-21T07:43:00.352806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66332,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":99,"num_write":38,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.765829+0000","last_change":"2024-02-21T07:42:07.013938+0000","last_active":"2024-02-21T07:42:48.765829+0000","last_peered":"2024-02-21T07:42:48.765829+0000","last_clean":"2024-02-21T07:42:48.765829+0000","last_became_active":"2024-02-21T07:42:07.013409+0000","last_became_peered":"2024-02-21T07:42:07.013409+0000","last_unstale":"2024-02-21T07:42:48.765829+0000","last_undegraded":"2024-02-21T07:42:48.765829+0000","last_fullsized":"2024-02-21T07:42:48.765829+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:52:00.302670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479660+0000","last_change":"2024-02-21T07:42:02.960084+0000","last_active":"2024-02-21T07:42:48.479660+0000","last_peered":"2024-02-21T07:42:48.479660+0000","last_clean":"2024-02-21T07:42:48.479660+0000","last_became_active":"2024-02-21T07:42:02.959610+0000","last_became_peered":"2024-02-21T07:42:02.959610+0000","last_unstale":"2024-02-21T07:42:48.479660+0000","last_undegraded":"2024-02-21T07:42:48.479660+0000","last_fullsized":"2024-02-21T07:42:48.479660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255791+0000","last_change":"2024-02-21T07:42:01.946668+0000","last_active":"2024-02-21T07:42:49.255791+0000","last_peered":"2024-02-21T07:42:49.255791+0000","last_clean":"2024-02-21T07:42:49.255791+0000","last_became_active":"2024-02-21T07:42:01.946454+0000","last_became_peered":"2024-02-21T07:42:01.946454+0000","last_unstale":"2024-02-21T07:42:49.255791+0000","last_undegraded":"2024-02-21T07:42:49.255791+0000","last_fullsized":"2024-02-21T07:42:49.255791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.085966+0000","last_change":"2024-02-21T07:42:49.085966+0000","last_active":"2024-02-21T07:42:49.085966+0000","last_peered":"2024-02-21T07:42:49.085966+0000","last_clean":"2024-02-21T07:42:49.085966+0000","last_became_active":"2024-02-21T07:42:49.085400+0000","last_became_peered":"2024-02-21T07:42:49.085400+0000","last_unstale":"2024-02-21T07:42:49.085966+0000","last_undegraded":"2024-02-21T07:42:49.085966+0000","last_fullsized":"2024-02-21T07:42:49.085966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:38:24.009546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268377+0000","last_change":"2024-02-21T07:42:02.969725+0000","last_active":"2024-02-21T07:42:49.268377+0000","last_peered":"2024-02-21T07:42:49.268377+0000","last_clean":"2024-02-21T07:42:49.268377+0000","last_became_active":"2024-02-21T07:42:02.969125+0000","last_became_peered":"2024-02-21T07:42:02.969125+0000","last_unstale":"2024-02-21T07:42:49.268377+0000","last_undegraded":"2024-02-21T07:42:49.268377+0000","last_fullsized":"2024-02-21T07:42:49.268377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730160+0000","last_change":"2024-02-21T07:42:01.931035+0000","last_active":"2024-02-21T07:42:48.730160+0000","last_peered":"2024-02-21T07:42:48.730160+0000","last_clean":"2024-02-21T07:42:48.730160+0000","last_became_active":"2024-02-21T07:42:01.930665+0000","last_became_peered":"2024-02-21T07:42:01.930665+0000","last_unstale":"2024-02-21T07:42:48.730160+0000","last_undegraded":"2024-02-21T07:42:48.730160+0000","last_fullsized":"2024-02-21T07:42:48.730160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.275276+0000","last_change":"2024-02-21T07:42:49.272248+0000","last_active":"2024-02-21T07:42:49.275276+0000","last_peered":"2024-02-21T07:42:49.275276+0000","last_clean":"2024-02-21T07:42:49.275276+0000","last_became_active":"2024-02-21T07:42:49.271686+0000","last_became_peered":"2024-02-21T07:42:49.271686+0000","last_unstale":"2024-02-21T07:42:49.275276+0000","last_undegraded":"2024-02-21T07:42:49.275276+0000","last_fullsized":"2024-02-21T07:42:49.275276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:59:54.935538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479700+0000","last_change":"2024-02-21T07:42:02.956416+0000","last_active":"2024-02-21T07:42:48.479700+0000","last_peered":"2024-02-21T07:42:48.479700+0000","last_clean":"2024-02-21T07:42:48.479700+0000","last_became_active":"2024-02-21T07:42:02.956098+0000","last_became_peered":"2024-02-21T07:42:02.956098+0000","last_unstale":"2024-02-21T07:42:48.479700+0000","last_undegraded":"2024-02-21T07:42:48.479700+0000","last_fullsized":"2024-02-21T07:42:48.479700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"31'5","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:43:00.347206+0000","last_change":"2024-02-21T07:42:01.937810+0000","last_active":"2024-02-21T07:43:00.347206+0000","last_peered":"2024-02-21T07:43:00.347206+0000","last_clean":"2024-02-21T07:43:00.347206+0000","last_became_active":"2024-02-21T07:42:01.937555+0000","last_became_peered":"2024-02-21T07:42:01.937555+0000","last_unstale":"2024-02-21T07:43:00.347206+0000","last_undegraded":"2024-02-21T07:43:00.347206+0000","last_fullsized":"2024-02-21T07:43:00.347206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269724+0000","last_change":"2024-02-21T07:42:07.013284+0000","last_active":"2024-02-21T07:42:49.269724+0000","last_peered":"2024-02-21T07:42:49.269724+0000","last_clean":"2024-02-21T07:42:49.269724+0000","last_became_active":"2024-02-21T07:42:07.012412+0000","last_became_peered":"2024-02-21T07:42:07.012412+0000","last_unstale":"2024-02-21T07:42:49.269724+0000","last_undegraded":"2024-02-21T07:42:49.269724+0000","last_fullsized":"2024-02-21T07:42:49.269724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268227+0000","last_change":"2024-02-21T07:42:07.016945+0000","last_active":"2024-02-21T07:42:49.268227+0000","last_peered":"2024-02-21T07:42:49.268227+0000","last_clean":"2024-02-21T07:42:49.268227+0000","last_became_active":"2024-02-21T07:42:07.016572+0000","last_became_peered":"2024-02-21T07:42:07.016572+0000","last_unstale":"2024-02-21T07:42:49.268227+0000","last_undegraded":"2024-02-21T07:42:49.268227+0000","last_fullsized":"2024-02-21T07:42:49.268227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.765761+0000","last_change":"2024-02-21T07:42:02.977972+0000","last_active":"2024-02-21T07:42:48.765761+0000","last_peered":"2024-02-21T07:42:48.765761+0000","last_clean":"2024-02-21T07:42:48.765761+0000","last_became_active":"2024-02-21T07:42:02.977632+0000","last_became_peered":"2024-02-21T07:42:02.977632+0000","last_unstale":"2024-02-21T07:42:48.765761+0000","last_undegraded":"2024-02-21T07:42:48.765761+0000","last_fullsized":"2024-02-21T07:42:48.765761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255507+0000","last_change":"2024-02-21T07:42:01.930402+0000","last_active":"2024-02-21T07:42:49.255507+0000","last_peered":"2024-02-21T07:42:49.255507+0000","last_clean":"2024-02-21T07:42:49.255507+0000","last_became_active":"2024-02-21T07:42:01.930084+0000","last_became_peered":"2024-02-21T07:42:01.930084+0000","last_unstale":"2024-02-21T07:42:49.255507+0000","last_undegraded":"2024-02-21T07:42:49.255507+0000","last_fullsized":"2024-02-21T07:42:49.255507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472910+0000","last_change":"2024-02-21T07:42:07.016859+0000","last_active":"2024-02-21T07:42:48.472910+0000","last_peered":"2024-02-21T07:42:48.472910+0000","last_clean":"2024-02-21T07:42:48.472910+0000","last_became_active":"2024-02-21T07:42:07.016372+0000","last_became_peered":"2024-02-21T07:42:07.016372+0000","last_unstale":"2024-02-21T07:42:48.472910+0000","last_undegraded":"2024-02-21T07:42:48.472910+0000","last_fullsized":"2024-02-21T07:42:48.472910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269340+0000","last_change":"2024-02-21T07:42:02.948576+0000","last_active":"2024-02-21T07:42:49.269340+0000","last_peered":"2024-02-21T07:42:49.269340+0000","last_clean":"2024-02-21T07:42:49.269340+0000","last_became_active":"2024-02-21T07:42:02.947666+0000","last_became_peered":"2024-02-21T07:42:02.947666+0000","last_unstale":"2024-02-21T07:42:49.269340+0000","last_undegraded":"2024-02-21T07:42:49.269340+0000","last_fullsized":"2024-02-21T07:42:49.269340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474551+0000","last_change":"2024-02-21T07:42:01.929126+0000","last_active":"2024-02-21T07:42:48.474551+0000","last_peered":"2024-02-21T07:42:48.474551+0000","last_clean":"2024-02-21T07:42:48.474551+0000","last_became_active":"2024-02-21T07:42:01.928667+0000","last_became_peered":"2024-02-21T07:42:01.928667+0000","last_unstale":"2024-02-21T07:42:48.474551+0000","last_undegraded":"2024-02-21T07:42:48.474551+0000","last_fullsized":"2024-02-21T07:42:48.474551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979178+0000","last_change":"2024-02-21T07:42:01.933903+0000","last_active":"2024-02-21T07:42:48.979178+0000","last_peered":"2024-02-21T07:42:48.979178+0000","last_clean":"2024-02-21T07:42:48.979178+0000","last_became_active":"2024-02-21T07:42:01.933578+0000","last_became_peered":"2024-02-21T07:42:01.933578+0000","last_unstale":"2024-02-21T07:42:48.979178+0000","last_undegraded":"2024-02-21T07:42:48.979178+0000","last_fullsized":"2024-02-21T07:42:48.979178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255429+0000","last_change":"2024-02-21T07:42:02.964660+0000","last_active":"2024-02-21T07:42:49.255429+0000","last_peered":"2024-02-21T07:42:49.255429+0000","last_clean":"2024-02-21T07:42:49.255429+0000","last_became_active":"2024-02-21T07:42:02.964389+0000","last_became_peered":"2024-02-21T07:42:02.964389+0000","last_unstale":"2024-02-21T07:42:49.255429+0000","last_undegraded":"2024-02-21T07:42:49.255429+0000","last_fullsized":"2024-02-21T07:42:49.255429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083837+0000","last_change":"2024-02-21T07:42:07.015720+0000","last_active":"2024-02-21T07:42:49.083837+0000","last_peered":"2024-02-21T07:42:49.083837+0000","last_clean":"2024-02-21T07:42:49.083837+0000","last_became_active":"2024-02-21T07:42:07.015315+0000","last_became_peered":"2024-02-21T07:42:07.015315+0000","last_unstale":"2024-02-21T07:42:49.083837+0000","last_undegraded":"2024-02-21T07:42:49.083837+0000","last_fullsized":"2024-02-21T07:42:49.083837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'7","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.346579+0000","last_change":"2024-02-21T07:42:01.927978+0000","last_active":"2024-02-21T07:42:59.346579+0000","last_peered":"2024-02-21T07:42:59.346579+0000","last_clean":"2024-02-21T07:42:59.346579+0000","last_became_active":"2024-02-21T07:42:01.927661+0000","last_became_peered":"2024-02-21T07:42:01.927661+0000","last_unstale":"2024-02-21T07:42:59.346579+0000","last_undegraded":"2024-02-21T07:42:59.346579+0000","last_fullsized":"2024-02-21T07:42:59.346579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477603+0000","last_change":"2024-02-21T07:42:02.971175+0000","last_active":"2024-02-21T07:42:48.477603+0000","last_peered":"2024-02-21T07:42:48.477603+0000","last_clean":"2024-02-21T07:42:48.477603+0000","last_became_active":"2024-02-21T07:42:02.970886+0000","last_became_peered":"2024-02-21T07:42:02.970886+0000","last_unstale":"2024-02-21T07:42:48.477603+0000","last_undegraded":"2024-02-21T07:42:48.477603+0000","last_fullsized":"2024-02-21T07:42:48.477603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084180+0000","last_change":"2024-02-21T07:42:07.003267+0000","last_active":"2024-02-21T07:42:49.084180+0000","last_peered":"2024-02-21T07:42:49.084180+0000","last_clean":"2024-02-21T07:42:49.084180+0000","last_became_active":"2024-02-21T07:42:07.002824+0000","last_became_peered":"2024-02-21T07:42:07.002824+0000","last_unstale":"2024-02-21T07:42:49.084180+0000","last_undegraded":"2024-02-21T07:42:49.084180+0000","last_fullsized":"2024-02-21T07:42:49.084180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472669+0000","last_change":"2024-02-21T07:42:02.960884+0000","last_active":"2024-02-21T07:42:48.472669+0000","last_peered":"2024-02-21T07:42:48.472669+0000","last_clean":"2024-02-21T07:42:48.472669+0000","last_became_active":"2024-02-21T07:42:02.960515+0000","last_became_peered":"2024-02-21T07:42:02.960515+0000","last_unstale":"2024-02-21T07:42:48.472669+0000","last_undegraded":"2024-02-21T07:42:48.472669+0000","last_fullsized":"2024-02-21T07:42:48.472669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083874+0000","last_change":"2024-02-21T07:42:02.960807+0000","last_active":"2024-02-21T07:42:49.083874+0000","last_peered":"2024-02-21T07:42:49.083874+0000","last_clean":"2024-02-21T07:42:49.083874+0000","last_became_active":"2024-02-21T07:42:02.960478+0000","last_became_peered":"2024-02-21T07:42:02.960478+0000","last_unstale":"2024-02-21T07:42:49.083874+0000","last_undegraded":"2024-02-21T07:42:49.083874+0000","last_fullsized":"2024-02-21T07:42:49.083874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083754+0000","last_change":"2024-02-21T07:42:02.966666+0000","last_active":"2024-02-21T07:42:49.083754+0000","last_peered":"2024-02-21T07:42:49.083754+0000","last_clean":"2024-02-21T07:42:49.083754+0000","last_became_active":"2024-02-21T07:42:02.966350+0000","last_became_peered":"2024-02-21T07:42:02.966350+0000","last_unstale":"2024-02-21T07:42:49.083754+0000","last_undegraded":"2024-02-21T07:42:49.083754+0000","last_fullsized":"2024-02-21T07:42:49.083754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267525+0000","last_change":"2024-02-21T07:42:02.973149+0000","last_active":"2024-02-21T07:42:49.267525+0000","last_peered":"2024-02-21T07:42:49.267525+0000","last_clean":"2024-02-21T07:42:49.267525+0000","last_became_active":"2024-02-21T07:42:02.972869+0000","last_became_peered":"2024-02-21T07:42:02.972869+0000","last_unstale":"2024-02-21T07:42:49.267525+0000","last_undegraded":"2024-02-21T07:42:49.267525+0000","last_fullsized":"2024-02-21T07:42:49.267525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475249+0000","last_change":"2024-02-21T07:42:02.957623+0000","last_active":"2024-02-21T07:42:48.475249+0000","last_peered":"2024-02-21T07:42:48.475249+0000","last_clean":"2024-02-21T07:42:48.475249+0000","last_became_active":"2024-02-21T07:42:02.956527+0000","last_became_peered":"2024-02-21T07:42:02.956527+0000","last_unstale":"2024-02-21T07:42:48.475249+0000","last_undegraded":"2024-02-21T07:42:48.475249+0000","last_fullsized":"2024-02-21T07:42:48.475249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473016+0000","last_change":"2024-02-21T07:42:02.961369+0000","last_active":"2024-02-21T07:42:48.473016+0000","last_peered":"2024-02-21T07:42:48.473016+0000","last_clean":"2024-02-21T07:42:48.473016+0000","last_became_active":"2024-02-21T07:42:02.961075+0000","last_became_peered":"2024-02-21T07:42:02.961075+0000","last_unstale":"2024-02-21T07:42:48.473016+0000","last_undegraded":"2024-02-21T07:42:48.473016+0000","last_fullsized":"2024-02-21T07:42:48.473016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084324+0000","last_change":"2024-02-21T07:42:02.960461+0000","last_active":"2024-02-21T07:42:49.084324+0000","last_peered":"2024-02-21T07:42:49.084324+0000","last_clean":"2024-02-21T07:42:49.084324+0000","last_became_active":"2024-02-21T07:42:02.960168+0000","last_became_peered":"2024-02-21T07:42:02.960168+0000","last_unstale":"2024-02-21T07:42:49.084324+0000","last_undegraded":"2024-02-21T07:42:49.084324+0000","last_fullsized":"2024-02-21T07:42:49.084324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271234+0000","last_change":"2024-02-21T07:42:02.966173+0000","last_active":"2024-02-21T07:42:49.271234+0000","last_peered":"2024-02-21T07:42:49.271234+0000","last_clean":"2024-02-21T07:42:49.271234+0000","last_became_active":"2024-02-21T07:42:02.964280+0000","last_became_peered":"2024-02-21T07:42:02.964280+0000","last_unstale":"2024-02-21T07:42:49.271234+0000","last_undegraded":"2024-02-21T07:42:49.271234+0000","last_fullsized":"2024-02-21T07:42:49.271234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255281+0000","last_change":"2024-02-21T07:42:02.975012+0000","last_active":"2024-02-21T07:42:49.255281+0000","last_peered":"2024-02-21T07:42:49.255281+0000","last_clean":"2024-02-21T07:42:49.255281+0000","last_became_active":"2024-02-21T07:42:02.974682+0000","last_became_peered":"2024-02-21T07:42:02.974682+0000","last_unstale":"2024-02-21T07:42:49.255281+0000","last_undegraded":"2024-02-21T07:42:49.255281+0000","last_fullsized":"2024-02-21T07:42:49.255281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270290+0000","last_change":"2024-02-21T07:42:02.966976+0000","last_active":"2024-02-21T07:42:49.270290+0000","last_peered":"2024-02-21T07:42:49.270290+0000","last_clean":"2024-02-21T07:42:49.270290+0000","last_became_active":"2024-02-21T07:42:02.966422+0000","last_became_peered":"2024-02-21T07:42:02.966422+0000","last_unstale":"2024-02-21T07:42:49.270290+0000","last_undegraded":"2024-02-21T07:42:49.270290+0000","last_fullsized":"2024-02-21T07:42:49.270290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.480003+0000","last_change":"2024-02-21T07:42:02.957398+0000","last_active":"2024-02-21T07:42:48.480003+0000","last_peered":"2024-02-21T07:42:48.480003+0000","last_clean":"2024-02-21T07:42:48.480003+0000","last_became_active":"2024-02-21T07:42:02.957115+0000","last_became_peered":"2024-02-21T07:42:02.957115+0000","last_unstale":"2024-02-21T07:42:48.480003+0000","last_undegraded":"2024-02-21T07:42:48.480003+0000","last_fullsized":"2024-02-21T07:42:48.480003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475295+0000","last_change":"2024-02-21T07:42:02.956114+0000","last_active":"2024-02-21T07:42:48.475295+0000","last_peered":"2024-02-21T07:42:48.475295+0000","last_clean":"2024-02-21T07:42:48.475295+0000","last_became_active":"2024-02-21T07:42:02.955476+0000","last_became_peered":"2024-02-21T07:42:02.955476+0000","last_unstale":"2024-02-21T07:42:48.475295+0000","last_undegraded":"2024-02-21T07:42:48.475295+0000","last_fullsized":"2024-02-21T07:42:48.475295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473015+0000","last_change":"2024-02-21T07:42:02.955604+0000","last_active":"2024-02-21T07:42:48.473015+0000","last_peered":"2024-02-21T07:42:48.473015+0000","last_clean":"2024-02-21T07:42:48.473015+0000","last_became_active":"2024-02-21T07:42:02.955327+0000","last_became_peered":"2024-02-21T07:42:02.955327+0000","last_unstale":"2024-02-21T07:42:48.473015+0000","last_undegraded":"2024-02-21T07:42:48.473015+0000","last_fullsized":"2024-02-21T07:42:48.473015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084361+0000","last_change":"2024-02-21T07:42:02.967092+0000","last_active":"2024-02-21T07:42:49.084361+0000","last_peered":"2024-02-21T07:42:49.084361+0000","last_clean":"2024-02-21T07:42:49.084361+0000","last_became_active":"2024-02-21T07:42:02.966845+0000","last_became_peered":"2024-02-21T07:42:02.966845+0000","last_unstale":"2024-02-21T07:42:49.084361+0000","last_undegraded":"2024-02-21T07:42:49.084361+0000","last_fullsized":"2024-02-21T07:42:49.084361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766655+0000","last_change":"2024-02-21T07:42:02.973535+0000","last_active":"2024-02-21T07:42:48.766655+0000","last_peered":"2024-02-21T07:42:48.766655+0000","last_clean":"2024-02-21T07:42:48.766655+0000","last_became_active":"2024-02-21T07:42:02.973202+0000","last_became_peered":"2024-02-21T07:42:02.973202+0000","last_unstale":"2024-02-21T07:42:48.766655+0000","last_undegraded":"2024-02-21T07:42:48.766655+0000","last_fullsized":"2024-02-21T07:42:48.766655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473283+0000","last_change":"2024-02-21T07:42:02.954398+0000","last_active":"2024-02-21T07:42:48.473283+0000","last_peered":"2024-02-21T07:42:48.473283+0000","last_clean":"2024-02-21T07:42:48.473283+0000","last_became_active":"2024-02-21T07:42:02.954099+0000","last_became_peered":"2024-02-21T07:42:02.954099+0000","last_unstale":"2024-02-21T07:42:48.473283+0000","last_undegraded":"2024-02-21T07:42:48.473283+0000","last_fullsized":"2024-02-21T07:42:48.473283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479373+0000","last_change":"2024-02-21T07:42:02.958214+0000","last_active":"2024-02-21T07:42:48.479373+0000","last_peered":"2024-02-21T07:42:48.479373+0000","last_clean":"2024-02-21T07:42:48.479373+0000","last_became_active":"2024-02-21T07:42:02.957885+0000","last_became_peered":"2024-02-21T07:42:02.957885+0000","last_unstale":"2024-02-21T07:42:48.479373+0000","last_undegraded":"2024-02-21T07:42:48.479373+0000","last_fullsized":"2024-02-21T07:42:48.479373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.266995+0000","last_change":"2024-02-21T07:42:02.980607+0000","last_active":"2024-02-21T07:42:49.266995+0000","last_peered":"2024-02-21T07:42:49.266995+0000","last_clean":"2024-02-21T07:42:49.266995+0000","last_became_active":"2024-02-21T07:42:02.980239+0000","last_became_peered":"2024-02-21T07:42:02.980239+0000","last_unstale":"2024-02-21T07:42:49.266995+0000","last_undegraded":"2024-02-21T07:42:49.266995+0000","last_fullsized":"2024-02-21T07:42:49.266995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267159+0000","last_change":"2024-02-21T07:42:02.972536+0000","last_active":"2024-02-21T07:42:49.267159+0000","last_peered":"2024-02-21T07:42:49.267159+0000","last_clean":"2024-02-21T07:42:49.267159+0000","last_became_active":"2024-02-21T07:42:02.972216+0000","last_became_peered":"2024-02-21T07:42:02.972216+0000","last_unstale":"2024-02-21T07:42:49.267159+0000","last_undegraded":"2024-02-21T07:42:49.267159+0000","last_fullsized":"2024-02-21T07:42:49.267159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474978+0000","last_change":"2024-02-21T07:42:02.958082+0000","last_active":"2024-02-21T07:42:48.474978+0000","last_peered":"2024-02-21T07:42:48.474978+0000","last_clean":"2024-02-21T07:42:48.474978+0000","last_became_active":"2024-02-21T07:42:02.957711+0000","last_became_peered":"2024-02-21T07:42:02.957711+0000","last_unstale":"2024-02-21T07:42:48.474978+0000","last_undegraded":"2024-02-21T07:42:48.474978+0000","last_fullsized":"2024-02-21T07:42:48.474978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475415+0000","last_change":"2024-02-21T07:42:02.957799+0000","last_active":"2024-02-21T07:42:48.475415+0000","last_peered":"2024-02-21T07:42:48.475415+0000","last_clean":"2024-02-21T07:42:48.475415+0000","last_became_active":"2024-02-21T07:42:02.957510+0000","last_became_peered":"2024-02-21T07:42:02.957510+0000","last_unstale":"2024-02-21T07:42:48.475415+0000","last_undegraded":"2024-02-21T07:42:48.475415+0000","last_fullsized":"2024-02-21T07:42:48.475415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730379+0000","last_change":"2024-02-21T07:42:02.962565+0000","last_active":"2024-02-21T07:42:48.730379+0000","last_peered":"2024-02-21T07:42:48.730379+0000","last_clean":"2024-02-21T07:42:48.730379+0000","last_became_active":"2024-02-21T07:42:02.962298+0000","last_became_peered":"2024-02-21T07:42:02.962298+0000","last_unstale":"2024-02-21T07:42:48.730379+0000","last_undegraded":"2024-02-21T07:42:48.730379+0000","last_fullsized":"2024-02-21T07:42:48.730379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979764+0000","last_change":"2024-02-21T07:42:02.961018+0000","last_active":"2024-02-21T07:42:48.979764+0000","last_peered":"2024-02-21T07:42:48.979764+0000","last_clean":"2024-02-21T07:42:48.979764+0000","last_became_active":"2024-02-21T07:42:02.960634+0000","last_became_peered":"2024-02-21T07:42:02.960634+0000","last_unstale":"2024-02-21T07:42:48.979764+0000","last_undegraded":"2024-02-21T07:42:48.979764+0000","last_fullsized":"2024-02-21T07:42:48.979764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479750+0000","last_change":"2024-02-21T07:42:02.959426+0000","last_active":"2024-02-21T07:42:48.479750+0000","last_peered":"2024-02-21T07:42:48.479750+0000","last_clean":"2024-02-21T07:42:48.479750+0000","last_became_active":"2024-02-21T07:42:02.959021+0000","last_became_peered":"2024-02-21T07:42:02.959021+0000","last_unstale":"2024-02-21T07:42:48.479750+0000","last_undegraded":"2024-02-21T07:42:48.479750+0000","last_fullsized":"2024-02-21T07:42:48.479750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269079+0000","last_change":"2024-02-21T07:42:02.971151+0000","last_active":"2024-02-21T07:42:49.269079+0000","last_peered":"2024-02-21T07:42:49.269079+0000","last_clean":"2024-02-21T07:42:49.269079+0000","last_became_active":"2024-02-21T07:42:02.967323+0000","last_became_peered":"2024-02-21T07:42:02.967323+0000","last_unstale":"2024-02-21T07:42:49.269079+0000","last_undegraded":"2024-02-21T07:42:49.269079+0000","last_fullsized":"2024-02-21T07:42:49.269079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730044+0000","last_change":"2024-02-21T07:42:02.974767+0000","last_active":"2024-02-21T07:42:48.730044+0000","last_peered":"2024-02-21T07:42:48.730044+0000","last_clean":"2024-02-21T07:42:48.730044+0000","last_became_active":"2024-02-21T07:42:02.974292+0000","last_became_peered":"2024-02-21T07:42:02.974292+0000","last_unstale":"2024-02-21T07:42:48.730044+0000","last_undegraded":"2024-02-21T07:42:48.730044+0000","last_fullsized":"2024-02-21T07:42:48.730044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979118+0000","last_change":"2024-02-21T07:42:02.968079+0000","last_active":"2024-02-21T07:42:48.979118+0000","last_peered":"2024-02-21T07:42:48.979118+0000","last_clean":"2024-02-21T07:42:48.979118+0000","last_became_active":"2024-02-21T07:42:02.967767+0000","last_became_peered":"2024-02-21T07:42:02.967767+0000","last_unstale":"2024-02-21T07:42:48.979118+0000","last_undegraded":"2024-02-21T07:42:48.979118+0000","last_fullsized":"2024-02-21T07:42:48.979118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477567+0000","last_change":"2024-02-21T07:42:02.978031+0000","last_active":"2024-02-21T07:42:48.477567+0000","last_peered":"2024-02-21T07:42:48.477567+0000","last_clean":"2024-02-21T07:42:48.477567+0000","last_became_active":"2024-02-21T07:42:02.977704+0000","last_became_peered":"2024-02-21T07:42:02.977704+0000","last_unstale":"2024-02-21T07:42:48.477567+0000","last_undegraded":"2024-02-21T07:42:48.477567+0000","last_fullsized":"2024-02-21T07:42:48.477567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475325+0000","last_change":"2024-02-21T07:42:02.959959+0000","last_active":"2024-02-21T07:42:48.475325+0000","last_peered":"2024-02-21T07:42:48.475325+0000","last_clean":"2024-02-21T07:42:48.475325+0000","last_became_active":"2024-02-21T07:42:02.959655+0000","last_became_peered":"2024-02-21T07:42:02.959655+0000","last_unstale":"2024-02-21T07:42:48.475325+0000","last_undegraded":"2024-02-21T07:42:48.475325+0000","last_fullsized":"2024-02-21T07:42:48.475325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267187+0000","last_change":"2024-02-21T07:42:02.975851+0000","last_active":"2024-02-21T07:42:49.267187+0000","last_peered":"2024-02-21T07:42:49.267187+0000","last_clean":"2024-02-21T07:42:49.267187+0000","last_became_active":"2024-02-21T07:42:02.973848+0000","last_became_peered":"2024-02-21T07:42:02.973848+0000","last_unstale":"2024-02-21T07:42:49.267187+0000","last_undegraded":"2024-02-21T07:42:49.267187+0000","last_fullsized":"2024-02-21T07:42:49.267187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268544+0000","last_change":"2024-02-21T07:42:02.981681+0000","last_active":"2024-02-21T07:42:49.268544+0000","last_peered":"2024-02-21T07:42:49.268544+0000","last_clean":"2024-02-21T07:42:49.268544+0000","last_became_active":"2024-02-21T07:42:02.981324+0000","last_became_peered":"2024-02-21T07:42:02.981324+0000","last_unstale":"2024-02-21T07:42:49.268544+0000","last_undegraded":"2024-02-21T07:42:49.268544+0000","last_fullsized":"2024-02-21T07:42:49.268544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473173+0000","last_change":"2024-02-21T07:42:02.954466+0000","last_active":"2024-02-21T07:42:48.473173+0000","last_peered":"2024-02-21T07:42:48.473173+0000","last_clean":"2024-02-21T07:42:48.473173+0000","last_became_active":"2024-02-21T07:42:02.954168+0000","last_became_peered":"2024-02-21T07:42:02.954168+0000","last_unstale":"2024-02-21T07:42:48.473173+0000","last_undegraded":"2024-02-21T07:42:48.473173+0000","last_fullsized":"2024-02-21T07:42:48.473173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74249,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":331,"num_read_kb":248,"num_write":250,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":148498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444049,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":164376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.503},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44900000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38500000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.79200000000000004}]},{"osd":7,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.60699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":9,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.67800000000000005}]},{"osd":10,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71299999999999997}]}]},{"osd":10,"up_from":17,"seq":73014444049,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":454656,"data_stored":225411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":0.81499999999999995}]},{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.5990000000000002,"5min":4.5990000000000002,"15min":4.5990000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.69799999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.63800000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66000000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":9,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.2610000000000001,"5min":3.2610000000000001,"15min":3.2610000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.3130000000000002,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.996}]},{"osd":11,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.748}]}]},{"osd":9,"up_from":17,"seq":73014444049,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":167647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.038},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.93999999999999995}]},{"osd":2,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.226},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.52},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"min":{"1min":1.208,"5min":1.208,"15min":1.208},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":1.2969999999999999}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.097},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.6040000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":1.655,"15min":1.655},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.369},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.716}]},{"osd":8,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.74,"15min":1.74},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.403},{"interface":"front","average":{"1min":1.839,"5min":1.839,"15min":1.839},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":3.5209999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":1.8420000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.893,"5min":1.893,"15min":1.893},"min":{"1min":1.353,"5min":1.353,"15min":1.353},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"min":{"1min":1.05,"5min":1.05,"15min":1.05},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.4470000000000001}]},{"osd":11,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":1.843,"15min":1.843},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.79},{"interface":"front","average":{"1min":1.946,"5min":1.946,"15min":1.946},"min":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.7}]}]},{"osd":8,"up_from":17,"seq":73014444048,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":163617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.80900000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41399999999999998}]},{"osd":7,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.62},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69199999999999995}]},{"osd":9,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72699999999999998}]},{"osd":10,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.747}]},{"osd":11,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.77300000000000002}]}]},{"osd":7,"up_from":17,"seq":73014444049,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":759496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48099999999999998}]},{"osd":2,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63700000000000001}]},{"osd":3,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.69999999999999996}]},{"osd":6,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.73399999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71299999999999997}]},{"osd":9,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.81399999999999995}]},{"osd":10,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.77100000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.80300000000000005}]}]},{"osd":6,"up_from":17,"seq":73014444049,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":159393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.75600000000000001}]},{"osd":3,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.65700000000000003}]},{"osd":8,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.0939999999999999,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":0.78700000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":10,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.754,"15min":1.754},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.171},{"interface":"front","average":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.875}]},{"osd":11,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.873,"15min":1.873},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.819,"5min":2.819,"15min":2.819},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.861,"5min":1.861,"15min":1.861},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":3.5659999999999998,"5min":3.5659999999999998,"15min":3.5659999999999998},"last":0.80700000000000005}]}]},{"osd":5,"up_from":17,"seq":73014444049,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":987136,"data_stored":756100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.629}]},{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54800000000000004}]},{"osd":6,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46500000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2,"5min":2,"15min":2},"last":0.72799999999999998}]},{"osd":10,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.505}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444049,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":163862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.875},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.76300000000000001}]},{"osd":1,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.81100000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53900000000000003}]},{"osd":8,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.79700000000000004}]},{"osd":9,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.89100000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.78000000000000003}]},{"osd":11,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.90500000000000003}]}]},{"osd":3,"up_from":17,"seq":73014444049,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":158985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.91000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.595},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2470000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.7669999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":2.0230000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.9319999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":2.5209999999999999},"last":2.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]},{"osd":7,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":2.1429999999999998},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.653}]},{"osd":8,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":2.0870000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":2.2530000000000001},{"interface":"front","average":{"1min":1.708,"5min":1.708,"15min":1.708},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.294,"5min":3.294,"15min":3.294},"last":2.383}]},{"osd":10,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":2.3239999999999998},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.825}]},{"osd":11,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.9260000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":1.988},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":2.1840000000000002}]}]},{"osd":2,"up_from":17,"seq":73014444049,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":161653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.622},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91800000000000004}]},{"osd":4,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.55800000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46700000000000003}]},{"osd":6,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.4299999999999997,"5min":4.4299999999999997,"15min":4.4299999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.749},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.89900000000000002}]},{"osd":8,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67500000000000004}]},{"osd":9,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.876},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69899999999999995}]},{"osd":10,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76300000000000001}]},{"osd":11,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59699999999999998}]}]},{"osd":1,"up_from":17,"seq":73014444049,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":434176,"data_stored":226189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.53200000000000003}]},{"osd":3,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.79800000000000004}]},{"osd":7,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.42599999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.624},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66800000000000004}]},{"osd":9,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.747},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68700000000000006}]}]},{"osd":0,"up_from":17,"seq":73014444050,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":159589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.89500000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.0029999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":1.649}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.125},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7450000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":1.325},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.2189999999999999,"5min":3.2189999999999999,"15min":3.2189999999999999},"last":1.387}]},{"osd":7,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.6190000000000002,"5min":3.6190000000000002,"15min":3.6190000000000002},"last":1.1659999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":1.498},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.4450000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.851}]},{"osd":10,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":1.722,"15min":1.722},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.6600000000000001,"5min":3.6600000000000001,"15min":3.6600000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":7.016,"5min":7.016,"15min":7.016},"last":1.762}]},{"osd":11,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":3.7639999999999998,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":1.5369999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:43:03.020 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-02-21T07:43:03.020 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:43:03.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.261+0000 7f1a12c00640 1 Processor -- start 2024-02-21T07:43:03.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.261+0000 7f1a12c00640 1 -- start start 2024-02-21T07:43:03.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.262+0000 7f1a12c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1a0c188c50 0x7f1a0c0f9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a12c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1a0c189740 0x7f1a0c18bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a12c00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c0f8cd0 con 0x7f1a0c0f9840 2024-02-21T07:43:03.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a12c00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0f8f00 con 0x7f1a0c188c50 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a12c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c183700 con 0x7f1a0c189740 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a11800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1a0c188c50 0x7f1a0c0f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a11800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1a0c188c50 0x7f1a0c0f9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36728/0 (socket says 172.21.15.69:36728) 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a10e00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1a0c0f9840 0x7f1a0c189030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:57290/0 (socket says 172.21.15.69:57290) 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a11800640 1 -- 172.21.15.69:0/1907883158 learned_addr learned my addr 172.21.15.69:0/1907883158 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a12200640 1 --2- 172.21.15.69:0/1907883158 >> v2:172.21.15.174:3300/0 conn(0x7f1a0c189740 0x7f1a0c18bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a11800640 1 -- 172.21.15.69:0/1907883158 >> v2:172.21.15.174:3300/0 conn(0x7f1a0c189740 msgr2=0x7f1a0c18bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a11800640 1 --2- 172.21.15.69:0/1907883158 >> v2:172.21.15.174:3300/0 conn(0x7f1a0c189740 0x7f1a0c18bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a11800640 1 -- 172.21.15.69:0/1907883158 >> v1:172.21.15.69:6789/0 conn(0x7f1a0c0f9840 legacy=0x7f1a0c189030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a11800640 1 -- 172.21.15.69:0/1907883158 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c1839e0 con 0x7f1a0c188c50 2024-02-21T07:43:03.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.263+0000 7f1a0be00640 1 -- 172.21.15.69:0/1907883158 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770716432 0 0) 0x7f1a0c0f8cd0 con 0x7f1a0c0f9840 2024-02-21T07:43:03.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.265+0000 7f1a11800640 1 --2- 172.21.15.69:0/1907883158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c188c50 0x7f1a0c0f9300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0f43a0 tx=0x7f19fc02e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773572d3cf376fce server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:03.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.265+0000 7f1a0be00640 1 -- 172.21.15.69:0/1907883158 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc02ea00 con 0x7f1a0c188c50 2024-02-21T07:43:03.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.265+0000 7f1a0be00640 1 -- 172.21.15.69:0/1907883158 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc02eb60 con 0x7f1a0c188c50 2024-02-21T07:43:03.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.265+0000 7f1a0be00640 1 -- 172.21.15.69:0/1907883158 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc009600 con 0x7f1a0c188c50 2024-02-21T07:43:03.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.265+0000 7f1a12c00640 1 -- 172.21.15.69:0/1907883158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c188c50 msgr2=0x7f1a0c0f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.265+0000 7f1a12c00640 1 --2- 172.21.15.69:0/1907883158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c188c50 0x7f1a0c0f9300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0f43a0 tx=0x7f19fc02e060 comp rx=0 tx=0).stop 2024-02-21T07:43:03.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.265+0000 7f1a12c00640 1 -- 172.21.15.69:0/1907883158 shutdown_connections 2024-02-21T07:43:03.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.265+0000 7f1a12c00640 1 --2- 172.21.15.69:0/1907883158 >> v2:172.21.15.174:3300/0 conn(0x7f1a0c189740 0x7f1a0c18bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.265+0000 7f1a12c00640 1 --2- 172.21.15.69:0/1907883158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c188c50 0x7f1a0c0f9300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.265+0000 7f1a12c00640 1 -- 172.21.15.69:0/1907883158 >> 172.21.15.69:0/1907883158 conn(0x7f1a0c0ce290 msgr2=0x7f1a0c0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:03.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.266+0000 7f1a12c00640 1 -- 172.21.15.69:0/1907883158 shutdown_connections 2024-02-21T07:43:03.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.266+0000 7f1a12c00640 1 -- 172.21.15.69:0/1907883158 wait complete. 2024-02-21T07:43:03.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.268+0000 7f1a12c00640 1 Processor -- start 2024-02-21T07:43:03.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.268+0000 7f1a12c00640 1 -- start start 2024-02-21T07:43:03.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a12c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a0c0f9840 0x7f1a0c2187c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a12c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a0c188c50 0x7f1a0c0f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a12c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c189740 0x7f1a0c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a12c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c21b860 con 0x7f1a0c189740 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a12c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0f5ca0 con 0x7f1a0c188c50 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a12c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c21b580 con 0x7f1a0c0f9840 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a12200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c189740 0x7f1a0c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a10e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a0c188c50 0x7f1a0c0f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a12200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c189740 0x7f1a0c06f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36744/0 (socket says 172.21.15.69:36744) 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a12200640 1 -- 172.21.15.69:0/3340329575 learned_addr learned my addr 172.21.15.69:0/3340329575 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.269+0000 7f1a11800640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a0c0f9840 0x7f1a0c2187c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a10e00640 1 -- 172.21.15.69:0/3340329575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a0c0f9840 msgr2=0x7f1a0c2187c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a10e00640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a0c0f9840 0x7f1a0c2187c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a10e00640 1 -- 172.21.15.69:0/3340329575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c189740 msgr2=0x7f1a0c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a10e00640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c189740 0x7f1a0c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a10e00640 1 -- 172.21.15.69:0/3340329575 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc00bd40 con 0x7f1a0c188c50 2024-02-21T07:43:03.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a12200640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c189740 0x7f1a0c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:03.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a10e00640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a0c188c50 0x7f1a0c0f5760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f19f800c3e0 tx=0x7f19f800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:03.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a09600640 1 -- 172.21.15.69:0/3340329575 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80074e0 con 0x7f1a0c188c50 2024-02-21T07:43:03.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a09600640 1 -- 172.21.15.69:0/3340329575 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f8007640 con 0x7f1a0c188c50 2024-02-21T07:43:03.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a09600640 1 -- 172.21.15.69:0/3340329575 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8004a20 con 0x7f1a0c188c50 2024-02-21T07:43:03.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a12c00640 1 -- 172.21.15.69:0/3340329575 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0c06e400 con 0x7f1a0c188c50 2024-02-21T07:43:03.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.270+0000 7f1a12c00640 1 -- 172.21.15.69:0/3340329575 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c06e9c0 con 0x7f1a0c188c50 2024-02-21T07:43:03.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.271+0000 7f1a12c00640 1 -- 172.21.15.69:0/3340329575 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c069c10 con 0x7f1a0c188c50 2024-02-21T07:43:03.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.273+0000 7f1a09600640 1 -- 172.21.15.69:0/3340329575 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f19f8004c40 con 0x7f1a0c188c50 2024-02-21T07:43:03.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.275+0000 7f1a09600640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f19ec09f130 0x7f19ec0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.275+0000 7f1a09600640 1 -- 172.21.15.69:0/3340329575 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f19f80c9e10 con 0x7f1a0c188c50 2024-02-21T07:43:03.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.275+0000 7f1a11800640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f19ec09f130 0x7f19ec0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.276+0000 7f1a11800640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f19ec09f130 0x7f19ec0a15f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f19fc037000 tx=0x7f19fc032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:03.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.277+0000 7f1a09600640 1 -- 172.21.15.69:0/3340329575 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f19f8093bd0 con 0x7f1a0c188c50 2024-02-21T07:43:03.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.470+0000 7f1a12c00640 1 -- 172.21.15.69:0/3340329575 --> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a0c184280 con 0x7f19ec09f130 2024-02-21T07:43:03.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.483+0000 7f1a09600640 1 -- 172.21.15.69:0/3340329575 <== mgr.4105 v2:172.21.15.174:6800/1264070995 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+413586 (secure 0 0 0) 0x7f19fc009520 con 0x7f19ec09f130 2024-02-21T07:43:03.495 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:43:03.498 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-02-21T07:43:03.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 -- 172.21.15.69:0/3340329575 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f19ec09f130 msgr2=0x7f19ec0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f19ec09f130 0x7f19ec0a15f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f19fc037000 tx=0x7f19fc032000 comp rx=0 tx=0).stop 2024-02-21T07:43:03.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 -- 172.21.15.69:0/3340329575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a0c188c50 msgr2=0x7f1a0c0f5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a0c188c50 0x7f1a0c0f5760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f19f800c3e0 tx=0x7f19f800c8a0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 -- 172.21.15.69:0/3340329575 shutdown_connections 2024-02-21T07:43:03.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f19ec09f130 0x7f19ec0a15f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a0c189740 0x7f1a0c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f1a0c188c50 0x7f1a0c0f5760 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 --2- 172.21.15.69:0/3340329575 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a0c0f9840 0x7f1a0c2187c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 -- 172.21.15.69:0/3340329575 >> 172.21.15.69:0/3340329575 conn(0x7f1a0c0ce290 msgr2=0x7f1a0c0f6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:03.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 -- 172.21.15.69:0/3340329575 shutdown_connections 2024-02-21T07:43:03.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.491+0000 7f1a12c00640 1 -- 172.21.15.69:0/3340329575 wait complete. 2024-02-21T07:43:03.517 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-02-21T07:43:02.457991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664851,"num_objects":102,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":457,"num_read_kb":357,"num_write":433,"num_write_kb":3089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":356,"ondisk_log_size":356,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":329896,"kb_used_data":5656,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132132184,"statfs":{"total":1159641169920,"available":1159303356416,"internally_reserved":0,"allocated":5791744,"data_stored":3266318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":331855161},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8498,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":86,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003263"},"pg_stats":[{"pgid":"2.1f","version":"29'13","reported_seq":68,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.392964+0000","last_change":"2024-02-21T07:42:01.938302+0000","last_active":"2024-02-21T07:42:59.392964+0000","last_peered":"2024-02-21T07:42:59.392964+0000","last_clean":"2024-02-21T07:42:59.392964+0000","last_became_active":"2024-02-21T07:42:01.935737+0000","last_became_peered":"2024-02-21T07:42:01.935737+0000","last_unstale":"2024-02-21T07:42:59.392964+0000","last_undegraded":"2024-02-21T07:42:59.392964+0000","last_fullsized":"2024-02-21T07:42:59.392964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271108+0000","last_change":"2024-02-21T07:42:02.963926+0000","last_active":"2024-02-21T07:42:49.271108+0000","last_peered":"2024-02-21T07:42:49.271108+0000","last_clean":"2024-02-21T07:42:49.271108+0000","last_became_active":"2024-02-21T07:42:02.963585+0000","last_became_peered":"2024-02-21T07:42:02.963585+0000","last_unstale":"2024-02-21T07:42:49.271108+0000","last_undegraded":"2024-02-21T07:42:49.271108+0000","last_fullsized":"2024-02-21T07:42:49.271108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083699+0000","last_change":"2024-02-21T07:42:07.017236+0000","last_active":"2024-02-21T07:42:49.083699+0000","last_peered":"2024-02-21T07:42:49.083699+0000","last_clean":"2024-02-21T07:42:49.083699+0000","last_became_active":"2024-02-21T07:42:07.016750+0000","last_became_peered":"2024-02-21T07:42:07.016750+0000","last_unstale":"2024-02-21T07:42:49.083699+0000","last_undegraded":"2024-02-21T07:42:49.083699+0000","last_fullsized":"2024-02-21T07:42:49.083699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271355+0000","last_change":"2024-02-21T07:42:01.947176+0000","last_active":"2024-02-21T07:42:49.271355+0000","last_peered":"2024-02-21T07:42:49.271355+0000","last_clean":"2024-02-21T07:42:49.271355+0000","last_became_active":"2024-02-21T07:42:01.946831+0000","last_became_peered":"2024-02-21T07:42:01.946831+0000","last_unstale":"2024-02-21T07:42:49.271355+0000","last_undegraded":"2024-02-21T07:42:49.271355+0000","last_fullsized":"2024-02-21T07:42:49.271355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268284+0000","last_change":"2024-02-21T07:42:02.970038+0000","last_active":"2024-02-21T07:42:49.268284+0000","last_peered":"2024-02-21T07:42:49.268284+0000","last_clean":"2024-02-21T07:42:49.268284+0000","last_became_active":"2024-02-21T07:42:02.969433+0000","last_became_peered":"2024-02-21T07:42:02.969433+0000","last_unstale":"2024-02-21T07:42:49.268284+0000","last_undegraded":"2024-02-21T07:42:49.268284+0000","last_fullsized":"2024-02-21T07:42:49.268284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474778+0000","last_change":"2024-02-21T07:42:07.009585+0000","last_active":"2024-02-21T07:42:48.474778+0000","last_peered":"2024-02-21T07:42:48.474778+0000","last_clean":"2024-02-21T07:42:48.474778+0000","last_became_active":"2024-02-21T07:42:07.009264+0000","last_became_peered":"2024-02-21T07:42:07.009264+0000","last_unstale":"2024-02-21T07:42:48.474778+0000","last_undegraded":"2024-02-21T07:42:48.474778+0000","last_fullsized":"2024-02-21T07:42:48.474778+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'12","reported_seq":38,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477868+0000","last_change":"2024-02-21T07:42:01.930474+0000","last_active":"2024-02-21T07:42:48.477868+0000","last_peered":"2024-02-21T07:42:48.477868+0000","last_clean":"2024-02-21T07:42:48.477868+0000","last_became_active":"2024-02-21T07:42:01.930173+0000","last_became_peered":"2024-02-21T07:42:01.930173+0000","last_unstale":"2024-02-21T07:42:48.477868+0000","last_undegraded":"2024-02-21T07:42:48.477868+0000","last_fullsized":"2024-02-21T07:42:48.477868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:42.554637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479544+0000","last_change":"2024-02-21T07:42:02.955640+0000","last_active":"2024-02-21T07:42:48.479544+0000","last_peered":"2024-02-21T07:42:48.479544+0000","last_clean":"2024-02-21T07:42:48.479544+0000","last_became_active":"2024-02-21T07:42:02.955341+0000","last_became_peered":"2024-02-21T07:42:02.955341+0000","last_unstale":"2024-02-21T07:42:48.479544+0000","last_undegraded":"2024-02-21T07:42:48.479544+0000","last_fullsized":"2024-02-21T07:42:48.479544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475209+0000","last_change":"2024-02-21T07:42:07.013240+0000","last_active":"2024-02-21T07:42:48.475209+0000","last_peered":"2024-02-21T07:42:48.475209+0000","last_clean":"2024-02-21T07:42:48.475209+0000","last_became_active":"2024-02-21T07:42:07.012852+0000","last_became_peered":"2024-02-21T07:42:07.012852+0000","last_unstale":"2024-02-21T07:42:48.475209+0000","last_undegraded":"2024-02-21T07:42:48.475209+0000","last_fullsized":"2024-02-21T07:42:48.475209+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477876+0000","last_change":"2024-02-21T07:42:01.933225+0000","last_active":"2024-02-21T07:42:48.477876+0000","last_peered":"2024-02-21T07:42:48.477876+0000","last_clean":"2024-02-21T07:42:48.477876+0000","last_became_active":"2024-02-21T07:42:01.932908+0000","last_became_peered":"2024-02-21T07:42:01.932908+0000","last_unstale":"2024-02-21T07:42:48.477876+0000","last_undegraded":"2024-02-21T07:42:48.477876+0000","last_fullsized":"2024-02-21T07:42:48.477876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255552+0000","last_change":"2024-02-21T07:42:02.965143+0000","last_active":"2024-02-21T07:42:49.255552+0000","last_peered":"2024-02-21T07:42:49.255552+0000","last_clean":"2024-02-21T07:42:49.255552+0000","last_became_active":"2024-02-21T07:42:02.964614+0000","last_became_peered":"2024-02-21T07:42:02.964614+0000","last_unstale":"2024-02-21T07:42:49.255552+0000","last_undegraded":"2024-02-21T07:42:49.255552+0000","last_fullsized":"2024-02-21T07:42:49.255552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474912+0000","last_change":"2024-02-21T07:42:07.017243+0000","last_active":"2024-02-21T07:42:48.474912+0000","last_peered":"2024-02-21T07:42:48.474912+0000","last_clean":"2024-02-21T07:42:48.474912+0000","last_became_active":"2024-02-21T07:42:07.016898+0000","last_became_peered":"2024-02-21T07:42:07.016898+0000","last_unstale":"2024-02-21T07:42:48.474912+0000","last_undegraded":"2024-02-21T07:42:48.474912+0000","last_fullsized":"2024-02-21T07:42:48.474912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730392+0000","last_change":"2024-02-21T07:42:02.961021+0000","last_active":"2024-02-21T07:42:48.730392+0000","last_peered":"2024-02-21T07:42:48.730392+0000","last_clean":"2024-02-21T07:42:48.730392+0000","last_became_active":"2024-02-21T07:42:02.960723+0000","last_became_peered":"2024-02-21T07:42:02.960723+0000","last_unstale":"2024-02-21T07:42:48.730392+0000","last_undegraded":"2024-02-21T07:42:48.730392+0000","last_fullsized":"2024-02-21T07:42:48.730392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477604+0000","last_change":"2024-02-21T07:42:01.928055+0000","last_active":"2024-02-21T07:42:48.477604+0000","last_peered":"2024-02-21T07:42:48.477604+0000","last_clean":"2024-02-21T07:42:48.477604+0000","last_became_active":"2024-02-21T07:42:01.927733+0000","last_became_peered":"2024-02-21T07:42:01.927733+0000","last_unstale":"2024-02-21T07:42:48.477604+0000","last_undegraded":"2024-02-21T07:42:48.477604+0000","last_fullsized":"2024-02-21T07:42:48.477604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475734+0000","last_change":"2024-02-21T07:42:07.124695+0000","last_active":"2024-02-21T07:42:48.475734+0000","last_peered":"2024-02-21T07:42:48.475734+0000","last_clean":"2024-02-21T07:42:48.475734+0000","last_became_active":"2024-02-21T07:42:07.123973+0000","last_became_peered":"2024-02-21T07:42:07.123973+0000","last_unstale":"2024-02-21T07:42:48.475734+0000","last_undegraded":"2024-02-21T07:42:48.475734+0000","last_fullsized":"2024-02-21T07:42:48.475734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270778+0000","last_change":"2024-02-21T07:42:02.982537+0000","last_active":"2024-02-21T07:42:49.270778+0000","last_peered":"2024-02-21T07:42:49.270778+0000","last_clean":"2024-02-21T07:42:49.270778+0000","last_became_active":"2024-02-21T07:42:02.982222+0000","last_became_peered":"2024-02-21T07:42:02.982222+0000","last_unstale":"2024-02-21T07:42:49.270778+0000","last_undegraded":"2024-02-21T07:42:49.270778+0000","last_fullsized":"2024-02-21T07:42:49.270778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083823+0000","last_change":"2024-02-21T07:42:01.942392+0000","last_active":"2024-02-21T07:42:49.083823+0000","last_peered":"2024-02-21T07:42:49.083823+0000","last_clean":"2024-02-21T07:42:49.083823+0000","last_became_active":"2024-02-21T07:42:01.942152+0000","last_became_peered":"2024-02-21T07:42:01.942152+0000","last_unstale":"2024-02-21T07:42:49.083823+0000","last_undegraded":"2024-02-21T07:42:49.083823+0000","last_fullsized":"2024-02-21T07:42:49.083823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475048+0000","last_change":"2024-02-21T07:42:07.015054+0000","last_active":"2024-02-21T07:42:48.475048+0000","last_peered":"2024-02-21T07:42:48.475048+0000","last_clean":"2024-02-21T07:42:48.475048+0000","last_became_active":"2024-02-21T07:42:07.014713+0000","last_became_peered":"2024-02-21T07:42:07.014713+0000","last_unstale":"2024-02-21T07:42:48.475048+0000","last_undegraded":"2024-02-21T07:42:48.475048+0000","last_fullsized":"2024-02-21T07:42:48.475048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472769+0000","last_change":"2024-02-21T07:42:02.970973+0000","last_active":"2024-02-21T07:42:48.472769+0000","last_peered":"2024-02-21T07:42:48.472769+0000","last_clean":"2024-02-21T07:42:48.472769+0000","last_became_active":"2024-02-21T07:42:02.970644+0000","last_became_peered":"2024-02-21T07:42:02.970644+0000","last_unstale":"2024-02-21T07:42:48.472769+0000","last_undegraded":"2024-02-21T07:42:48.472769+0000","last_fullsized":"2024-02-21T07:42:48.472769+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'7","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270271+0000","last_change":"2024-02-21T07:42:01.947758+0000","last_active":"2024-02-21T07:42:49.270271+0000","last_peered":"2024-02-21T07:42:49.270271+0000","last_clean":"2024-02-21T07:42:49.270271+0000","last_became_active":"2024-02-21T07:42:01.947407+0000","last_became_peered":"2024-02-21T07:42:01.947407+0000","last_unstale":"2024-02-21T07:42:49.270271+0000","last_undegraded":"2024-02-21T07:42:49.270271+0000","last_fullsized":"2024-02-21T07:42:49.270271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766823+0000","last_change":"2024-02-21T07:42:07.023243+0000","last_active":"2024-02-21T07:42:48.766823+0000","last_peered":"2024-02-21T07:42:48.766823+0000","last_clean":"2024-02-21T07:42:48.766823+0000","last_became_active":"2024-02-21T07:42:07.022308+0000","last_became_peered":"2024-02-21T07:42:07.022308+0000","last_unstale":"2024-02-21T07:42:48.766823+0000","last_undegraded":"2024-02-21T07:42:48.766823+0000","last_fullsized":"2024-02-21T07:42:48.766823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:24.601640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477347+0000","last_change":"2024-02-21T07:42:02.963456+0000","last_active":"2024-02-21T07:42:48.477347+0000","last_peered":"2024-02-21T07:42:48.477347+0000","last_clean":"2024-02-21T07:42:48.477347+0000","last_became_active":"2024-02-21T07:42:02.963049+0000","last_became_peered":"2024-02-21T07:42:02.963049+0000","last_unstale":"2024-02-21T07:42:48.477347+0000","last_undegraded":"2024-02-21T07:42:48.477347+0000","last_fullsized":"2024-02-21T07:42:48.477347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479529+0000","last_change":"2024-02-21T07:42:01.930737+0000","last_active":"2024-02-21T07:42:48.479529+0000","last_peered":"2024-02-21T07:42:48.479529+0000","last_clean":"2024-02-21T07:42:48.479529+0000","last_became_active":"2024-02-21T07:42:01.930465+0000","last_became_peered":"2024-02-21T07:42:01.930465+0000","last_unstale":"2024-02-21T07:42:48.479529+0000","last_undegraded":"2024-02-21T07:42:48.479529+0000","last_fullsized":"2024-02-21T07:42:48.479529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:08:11.073826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475484+0000","last_change":"2024-02-21T07:42:07.124659+0000","last_active":"2024-02-21T07:42:48.475484+0000","last_peered":"2024-02-21T07:42:48.475484+0000","last_clean":"2024-02-21T07:42:48.475484+0000","last_became_active":"2024-02-21T07:42:07.124217+0000","last_became_peered":"2024-02-21T07:42:07.124217+0000","last_unstale":"2024-02-21T07:42:48.475484+0000","last_undegraded":"2024-02-21T07:42:48.475484+0000","last_fullsized":"2024-02-21T07:42:48.475484+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268590+0000","last_change":"2024-02-21T07:42:02.980306+0000","last_active":"2024-02-21T07:42:49.268590+0000","last_peered":"2024-02-21T07:42:49.268590+0000","last_clean":"2024-02-21T07:42:49.268590+0000","last_became_active":"2024-02-21T07:42:02.978879+0000","last_became_peered":"2024-02-21T07:42:02.978879+0000","last_unstale":"2024-02-21T07:42:49.268590+0000","last_undegraded":"2024-02-21T07:42:49.268590+0000","last_fullsized":"2024-02-21T07:42:49.268590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'7","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475670+0000","last_change":"2024-02-21T07:42:01.931986+0000","last_active":"2024-02-21T07:42:48.475670+0000","last_peered":"2024-02-21T07:42:48.475670+0000","last_clean":"2024-02-21T07:42:48.475670+0000","last_became_active":"2024-02-21T07:42:01.931671+0000","last_became_peered":"2024-02-21T07:42:01.931671+0000","last_unstale":"2024-02-21T07:42:48.475670+0000","last_undegraded":"2024-02-21T07:42:48.475670+0000","last_fullsized":"2024-02-21T07:42:48.475670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083685+0000","last_change":"2024-02-21T07:42:06.999795+0000","last_active":"2024-02-21T07:42:49.083685+0000","last_peered":"2024-02-21T07:42:49.083685+0000","last_clean":"2024-02-21T07:42:49.083685+0000","last_became_active":"2024-02-21T07:42:06.999315+0000","last_became_peered":"2024-02-21T07:42:06.999315+0000","last_unstale":"2024-02-21T07:42:49.083685+0000","last_undegraded":"2024-02-21T07:42:49.083685+0000","last_fullsized":"2024-02-21T07:42:49.083685+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271316+0000","last_change":"2024-02-21T07:42:02.968914+0000","last_active":"2024-02-21T07:42:49.271316+0000","last_peered":"2024-02-21T07:42:49.271316+0000","last_clean":"2024-02-21T07:42:49.271316+0000","last_became_active":"2024-02-21T07:42:02.961877+0000","last_became_peered":"2024-02-21T07:42:02.961877+0000","last_unstale":"2024-02-21T07:42:49.271316+0000","last_undegraded":"2024-02-21T07:42:49.271316+0000","last_fullsized":"2024-02-21T07:42:49.271316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'14","reported_seq":40,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766760+0000","last_change":"2024-02-21T07:42:01.937837+0000","last_active":"2024-02-21T07:42:48.766760+0000","last_peered":"2024-02-21T07:42:48.766760+0000","last_clean":"2024-02-21T07:42:48.766760+0000","last_became_active":"2024-02-21T07:42:01.937536+0000","last_became_peered":"2024-02-21T07:42:01.937536+0000","last_unstale":"2024-02-21T07:42:48.766760+0000","last_undegraded":"2024-02-21T07:42:48.766760+0000","last_fullsized":"2024-02-21T07:42:48.766760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269091+0000","last_change":"2024-02-21T07:42:07.125588+0000","last_active":"2024-02-21T07:42:49.269091+0000","last_peered":"2024-02-21T07:42:49.269091+0000","last_clean":"2024-02-21T07:42:49.269091+0000","last_became_active":"2024-02-21T07:42:07.124044+0000","last_became_peered":"2024-02-21T07:42:07.124044+0000","last_unstale":"2024-02-21T07:42:49.269091+0000","last_undegraded":"2024-02-21T07:42:49.269091+0000","last_fullsized":"2024-02-21T07:42:49.269091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475318+0000","last_change":"2024-02-21T07:42:02.961820+0000","last_active":"2024-02-21T07:42:48.475318+0000","last_peered":"2024-02-21T07:42:48.475318+0000","last_clean":"2024-02-21T07:42:48.475318+0000","last_became_active":"2024-02-21T07:42:02.961478+0000","last_became_peered":"2024-02-21T07:42:02.961478+0000","last_unstale":"2024-02-21T07:42:48.475318+0000","last_undegraded":"2024-02-21T07:42:48.475318+0000","last_fullsized":"2024-02-21T07:42:48.475318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477899+0000","last_change":"2024-02-21T07:42:01.947736+0000","last_active":"2024-02-21T07:42:48.477899+0000","last_peered":"2024-02-21T07:42:48.477899+0000","last_clean":"2024-02-21T07:42:48.477899+0000","last_became_active":"2024-02-21T07:42:01.947443+0000","last_became_peered":"2024-02-21T07:42:01.947443+0000","last_unstale":"2024-02-21T07:42:48.477899+0000","last_undegraded":"2024-02-21T07:42:48.477899+0000","last_fullsized":"2024-02-21T07:42:48.477899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:17.915214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472688+0000","last_change":"2024-02-21T07:42:07.008819+0000","last_active":"2024-02-21T07:42:48.472688+0000","last_peered":"2024-02-21T07:42:48.472688+0000","last_clean":"2024-02-21T07:42:48.472688+0000","last_became_active":"2024-02-21T07:42:07.008423+0000","last_became_peered":"2024-02-21T07:42:07.008423+0000","last_unstale":"2024-02-21T07:42:48.472688+0000","last_undegraded":"2024-02-21T07:42:48.472688+0000","last_fullsized":"2024-02-21T07:42:48.472688+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979420+0000","last_change":"2024-02-21T07:42:02.975343+0000","last_active":"2024-02-21T07:42:48.979420+0000","last_peered":"2024-02-21T07:42:48.979420+0000","last_clean":"2024-02-21T07:42:48.979420+0000","last_became_active":"2024-02-21T07:42:02.975041+0000","last_became_peered":"2024-02-21T07:42:02.975041+0000","last_unstale":"2024-02-21T07:42:48.979420+0000","last_undegraded":"2024-02-21T07:42:48.979420+0000","last_fullsized":"2024-02-21T07:42:48.979420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766490+0000","last_change":"2024-02-21T07:42:01.935020+0000","last_active":"2024-02-21T07:42:48.766490+0000","last_peered":"2024-02-21T07:42:48.766490+0000","last_clean":"2024-02-21T07:42:48.766490+0000","last_became_active":"2024-02-21T07:42:01.934752+0000","last_became_peered":"2024-02-21T07:42:01.934752+0000","last_unstale":"2024-02-21T07:42:48.766490+0000","last_undegraded":"2024-02-21T07:42:48.766490+0000","last_fullsized":"2024-02-21T07:42:48.766490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477397+0000","last_change":"2024-02-21T07:42:07.124477+0000","last_active":"2024-02-21T07:42:48.477397+0000","last_peered":"2024-02-21T07:42:48.477397+0000","last_clean":"2024-02-21T07:42:48.477397+0000","last_became_active":"2024-02-21T07:42:07.123915+0000","last_became_peered":"2024-02-21T07:42:07.123915+0000","last_unstale":"2024-02-21T07:42:48.477397+0000","last_undegraded":"2024-02-21T07:42:48.477397+0000","last_fullsized":"2024-02-21T07:42:48.477397+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979201+0000","last_change":"2024-02-21T07:42:02.964531+0000","last_active":"2024-02-21T07:42:48.979201+0000","last_peered":"2024-02-21T07:42:48.979201+0000","last_clean":"2024-02-21T07:42:48.979201+0000","last_became_active":"2024-02-21T07:42:02.964185+0000","last_became_peered":"2024-02-21T07:42:02.964185+0000","last_unstale":"2024-02-21T07:42:48.979201+0000","last_undegraded":"2024-02-21T07:42:48.979201+0000","last_fullsized":"2024-02-21T07:42:48.979201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'5","reported_seq":60,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.393673+0000","last_change":"2024-02-21T07:42:01.934093+0000","last_active":"2024-02-21T07:42:59.393673+0000","last_peered":"2024-02-21T07:42:59.393673+0000","last_clean":"2024-02-21T07:42:59.393673+0000","last_became_active":"2024-02-21T07:42:01.933841+0000","last_became_peered":"2024-02-21T07:42:01.933841+0000","last_unstale":"2024-02-21T07:42:59.393673+0000","last_undegraded":"2024-02-21T07:42:59.393673+0000","last_fullsized":"2024-02-21T07:42:59.393673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475132+0000","last_change":"2024-02-21T07:42:07.018134+0000","last_active":"2024-02-21T07:42:48.475132+0000","last_peered":"2024-02-21T07:42:48.475132+0000","last_clean":"2024-02-21T07:42:48.475132+0000","last_became_active":"2024-02-21T07:42:07.017670+0000","last_became_peered":"2024-02-21T07:42:07.017670+0000","last_unstale":"2024-02-21T07:42:48.475132+0000","last_undegraded":"2024-02-21T07:42:48.475132+0000","last_fullsized":"2024-02-21T07:42:48.475132+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:02:51.888650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255349+0000","last_change":"2024-02-21T07:42:02.962279+0000","last_active":"2024-02-21T07:42:49.255349+0000","last_peered":"2024-02-21T07:42:49.255349+0000","last_clean":"2024-02-21T07:42:49.255349+0000","last_became_active":"2024-02-21T07:42:02.961965+0000","last_became_peered":"2024-02-21T07:42:02.961965+0000","last_unstale":"2024-02-21T07:42:49.255349+0000","last_undegraded":"2024-02-21T07:42:49.255349+0000","last_fullsized":"2024-02-21T07:42:49.255349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'5","reported_seq":61,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.362529+0000","last_change":"2024-02-21T07:42:01.948478+0000","last_active":"2024-02-21T07:42:59.362529+0000","last_peered":"2024-02-21T07:42:59.362529+0000","last_clean":"2024-02-21T07:42:59.362529+0000","last_became_active":"2024-02-21T07:42:01.948184+0000","last_became_peered":"2024-02-21T07:42:01.948184+0000","last_unstale":"2024-02-21T07:42:59.362529+0000","last_undegraded":"2024-02-21T07:42:59.362529+0000","last_fullsized":"2024-02-21T07:42:59.362529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475526+0000","last_change":"2024-02-21T07:42:07.124759+0000","last_active":"2024-02-21T07:42:48.475526+0000","last_peered":"2024-02-21T07:42:48.475526+0000","last_clean":"2024-02-21T07:42:48.475526+0000","last_became_active":"2024-02-21T07:42:07.124275+0000","last_became_peered":"2024-02-21T07:42:07.124275+0000","last_unstale":"2024-02-21T07:42:48.475526+0000","last_undegraded":"2024-02-21T07:42:48.475526+0000","last_fullsized":"2024-02-21T07:42:48.475526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474564+0000","last_change":"2024-02-21T07:42:02.961213+0000","last_active":"2024-02-21T07:42:48.474564+0000","last_peered":"2024-02-21T07:42:48.474564+0000","last_clean":"2024-02-21T07:42:48.474564+0000","last_became_active":"2024-02-21T07:42:02.960477+0000","last_became_peered":"2024-02-21T07:42:02.960477+0000","last_unstale":"2024-02-21T07:42:48.474564+0000","last_undegraded":"2024-02-21T07:42:48.474564+0000","last_fullsized":"2024-02-21T07:42:48.474564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.729819+0000","last_change":"2024-02-21T07:42:01.928302+0000","last_active":"2024-02-21T07:42:48.729819+0000","last_peered":"2024-02-21T07:42:48.729819+0000","last_clean":"2024-02-21T07:42:48.729819+0000","last_became_active":"2024-02-21T07:42:01.927234+0000","last_became_peered":"2024-02-21T07:42:01.927234+0000","last_unstale":"2024-02-21T07:42:48.729819+0000","last_undegraded":"2024-02-21T07:42:48.729819+0000","last_fullsized":"2024-02-21T07:42:48.729819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255689+0000","last_change":"2024-02-21T07:42:07.124715+0000","last_active":"2024-02-21T07:42:49.255689+0000","last_peered":"2024-02-21T07:42:49.255689+0000","last_clean":"2024-02-21T07:42:49.255689+0000","last_became_active":"2024-02-21T07:42:07.124248+0000","last_became_peered":"2024-02-21T07:42:07.124248+0000","last_unstale":"2024-02-21T07:42:49.255689+0000","last_undegraded":"2024-02-21T07:42:49.255689+0000","last_fullsized":"2024-02-21T07:42:49.255689+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:17:21.721728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270752+0000","last_change":"2024-02-21T07:42:02.971762+0000","last_active":"2024-02-21T07:42:49.270752+0000","last_peered":"2024-02-21T07:42:49.270752+0000","last_clean":"2024-02-21T07:42:49.270752+0000","last_became_active":"2024-02-21T07:42:02.970032+0000","last_became_peered":"2024-02-21T07:42:02.970032+0000","last_unstale":"2024-02-21T07:42:49.270752+0000","last_undegraded":"2024-02-21T07:42:49.270752+0000","last_fullsized":"2024-02-21T07:42:49.270752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'6","reported_seq":34,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475449+0000","last_change":"2024-02-21T07:42:01.932968+0000","last_active":"2024-02-21T07:42:48.475449+0000","last_peered":"2024-02-21T07:42:48.475449+0000","last_clean":"2024-02-21T07:42:48.475449+0000","last_became_active":"2024-02-21T07:42:01.932620+0000","last_became_peered":"2024-02-21T07:42:01.932620+0000","last_unstale":"2024-02-21T07:42:48.475449+0000","last_undegraded":"2024-02-21T07:42:48.475449+0000","last_fullsized":"2024-02-21T07:42:48.475449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:18:51.022752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":205,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730104+0000","last_change":"2024-02-21T07:41:57.883808+0000","last_active":"2024-02-21T07:42:48.730104+0000","last_peered":"2024-02-21T07:42:48.730104+0000","last_clean":"2024-02-21T07:42:48.730104+0000","last_became_active":"2024-02-21T07:41:57.883530+0000","last_became_peered":"2024-02-21T07:41:57.883530+0000","last_unstale":"2024-02-21T07:42:48.730104+0000","last_undegraded":"2024-02-21T07:42:48.730104+0000","last_fullsized":"2024-02-21T07:42:48.730104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:41:56.862963+0000","last_clean_scrub_stamp":"2024-02-21T07:41:56.862963+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:09:51.756066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730094+0000","last_change":"2024-02-21T07:42:07.011954+0000","last_active":"2024-02-21T07:42:48.730094+0000","last_peered":"2024-02-21T07:42:48.730094+0000","last_clean":"2024-02-21T07:42:48.730094+0000","last_became_active":"2024-02-21T07:42:07.011654+0000","last_became_peered":"2024-02-21T07:42:07.011654+0000","last_unstale":"2024-02-21T07:42:48.730094+0000","last_undegraded":"2024-02-21T07:42:48.730094+0000","last_fullsized":"2024-02-21T07:42:48.730094+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730347+0000","last_change":"2024-02-21T07:42:02.956569+0000","last_active":"2024-02-21T07:42:48.730347+0000","last_peered":"2024-02-21T07:42:48.730347+0000","last_clean":"2024-02-21T07:42:48.730347+0000","last_became_active":"2024-02-21T07:42:02.956232+0000","last_became_peered":"2024-02-21T07:42:02.956232+0000","last_unstale":"2024-02-21T07:42:48.730347+0000","last_undegraded":"2024-02-21T07:42:48.730347+0000","last_fullsized":"2024-02-21T07:42:48.730347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'6","reported_seq":64,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.346411+0000","last_change":"2024-02-21T07:42:01.926736+0000","last_active":"2024-02-21T07:42:59.346411+0000","last_peered":"2024-02-21T07:42:59.346411+0000","last_clean":"2024-02-21T07:42:59.346411+0000","last_became_active":"2024-02-21T07:42:01.926454+0000","last_became_peered":"2024-02-21T07:42:01.926454+0000","last_unstale":"2024-02-21T07:42:59.346411+0000","last_undegraded":"2024-02-21T07:42:59.346411+0000","last_fullsized":"2024-02-21T07:42:59.346411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.731511+0000","last_change":"2024-02-21T07:42:48.731511+0000","last_active":"2024-02-21T07:42:48.731511+0000","last_peered":"2024-02-21T07:42:48.731511+0000","last_clean":"2024-02-21T07:42:48.731511+0000","last_became_active":"2024-02-21T07:42:48.731074+0000","last_became_peered":"2024-02-21T07:42:48.731074+0000","last_unstale":"2024-02-21T07:42:48.731511+0000","last_undegraded":"2024-02-21T07:42:48.731511+0000","last_fullsized":"2024-02-21T07:42:48.731511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:49:35.717727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6,7],"acting":[1,8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730270+0000","last_change":"2024-02-21T07:42:02.976255+0000","last_active":"2024-02-21T07:42:48.730270+0000","last_peered":"2024-02-21T07:42:48.730270+0000","last_clean":"2024-02-21T07:42:48.730270+0000","last_became_active":"2024-02-21T07:42:02.975927+0000","last_became_peered":"2024-02-21T07:42:02.975927+0000","last_unstale":"2024-02-21T07:42:48.730270+0000","last_undegraded":"2024-02-21T07:42:48.730270+0000","last_fullsized":"2024-02-21T07:42:48.730270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255791+0000","last_change":"2024-02-21T07:42:01.932488+0000","last_active":"2024-02-21T07:42:49.255791+0000","last_peered":"2024-02-21T07:42:49.255791+0000","last_clean":"2024-02-21T07:42:49.255791+0000","last_became_active":"2024-02-21T07:42:01.932131+0000","last_became_peered":"2024-02-21T07:42:01.932131+0000","last_unstale":"2024-02-21T07:42:49.255791+0000","last_undegraded":"2024-02-21T07:42:49.255791+0000","last_fullsized":"2024-02-21T07:42:49.255791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:18.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267461+0000","last_change":"2024-02-21T07:42:07.017329+0000","last_active":"2024-02-21T07:42:49.267461+0000","last_peered":"2024-02-21T07:42:49.267461+0000","last_clean":"2024-02-21T07:42:49.267461+0000","last_became_active":"2024-02-21T07:42:07.016916+0000","last_became_peered":"2024-02-21T07:42:07.016916+0000","last_unstale":"2024-02-21T07:42:49.267461+0000","last_undegraded":"2024-02-21T07:42:49.267461+0000","last_fullsized":"2024-02-21T07:42:49.267461+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730155+0000","last_change":"2024-02-21T07:42:02.959157+0000","last_active":"2024-02-21T07:42:48.730155+0000","last_peered":"2024-02-21T07:42:48.730155+0000","last_clean":"2024-02-21T07:42:48.730155+0000","last_became_active":"2024-02-21T07:42:02.958593+0000","last_became_peered":"2024-02-21T07:42:02.958593+0000","last_unstale":"2024-02-21T07:42:48.730155+0000","last_undegraded":"2024-02-21T07:42:48.730155+0000","last_fullsized":"2024-02-21T07:42:48.730155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:55.509520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475193+0000","last_change":"2024-02-21T07:42:01.949434+0000","last_active":"2024-02-21T07:42:48.475193+0000","last_peered":"2024-02-21T07:42:48.475193+0000","last_clean":"2024-02-21T07:42:48.475193+0000","last_became_active":"2024-02-21T07:42:01.948805+0000","last_became_peered":"2024-02-21T07:42:01.948805+0000","last_unstale":"2024-02-21T07:42:48.475193+0000","last_undegraded":"2024-02-21T07:42:48.475193+0000","last_fullsized":"2024-02-21T07:42:48.475193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255139+0000","last_change":"2024-02-21T07:42:07.003190+0000","last_active":"2024-02-21T07:42:49.255139+0000","last_peered":"2024-02-21T07:42:49.255139+0000","last_clean":"2024-02-21T07:42:49.255139+0000","last_became_active":"2024-02-21T07:42:07.002780+0000","last_became_peered":"2024-02-21T07:42:07.002780+0000","last_unstale":"2024-02-21T07:42:49.255139+0000","last_undegraded":"2024-02-21T07:42:49.255139+0000","last_fullsized":"2024-02-21T07:42:49.255139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T16:38:37.469952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473048+0000","last_change":"2024-02-21T07:42:02.959569+0000","last_active":"2024-02-21T07:42:48.473048+0000","last_peered":"2024-02-21T07:42:48.473048+0000","last_clean":"2024-02-21T07:42:48.473048+0000","last_became_active":"2024-02-21T07:42:02.959146+0000","last_became_peered":"2024-02-21T07:42:02.959146+0000","last_unstale":"2024-02-21T07:42:48.473048+0000","last_undegraded":"2024-02-21T07:42:48.473048+0000","last_fullsized":"2024-02-21T07:42:48.473048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477817+0000","last_change":"2024-02-21T07:42:01.926878+0000","last_active":"2024-02-21T07:42:48.477817+0000","last_peered":"2024-02-21T07:42:48.477817+0000","last_clean":"2024-02-21T07:42:48.477817+0000","last_became_active":"2024-02-21T07:42:01.926212+0000","last_became_peered":"2024-02-21T07:42:01.926212+0000","last_unstale":"2024-02-21T07:42:48.477817+0000","last_undegraded":"2024-02-21T07:42:48.477817+0000","last_fullsized":"2024-02-21T07:42:48.477817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255229+0000","last_change":"2024-02-21T07:42:07.017443+0000","last_active":"2024-02-21T07:42:49.255229+0000","last_peered":"2024-02-21T07:42:49.255229+0000","last_clean":"2024-02-21T07:42:49.255229+0000","last_became_active":"2024-02-21T07:42:07.016918+0000","last_became_peered":"2024-02-21T07:42:07.016918+0000","last_unstale":"2024-02-21T07:42:49.255229+0000","last_undegraded":"2024-02-21T07:42:49.255229+0000","last_fullsized":"2024-02-21T07:42:49.255229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:49:35.717727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255615+0000","last_change":"2024-02-21T07:42:02.965178+0000","last_active":"2024-02-21T07:42:49.255615+0000","last_peered":"2024-02-21T07:42:49.255615+0000","last_clean":"2024-02-21T07:42:49.255615+0000","last_became_active":"2024-02-21T07:42:02.964846+0000","last_became_peered":"2024-02-21T07:42:02.964846+0000","last_unstale":"2024-02-21T07:42:49.255615+0000","last_undegraded":"2024-02-21T07:42:49.255615+0000","last_fullsized":"2024-02-21T07:42:49.255615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'17","reported_seq":43,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477336+0000","last_change":"2024-02-21T07:42:01.946183+0000","last_active":"2024-02-21T07:42:48.477336+0000","last_peered":"2024-02-21T07:42:48.477336+0000","last_clean":"2024-02-21T07:42:48.477336+0000","last_became_active":"2024-02-21T07:42:01.945960+0000","last_became_peered":"2024-02-21T07:42:01.945960+0000","last_unstale":"2024-02-21T07:42:48.477336+0000","last_undegraded":"2024-02-21T07:42:48.477336+0000","last_fullsized":"2024-02-21T07:42:48.477336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.275007+0000","last_change":"2024-02-21T07:42:49.275007+0000","last_active":"2024-02-21T07:42:49.275007+0000","last_peered":"2024-02-21T07:42:49.275007+0000","last_clean":"2024-02-21T07:42:49.275007+0000","last_became_active":"2024-02-21T07:42:49.273404+0000","last_became_peered":"2024-02-21T07:42:49.273404+0000","last_unstale":"2024-02-21T07:42:49.275007+0000","last_undegraded":"2024-02-21T07:42:49.275007+0000","last_fullsized":"2024-02-21T07:42:49.275007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:38:24.009546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.729810+0000","last_change":"2024-02-21T07:42:02.960144+0000","last_active":"2024-02-21T07:42:48.729810+0000","last_peered":"2024-02-21T07:42:48.729810+0000","last_clean":"2024-02-21T07:42:48.729810+0000","last_became_active":"2024-02-21T07:42:02.959714+0000","last_became_peered":"2024-02-21T07:42:02.959714+0000","last_unstale":"2024-02-21T07:42:48.729810+0000","last_undegraded":"2024-02-21T07:42:48.729810+0000","last_fullsized":"2024-02-21T07:42:48.729810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.363160+0000","last_change":"2024-02-21T07:42:01.930429+0000","last_active":"2024-02-21T07:42:59.363160+0000","last_peered":"2024-02-21T07:42:59.363160+0000","last_clean":"2024-02-21T07:42:59.363160+0000","last_became_active":"2024-02-21T07:42:01.930076+0000","last_became_peered":"2024-02-21T07:42:01.930076+0000","last_unstale":"2024-02-21T07:42:59.363160+0000","last_undegraded":"2024-02-21T07:42:59.363160+0000","last_fullsized":"2024-02-21T07:42:59.363160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766660+0000","last_change":"2024-02-21T07:42:07.025234+0000","last_active":"2024-02-21T07:42:48.766660+0000","last_peered":"2024-02-21T07:42:48.766660+0000","last_clean":"2024-02-21T07:42:48.766660+0000","last_became_active":"2024-02-21T07:42:07.024452+0000","last_became_peered":"2024-02-21T07:42:07.024452+0000","last_unstale":"2024-02-21T07:42:48.766660+0000","last_undegraded":"2024-02-21T07:42:48.766660+0000","last_fullsized":"2024-02-21T07:42:48.766660+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:18.569837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730040+0000","last_change":"2024-02-21T07:42:02.958015+0000","last_active":"2024-02-21T07:42:48.730040+0000","last_peered":"2024-02-21T07:42:48.730040+0000","last_clean":"2024-02-21T07:42:48.730040+0000","last_became_active":"2024-02-21T07:42:02.956436+0000","last_became_peered":"2024-02-21T07:42:02.956436+0000","last_unstale":"2024-02-21T07:42:48.730040+0000","last_undegraded":"2024-02-21T07:42:48.730040+0000","last_fullsized":"2024-02-21T07:42:48.730040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:39.265082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255581+0000","last_change":"2024-02-21T07:42:01.943079+0000","last_active":"2024-02-21T07:42:49.255581+0000","last_peered":"2024-02-21T07:42:49.255581+0000","last_clean":"2024-02-21T07:42:49.255581+0000","last_became_active":"2024-02-21T07:42:01.942831+0000","last_became_peered":"2024-02-21T07:42:01.942831+0000","last_unstale":"2024-02-21T07:42:49.255581+0000","last_undegraded":"2024-02-21T07:42:49.255581+0000","last_fullsized":"2024-02-21T07:42:49.255581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472680+0000","last_change":"2024-02-21T07:42:07.015228+0000","last_active":"2024-02-21T07:42:48.472680+0000","last_peered":"2024-02-21T07:42:48.472680+0000","last_clean":"2024-02-21T07:42:48.472680+0000","last_became_active":"2024-02-21T07:42:07.014798+0000","last_became_peered":"2024-02-21T07:42:07.014798+0000","last_unstale":"2024-02-21T07:42:48.472680+0000","last_undegraded":"2024-02-21T07:42:48.472680+0000","last_fullsized":"2024-02-21T07:42:48.472680+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:58:43.325645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474857+0000","last_change":"2024-02-21T07:42:02.965287+0000","last_active":"2024-02-21T07:42:48.474857+0000","last_peered":"2024-02-21T07:42:48.474857+0000","last_clean":"2024-02-21T07:42:48.474857+0000","last_became_active":"2024-02-21T07:42:02.960780+0000","last_became_peered":"2024-02-21T07:42:02.960780+0000","last_unstale":"2024-02-21T07:42:48.474857+0000","last_undegraded":"2024-02-21T07:42:48.474857+0000","last_fullsized":"2024-02-21T07:42:48.474857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'9","reported_seq":37,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084260+0000","last_change":"2024-02-21T07:42:01.932401+0000","last_active":"2024-02-21T07:42:49.084260+0000","last_peered":"2024-02-21T07:42:49.084260+0000","last_clean":"2024-02-21T07:42:49.084260+0000","last_became_active":"2024-02-21T07:42:01.932108+0000","last_became_peered":"2024-02-21T07:42:01.932108+0000","last_unstale":"2024-02-21T07:42:49.084260+0000","last_undegraded":"2024-02-21T07:42:49.084260+0000","last_fullsized":"2024-02-21T07:42:49.084260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255518+0000","last_change":"2024-02-21T07:42:07.018725+0000","last_active":"2024-02-21T07:42:49.255518+0000","last_peered":"2024-02-21T07:42:49.255518+0000","last_clean":"2024-02-21T07:42:49.255518+0000","last_became_active":"2024-02-21T07:42:07.018322+0000","last_became_peered":"2024-02-21T07:42:07.018322+0000","last_unstale":"2024-02-21T07:42:49.255518+0000","last_undegraded":"2024-02-21T07:42:49.255518+0000","last_fullsized":"2024-02-21T07:42:49.255518+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:04:05.896966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477711+0000","last_change":"2024-02-21T07:42:02.963384+0000","last_active":"2024-02-21T07:42:48.477711+0000","last_peered":"2024-02-21T07:42:48.477711+0000","last_clean":"2024-02-21T07:42:48.477711+0000","last_became_active":"2024-02-21T07:42:02.963098+0000","last_became_peered":"2024-02-21T07:42:02.963098+0000","last_unstale":"2024-02-21T07:42:48.477711+0000","last_undegraded":"2024-02-21T07:42:48.477711+0000","last_fullsized":"2024-02-21T07:42:48.477711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"31'36","reported_seq":128,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:43:00.352806+0000","last_change":"2024-02-21T07:42:01.936472+0000","last_active":"2024-02-21T07:43:00.352806+0000","last_peered":"2024-02-21T07:43:00.352806+0000","last_clean":"2024-02-21T07:43:00.352806+0000","last_became_active":"2024-02-21T07:42:01.936181+0000","last_became_peered":"2024-02-21T07:42:01.936181+0000","last_unstale":"2024-02-21T07:43:00.352806+0000","last_undegraded":"2024-02-21T07:43:00.352806+0000","last_fullsized":"2024-02-21T07:43:00.352806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66332,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":99,"num_write":38,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.765829+0000","last_change":"2024-02-21T07:42:07.013938+0000","last_active":"2024-02-21T07:42:48.765829+0000","last_peered":"2024-02-21T07:42:48.765829+0000","last_clean":"2024-02-21T07:42:48.765829+0000","last_became_active":"2024-02-21T07:42:07.013409+0000","last_became_peered":"2024-02-21T07:42:07.013409+0000","last_unstale":"2024-02-21T07:42:48.765829+0000","last_undegraded":"2024-02-21T07:42:48.765829+0000","last_fullsized":"2024-02-21T07:42:48.765829+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:52:00.302670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479660+0000","last_change":"2024-02-21T07:42:02.960084+0000","last_active":"2024-02-21T07:42:48.479660+0000","last_peered":"2024-02-21T07:42:48.479660+0000","last_clean":"2024-02-21T07:42:48.479660+0000","last_became_active":"2024-02-21T07:42:02.959610+0000","last_became_peered":"2024-02-21T07:42:02.959610+0000","last_unstale":"2024-02-21T07:42:48.479660+0000","last_undegraded":"2024-02-21T07:42:48.479660+0000","last_fullsized":"2024-02-21T07:42:48.479660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255791+0000","last_change":"2024-02-21T07:42:01.946668+0000","last_active":"2024-02-21T07:42:49.255791+0000","last_peered":"2024-02-21T07:42:49.255791+0000","last_clean":"2024-02-21T07:42:49.255791+0000","last_became_active":"2024-02-21T07:42:01.946454+0000","last_became_peered":"2024-02-21T07:42:01.946454+0000","last_unstale":"2024-02-21T07:42:49.255791+0000","last_undegraded":"2024-02-21T07:42:49.255791+0000","last_fullsized":"2024-02-21T07:42:49.255791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:30.119221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.085966+0000","last_change":"2024-02-21T07:42:49.085966+0000","last_active":"2024-02-21T07:42:49.085966+0000","last_peered":"2024-02-21T07:42:49.085966+0000","last_clean":"2024-02-21T07:42:49.085966+0000","last_became_active":"2024-02-21T07:42:49.085400+0000","last_became_peered":"2024-02-21T07:42:49.085400+0000","last_unstale":"2024-02-21T07:42:49.085966+0000","last_undegraded":"2024-02-21T07:42:49.085966+0000","last_fullsized":"2024-02-21T07:42:49.085966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:38:24.009546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268377+0000","last_change":"2024-02-21T07:42:02.969725+0000","last_active":"2024-02-21T07:42:49.268377+0000","last_peered":"2024-02-21T07:42:49.268377+0000","last_clean":"2024-02-21T07:42:49.268377+0000","last_became_active":"2024-02-21T07:42:02.969125+0000","last_became_peered":"2024-02-21T07:42:02.969125+0000","last_unstale":"2024-02-21T07:42:49.268377+0000","last_undegraded":"2024-02-21T07:42:49.268377+0000","last_fullsized":"2024-02-21T07:42:49.268377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730160+0000","last_change":"2024-02-21T07:42:01.931035+0000","last_active":"2024-02-21T07:42:48.730160+0000","last_peered":"2024-02-21T07:42:48.730160+0000","last_clean":"2024-02-21T07:42:48.730160+0000","last_became_active":"2024-02-21T07:42:01.930665+0000","last_became_peered":"2024-02-21T07:42:01.930665+0000","last_unstale":"2024-02-21T07:42:48.730160+0000","last_undegraded":"2024-02-21T07:42:48.730160+0000","last_fullsized":"2024-02-21T07:42:48.730160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.275276+0000","last_change":"2024-02-21T07:42:49.272248+0000","last_active":"2024-02-21T07:42:49.275276+0000","last_peered":"2024-02-21T07:42:49.275276+0000","last_clean":"2024-02-21T07:42:49.275276+0000","last_became_active":"2024-02-21T07:42:49.271686+0000","last_became_peered":"2024-02-21T07:42:49.271686+0000","last_unstale":"2024-02-21T07:42:49.275276+0000","last_undegraded":"2024-02-21T07:42:49.275276+0000","last_fullsized":"2024-02-21T07:42:49.275276+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:59:54.935538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479700+0000","last_change":"2024-02-21T07:42:02.956416+0000","last_active":"2024-02-21T07:42:48.479700+0000","last_peered":"2024-02-21T07:42:48.479700+0000","last_clean":"2024-02-21T07:42:48.479700+0000","last_became_active":"2024-02-21T07:42:02.956098+0000","last_became_peered":"2024-02-21T07:42:02.956098+0000","last_unstale":"2024-02-21T07:42:48.479700+0000","last_undegraded":"2024-02-21T07:42:48.479700+0000","last_fullsized":"2024-02-21T07:42:48.479700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"31'5","reported_seq":88,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:43:00.347206+0000","last_change":"2024-02-21T07:42:01.937810+0000","last_active":"2024-02-21T07:43:00.347206+0000","last_peered":"2024-02-21T07:43:00.347206+0000","last_clean":"2024-02-21T07:43:00.347206+0000","last_became_active":"2024-02-21T07:42:01.937555+0000","last_became_peered":"2024-02-21T07:42:01.937555+0000","last_unstale":"2024-02-21T07:43:00.347206+0000","last_undegraded":"2024-02-21T07:43:00.347206+0000","last_fullsized":"2024-02-21T07:43:00.347206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:14:16.855603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269724+0000","last_change":"2024-02-21T07:42:07.013284+0000","last_active":"2024-02-21T07:42:49.269724+0000","last_peered":"2024-02-21T07:42:49.269724+0000","last_clean":"2024-02-21T07:42:49.269724+0000","last_became_active":"2024-02-21T07:42:07.012412+0000","last_became_peered":"2024-02-21T07:42:07.012412+0000","last_unstale":"2024-02-21T07:42:49.269724+0000","last_undegraded":"2024-02-21T07:42:49.269724+0000","last_fullsized":"2024-02-21T07:42:49.269724+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:15:01.865273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268227+0000","last_change":"2024-02-21T07:42:07.016945+0000","last_active":"2024-02-21T07:42:49.268227+0000","last_peered":"2024-02-21T07:42:49.268227+0000","last_clean":"2024-02-21T07:42:49.268227+0000","last_became_active":"2024-02-21T07:42:07.016572+0000","last_became_peered":"2024-02-21T07:42:07.016572+0000","last_unstale":"2024-02-21T07:42:49.268227+0000","last_undegraded":"2024-02-21T07:42:49.268227+0000","last_fullsized":"2024-02-21T07:42:49.268227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:30.957073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.765761+0000","last_change":"2024-02-21T07:42:02.977972+0000","last_active":"2024-02-21T07:42:48.765761+0000","last_peered":"2024-02-21T07:42:48.765761+0000","last_clean":"2024-02-21T07:42:48.765761+0000","last_became_active":"2024-02-21T07:42:02.977632+0000","last_became_peered":"2024-02-21T07:42:02.977632+0000","last_unstale":"2024-02-21T07:42:48.765761+0000","last_undegraded":"2024-02-21T07:42:48.765761+0000","last_fullsized":"2024-02-21T07:42:48.765761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255507+0000","last_change":"2024-02-21T07:42:01.930402+0000","last_active":"2024-02-21T07:42:49.255507+0000","last_peered":"2024-02-21T07:42:49.255507+0000","last_clean":"2024-02-21T07:42:49.255507+0000","last_became_active":"2024-02-21T07:42:01.930084+0000","last_became_peered":"2024-02-21T07:42:01.930084+0000","last_unstale":"2024-02-21T07:42:49.255507+0000","last_undegraded":"2024-02-21T07:42:49.255507+0000","last_fullsized":"2024-02-21T07:42:49.255507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:29:05.037427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472910+0000","last_change":"2024-02-21T07:42:07.016859+0000","last_active":"2024-02-21T07:42:48.472910+0000","last_peered":"2024-02-21T07:42:48.472910+0000","last_clean":"2024-02-21T07:42:48.472910+0000","last_became_active":"2024-02-21T07:42:07.016372+0000","last_became_peered":"2024-02-21T07:42:07.016372+0000","last_unstale":"2024-02-21T07:42:48.472910+0000","last_undegraded":"2024-02-21T07:42:48.472910+0000","last_fullsized":"2024-02-21T07:42:48.472910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269340+0000","last_change":"2024-02-21T07:42:02.948576+0000","last_active":"2024-02-21T07:42:49.269340+0000","last_peered":"2024-02-21T07:42:49.269340+0000","last_clean":"2024-02-21T07:42:49.269340+0000","last_became_active":"2024-02-21T07:42:02.947666+0000","last_became_peered":"2024-02-21T07:42:02.947666+0000","last_unstale":"2024-02-21T07:42:49.269340+0000","last_undegraded":"2024-02-21T07:42:49.269340+0000","last_fullsized":"2024-02-21T07:42:49.269340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474551+0000","last_change":"2024-02-21T07:42:01.929126+0000","last_active":"2024-02-21T07:42:48.474551+0000","last_peered":"2024-02-21T07:42:48.474551+0000","last_clean":"2024-02-21T07:42:48.474551+0000","last_became_active":"2024-02-21T07:42:01.928667+0000","last_became_peered":"2024-02-21T07:42:01.928667+0000","last_unstale":"2024-02-21T07:42:48.474551+0000","last_undegraded":"2024-02-21T07:42:48.474551+0000","last_fullsized":"2024-02-21T07:42:48.474551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T07:49:48.863342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'7","reported_seq":32,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979178+0000","last_change":"2024-02-21T07:42:01.933903+0000","last_active":"2024-02-21T07:42:48.979178+0000","last_peered":"2024-02-21T07:42:48.979178+0000","last_clean":"2024-02-21T07:42:48.979178+0000","last_became_active":"2024-02-21T07:42:01.933578+0000","last_became_peered":"2024-02-21T07:42:01.933578+0000","last_unstale":"2024-02-21T07:42:48.979178+0000","last_undegraded":"2024-02-21T07:42:48.979178+0000","last_fullsized":"2024-02-21T07:42:48.979178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255429+0000","last_change":"2024-02-21T07:42:02.964660+0000","last_active":"2024-02-21T07:42:49.255429+0000","last_peered":"2024-02-21T07:42:49.255429+0000","last_clean":"2024-02-21T07:42:49.255429+0000","last_became_active":"2024-02-21T07:42:02.964389+0000","last_became_peered":"2024-02-21T07:42:02.964389+0000","last_unstale":"2024-02-21T07:42:49.255429+0000","last_undegraded":"2024-02-21T07:42:49.255429+0000","last_fullsized":"2024-02-21T07:42:49.255429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083837+0000","last_change":"2024-02-21T07:42:07.015720+0000","last_active":"2024-02-21T07:42:49.083837+0000","last_peered":"2024-02-21T07:42:49.083837+0000","last_clean":"2024-02-21T07:42:49.083837+0000","last_became_active":"2024-02-21T07:42:07.015315+0000","last_became_peered":"2024-02-21T07:42:07.015315+0000","last_unstale":"2024-02-21T07:42:49.083837+0000","last_undegraded":"2024-02-21T07:42:49.083837+0000","last_fullsized":"2024-02-21T07:42:49.083837+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T11:35:59.570083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"31'7","reported_seq":65,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:59.346579+0000","last_change":"2024-02-21T07:42:01.927978+0000","last_active":"2024-02-21T07:42:59.346579+0000","last_peered":"2024-02-21T07:42:59.346579+0000","last_clean":"2024-02-21T07:42:59.346579+0000","last_became_active":"2024-02-21T07:42:01.927661+0000","last_became_peered":"2024-02-21T07:42:01.927661+0000","last_unstale":"2024-02-21T07:42:59.346579+0000","last_undegraded":"2024-02-21T07:42:59.346579+0000","last_fullsized":"2024-02-21T07:42:59.346579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:00.895592+0000","last_clean_scrub_stamp":"2024-02-21T07:42:00.895592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:06:22.599674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477603+0000","last_change":"2024-02-21T07:42:02.971175+0000","last_active":"2024-02-21T07:42:48.477603+0000","last_peered":"2024-02-21T07:42:48.477603+0000","last_clean":"2024-02-21T07:42:48.477603+0000","last_became_active":"2024-02-21T07:42:02.970886+0000","last_became_peered":"2024-02-21T07:42:02.970886+0000","last_unstale":"2024-02-21T07:42:48.477603+0000","last_undegraded":"2024-02-21T07:42:48.477603+0000","last_fullsized":"2024-02-21T07:42:48.477603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084180+0000","last_change":"2024-02-21T07:42:07.003267+0000","last_active":"2024-02-21T07:42:49.084180+0000","last_peered":"2024-02-21T07:42:49.084180+0000","last_clean":"2024-02-21T07:42:49.084180+0000","last_became_active":"2024-02-21T07:42:07.002824+0000","last_became_peered":"2024-02-21T07:42:07.002824+0000","last_unstale":"2024-02-21T07:42:49.084180+0000","last_undegraded":"2024-02-21T07:42:49.084180+0000","last_fullsized":"2024-02-21T07:42:49.084180+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:05.968927+0000","last_clean_scrub_stamp":"2024-02-21T07:42:05.968927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:16:29.285539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.472669+0000","last_change":"2024-02-21T07:42:02.960884+0000","last_active":"2024-02-21T07:42:48.472669+0000","last_peered":"2024-02-21T07:42:48.472669+0000","last_clean":"2024-02-21T07:42:48.472669+0000","last_became_active":"2024-02-21T07:42:02.960515+0000","last_became_peered":"2024-02-21T07:42:02.960515+0000","last_unstale":"2024-02-21T07:42:48.472669+0000","last_undegraded":"2024-02-21T07:42:48.472669+0000","last_fullsized":"2024-02-21T07:42:48.472669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083874+0000","last_change":"2024-02-21T07:42:02.960807+0000","last_active":"2024-02-21T07:42:49.083874+0000","last_peered":"2024-02-21T07:42:49.083874+0000","last_clean":"2024-02-21T07:42:49.083874+0000","last_became_active":"2024-02-21T07:42:02.960478+0000","last_became_peered":"2024-02-21T07:42:02.960478+0000","last_unstale":"2024-02-21T07:42:49.083874+0000","last_undegraded":"2024-02-21T07:42:49.083874+0000","last_fullsized":"2024-02-21T07:42:49.083874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.083754+0000","last_change":"2024-02-21T07:42:02.966666+0000","last_active":"2024-02-21T07:42:49.083754+0000","last_peered":"2024-02-21T07:42:49.083754+0000","last_clean":"2024-02-21T07:42:49.083754+0000","last_became_active":"2024-02-21T07:42:02.966350+0000","last_became_peered":"2024-02-21T07:42:02.966350+0000","last_unstale":"2024-02-21T07:42:49.083754+0000","last_undegraded":"2024-02-21T07:42:49.083754+0000","last_fullsized":"2024-02-21T07:42:49.083754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267525+0000","last_change":"2024-02-21T07:42:02.973149+0000","last_active":"2024-02-21T07:42:49.267525+0000","last_peered":"2024-02-21T07:42:49.267525+0000","last_clean":"2024-02-21T07:42:49.267525+0000","last_became_active":"2024-02-21T07:42:02.972869+0000","last_became_peered":"2024-02-21T07:42:02.972869+0000","last_unstale":"2024-02-21T07:42:49.267525+0000","last_undegraded":"2024-02-21T07:42:49.267525+0000","last_fullsized":"2024-02-21T07:42:49.267525+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475249+0000","last_change":"2024-02-21T07:42:02.957623+0000","last_active":"2024-02-21T07:42:48.475249+0000","last_peered":"2024-02-21T07:42:48.475249+0000","last_clean":"2024-02-21T07:42:48.475249+0000","last_became_active":"2024-02-21T07:42:02.956527+0000","last_became_peered":"2024-02-21T07:42:02.956527+0000","last_unstale":"2024-02-21T07:42:48.475249+0000","last_undegraded":"2024-02-21T07:42:48.475249+0000","last_fullsized":"2024-02-21T07:42:48.475249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473016+0000","last_change":"2024-02-21T07:42:02.961369+0000","last_active":"2024-02-21T07:42:48.473016+0000","last_peered":"2024-02-21T07:42:48.473016+0000","last_clean":"2024-02-21T07:42:48.473016+0000","last_became_active":"2024-02-21T07:42:02.961075+0000","last_became_peered":"2024-02-21T07:42:02.961075+0000","last_unstale":"2024-02-21T07:42:48.473016+0000","last_undegraded":"2024-02-21T07:42:48.473016+0000","last_fullsized":"2024-02-21T07:42:48.473016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084324+0000","last_change":"2024-02-21T07:42:02.960461+0000","last_active":"2024-02-21T07:42:49.084324+0000","last_peered":"2024-02-21T07:42:49.084324+0000","last_clean":"2024-02-21T07:42:49.084324+0000","last_became_active":"2024-02-21T07:42:02.960168+0000","last_became_peered":"2024-02-21T07:42:02.960168+0000","last_unstale":"2024-02-21T07:42:49.084324+0000","last_undegraded":"2024-02-21T07:42:49.084324+0000","last_fullsized":"2024-02-21T07:42:49.084324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.271234+0000","last_change":"2024-02-21T07:42:02.966173+0000","last_active":"2024-02-21T07:42:49.271234+0000","last_peered":"2024-02-21T07:42:49.271234+0000","last_clean":"2024-02-21T07:42:49.271234+0000","last_became_active":"2024-02-21T07:42:02.964280+0000","last_became_peered":"2024-02-21T07:42:02.964280+0000","last_unstale":"2024-02-21T07:42:49.271234+0000","last_undegraded":"2024-02-21T07:42:49.271234+0000","last_fullsized":"2024-02-21T07:42:49.271234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:14:48.940776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.255281+0000","last_change":"2024-02-21T07:42:02.975012+0000","last_active":"2024-02-21T07:42:49.255281+0000","last_peered":"2024-02-21T07:42:49.255281+0000","last_clean":"2024-02-21T07:42:49.255281+0000","last_became_active":"2024-02-21T07:42:02.974682+0000","last_became_peered":"2024-02-21T07:42:02.974682+0000","last_unstale":"2024-02-21T07:42:49.255281+0000","last_undegraded":"2024-02-21T07:42:49.255281+0000","last_fullsized":"2024-02-21T07:42:49.255281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.270290+0000","last_change":"2024-02-21T07:42:02.966976+0000","last_active":"2024-02-21T07:42:49.270290+0000","last_peered":"2024-02-21T07:42:49.270290+0000","last_clean":"2024-02-21T07:42:49.270290+0000","last_became_active":"2024-02-21T07:42:02.966422+0000","last_became_peered":"2024-02-21T07:42:02.966422+0000","last_unstale":"2024-02-21T07:42:49.270290+0000","last_undegraded":"2024-02-21T07:42:49.270290+0000","last_fullsized":"2024-02-21T07:42:49.270290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T08:19:26.896510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.480003+0000","last_change":"2024-02-21T07:42:02.957398+0000","last_active":"2024-02-21T07:42:48.480003+0000","last_peered":"2024-02-21T07:42:48.480003+0000","last_clean":"2024-02-21T07:42:48.480003+0000","last_became_active":"2024-02-21T07:42:02.957115+0000","last_became_peered":"2024-02-21T07:42:02.957115+0000","last_unstale":"2024-02-21T07:42:48.480003+0000","last_undegraded":"2024-02-21T07:42:48.480003+0000","last_fullsized":"2024-02-21T07:42:48.480003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475295+0000","last_change":"2024-02-21T07:42:02.956114+0000","last_active":"2024-02-21T07:42:48.475295+0000","last_peered":"2024-02-21T07:42:48.475295+0000","last_clean":"2024-02-21T07:42:48.475295+0000","last_became_active":"2024-02-21T07:42:02.955476+0000","last_became_peered":"2024-02-21T07:42:02.955476+0000","last_unstale":"2024-02-21T07:42:48.475295+0000","last_undegraded":"2024-02-21T07:42:48.475295+0000","last_fullsized":"2024-02-21T07:42:48.475295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T13:38:20.541078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473015+0000","last_change":"2024-02-21T07:42:02.955604+0000","last_active":"2024-02-21T07:42:48.473015+0000","last_peered":"2024-02-21T07:42:48.473015+0000","last_clean":"2024-02-21T07:42:48.473015+0000","last_became_active":"2024-02-21T07:42:02.955327+0000","last_became_peered":"2024-02-21T07:42:02.955327+0000","last_unstale":"2024-02-21T07:42:48.473015+0000","last_undegraded":"2024-02-21T07:42:48.473015+0000","last_fullsized":"2024-02-21T07:42:48.473015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.084361+0000","last_change":"2024-02-21T07:42:02.967092+0000","last_active":"2024-02-21T07:42:49.084361+0000","last_peered":"2024-02-21T07:42:49.084361+0000","last_clean":"2024-02-21T07:42:49.084361+0000","last_became_active":"2024-02-21T07:42:02.966845+0000","last_became_peered":"2024-02-21T07:42:02.966845+0000","last_unstale":"2024-02-21T07:42:49.084361+0000","last_undegraded":"2024-02-21T07:42:49.084361+0000","last_fullsized":"2024-02-21T07:42:49.084361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.766655+0000","last_change":"2024-02-21T07:42:02.973535+0000","last_active":"2024-02-21T07:42:48.766655+0000","last_peered":"2024-02-21T07:42:48.766655+0000","last_clean":"2024-02-21T07:42:48.766655+0000","last_became_active":"2024-02-21T07:42:02.973202+0000","last_became_peered":"2024-02-21T07:42:02.973202+0000","last_unstale":"2024-02-21T07:42:48.766655+0000","last_undegraded":"2024-02-21T07:42:48.766655+0000","last_fullsized":"2024-02-21T07:42:48.766655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473283+0000","last_change":"2024-02-21T07:42:02.954398+0000","last_active":"2024-02-21T07:42:48.473283+0000","last_peered":"2024-02-21T07:42:48.473283+0000","last_clean":"2024-02-21T07:42:48.473283+0000","last_became_active":"2024-02-21T07:42:02.954099+0000","last_became_peered":"2024-02-21T07:42:02.954099+0000","last_unstale":"2024-02-21T07:42:48.473283+0000","last_undegraded":"2024-02-21T07:42:48.473283+0000","last_fullsized":"2024-02-21T07:42:48.473283+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479373+0000","last_change":"2024-02-21T07:42:02.958214+0000","last_active":"2024-02-21T07:42:48.479373+0000","last_peered":"2024-02-21T07:42:48.479373+0000","last_clean":"2024-02-21T07:42:48.479373+0000","last_became_active":"2024-02-21T07:42:02.957885+0000","last_became_peered":"2024-02-21T07:42:02.957885+0000","last_unstale":"2024-02-21T07:42:48.479373+0000","last_undegraded":"2024-02-21T07:42:48.479373+0000","last_fullsized":"2024-02-21T07:42:48.479373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T19:28:31.131993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.266995+0000","last_change":"2024-02-21T07:42:02.980607+0000","last_active":"2024-02-21T07:42:49.266995+0000","last_peered":"2024-02-21T07:42:49.266995+0000","last_clean":"2024-02-21T07:42:49.266995+0000","last_became_active":"2024-02-21T07:42:02.980239+0000","last_became_peered":"2024-02-21T07:42:02.980239+0000","last_unstale":"2024-02-21T07:42:49.266995+0000","last_undegraded":"2024-02-21T07:42:49.266995+0000","last_fullsized":"2024-02-21T07:42:49.266995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267159+0000","last_change":"2024-02-21T07:42:02.972536+0000","last_active":"2024-02-21T07:42:49.267159+0000","last_peered":"2024-02-21T07:42:49.267159+0000","last_clean":"2024-02-21T07:42:49.267159+0000","last_became_active":"2024-02-21T07:42:02.972216+0000","last_became_peered":"2024-02-21T07:42:02.972216+0000","last_unstale":"2024-02-21T07:42:49.267159+0000","last_undegraded":"2024-02-21T07:42:49.267159+0000","last_fullsized":"2024-02-21T07:42:49.267159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.474978+0000","last_change":"2024-02-21T07:42:02.958082+0000","last_active":"2024-02-21T07:42:48.474978+0000","last_peered":"2024-02-21T07:42:48.474978+0000","last_clean":"2024-02-21T07:42:48.474978+0000","last_became_active":"2024-02-21T07:42:02.957711+0000","last_became_peered":"2024-02-21T07:42:02.957711+0000","last_unstale":"2024-02-21T07:42:48.474978+0000","last_undegraded":"2024-02-21T07:42:48.474978+0000","last_fullsized":"2024-02-21T07:42:48.474978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475415+0000","last_change":"2024-02-21T07:42:02.957799+0000","last_active":"2024-02-21T07:42:48.475415+0000","last_peered":"2024-02-21T07:42:48.475415+0000","last_clean":"2024-02-21T07:42:48.475415+0000","last_became_active":"2024-02-21T07:42:02.957510+0000","last_became_peered":"2024-02-21T07:42:02.957510+0000","last_unstale":"2024-02-21T07:42:48.475415+0000","last_undegraded":"2024-02-21T07:42:48.475415+0000","last_fullsized":"2024-02-21T07:42:48.475415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T17:26:18.927986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730379+0000","last_change":"2024-02-21T07:42:02.962565+0000","last_active":"2024-02-21T07:42:48.730379+0000","last_peered":"2024-02-21T07:42:48.730379+0000","last_clean":"2024-02-21T07:42:48.730379+0000","last_became_active":"2024-02-21T07:42:02.962298+0000","last_became_peered":"2024-02-21T07:42:02.962298+0000","last_unstale":"2024-02-21T07:42:48.730379+0000","last_undegraded":"2024-02-21T07:42:48.730379+0000","last_fullsized":"2024-02-21T07:42:48.730379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:19:14.509274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979764+0000","last_change":"2024-02-21T07:42:02.961018+0000","last_active":"2024-02-21T07:42:48.979764+0000","last_peered":"2024-02-21T07:42:48.979764+0000","last_clean":"2024-02-21T07:42:48.979764+0000","last_became_active":"2024-02-21T07:42:02.960634+0000","last_became_peered":"2024-02-21T07:42:02.960634+0000","last_unstale":"2024-02-21T07:42:48.979764+0000","last_undegraded":"2024-02-21T07:42:48.979764+0000","last_fullsized":"2024-02-21T07:42:48.979764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:11:09.807705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.479750+0000","last_change":"2024-02-21T07:42:02.959426+0000","last_active":"2024-02-21T07:42:48.479750+0000","last_peered":"2024-02-21T07:42:48.479750+0000","last_clean":"2024-02-21T07:42:48.479750+0000","last_became_active":"2024-02-21T07:42:02.959021+0000","last_became_peered":"2024-02-21T07:42:02.959021+0000","last_unstale":"2024-02-21T07:42:48.479750+0000","last_undegraded":"2024-02-21T07:42:48.479750+0000","last_fullsized":"2024-02-21T07:42:48.479750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.269079+0000","last_change":"2024-02-21T07:42:02.971151+0000","last_active":"2024-02-21T07:42:49.269079+0000","last_peered":"2024-02-21T07:42:49.269079+0000","last_clean":"2024-02-21T07:42:49.269079+0000","last_became_active":"2024-02-21T07:42:02.967323+0000","last_became_peered":"2024-02-21T07:42:02.967323+0000","last_unstale":"2024-02-21T07:42:49.269079+0000","last_undegraded":"2024-02-21T07:42:49.269079+0000","last_fullsized":"2024-02-21T07:42:49.269079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.730044+0000","last_change":"2024-02-21T07:42:02.974767+0000","last_active":"2024-02-21T07:42:48.730044+0000","last_peered":"2024-02-21T07:42:48.730044+0000","last_clean":"2024-02-21T07:42:48.730044+0000","last_became_active":"2024-02-21T07:42:02.974292+0000","last_became_peered":"2024-02-21T07:42:02.974292+0000","last_unstale":"2024-02-21T07:42:48.730044+0000","last_undegraded":"2024-02-21T07:42:48.730044+0000","last_fullsized":"2024-02-21T07:42:48.730044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:48:13.799233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.979118+0000","last_change":"2024-02-21T07:42:02.968079+0000","last_active":"2024-02-21T07:42:48.979118+0000","last_peered":"2024-02-21T07:42:48.979118+0000","last_clean":"2024-02-21T07:42:48.979118+0000","last_became_active":"2024-02-21T07:42:02.967767+0000","last_became_peered":"2024-02-21T07:42:02.967767+0000","last_unstale":"2024-02-21T07:42:48.979118+0000","last_undegraded":"2024-02-21T07:42:48.979118+0000","last_fullsized":"2024-02-21T07:42:48.979118+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T15:59:43.567409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.477567+0000","last_change":"2024-02-21T07:42:02.978031+0000","last_active":"2024-02-21T07:42:48.477567+0000","last_peered":"2024-02-21T07:42:48.477567+0000","last_clean":"2024-02-21T07:42:48.477567+0000","last_became_active":"2024-02-21T07:42:02.977704+0000","last_became_peered":"2024-02-21T07:42:02.977704+0000","last_unstale":"2024-02-21T07:42:48.477567+0000","last_undegraded":"2024-02-21T07:42:48.477567+0000","last_fullsized":"2024-02-21T07:42:48.477567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T18:51:56.242107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.475325+0000","last_change":"2024-02-21T07:42:02.959959+0000","last_active":"2024-02-21T07:42:48.475325+0000","last_peered":"2024-02-21T07:42:48.475325+0000","last_clean":"2024-02-21T07:42:48.475325+0000","last_became_active":"2024-02-21T07:42:02.959655+0000","last_became_peered":"2024-02-21T07:42:02.959655+0000","last_unstale":"2024-02-21T07:42:48.475325+0000","last_undegraded":"2024-02-21T07:42:48.475325+0000","last_fullsized":"2024-02-21T07:42:48.475325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T12:25:19.421890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.267187+0000","last_change":"2024-02-21T07:42:02.975851+0000","last_active":"2024-02-21T07:42:49.267187+0000","last_peered":"2024-02-21T07:42:49.267187+0000","last_clean":"2024-02-21T07:42:49.267187+0000","last_became_active":"2024-02-21T07:42:02.973848+0000","last_became_peered":"2024-02-21T07:42:02.973848+0000","last_unstale":"2024-02-21T07:42:49.267187+0000","last_undegraded":"2024-02-21T07:42:49.267187+0000","last_fullsized":"2024-02-21T07:42:49.267187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T09:52:08.977267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":23,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:49.268544+0000","last_change":"2024-02-21T07:42:02.981681+0000","last_active":"2024-02-21T07:42:49.268544+0000","last_peered":"2024-02-21T07:42:49.268544+0000","last_clean":"2024-02-21T07:42:49.268544+0000","last_became_active":"2024-02-21T07:42:02.981324+0000","last_became_peered":"2024-02-21T07:42:02.981324+0000","last_unstale":"2024-02-21T07:42:49.268544+0000","last_undegraded":"2024-02-21T07:42:49.268544+0000","last_fullsized":"2024-02-21T07:42:49.268544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T07:42:48.473173+0000","last_change":"2024-02-21T07:42:02.954466+0000","last_active":"2024-02-21T07:42:48.473173+0000","last_peered":"2024-02-21T07:42:48.473173+0000","last_clean":"2024-02-21T07:42:48.473173+0000","last_became_active":"2024-02-21T07:42:02.954168+0000","last_became_peered":"2024-02-21T07:42:02.954168+0000","last_unstale":"2024-02-21T07:42:48.473173+0000","last_undegraded":"2024-02-21T07:42:48.473173+0000","last_fullsized":"2024-02-21T07:42:48.473173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T07:42:01.908364+0000","last_clean_scrub_stamp":"2024-02-21T07:42:01.908364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T14:41:40.978301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74249,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":331,"num_read_kb":248,"num_write":250,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":148498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444049,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":364544,"data_stored":164376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.503},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.44900000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.38500000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.79200000000000004}]},{"osd":7,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.60699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":9,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.67800000000000005}]},{"osd":10,"last update":"Wed Feb 21 07:42:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71299999999999997}]}]},{"osd":10,"up_from":17,"seq":73014444049,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":454656,"data_stored":225411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.8999999999999999,"5min":2.8999999999999999,"15min":2.8999999999999999},"last":0.81499999999999995}]},{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.5990000000000002,"5min":4.5990000000000002,"15min":4.5990000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":0.69799999999999995}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.63800000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":7,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66000000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":9,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.2610000000000001,"5min":3.2610000000000001,"15min":3.2610000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":3.3130000000000002,"5min":3.3130000000000002,"15min":3.3130000000000002},"last":0.996}]},{"osd":11,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.748}]}]},{"osd":9,"up_from":17,"seq":73014444049,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":167647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.038},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":0.93999999999999995}]},{"osd":2,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":1.226},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":2.2269999999999999,"5min":2.2269999999999999,"15min":2.2269999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":1.52},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"min":{"1min":1.208,"5min":1.208,"15min":1.208},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":1.2969999999999999}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.097},{"interface":"front","average":{"1min":1.583,"5min":1.583,"15min":1.583},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.6040000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":1.655,"15min":1.655},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":3.4319999999999999,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":1.369},{"interface":"front","average":{"1min":1.571,"5min":1.571,"15min":1.571},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4470000000000001,"5min":2.4470000000000001,"15min":2.4470000000000001},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.716}]},{"osd":8,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.74,"5min":1.74,"15min":1.74},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":3.1059999999999999},"last":1.403},{"interface":"front","average":{"1min":1.839,"5min":1.839,"15min":1.839},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":3.5209999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":1.8420000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.893,"5min":1.893,"15min":1.893},"min":{"1min":1.353,"5min":1.353,"15min":1.353},"max":{"1min":3.3220000000000001,"5min":3.3220000000000001,"15min":3.3220000000000001},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"min":{"1min":1.05,"5min":1.05,"15min":1.05},"max":{"1min":2.7890000000000001,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":1.4470000000000001}]},{"osd":11,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":1.843,"15min":1.843},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.79},{"interface":"front","average":{"1min":1.946,"5min":1.946,"15min":1.946},"min":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"max":{"1min":3.6440000000000001,"5min":3.6440000000000001,"15min":3.6440000000000001},"last":1.7}]}]},{"osd":8,"up_from":17,"seq":73014444048,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":163617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46400000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.79200000000000004}]},{"osd":2,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.58499999999999996}]},{"osd":4,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.80900000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41399999999999998}]},{"osd":7,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.62},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.69199999999999995}]},{"osd":9,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72699999999999998}]},{"osd":10,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.747}]},{"osd":11,"last update":"Wed Feb 21 07:42:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.77300000000000002}]}]},{"osd":7,"up_from":17,"seq":73014444049,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":759496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":1,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.48099999999999998}]},{"osd":2,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63700000000000001}]},{"osd":3,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.69999999999999996}]},{"osd":6,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.73399999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.71299999999999997}]},{"osd":9,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.1869999999999998,"5min":2.1869999999999998,"15min":2.1869999999999998},"last":0.81399999999999995}]},{"osd":10,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.77100000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.80300000000000005}]}]},{"osd":6,"up_from":17,"seq":73014444049,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":159393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":0.53300000000000003}]},{"osd":2,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.75600000000000001}]},{"osd":3,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":5,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.498,"15min":1.498},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.593,"5min":1.593,"15min":1.593},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.65700000000000003}]},{"osd":8,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.6269999999999998,"5min":2.6269999999999998,"15min":2.6269999999999998},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":3.0939999999999999,"5min":3.0939999999999999,"15min":3.0939999999999999},"last":0.78700000000000003}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":10,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.754,"15min":1.754},"min":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":1.171},{"interface":"front","average":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":3.23,"5min":3.23,"15min":3.23},"last":0.875}]},{"osd":11,"last update":"Wed Feb 21 07:42:54 2024","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.873,"15min":1.873},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.819,"5min":2.819,"15min":2.819},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.861,"5min":1.861,"15min":1.861},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"max":{"1min":3.5659999999999998,"5min":3.5659999999999998,"15min":3.5659999999999998},"last":0.80700000000000005}]}]},{"osd":5,"up_from":17,"seq":73014444049,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":987136,"data_stored":756100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.629}]},{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.33300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.54800000000000004}]},{"osd":6,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":3.1429999999999998,"5min":3.1429999999999998,"15min":3.1429999999999998},"last":0.68000000000000005}]},{"osd":7,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.46500000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":2.0379999999999998,"5min":2.0379999999999998,"15min":2.0379999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2,"5min":2,"15min":2},"last":0.72799999999999998}]},{"osd":10,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.505}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]}]},{"osd":4,"up_from":17,"seq":73014444049,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":163862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.875},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.76300000000000001}]},{"osd":1,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.81100000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.64600000000000002}]},{"osd":6,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53900000000000003}]},{"osd":8,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.79700000000000004}]},{"osd":9,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.89100000000000001}]},{"osd":10,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.78000000000000003}]},{"osd":11,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.90500000000000003}]}]},{"osd":3,"up_from":17,"seq":73014444049,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":158985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.91000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.595},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0640000000000001,"5min":2.0640000000000001,"15min":2.0640000000000001},"last":1.2470000000000001}]},{"osd":4,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.7669999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3780000000000001,"5min":2.3780000000000001,"15min":2.3780000000000001},"last":2.0230000000000001}]},{"osd":5,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.9319999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.5209999999999999,"5min":2.5209999999999999,"15min":2.5209999999999999},"last":2.214}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]},{"osd":7,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":2.1429999999999998},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":1.653}]},{"osd":8,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":4.0199999999999996},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.444,"5min":1.444,"15min":1.444},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":2.0870000000000002}]},{"osd":9,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.4510000000000001,"5min":2.4510000000000001,"15min":2.4510000000000001},"last":2.2530000000000001},{"interface":"front","average":{"1min":1.708,"5min":1.708,"15min":1.708},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.294,"5min":3.294,"15min":3.294},"last":2.383}]},{"osd":10,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.661,"5min":1.661,"15min":1.661},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":2.3239999999999998},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":4.1319999999999997,"5min":4.1319999999999997,"15min":4.1319999999999997},"last":1.825}]},{"osd":11,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.9260000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":1.988},{"interface":"front","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":3.1499999999999999,"5min":3.1499999999999999,"15min":3.1499999999999999},"last":2.1840000000000002}]}]},{"osd":2,"up_from":17,"seq":73014444049,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":161653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.622},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.80400000000000005}]},{"osd":3,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91800000000000004}]},{"osd":4,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.55800000000000005}]},{"osd":5,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46700000000000003}]},{"osd":6,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.4299999999999997,"5min":4.4299999999999997,"15min":4.4299999999999997},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.749},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.89900000000000002}]},{"osd":8,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.67500000000000004}]},{"osd":9,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.876},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69899999999999995}]},{"osd":10,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.76300000000000001}]},{"osd":11,"last update":"Wed Feb 21 07:42:56 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59699999999999998}]}]},{"osd":1,"up_from":17,"seq":73014444049,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":434176,"data_stored":226189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.76500000000000001}]},{"osd":2,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.53200000000000003}]},{"osd":3,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.83199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":5,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.79800000000000004}]},{"osd":7,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.42599999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.624},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.66800000000000004}]},{"osd":9,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.747},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":11,"last update":"Wed Feb 21 07:42:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68700000000000006}]}]},{"osd":0,"up_from":17,"seq":73014444050,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":372736,"data_stored":159589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.3260000000000001,"5min":2.3260000000000001,"15min":2.3260000000000001},"last":0.89500000000000002}]},{"osd":2,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.2509999999999999,"5min":3.2509999999999999,"15min":3.2509999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.0029999999999999}]},{"osd":3,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":1.649}]},{"osd":4,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.125},{"interface":"front","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.0669999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7450000000000001}]},{"osd":6,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":3.456,"5min":3.456,"15min":3.456},"last":1.325},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.2189999999999999,"5min":3.2189999999999999,"15min":3.2189999999999999},"last":1.387}]},{"osd":7,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":3.6190000000000002,"5min":3.6190000000000002,"15min":3.6190000000000002},"last":1.1659999999999999}]},{"osd":8,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":3.3149999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":1.498},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.3759999999999999,"5min":2.3759999999999999,"15min":2.3759999999999999},"last":1.4450000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.851}]},{"osd":10,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.722,"5min":1.722,"15min":1.722},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":3.6600000000000001,"5min":3.6600000000000001,"15min":3.6600000000000001},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":7.016,"5min":7.016,"15min":7.016},"last":1.762}]},{"osd":11,"last update":"Wed Feb 21 07:42:55 2024","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.827,"5min":1.827,"15min":1.827},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":3.7639999999999998,"5min":3.7639999999999998,"15min":3.7639999999999998},"last":1.5369999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T07:43:03.527 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:43:03.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.770+0000 7f9110000640 1 Processor -- start 2024-02-21T07:43:03.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.770+0000 7f9110000640 1 -- start start 2024-02-21T07:43:03.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.772+0000 7f9110000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f91080cd090 0x7f91080f6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.772+0000 7f9110000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9108188980 0x7f9108186730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.772+0000 7f9110000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91080ce230 con 0x7f9108183fa0 2024-02-21T07:43:03.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.772+0000 7f9110000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910806dcd0 con 0x7f9108188980 2024-02-21T07:43:03.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.772+0000 7f9110000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9108184380 con 0x7f91080cd090 2024-02-21T07:43:03.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.773+0000 7f910e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9108188980 0x7f9108186730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.773+0000 7f910cc00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f91080cd090 0x7f91080f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.773+0000 7f910e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9108188980 0x7f9108186730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36758/0 (socket says 172.21.15.69:36758) 2024-02-21T07:43:03.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.773+0000 7f910e000640 1 -- 172.21.15.69:0/1881889145 learned_addr learned my addr 172.21.15.69:0/1881889145 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:03.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.773+0000 7f910d600640 1 --1- 172.21.15.69:0/1881889145 >> v1:172.21.15.184:6789/0 conn(0x7f9108183fa0 0x7f9108188270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:51588/0 (socket says 172.21.15.69:51588) 2024-02-21T07:43:03.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.773+0000 7f910e000640 1 -- 172.21.15.69:0/1881889145 >> v2:172.21.15.184:3300/0 conn(0x7f91080cd090 msgr2=0x7f91080f6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:03.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.773+0000 7f910e000640 1 --2- 172.21.15.69:0/1881889145 >> v2:172.21.15.184:3300/0 conn(0x7f91080cd090 0x7f91080f6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.773+0000 7f910e000640 1 -- 172.21.15.69:0/1881889145 >> v1:172.21.15.184:6789/0 conn(0x7f9108183fa0 legacy=0x7f9108188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.773+0000 7f910e000640 1 -- 172.21.15.69:0/1881889145 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91080cd6b0 con 0x7f9108188980 2024-02-21T07:43:03.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.774+0000 7f910e000640 1 --2- 172.21.15.69:0/1881889145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108188980 0x7f9108186730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9108162ab0 tx=0x7f910002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34823603cf486251 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:03.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.774+0000 7f9107e00640 1 -- 172.21.15.69:0/1881889145 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910002c9f0 con 0x7f9108188980 2024-02-21T07:43:03.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.774+0000 7f9107e00640 1 -- 172.21.15.69:0/1881889145 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910002cb50 con 0x7f9108188980 2024-02-21T07:43:03.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.774+0000 7f9107e00640 1 -- 172.21.15.69:0/1881889145 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91000343f0 con 0x7f9108188980 2024-02-21T07:43:03.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.775+0000 7f9110000640 1 -- 172.21.15.69:0/1881889145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108188980 msgr2=0x7f9108186730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.775+0000 7f9110000640 1 --2- 172.21.15.69:0/1881889145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108188980 0x7f9108186730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9108162ab0 tx=0x7f910002be50 comp rx=0 tx=0).stop 2024-02-21T07:43:03.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.775+0000 7f9110000640 1 -- 172.21.15.69:0/1881889145 shutdown_connections 2024-02-21T07:43:03.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.775+0000 7f9110000640 1 --2- 172.21.15.69:0/1881889145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108188980 0x7f9108186730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.775+0000 7f9110000640 1 --2- 172.21.15.69:0/1881889145 >> v2:172.21.15.184:3300/0 conn(0x7f91080cd090 0x7f91080f6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.775+0000 7f9110000640 1 -- 172.21.15.69:0/1881889145 >> 172.21.15.69:0/1881889145 conn(0x7f91080f69c0 msgr2=0x7f91080f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:03.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.775+0000 7f9110000640 1 -- 172.21.15.69:0/1881889145 shutdown_connections 2024-02-21T07:43:03.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.775+0000 7f9110000640 1 -- 172.21.15.69:0/1881889145 wait complete. 2024-02-21T07:43:03.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.777+0000 7f9110000640 1 Processor -- start 2024-02-21T07:43:03.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.777+0000 7f9110000640 1 -- start start 2024-02-21T07:43:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.778+0000 7f9110000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91080cd090 0x7f91082228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.778+0000 7f9110000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108183fa0 0x7f9108222e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.778+0000 7f9110000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9108188980 0x7f9108165300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f9110000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108172f20 con 0x7f9108183fa0 2024-02-21T07:43:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f9110000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108172680 con 0x7f9108188980 2024-02-21T07:43:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f9110000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9108172960 con 0x7f91080cd090 2024-02-21T07:43:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f910cc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108183fa0 0x7f9108222e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f910cc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108183fa0 0x7f9108222e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36772/0 (socket says 172.21.15.69:36772) 2024-02-21T07:43:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f910cc00640 1 -- 172.21.15.69:0/2500929593 learned_addr learned my addr 172.21.15.69:0/2500929593 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f910d600640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91080cd090 0x7f91082228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f910e000640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9108188980 0x7f9108165300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f910cc00640 1 -- 172.21.15.69:0/2500929593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91080cd090 msgr2=0x7f91082228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f910cc00640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91080cd090 0x7f91082228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f910cc00640 1 -- 172.21.15.69:0/2500929593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9108188980 msgr2=0x7f9108165300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f910cc00640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9108188980 0x7f9108165300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.779+0000 7f910cc00640 1 -- 172.21.15.69:0/2500929593 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9100009b30 con 0x7f9108183fa0 2024-02-21T07:43:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.780+0000 7f910cc00640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108183fa0 0x7f9108222e30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f90f400e870 tx=0x7f90f400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.780+0000 7f9105600640 1 -- 172.21.15.69:0/2500929593 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f40094f0 con 0x7f9108183fa0 2024-02-21T07:43:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.780+0000 7f9105600640 1 -- 172.21.15.69:0/2500929593 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f400c940 con 0x7f9108183fa0 2024-02-21T07:43:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.780+0000 7f9105600640 1 -- 172.21.15.69:0/2500929593 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f400ccf0 con 0x7f9108183fa0 2024-02-21T07:43:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.780+0000 7f9110000640 1 -- 172.21.15.69:0/2500929593 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9108172c40 con 0x7f9108183fa0 2024-02-21T07:43:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.780+0000 7f9110000640 1 -- 172.21.15.69:0/2500929593 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9108173c00 con 0x7f9108183fa0 2024-02-21T07:43:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.781+0000 7f9110000640 1 -- 172.21.15.69:0/2500929593 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9108173dc0 con 0x7f9108183fa0 2024-02-21T07:43:03.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.783+0000 7f9105600640 1 -- 172.21.15.69:0/2500929593 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f90f4013470 con 0x7f9108183fa0 2024-02-21T07:43:03.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.784+0000 7f9105600640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f90e809f1b0 0x7f90e80a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:03.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.784+0000 7f9105600640 1 -- 172.21.15.69:0/2500929593 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f90f40c9c00 con 0x7f9108183fa0 2024-02-21T07:43:03.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.785+0000 7f910d600640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f90e809f1b0 0x7f90e80a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:03.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.785+0000 7f910d600640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f90e809f1b0 0x7f90e80a1670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f910817df80 tx=0x7f90fc007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:03.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.788+0000 7f9105600640 1 -- 172.21.15.69:0/2500929593 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f90f40939e0 con 0x7f9108183fa0 2024-02-21T07:43:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.983+0000 7f9110000640 1 -- 172.21.15.69:0/2500929593 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9108173780 con 0x7f9108183fa0 2024-02-21T07:43:03.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.987+0000 7f9105600640 1 -- 172.21.15.69:0/2500929593 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23736 (secure 0 0 0) 0x7f9108173780 con 0x7f9108183fa0 2024-02-21T07:43:03.993 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:43:03.993 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":31,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:48.463144+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:43:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 -- 172.21.15.69:0/2500929593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f90e809f1b0 msgr2=0x7f90e80a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f90e809f1b0 0x7f90e80a1670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f910817df80 tx=0x7f90fc007e80 comp rx=0 tx=0).stop 2024-02-21T07:43:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 -- 172.21.15.69:0/2500929593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108183fa0 msgr2=0x7f9108222e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108183fa0 0x7f9108222e30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f90f400e870 tx=0x7f90f400ed30 comp rx=0 tx=0).stop 2024-02-21T07:43:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 -- 172.21.15.69:0/2500929593 shutdown_connections 2024-02-21T07:43:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f90e809f1b0 0x7f90e80a1670 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9108188980 0x7f9108165300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9108183fa0 0x7f9108222e30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 --2- 172.21.15.69:0/2500929593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f91080cd090 0x7f91082228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 -- 172.21.15.69:0/2500929593 >> 172.21.15.69:0/2500929593 conn(0x7f91080f69c0 msgr2=0x7f91080f56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 -- 172.21.15.69:0/2500929593 shutdown_connections 2024-02-21T07:43:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:03.990+0000 7f9110000640 1 -- 172.21.15.69:0/2500929593 wait complete. 2024-02-21T07:43:04.017 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:41:56.520105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:42:00.759386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:42:01.409274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:42:05.025537+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:43:04.017 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:43:04.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.227+0000 7f5c7a200640 1 Processor -- start 2024-02-21T07:43:04.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.227+0000 7f5c7a200640 1 -- start start 2024-02-21T07:43:04.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.229+0000 7f5c7a200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c740f5890 0x7f5c74186bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.229+0000 7f5c7a200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c74184df0 con 0x7f5c740ee640 2024-02-21T07:43:04.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.229+0000 7f5c7a200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c741850b0 con 0x7f5c74183ea0 2024-02-21T07:43:04.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.229+0000 7f5c7a200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c74186010 con 0x7f5c740f5890 2024-02-21T07:43:04.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.230+0000 7f5c73e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c740f5890 0x7f5c74186bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.230+0000 7f5c73400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f5c74183ea0 0x7f5c741846e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:40044/0 (socket says 172.21.15.69:40044) 2024-02-21T07:43:04.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.230+0000 7f5c73400640 1 -- 172.21.15.69:0/354568405 learned_addr learned my addr 172.21.15.69:0/354568405 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:04.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.230+0000 7f5c72000640 1 -- 172.21.15.69:0/354568405 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823756566 0 0) 0x7f5c741850b0 con 0x7f5c74183ea0 2024-02-21T07:43:04.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.230+0000 7f5c72000640 1 -- 172.21.15.69:0/354568405 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c58003520 con 0x7f5c74183ea0 2024-02-21T07:43:04.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.230+0000 7f5c73e00640 1 -- 172.21.15.69:0/354568405 >> v1:172.21.15.174:6789/0 conn(0x7f5c74183ea0 legacy=0x7f5c741846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.230+0000 7f5c73e00640 1 -- 172.21.15.69:0/354568405 >> v1:172.21.15.69:6789/0 conn(0x7f5c740ee640 legacy=0x7f5c740eead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.230+0000 7f5c73e00640 1 -- 172.21.15.69:0/354568405 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c74185390 con 0x7f5c740f5890 2024-02-21T07:43:04.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.231+0000 7f5c73e00640 1 --2- 172.21.15.69:0/354568405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c740f5890 0x7f5c74186bc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c009d90 tx=0x7f5c6c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497344fb37a13d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:04.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.232+0000 7f5c72000640 1 -- 172.21.15.69:0/354568405 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c02cc60 con 0x7f5c740f5890 2024-02-21T07:43:04.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.232+0000 7f5c72000640 1 -- 172.21.15.69:0/354568405 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c02cdc0 con 0x7f5c740f5890 2024-02-21T07:43:04.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.232+0000 7f5c72000640 1 -- 172.21.15.69:0/354568405 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c034660 con 0x7f5c740f5890 2024-02-21T07:43:04.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.232+0000 7f5c7a200640 1 -- 172.21.15.69:0/354568405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c740f5890 msgr2=0x7f5c74186bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.232+0000 7f5c7a200640 1 --2- 172.21.15.69:0/354568405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c740f5890 0x7f5c74186bc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c009d90 tx=0x7f5c6c02beb0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.232+0000 7f5c7a200640 1 -- 172.21.15.69:0/354568405 shutdown_connections 2024-02-21T07:43:04.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.232+0000 7f5c7a200640 1 --2- 172.21.15.69:0/354568405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c740f5890 0x7f5c74186bc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.232+0000 7f5c7a200640 1 -- 172.21.15.69:0/354568405 >> 172.21.15.69:0/354568405 conn(0x7f5c740ce3d0 msgr2=0x7f5c740ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:04.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.232+0000 7f5c7a200640 1 -- 172.21.15.69:0/354568405 shutdown_connections 2024-02-21T07:43:04.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.232+0000 7f5c7a200640 1 -- 172.21.15.69:0/354568405 wait complete. 2024-02-21T07:43:04.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.234+0000 7f5c7a200640 1 Processor -- start 2024-02-21T07:43:04.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.234+0000 7f5c7a200640 1 -- start start 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c7a200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c740ee640 0x7f5c741831e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c7a200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c740f5890 0x7f5c741748f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c7a200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c74183ea0 0x7f5c741822d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c7a200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74181eb0 con 0x7f5c74183ea0 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c7a200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74176980 con 0x7f5c740f5890 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c7a200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c741763c0 con 0x7f5c740ee640 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c73e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c74183ea0 0x7f5c741822d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c73e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c74183ea0 0x7f5c741822d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36782/0 (socket says 172.21.15.69:36782) 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c73e00640 1 -- 172.21.15.69:0/166075318 learned_addr learned my addr 172.21.15.69:0/166075318 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c73400640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c740ee640 0x7f5c741831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c72a00640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c740f5890 0x7f5c741748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c73e00640 1 -- 172.21.15.69:0/166075318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c740ee640 msgr2=0x7f5c741831e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c73e00640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c740ee640 0x7f5c741831e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c73e00640 1 -- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c740f5890 msgr2=0x7f5c741748f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c73e00640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c740f5890 0x7f5c741748f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c73e00640 1 -- 172.21.15.69:0/166075318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c009a70 con 0x7f5c74183ea0 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.236+0000 7f5c72a00640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c740f5890 0x7f5c741748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.237+0000 7f5c73e00640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c74183ea0 0x7f5c741822d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c009d90 tx=0x7f5c6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.237+0000 7f5c6b400640 1 -- 172.21.15.69:0/166075318 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c040650 con 0x7f5c74183ea0 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.237+0000 7f5c6b400640 1 -- 172.21.15.69:0/166075318 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6c0407b0 con 0x7f5c74183ea0 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.237+0000 7f5c6b400640 1 -- 172.21.15.69:0/166075318 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c040b60 con 0x7f5c74183ea0 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.237+0000 7f5c7a200640 1 -- 172.21.15.69:0/166075318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c741766a0 con 0x7f5c74183ea0 2024-02-21T07:43:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.237+0000 7f5c7a200640 1 -- 172.21.15.69:0/166075318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c74181ad0 con 0x7f5c74183ea0 2024-02-21T07:43:04.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.239+0000 7f5c7a200640 1 -- 172.21.15.69:0/166075318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c74069d50 con 0x7f5c74183ea0 2024-02-21T07:43:04.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.240+0000 7f5c6b400640 1 -- 172.21.15.69:0/166075318 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5c6c040cc0 con 0x7f5c74183ea0 2024-02-21T07:43:04.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.242+0000 7f5c6b400640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5c5409f130 0x7f5c540a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.242+0000 7f5c6b400640 1 -- 172.21.15.69:0/166075318 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5c6c0ec870 con 0x7f5c74183ea0 2024-02-21T07:43:04.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.242+0000 7f5c73400640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5c5409f130 0x7f5c540a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.243+0000 7f5c73400640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5c5409f130 0x7f5c540a15f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5c64005880 tx=0x7f5c64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:04.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.246+0000 7f5c6b400640 1 -- 172.21.15.69:0/166075318 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f5c6c0b6690 con 0x7f5c74183ea0 2024-02-21T07:43:04.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.442+0000 7f5c7a200640 1 -- 172.21.15.69:0/166075318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c740f6000 con 0x7f5c74183ea0 2024-02-21T07:43:04.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.443+0000 7f5c6b400640 1 -- 172.21.15.69:0/166075318 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c6c009450 con 0x7f5c74183ea0 2024-02-21T07:43:04.449 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-02-21T07:43:04.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 -- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5c5409f130 msgr2=0x7f5c540a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5c5409f130 0x7f5c540a15f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5c64005880 tx=0x7f5c64009040 comp rx=0 tx=0).stop 2024-02-21T07:43:04.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 -- 172.21.15.69:0/166075318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c74183ea0 msgr2=0x7f5c741822d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c74183ea0 0x7f5c741822d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c009d90 tx=0x7f5c6c004a40 comp rx=0 tx=0).stop 2024-02-21T07:43:04.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 -- 172.21.15.69:0/166075318 shutdown_connections 2024-02-21T07:43:04.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f5c5409f130 0x7f5c540a15f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c74183ea0 0x7f5c741822d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5c740f5890 0x7f5c741748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 --2- 172.21.15.69:0/166075318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5c740ee640 0x7f5c741831e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 -- 172.21.15.69:0/166075318 >> 172.21.15.69:0/166075318 conn(0x7f5c740ce3d0 msgr2=0x7f5c740ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:04.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 -- 172.21.15.69:0/166075318 shutdown_connections 2024-02-21T07:43:04.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.446+0000 7f5c7a200640 1 -- 172.21.15.69:0/166075318 wait complete. 2024-02-21T07:43:04.471 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:43:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.684+0000 7f0ec8a00640 1 Processor -- start 2024-02-21T07:43:04.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.684+0000 7f0ec8a00640 1 -- start start 2024-02-21T07:43:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.687+0000 7f0ec8a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0ec41868e0 0x7f0ec4188b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.687+0000 7f0ec8a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0ec4189070 0x7f0ec41894e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.687+0000 7f0ec8a00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec40f2640 con 0x7f0ec41862b0 2024-02-21T07:43:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.687+0000 7f0ec8a00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec4186690 con 0x7f0ec41868e0 2024-02-21T07:43:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.687+0000 7f0ec8a00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec40f2920 con 0x7f0ec4189070 2024-02-21T07:43:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.687+0000 7f0ec1400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0ec41868e0 0x7f0ec4188b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.687+0000 7f0ec2800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0ec4189070 0x7f0ec41894e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.687+0000 7f0ec1e00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f0ec41862b0 0x7f0ec40f39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:40048/0 (socket says 172.21.15.69:40048) 2024-02-21T07:43:04.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.687+0000 7f0ec1e00640 1 -- 172.21.15.69:0/3565092391 learned_addr learned my addr 172.21.15.69:0/3565092391 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:04.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.688+0000 7f0ec0a00640 1 -- 172.21.15.69:0/3565092391 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480413091 0 0) 0x7f0ec40f2640 con 0x7f0ec41862b0 2024-02-21T07:43:04.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.688+0000 7f0ec2800640 1 -- 172.21.15.69:0/3565092391 >> v2:172.21.15.69:3300/0 conn(0x7f0ec41868e0 msgr2=0x7f0ec4188b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:04.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.688+0000 7f0ec2800640 1 --2- 172.21.15.69:0/3565092391 >> v2:172.21.15.69:3300/0 conn(0x7f0ec41868e0 0x7f0ec4188b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.688+0000 7f0ec2800640 1 -- 172.21.15.69:0/3565092391 >> v1:172.21.15.174:6789/0 conn(0x7f0ec41862b0 legacy=0x7f0ec40f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.688+0000 7f0ec2800640 1 -- 172.21.15.69:0/3565092391 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40f2c00 con 0x7f0ec4189070 2024-02-21T07:43:04.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.688+0000 7f0ec1400640 1 --2- 172.21.15.69:0/3565092391 >> v2:172.21.15.69:3300/0 conn(0x7f0ec41868e0 0x7f0ec4188b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:04.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.689+0000 7f0ec2800640 1 --2- 172.21.15.69:0/3565092391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ec4189070 0x7f0ec41894e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ec408d8f0 tx=0x7f0ebc02be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82b2a300310e6f9b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:04.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.689+0000 7f0ec0a00640 1 -- 172.21.15.69:0/3565092391 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc02cbe0 con 0x7f0ec4189070 2024-02-21T07:43:04.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.689+0000 7f0ec0a00640 1 -- 172.21.15.69:0/3565092391 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc02cd40 con 0x7f0ec4189070 2024-02-21T07:43:04.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.689+0000 7f0ec0a00640 1 -- 172.21.15.69:0/3565092391 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc034660 con 0x7f0ec4189070 2024-02-21T07:43:04.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.690+0000 7f0ec8a00640 1 -- 172.21.15.69:0/3565092391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ec4189070 msgr2=0x7f0ec41894e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.690+0000 7f0ec8a00640 1 --2- 172.21.15.69:0/3565092391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ec4189070 0x7f0ec41894e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ec408d8f0 tx=0x7f0ebc02be30 comp rx=0 tx=0).stop 2024-02-21T07:43:04.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.690+0000 7f0ec8a00640 1 -- 172.21.15.69:0/3565092391 shutdown_connections 2024-02-21T07:43:04.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.690+0000 7f0ec8a00640 1 --2- 172.21.15.69:0/3565092391 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ec4189070 0x7f0ec41894e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.690+0000 7f0ec8a00640 1 --2- 172.21.15.69:0/3565092391 >> v2:172.21.15.69:3300/0 conn(0x7f0ec41868e0 0x7f0ec4188b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.690+0000 7f0ec8a00640 1 -- 172.21.15.69:0/3565092391 >> 172.21.15.69:0/3565092391 conn(0x7f0ec40ce3d0 msgr2=0x7f0ec40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:04.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.690+0000 7f0ec8a00640 1 -- 172.21.15.69:0/3565092391 shutdown_connections 2024-02-21T07:43:04.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.690+0000 7f0ec8a00640 1 -- 172.21.15.69:0/3565092391 wait complete. 2024-02-21T07:43:04.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.692+0000 7f0ec8a00640 1 Processor -- start 2024-02-21T07:43:04.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.692+0000 7f0ec8a00640 1 -- start start 2024-02-21T07:43:04.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.693+0000 7f0ec8a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec41862b0 0x7f0ec4159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.693+0000 7f0ec8a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ec41868e0 0x7f0ec40cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.693+0000 7f0ec8a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec4189070 0x7f0ec4185060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.693+0000 7f0ec8a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40cca00 con 0x7f0ec41862b0 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.693+0000 7f0ec8a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec4184bd0 con 0x7f0ec41868e0 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.693+0000 7f0ec8a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40cc720 con 0x7f0ec4189070 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec1e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec41862b0 0x7f0ec4159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec1e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec41862b0 0x7f0ec4159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36806/0 (socket says 172.21.15.69:36806) 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec1e00640 1 -- 172.21.15.69:0/907390327 learned_addr learned my addr 172.21.15.69:0/907390327 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec1400640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ec41868e0 0x7f0ec40cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec2800640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec4189070 0x7f0ec4185060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec1e00640 1 -- 172.21.15.69:0/907390327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec4189070 msgr2=0x7f0ec4185060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec1e00640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec4189070 0x7f0ec4185060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec1e00640 1 -- 172.21.15.69:0/907390327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ec41868e0 msgr2=0x7f0ec40cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec1e00640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ec41868e0 0x7f0ec40cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec1e00640 1 -- 172.21.15.69:0/907390327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0009400 con 0x7f0ec41862b0 2024-02-21T07:43:04.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.694+0000 7f0ec1e00640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec41862b0 0x7f0ec4159580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400c420 tx=0x7f0eb400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:04.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.695+0000 7f0eba000640 1 -- 172.21.15.69:0/907390327 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb40074e0 con 0x7f0ec41862b0 2024-02-21T07:43:04.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.695+0000 7f0eba000640 1 -- 172.21.15.69:0/907390327 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb4007640 con 0x7f0ec41862b0 2024-02-21T07:43:04.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.695+0000 7f0eba000640 1 -- 172.21.15.69:0/907390327 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4004a00 con 0x7f0ec41862b0 2024-02-21T07:43:04.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.695+0000 7f0ec8a00640 1 -- 172.21.15.69:0/907390327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ebc009a70 con 0x7f0ec41862b0 2024-02-21T07:43:04.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.695+0000 7f0ec8a00640 1 -- 172.21.15.69:0/907390327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec4184580 con 0x7f0ec41862b0 2024-02-21T07:43:04.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.696+0000 7f0ec8a00640 1 -- 172.21.15.69:0/907390327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec4069d50 con 0x7f0ec41862b0 2024-02-21T07:43:04.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.698+0000 7f0eba000640 1 -- 172.21.15.69:0/907390327 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f0eb4004b60 con 0x7f0ec41862b0 2024-02-21T07:43:04.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.700+0000 7f0eba000640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0ea409f130 0x7f0ea40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:04.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.700+0000 7f0eba000640 1 -- 172.21.15.69:0/907390327 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0eb40c9890 con 0x7f0ec41862b0 2024-02-21T07:43:04.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.701+0000 7f0ec1400640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0ea409f130 0x7f0ea40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:04.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.701+0000 7f0ec1400640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0ea409f130 0x7f0ea40a15f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4185bb0 tx=0x7f0eb0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:04.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.704+0000 7f0eba000640 1 -- 172.21.15.69:0/907390327 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0eb4093650 con 0x7f0ec41862b0 2024-02-21T07:43:04.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.899+0000 7f0ec8a00640 1 -- 172.21.15.69:0/907390327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ec40f6460 con 0x7f0ec41862b0 2024-02-21T07:43:04.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.900+0000 7f0eba000640 1 -- 172.21.15.69:0/907390327 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0eb4096d10 con 0x7f0ec41862b0 2024-02-21T07:43:04.906 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:43:04.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.903+0000 7f0ec8a00640 1 -- 172.21.15.69:0/907390327 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0ea409f130 msgr2=0x7f0ea40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.903+0000 7f0ec8a00640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0ea409f130 0x7f0ea40a15f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4185bb0 tx=0x7f0eb0009190 comp rx=0 tx=0).stop 2024-02-21T07:43:04.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.903+0000 7f0ec8a00640 1 -- 172.21.15.69:0/907390327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec41862b0 msgr2=0x7f0ec4159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:04.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.903+0000 7f0ec8a00640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec41862b0 0x7f0ec4159580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400c420 tx=0x7f0eb400c8e0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.903+0000 7f0ec8a00640 1 -- 172.21.15.69:0/907390327 shutdown_connections 2024-02-21T07:43:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.903+0000 7f0ec8a00640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0ea409f130 0x7f0ea40a15f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.903+0000 7f0ec8a00640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0ec4189070 0x7f0ec4185060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.903+0000 7f0ec8a00640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0ec41868e0 0x7f0ec40cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.903+0000 7f0ec8a00640 1 --2- 172.21.15.69:0/907390327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec41862b0 0x7f0ec4159580 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.903+0000 7f0ec8a00640 1 -- 172.21.15.69:0/907390327 >> 172.21.15.69:0/907390327 conn(0x7f0ec40ce3d0 msgr2=0x7f0ec40f7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.904+0000 7f0ec8a00640 1 -- 172.21.15.69:0/907390327 shutdown_connections 2024-02-21T07:43:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:04.904+0000 7f0ec8a00640 1 -- 172.21.15.69:0/907390327 wait complete. 2024-02-21T07:43:04.927 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:43:05.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.131+0000 7f8b72200640 1 Processor -- start 2024-02-21T07:43:05.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.131+0000 7f8b72200640 1 -- start start 2024-02-21T07:43:05.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.133+0000 7f8b72200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f8b6c188970 0x7f8b6c18b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.133+0000 7f8b72200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8b6c189df0 0x7f8b6c186870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.133+0000 7f8b72200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6c18b440 con 0x7f8b6c188d50 2024-02-21T07:43:05.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.133+0000 7f8b72200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6c1898f0 con 0x7f8b6c188970 2024-02-21T07:43:05.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.133+0000 7f8b72200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6c18a550 con 0x7f8b6c189df0 2024-02-21T07:43:05.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6aa00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f8b6c189df0 0x7f8b6c186870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6be00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f8b6c188d50 0x7f8b6c1891e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:51604/0 (socket says 172.21.15.69:51604) 2024-02-21T07:43:05.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6be00640 1 -- 172.21.15.69:0/368693251 learned_addr learned my addr 172.21.15.69:0/368693251 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:05.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6b400640 1 --2- 172.21.15.69:0/368693251 >> v2:172.21.15.174:3300/0 conn(0x7f8b6c188970 0x7f8b6c18b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6a000640 1 -- 172.21.15.69:0/368693251 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489700608 0 0) 0x7f8b6c18b440 con 0x7f8b6c188d50 2024-02-21T07:43:05.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6a000640 1 -- 172.21.15.69:0/368693251 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b50003520 con 0x7f8b6c188d50 2024-02-21T07:43:05.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6aa00640 1 -- 172.21.15.69:0/368693251 >> v2:172.21.15.174:3300/0 conn(0x7f8b6c188970 msgr2=0x7f8b6c18b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:05.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6aa00640 1 --2- 172.21.15.69:0/368693251 >> v2:172.21.15.174:3300/0 conn(0x7f8b6c188970 0x7f8b6c18b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6aa00640 1 -- 172.21.15.69:0/368693251 >> v1:172.21.15.184:6789/0 conn(0x7f8b6c188d50 legacy=0x7f8b6c1891e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6aa00640 1 -- 172.21.15.69:0/368693251 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c18a830 con 0x7f8b6c189df0 2024-02-21T07:43:05.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.134+0000 7f8b6b400640 1 --2- 172.21.15.69:0/368693251 >> v2:172.21.15.174:3300/0 conn(0x7f8b6c188970 0x7f8b6c18b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:05.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.135+0000 7f8b6aa00640 1 --2- 172.21.15.69:0/368693251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b6c189df0 0x7f8b6c186870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0d0500 tx=0x7f8b5802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4761b9cd2454ec13 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:05.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.136+0000 7f8b6a000640 1 -- 172.21.15.69:0/368693251 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58031830 con 0x7f8b6c189df0 2024-02-21T07:43:05.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.136+0000 7f8b6a000640 1 -- 172.21.15.69:0/368693251 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b58031990 con 0x7f8b6c189df0 2024-02-21T07:43:05.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.136+0000 7f8b6a000640 1 -- 172.21.15.69:0/368693251 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b58031d20 con 0x7f8b6c189df0 2024-02-21T07:43:05.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.136+0000 7f8b72200640 1 -- 172.21.15.69:0/368693251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b6c189df0 msgr2=0x7f8b6c186870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.136+0000 7f8b72200640 1 --2- 172.21.15.69:0/368693251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b6c189df0 0x7f8b6c186870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0d0500 tx=0x7f8b5802b8d0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.137+0000 7f8b72200640 1 -- 172.21.15.69:0/368693251 shutdown_connections 2024-02-21T07:43:05.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.137+0000 7f8b72200640 1 --2- 172.21.15.69:0/368693251 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b6c189df0 0x7f8b6c186870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.137+0000 7f8b72200640 1 --2- 172.21.15.69:0/368693251 >> v2:172.21.15.174:3300/0 conn(0x7f8b6c188970 0x7f8b6c18b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.137+0000 7f8b72200640 1 -- 172.21.15.69:0/368693251 >> 172.21.15.69:0/368693251 conn(0x7f8b6c0d2940 msgr2=0x7f8b6c0d2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:05.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.137+0000 7f8b72200640 1 -- 172.21.15.69:0/368693251 shutdown_connections 2024-02-21T07:43:05.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.137+0000 7f8b72200640 1 -- 172.21.15.69:0/368693251 wait complete. 2024-02-21T07:43:05.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.139+0000 7f8b72200640 1 Processor -- start 2024-02-21T07:43:05.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.139+0000 7f8b72200640 1 -- start start 2024-02-21T07:43:05.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b72200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b6c188970 0x7f8b6c0fcd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b72200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b6c188d50 0x7f8b6c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b72200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b6c189df0 0x7f8b6c0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b72200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0fdff0 con 0x7f8b6c188970 2024-02-21T07:43:05.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b72200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0fede0 con 0x7f8b6c188d50 2024-02-21T07:43:05.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b72200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c0fd750 con 0x7f8b6c189df0 2024-02-21T07:43:05.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b6b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b6c188970 0x7f8b6c0fcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b6b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b6c188970 0x7f8b6c0fcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36812/0 (socket says 172.21.15.69:36812) 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b6b400640 1 -- 172.21.15.69:0/2436351866 learned_addr learned my addr 172.21.15.69:0/2436351866 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b6aa00640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b6c188d50 0x7f8b6c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.140+0000 7f8b6be00640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b6c189df0 0x7f8b6c0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.141+0000 7f8b6b400640 1 -- 172.21.15.69:0/2436351866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b6c189df0 msgr2=0x7f8b6c0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.141+0000 7f8b6b400640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b6c189df0 0x7f8b6c0ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.141+0000 7f8b6b400640 1 -- 172.21.15.69:0/2436351866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b6c188d50 msgr2=0x7f8b6c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.141+0000 7f8b6b400640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b6c188d50 0x7f8b6c0cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.141+0000 7f8b6b400640 1 -- 172.21.15.69:0/2436351866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c009a70 con 0x7f8b6c188970 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.141+0000 7f8b6b400640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b6c188970 0x7f8b6c0fcd30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009ec0 tx=0x7f8b5c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.141+0000 7f8b63400640 1 -- 172.21.15.69:0/2436351866 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c014680 con 0x7f8b6c188970 2024-02-21T07:43:05.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.141+0000 7f8b63400640 1 -- 172.21.15.69:0/2436351866 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c00f040 con 0x7f8b6c188970 2024-02-21T07:43:05.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.141+0000 7f8b63400640 1 -- 172.21.15.69:0/2436351866 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c014a00 con 0x7f8b6c188970 2024-02-21T07:43:05.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.141+0000 7f8b72200640 1 -- 172.21.15.69:0/2436351866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b58009400 con 0x7f8b6c188970 2024-02-21T07:43:05.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.142+0000 7f8b72200640 1 -- 172.21.15.69:0/2436351866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6c0fdd10 con 0x7f8b6c188970 2024-02-21T07:43:05.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.143+0000 7f8b72200640 1 -- 172.21.15.69:0/2436351866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b6c069d50 con 0x7f8b6c188970 2024-02-21T07:43:05.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.145+0000 7f8b63400640 1 -- 172.21.15.69:0/2436351866 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f8b5c014b60 con 0x7f8b6c188970 2024-02-21T07:43:05.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.147+0000 7f8b63400640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8b4c09f130 0x7f8b4c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.147+0000 7f8b63400640 1 -- 172.21.15.69:0/2436351866 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8b5c0cac20 con 0x7f8b6c188970 2024-02-21T07:43:05.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.147+0000 7f8b6aa00640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8b4c09f130 0x7f8b4c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.148+0000 7f8b6aa00640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8b4c09f130 0x7f8b4c0a15f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8b58036000 tx=0x7f8b5803d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:05.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.151+0000 7f8b63400640 1 -- 172.21.15.69:0/2436351866 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8b5c0948a0 con 0x7f8b6c188970 2024-02-21T07:43:05.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.346+0000 7f8b72200640 1 -- 172.21.15.69:0/2436351866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b6c0fc950 con 0x7f8b6c188970 2024-02-21T07:43:05.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.346+0000 7f8b63400640 1 -- 172.21.15.69:0/2436351866 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b6c0fc950 con 0x7f8b6c188970 2024-02-21T07:43:05.352 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-02-21T07:43:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 -- 172.21.15.69:0/2436351866 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8b4c09f130 msgr2=0x7f8b4c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8b4c09f130 0x7f8b4c0a15f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8b58036000 tx=0x7f8b5803d040 comp rx=0 tx=0).stop 2024-02-21T07:43:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 -- 172.21.15.69:0/2436351866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b6c188970 msgr2=0x7f8b6c0fcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b6c188970 0x7f8b6c0fcd30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009ec0 tx=0x7f8b5c00c490 comp rx=0 tx=0).stop 2024-02-21T07:43:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 -- 172.21.15.69:0/2436351866 shutdown_connections 2024-02-21T07:43:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f8b4c09f130 0x7f8b4c0a15f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8b6c189df0 0x7f8b6c0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8b6c188d50 0x7f8b6c0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 --2- 172.21.15.69:0/2436351866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b6c188970 0x7f8b6c0fcd30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 -- 172.21.15.69:0/2436351866 >> 172.21.15.69:0/2436351866 conn(0x7f8b6c0d2940 msgr2=0x7f8b6c186770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:05.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 -- 172.21.15.69:0/2436351866 shutdown_connections 2024-02-21T07:43:05.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.349+0000 7f8b72200640 1 -- 172.21.15.69:0/2436351866 wait complete. 2024-02-21T07:43:05.373 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:43:05.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.580+0000 7f4679800640 1 Processor -- start 2024-02-21T07:43:05.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.580+0000 7f4679800640 1 -- start start 2024-02-21T07:43:05.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4679800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f467417f550 0x7f46740f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4679800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f46740fa7c0 0x7f467418b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4679800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467418bc10 con 0x7f46740fa350 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4679800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46740ff310 con 0x7f467417f550 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4679800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4674189f40 con 0x7f46740fa7c0 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4673400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f46740fa7c0 0x7f467418b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4672a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f467417f550 0x7f46740f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4673400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f46740fa7c0 0x7f467418b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:33278/0 (socket says 172.21.15.69:33278) 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4672a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f467417f550 0x7f46740f9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38390/0 (socket says 172.21.15.69:38390) 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4672000640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f46740fa350 0x7f467418afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:51616/0 (socket says 172.21.15.69:51616) 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.583+0000 7f4673400640 1 -- 172.21.15.69:0/259312477 learned_addr learned my addr 172.21.15.69:0/259312477 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.584+0000 7f4673400640 1 -- 172.21.15.69:0/259312477 >> v2:172.21.15.174:3300/0 conn(0x7f467417f550 msgr2=0x7f46740f9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.584+0000 7f4673400640 1 --2- 172.21.15.69:0/259312477 >> v2:172.21.15.174:3300/0 conn(0x7f467417f550 0x7f46740f9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.584+0000 7f4673400640 1 -- 172.21.15.69:0/259312477 >> v1:172.21.15.184:6789/0 conn(0x7f46740fa350 legacy=0x7f467418afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.584+0000 7f4673400640 1 -- 172.21.15.69:0/259312477 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467417f930 con 0x7f46740fa7c0 2024-02-21T07:43:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.584+0000 7f4671600640 1 -- 172.21.15.69:0/259312477 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382542096 0 0) 0x7f467418bc10 con 0x7f46740fa350 2024-02-21T07:43:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.585+0000 7f4673400640 1 --2- 172.21.15.69:0/259312477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46740fa7c0 0x7f467418b6d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f46740d0a30 tx=0x7f466c02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34ac6814f3198e66 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.585+0000 7f4671600640 1 -- 172.21.15.69:0/259312477 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c031870 con 0x7f46740fa7c0 2024-02-21T07:43:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.585+0000 7f4671600640 1 -- 172.21.15.69:0/259312477 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c0319d0 con 0x7f46740fa7c0 2024-02-21T07:43:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.585+0000 7f4671600640 1 -- 172.21.15.69:0/259312477 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c031d60 con 0x7f46740fa7c0 2024-02-21T07:43:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.586+0000 7f4679800640 1 -- 172.21.15.69:0/259312477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46740fa7c0 msgr2=0x7f467418b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.586+0000 7f4679800640 1 --2- 172.21.15.69:0/259312477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46740fa7c0 0x7f467418b6d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f46740d0a30 tx=0x7f466c02b910 comp rx=0 tx=0).stop 2024-02-21T07:43:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.586+0000 7f4679800640 1 -- 172.21.15.69:0/259312477 shutdown_connections 2024-02-21T07:43:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.586+0000 7f4679800640 1 --2- 172.21.15.69:0/259312477 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f46740fa7c0 0x7f467418b6d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.586+0000 7f4679800640 1 --2- 172.21.15.69:0/259312477 >> v2:172.21.15.174:3300/0 conn(0x7f467417f550 0x7f46740f9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.586+0000 7f4679800640 1 -- 172.21.15.69:0/259312477 >> 172.21.15.69:0/259312477 conn(0x7f46740668e0 msgr2=0x7f4674066cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.586+0000 7f4679800640 1 -- 172.21.15.69:0/259312477 shutdown_connections 2024-02-21T07:43:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.586+0000 7f4679800640 1 -- 172.21.15.69:0/259312477 wait complete. 2024-02-21T07:43:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.588+0000 7f4679800640 1 Processor -- start 2024-02-21T07:43:05.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.588+0000 7f4679800640 1 -- start start 2024-02-21T07:43:05.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.589+0000 7f4679800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46740fa350 0x7f467418b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.589+0000 7f4679800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f467417f550 0x7f46740cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.589+0000 7f4679800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46741645c0 0x7f46740d1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.589+0000 7f4679800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740d0770 con 0x7f46740fa350 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.589+0000 7f4679800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467416a860 con 0x7f46741645c0 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.589+0000 7f4679800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740d0980 con 0x7f467417f550 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.589+0000 7f4672a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46740fa350 0x7f467418b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.589+0000 7f4672a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46740fa350 0x7f467418b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36820/0 (socket says 172.21.15.69:36820) 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.589+0000 7f4672a00640 1 -- 172.21.15.69:0/2050311169 learned_addr learned my addr 172.21.15.69:0/2050311169 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.589+0000 7f4672000640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f467417f550 0x7f46740cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f4673400640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46741645c0 0x7f46740d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f4672000640 1 -- 172.21.15.69:0/2050311169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46741645c0 msgr2=0x7f46740d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f4672000640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46741645c0 0x7f46740d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f4672000640 1 -- 172.21.15.69:0/2050311169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46740fa350 msgr2=0x7f467418b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f4672000640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46740fa350 0x7f467418b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f4672000640 1 -- 172.21.15.69:0/2050311169 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c0094d0 con 0x7f467417f550 2024-02-21T07:43:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f4672a00640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46740fa350 0x7f467418b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f4672000640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f467417f550 0x7f46740cd1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c3e0 tx=0x7f465c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f466aa00640 1 -- 172.21.15.69:0/2050311169 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0074e0 con 0x7f467417f550 2024-02-21T07:43:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f466aa00640 1 -- 172.21.15.69:0/2050311169 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c007640 con 0x7f467417f550 2024-02-21T07:43:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.590+0000 7f466aa00640 1 -- 172.21.15.69:0/2050311169 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c004a20 con 0x7f467417f550 2024-02-21T07:43:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.591+0000 7f4679800640 1 -- 172.21.15.69:0/2050311169 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46740d0c60 con 0x7f467417f550 2024-02-21T07:43:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.591+0000 7f4679800640 1 -- 172.21.15.69:0/2050311169 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46740d1220 con 0x7f467417f550 2024-02-21T07:43:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.592+0000 7f4679800640 1 -- 172.21.15.69:0/2050311169 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4674069d50 con 0x7f467417f550 2024-02-21T07:43:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.594+0000 7f466aa00640 1 -- 172.21.15.69:0/2050311169 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f465c004c40 con 0x7f467417f550 2024-02-21T07:43:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.595+0000 7f466aa00640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f465009f130 0x7f46500a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.595+0000 7f466aa00640 1 -- 172.21.15.69:0/2050311169 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f465c0c9ea0 con 0x7f467417f550 2024-02-21T07:43:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.595+0000 7f4672a00640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f465009f130 0x7f46500a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.596+0000 7f4672a00640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f465009f130 0x7f46500a15f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4664009a40 tx=0x7f466400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:05.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.597+0000 7f466aa00640 1 -- 172.21.15.69:0/2050311169 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f465c093bd0 con 0x7f467417f550 2024-02-21T07:43:05.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.794+0000 7f4679800640 1 -- 172.21.15.69:0/2050311169 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f46740d0ac0 con 0x7f467417f550 2024-02-21T07:43:05.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.795+0000 7f466aa00640 1 -- 172.21.15.69:0/2050311169 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f46740d0ac0 con 0x7f467417f550 2024-02-21T07:43:05.801 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.797+0000 7f4679800640 1 -- 172.21.15.69:0/2050311169 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f465009f130 msgr2=0x7f46500a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.797+0000 7f4679800640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f465009f130 0x7f46500a15f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4664009a40 tx=0x7f466400b040 comp rx=0 tx=0).stop 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.797+0000 7f4679800640 1 -- 172.21.15.69:0/2050311169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f467417f550 msgr2=0x7f46740cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.797+0000 7f4679800640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f467417f550 0x7f46740cd1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f465c00c3e0 tx=0x7f465c00c8a0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.797+0000 7f4679800640 1 -- 172.21.15.69:0/2050311169 shutdown_connections 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.797+0000 7f4679800640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f465009f130 0x7f46500a15f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.797+0000 7f4679800640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f46741645c0 0x7f46740d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.797+0000 7f4679800640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f467417f550 0x7f46740cd1a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.797+0000 7f4679800640 1 --2- 172.21.15.69:0/2050311169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46740fa350 0x7f467418b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.797+0000 7f4679800640 1 -- 172.21.15.69:0/2050311169 >> 172.21.15.69:0/2050311169 conn(0x7f46740668e0 msgr2=0x7f467417a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.798+0000 7f4679800640 1 -- 172.21.15.69:0/2050311169 shutdown_connections 2024-02-21T07:43:05.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:05.798+0000 7f4679800640 1 -- 172.21.15.69:0/2050311169 wait complete. 2024-02-21T07:43:05.823 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:43:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.031+0000 7f11b5c00640 1 Processor -- start 2024-02-21T07:43:06.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.031+0000 7f11b5c00640 1 -- start start 2024-02-21T07:43:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.033+0000 7f11b5c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f11b0180900 0x7f11b006e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.033+0000 7f11b5c00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b006eba0 con 0x7f11b0184680 2024-02-21T07:43:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.033+0000 7f11b5c00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b006ee80 con 0x7f11b00f81f0 2024-02-21T07:43:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.033+0000 7f11b5c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b006fb00 con 0x7f11b0180900 2024-02-21T07:43:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.033+0000 7f11a7400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f11b0184680 0x7f11b0184b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:57306/0 (socket says 172.21.15.69:57306) 2024-02-21T07:43:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.033+0000 7f11a7400640 1 -- 172.21.15.69:0/1874678311 learned_addr learned my addr 172.21.15.69:0/1874678311 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.033+0000 7f11afe00640 1 --2- 172.21.15.69:0/1874678311 >> v2:172.21.15.174:3300/0 conn(0x7f11b0180900 0x7f11b006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.034+0000 7f11af400640 1 -- 172.21.15.69:0/1874678311 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311183732 0 0) 0x7f11b006eba0 con 0x7f11b0184680 2024-02-21T07:43:06.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.034+0000 7f11af400640 1 -- 172.21.15.69:0/1874678311 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1194003520 con 0x7f11b0184680 2024-02-21T07:43:06.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.034+0000 7f11afe00640 1 -- 172.21.15.69:0/1874678311 >> v1:172.21.15.184:6789/0 conn(0x7f11b00f81f0 legacy=0x7f11b00f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.034+0000 7f11afe00640 1 -- 172.21.15.69:0/1874678311 >> v1:172.21.15.69:6789/0 conn(0x7f11b0184680 legacy=0x7f11b0184b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.034+0000 7f11afe00640 1 -- 172.21.15.69:0/1874678311 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b006f160 con 0x7f11b0180900 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.035+0000 7f11afe00640 1 --2- 172.21.15.69:0/1874678311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11b0180900 0x7f11b006e260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f11a00097a0 tx=0x7f11a002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e645685294761daf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.035+0000 7f11af400640 1 -- 172.21.15.69:0/1874678311 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0031830 con 0x7f11b0180900 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.036+0000 7f11af400640 1 -- 172.21.15.69:0/1874678311 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a0031990 con 0x7f11b0180900 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.036+0000 7f11af400640 1 -- 172.21.15.69:0/1874678311 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0031d20 con 0x7f11b0180900 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.036+0000 7f11b5c00640 1 -- 172.21.15.69:0/1874678311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11b0180900 msgr2=0x7f11b006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.036+0000 7f11b5c00640 1 --2- 172.21.15.69:0/1874678311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11b0180900 0x7f11b006e260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f11a00097a0 tx=0x7f11a002b8d0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.036+0000 7f11b5c00640 1 -- 172.21.15.69:0/1874678311 shutdown_connections 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.036+0000 7f11b5c00640 1 --2- 172.21.15.69:0/1874678311 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11b0180900 0x7f11b006e260 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.036+0000 7f11b5c00640 1 -- 172.21.15.69:0/1874678311 >> 172.21.15.69:0/1874678311 conn(0x7f11b00ce290 msgr2=0x7f11b00ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.036+0000 7f11b5c00640 1 -- 172.21.15.69:0/1874678311 shutdown_connections 2024-02-21T07:43:06.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.036+0000 7f11b5c00640 1 -- 172.21.15.69:0/1874678311 wait complete. 2024-02-21T07:43:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.038+0000 7f11b5c00640 1 Processor -- start 2024-02-21T07:43:06.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.038+0000 7f11b5c00640 1 -- start start 2024-02-21T07:43:06.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11b5c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b00f81f0 0x7f11b016a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11b5c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11b0180900 0x7f11b01756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11b5c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11b0184680 0x7f11b0175bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11b5c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b0176130 con 0x7f11b00f81f0 2024-02-21T07:43:06.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11b5c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b021c5d0 con 0x7f11b0184680 2024-02-21T07:43:06.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11b5c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b021fb70 con 0x7f11b0180900 2024-02-21T07:43:06.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11afe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b00f81f0 0x7f11b016a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11a7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11b0180900 0x7f11b01756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11a7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11b0180900 0x7f11b01756b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:33292/0 (socket says 172.21.15.69:33292) 2024-02-21T07:43:06.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11afe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b00f81f0 0x7f11b016a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36824/0 (socket says 172.21.15.69:36824) 2024-02-21T07:43:06.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11a7400640 1 -- 172.21.15.69:0/3043347465 learned_addr learned my addr 172.21.15.69:0/3043347465 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:06.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11b5200640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11b0184680 0x7f11b0175bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11a7400640 1 -- 172.21.15.69:0/3043347465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11b0184680 msgr2=0x7f11b0175bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11a7400640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11b0184680 0x7f11b0175bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11a7400640 1 -- 172.21.15.69:0/3043347465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b00f81f0 msgr2=0x7f11b016a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11a7400640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b00f81f0 0x7f11b016a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.040+0000 7f11a7400640 1 -- 172.21.15.69:0/3043347465 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0009400 con 0x7f11b0180900 2024-02-21T07:43:06.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.041+0000 7f11a7400640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11b0180900 0x7f11b01756b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f119800c390 tx=0x7f119800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.041+0000 7f11acc00640 1 -- 172.21.15.69:0/3043347465 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198005ce0 con 0x7f11b0180900 2024-02-21T07:43:06.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.041+0000 7f11acc00640 1 -- 172.21.15.69:0/3043347465 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198005e40 con 0x7f11b0180900 2024-02-21T07:43:06.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.041+0000 7f11b5c00640 1 -- 172.21.15.69:0/3043347465 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b021fe50 con 0x7f11b0180900 2024-02-21T07:43:06.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.041+0000 7f11acc00640 1 -- 172.21.15.69:0/3043347465 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11980072f0 con 0x7f11b0180900 2024-02-21T07:43:06.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.041+0000 7f11b5c00640 1 -- 172.21.15.69:0/3043347465 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b0220410 con 0x7f11b0180900 2024-02-21T07:43:06.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.042+0000 7f11b5c00640 1 -- 172.21.15.69:0/3043347465 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b0069c10 con 0x7f11b0180900 2024-02-21T07:43:06.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.044+0000 7f11acc00640 1 -- 172.21.15.69:0/3043347465 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f1198007450 con 0x7f11b0180900 2024-02-21T07:43:06.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.045+0000 7f11acc00640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f118c09f130 0x7f118c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.046+0000 7f11acc00640 1 -- 172.21.15.69:0/3043347465 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f11980c94b0 con 0x7f11b0180900 2024-02-21T07:43:06.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.046+0000 7f11afe00640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f118c09f130 0x7f118c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.047+0000 7f11afe00640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f118c09f130 0x7f118c0a15f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f11a0036000 tx=0x7f11a003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.048+0000 7f11acc00640 1 -- 172.21.15.69:0/3043347465 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f11980932f0 con 0x7f11b0180900 2024-02-21T07:43:06.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.287+0000 7f11b5c00640 1 -- 172.21.15.69:0/3043347465 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11b00f8bb0 con 0x7f11b0180900 2024-02-21T07:43:06.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.288+0000 7f11acc00640 1 -- 172.21.15.69:0/3043347465 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f1198017070 con 0x7f11b0180900 2024-02-21T07:43:06.294 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:43:06.295 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:56.243830+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:43:06.295 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 19 2024-02-21T07:43:06.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 -- 172.21.15.69:0/3043347465 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f118c09f130 msgr2=0x7f118c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f118c09f130 0x7f118c0a15f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f11a0036000 tx=0x7f11a003c040 comp rx=0 tx=0).stop 2024-02-21T07:43:06.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 -- 172.21.15.69:0/3043347465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11b0180900 msgr2=0x7f11b01756b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11b0180900 0x7f11b01756b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f119800c390 tx=0x7f119800c850 comp rx=0 tx=0).stop 2024-02-21T07:43:06.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 -- 172.21.15.69:0/3043347465 shutdown_connections 2024-02-21T07:43:06.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f118c09f130 0x7f118c0a15f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f11b0184680 0x7f11b0175bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11b0180900 0x7f11b01756b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 --2- 172.21.15.69:0/3043347465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b00f81f0 0x7f11b016a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 -- 172.21.15.69:0/3043347465 >> 172.21.15.69:0/3043347465 conn(0x7f11b00ce290 msgr2=0x7f11b0186730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:06.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 -- 172.21.15.69:0/3043347465 shutdown_connections 2024-02-21T07:43:06.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.291+0000 7f11b5c00640 1 -- 172.21.15.69:0/3043347465 wait complete. 2024-02-21T07:43:06.317 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:43:06.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.519+0000 7f6e59000640 1 Processor -- start 2024-02-21T07:43:06.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.520+0000 7f6e59000640 1 -- start start 2024-02-21T07:43:06.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.521+0000 7f6e59000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6e54183fa0 0x7f6e540cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.521+0000 7f6e59000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f6e540f6310 0x7f6e54188270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.521+0000 7f6e59000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6e541887b0 0x7f6e54189d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.521+0000 7f6e59000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e540ce230 con 0x7f6e541887b0 2024-02-21T07:43:06.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.521+0000 7f6e59000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e54184380 con 0x7f6e540f6310 2024-02-21T07:43:06.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.521+0000 7f6e59000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e540cd6b0 con 0x7f6e54183fa0 2024-02-21T07:43:06.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e51e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6e54183fa0 0x7f6e540cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e52800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6e541887b0 0x7f6e54189d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e51e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f6e54183fa0 0x7f6e540cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:33294/0 (socket says 172.21.15.69:33294) 2024-02-21T07:43:06.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e51e00640 1 -- 172.21.15.69:0/1713916765 learned_addr learned my addr 172.21.15.69:0/1713916765 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:06.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e4be00640 1 --2- 172.21.15.69:0/1713916765 >> v2:172.21.15.174:3300/0 conn(0x7f6e540f6310 0x7f6e54188270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e52800640 1 -- 172.21.15.69:0/1713916765 >> v2:172.21.15.184:3300/0 conn(0x7f6e54183fa0 msgr2=0x7f6e540cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:06.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e52800640 1 --2- 172.21.15.69:0/1713916765 >> v2:172.21.15.184:3300/0 conn(0x7f6e54183fa0 0x7f6e540cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e52800640 1 -- 172.21.15.69:0/1713916765 >> v2:172.21.15.174:3300/0 conn(0x7f6e540f6310 msgr2=0x7f6e54188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:06.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e52800640 1 --2- 172.21.15.69:0/1713916765 >> v2:172.21.15.174:3300/0 conn(0x7f6e540f6310 0x7f6e54188270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e52800640 1 -- 172.21.15.69:0/1713916765 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e540cd990 con 0x7f6e541887b0 2024-02-21T07:43:06.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e51e00640 1 --2- 172.21.15.69:0/1713916765 >> v2:172.21.15.184:3300/0 conn(0x7f6e54183fa0 0x7f6e540cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:06.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.522+0000 7f6e4be00640 1 --2- 172.21.15.69:0/1713916765 >> v2:172.21.15.174:3300/0 conn(0x7f6e540f6310 0x7f6e54188270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:06.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.524+0000 7f6e52800640 1 --2- 172.21.15.69:0/1713916765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e541887b0 0x7f6e54189d20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6e54162ab0 tx=0x7f6e4c02bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b0051a178195aa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.524+0000 7f6e51400640 1 -- 172.21.15.69:0/1713916765 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c02cad0 con 0x7f6e541887b0 2024-02-21T07:43:06.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.524+0000 7f6e51400640 1 -- 172.21.15.69:0/1713916765 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c02cc30 con 0x7f6e541887b0 2024-02-21T07:43:06.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.524+0000 7f6e51400640 1 -- 172.21.15.69:0/1713916765 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c034440 con 0x7f6e541887b0 2024-02-21T07:43:06.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.525+0000 7f6e59000640 1 -- 172.21.15.69:0/1713916765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e541887b0 msgr2=0x7f6e54189d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.525+0000 7f6e59000640 1 --2- 172.21.15.69:0/1713916765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e541887b0 0x7f6e54189d20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6e54162ab0 tx=0x7f6e4c02bd20 comp rx=0 tx=0).stop 2024-02-21T07:43:06.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.525+0000 7f6e59000640 1 -- 172.21.15.69:0/1713916765 shutdown_connections 2024-02-21T07:43:06.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.525+0000 7f6e59000640 1 --2- 172.21.15.69:0/1713916765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e541887b0 0x7f6e54189d20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.525+0000 7f6e59000640 1 --2- 172.21.15.69:0/1713916765 >> v2:172.21.15.174:3300/0 conn(0x7f6e540f6310 0x7f6e54188270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.525+0000 7f6e59000640 1 --2- 172.21.15.69:0/1713916765 >> v2:172.21.15.184:3300/0 conn(0x7f6e54183fa0 0x7f6e540cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.525+0000 7f6e59000640 1 -- 172.21.15.69:0/1713916765 >> 172.21.15.69:0/1713916765 conn(0x7f6e540f69c0 msgr2=0x7f6e540f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:06.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.525+0000 7f6e59000640 1 -- 172.21.15.69:0/1713916765 shutdown_connections 2024-02-21T07:43:06.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.525+0000 7f6e59000640 1 -- 172.21.15.69:0/1713916765 wait complete. 2024-02-21T07:43:06.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.527+0000 7f6e59000640 1 Processor -- start 2024-02-21T07:43:06.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.527+0000 7f6e59000640 1 -- start start 2024-02-21T07:43:06.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.528+0000 7f6e59000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e540f6310 0x7f6e54222570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.528+0000 7f6e59000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e54183fa0 0x7f6e5421fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.528+0000 7f6e59000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e541887b0 0x7f6e54168c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.528+0000 7f6e59000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54222ab0 con 0x7f6e54183fa0 2024-02-21T07:43:06.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.528+0000 7f6e59000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5416d140 con 0x7f6e540f6310 2024-02-21T07:43:06.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.528+0000 7f6e59000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5416d420 con 0x7f6e541887b0 2024-02-21T07:43:06.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e51e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e540f6310 0x7f6e54222570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e52800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e541887b0 0x7f6e54168c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e51e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e540f6310 0x7f6e54222570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38444/0 (socket says 172.21.15.69:38444) 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e4be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e54183fa0 0x7f6e5421fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e51e00640 1 -- 172.21.15.69:0/213060906 learned_addr learned my addr 172.21.15.69:0/213060906 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e52800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e541887b0 0x7f6e54168c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:33310/0 (socket says 172.21.15.69:33310) 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e51e00640 1 -- 172.21.15.69:0/213060906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e541887b0 msgr2=0x7f6e54168c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e51e00640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e541887b0 0x7f6e54168c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e51e00640 1 -- 172.21.15.69:0/213060906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e54183fa0 msgr2=0x7f6e5421fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e51e00640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e54183fa0 0x7f6e5421fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e51e00640 1 -- 172.21.15.69:0/213060906 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c009400 con 0x7f6e540f6310 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.529+0000 7f6e4be00640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e54183fa0 0x7f6e5421fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:06.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.530+0000 7f6e51e00640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e540f6310 0x7f6e54222570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400e9d0 tx=0x7f6e4400ee90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.530+0000 7f6e4a000640 1 -- 172.21.15.69:0/213060906 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400ca60 con 0x7f6e540f6310 2024-02-21T07:43:06.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.530+0000 7f6e4a000640 1 -- 172.21.15.69:0/213060906 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4400cbc0 con 0x7f6e540f6310 2024-02-21T07:43:06.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.530+0000 7f6e59000640 1 -- 172.21.15.69:0/213060906 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e440094d0 con 0x7f6e540f6310 2024-02-21T07:43:06.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.530+0000 7f6e4a000640 1 -- 172.21.15.69:0/213060906 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44013470 con 0x7f6e540f6310 2024-02-21T07:43:06.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.530+0000 7f6e59000640 1 -- 172.21.15.69:0/213060906 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c009a70 con 0x7f6e540f6310 2024-02-21T07:43:06.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.531+0000 7f6e59000640 1 -- 172.21.15.69:0/213060906 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e54069d50 con 0x7f6e540f6310 2024-02-21T07:43:06.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.533+0000 7f6e4a000640 1 -- 172.21.15.69:0/213060906 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f6e44005990 con 0x7f6e540f6310 2024-02-21T07:43:06.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.534+0000 7f6e4a000640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e3009f130 0x7f6e300a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.535+0000 7f6e4a000640 1 -- 172.21.15.69:0/213060906 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6e440ca0b0 con 0x7f6e540f6310 2024-02-21T07:43:06.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.535+0000 7f6e4be00640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e3009f130 0x7f6e300a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.535+0000 7f6e4be00640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e3009f130 0x7f6e300a15f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6e5417f5f0 tx=0x7f6e3c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.537+0000 7f6e4a000640 1 -- 172.21.15.69:0/213060906 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f6e44093e90 con 0x7f6e540f6310 2024-02-21T07:43:06.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.737+0000 7f6e59000640 1 -- 172.21.15.69:0/213060906 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e540cce70 con 0x7f6e540f6310 2024-02-21T07:43:06.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.739+0000 7f6e4a000640 1 -- 172.21.15.69:0/213060906 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23736 (secure 0 0 0) 0x7f6e44021020 con 0x7f6e540f6310 2024-02-21T07:43:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:43:06.745 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":31,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:48.463144+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:43:06.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 -- 172.21.15.69:0/213060906 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e3009f130 msgr2=0x7f6e300a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e3009f130 0x7f6e300a15f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6e5417f5f0 tx=0x7f6e3c009190 comp rx=0 tx=0).stop 2024-02-21T07:43:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 -- 172.21.15.69:0/213060906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e540f6310 msgr2=0x7f6e54222570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e540f6310 0x7f6e54222570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400e9d0 tx=0x7f6e4400ee90 comp rx=0 tx=0).stop 2024-02-21T07:43:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 -- 172.21.15.69:0/213060906 shutdown_connections 2024-02-21T07:43:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6e3009f130 0x7f6e300a15f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e541887b0 0x7f6e54168c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e54183fa0 0x7f6e5421fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 --2- 172.21.15.69:0/213060906 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6e540f6310 0x7f6e54222570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 -- 172.21.15.69:0/213060906 >> 172.21.15.69:0/213060906 conn(0x7f6e540f69c0 msgr2=0x7f6e540f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.741+0000 7f6e59000640 1 -- 172.21.15.69:0/213060906 shutdown_connections 2024-02-21T07:43:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.742+0000 7f6e59000640 1 -- 172.21.15.69:0/213060906 wait complete. 2024-02-21T07:43:06.765 DEBUG:tasks.fwd_scrub:Yielding 2024-02-21T07:43:06.766 INFO:teuthology.run_tasks:Running task background_exec... 2024-02-21T07:43:06.776 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:43:06.777 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-02-21T07:43:06.777 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-02-21T07:43:06.777 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:43:06.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:43:06.777 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:43:06.782 INFO:teuthology.run_tasks:Running task workunit... 2024-02-21T07:43:06.832 INFO:tasks.workunit:Pulling workunits from ref e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb 2024-02-21T07:43:06.832 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-21T07:43:06.832 INFO:tasks.workunit:timeout=3h 2024-02-21T07:43:06.832 INFO:tasks.workunit:cleanup=True 2024-02-21T07:43:06.832 DEBUG:teuthology.orchestra.run.smithi069:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-21T07:43:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-21T07:43:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-21T07:43:06.875 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 27h/39d Inode: 1099511628283 Links: 2 2024-02-21T07:43:06.875 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T07:43:06.875 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-21T07:43:06.875 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-02-21 07:42:34.120538310 +0000 2024-02-21T07:43:06.875 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-02-21 07:42:34.120538310 +0000 2024-02-21T07:43:06.875 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-02-21 07:42:55.405805835 +0000 2024-02-21T07:43:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-02-21 07:42:34.120538310 +0000 2024-02-21T07:43:06.876 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-21T07:43:06.876 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-21T07:43:06.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.962+0000 7ff47d400640 1 Processor -- start 2024-02-21T07:43:06.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.962+0000 7ff47d400640 1 -- start start 2024-02-21T07:43:06.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.964+0000 7ff47d400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff4780fa000 0x7ff478189190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.964+0000 7ff47d400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4780fa430 con 0x7ff478186980 2024-02-21T07:43:06.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.964+0000 7ff47d400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47806b8a0 con 0x7ff47817f6e0 2024-02-21T07:43:06.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.964+0000 7ff47d400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff478187d60 con 0x7ff4780fa000 2024-02-21T07:43:06.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.964+0000 7ff476800640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7ff47817f6e0 0x7ff47806b190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:40054/0 (socket says 172.21.15.69:40054) 2024-02-21T07:43:06.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.965+0000 7ff476800640 1 -- 172.21.15.69:0/203532349 learned_addr learned my addr 172.21.15.69:0/203532349 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:06.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.965+0000 7ff477200640 1 --2- 172.21.15.69:0/203532349 >> v2:172.21.15.69:3300/0 conn(0x7ff4780fa000 0x7ff478189190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.965+0000 7ff475400640 1 -- 172.21.15.69:0/203532349 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897537302 0 0) 0x7ff47806b8a0 con 0x7ff47817f6e0 2024-02-21T07:43:06.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.965+0000 7ff475400640 1 -- 172.21.15.69:0/203532349 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff45c003520 con 0x7ff47817f6e0 2024-02-21T07:43:06.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.965+0000 7ff477200640 1 -- 172.21.15.69:0/203532349 >> v1:172.21.15.174:6789/0 conn(0x7ff47817f6e0 legacy=0x7ff47806b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.965+0000 7ff477200640 1 -- 172.21.15.69:0/203532349 >> v1:172.21.15.69:6789/0 conn(0x7ff478186980 legacy=0x7ff4780d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.965+0000 7ff477200640 1 -- 172.21.15.69:0/203532349 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478186e00 con 0x7ff4780fa000 2024-02-21T07:43:06.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.966+0000 7ff477200640 1 --2- 172.21.15.69:0/203532349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4780fa000 0x7ff478189190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff470009d90 tx=0x7ff47002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb85d65b5163e88e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.967+0000 7ff475400640 1 -- 172.21.15.69:0/203532349 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47002cb40 con 0x7ff4780fa000 2024-02-21T07:43:06.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.967+0000 7ff475400640 1 -- 172.21.15.69:0/203532349 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47002cca0 con 0x7ff4780fa000 2024-02-21T07:43:06.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.967+0000 7ff475400640 1 -- 172.21.15.69:0/203532349 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470034660 con 0x7ff4780fa000 2024-02-21T07:43:06.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.967+0000 7ff47d400640 1 -- 172.21.15.69:0/203532349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4780fa000 msgr2=0x7ff478189190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.967+0000 7ff47d400640 1 --2- 172.21.15.69:0/203532349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4780fa000 0x7ff478189190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff470009d90 tx=0x7ff47002bd90 comp rx=0 tx=0).stop 2024-02-21T07:43:06.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.967+0000 7ff47d400640 1 -- 172.21.15.69:0/203532349 shutdown_connections 2024-02-21T07:43:06.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.967+0000 7ff47d400640 1 --2- 172.21.15.69:0/203532349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4780fa000 0x7ff478189190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.967+0000 7ff47d400640 1 -- 172.21.15.69:0/203532349 >> 172.21.15.69:0/203532349 conn(0x7ff4780fc100 msgr2=0x7ff4780fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:06.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.968+0000 7ff47d400640 1 -- 172.21.15.69:0/203532349 shutdown_connections 2024-02-21T07:43:06.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.968+0000 7ff47d400640 1 -- 172.21.15.69:0/203532349 wait complete. 2024-02-21T07:43:06.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.970+0000 7ff47d400640 1 Processor -- start 2024-02-21T07:43:06.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.970+0000 7ff47d400640 1 -- start start 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.971+0000 7ff47d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4780fa000 0x7ff478214680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.971+0000 7ff47d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff47817f6e0 0x7ff478183f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.971+0000 7ff47d400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff478186980 0x7ff478220120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.971+0000 7ff47d400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780d0000 con 0x7ff47817f6e0 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.971+0000 7ff47d400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4780cfd20 con 0x7ff478186980 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.971+0000 7ff47d400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478183170 con 0x7ff4780fa000 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff476800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4780fa000 0x7ff478214680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff476800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4780fa000 0x7ff478214680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:33326/0 (socket says 172.21.15.69:33326) 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff476800640 1 -- 172.21.15.69:0/2835511133 learned_addr learned my addr 172.21.15.69:0/2835511133 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff475e00640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff47817f6e0 0x7ff478183f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff477200640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff478186980 0x7ff478220120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff476800640 1 -- 172.21.15.69:0/2835511133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff478186980 msgr2=0x7ff478220120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff476800640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff478186980 0x7ff478220120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff476800640 1 -- 172.21.15.69:0/2835511133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff47817f6e0 msgr2=0x7ff478183f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff476800640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff47817f6e0 0x7ff478183f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff476800640 1 -- 172.21.15.69:0/2835511133 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470009a70 con 0x7ff4780fa000 2024-02-21T07:43:06.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.972+0000 7ff476800640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4780fa000 0x7ff478214680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff46800c410 tx=0x7ff46800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.973+0000 7ff46ea00640 1 -- 172.21.15.69:0/2835511133 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4680074e0 con 0x7ff4780fa000 2024-02-21T07:43:06.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.973+0000 7ff46ea00640 1 -- 172.21.15.69:0/2835511133 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff468007640 con 0x7ff4780fa000 2024-02-21T07:43:06.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.973+0000 7ff47d400640 1 -- 172.21.15.69:0/2835511133 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff478183450 con 0x7ff4780fa000 2024-02-21T07:43:06.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.973+0000 7ff46ea00640 1 -- 172.21.15.69:0/2835511133 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468004a20 con 0x7ff4780fa000 2024-02-21T07:43:06.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.973+0000 7ff47d400640 1 -- 172.21.15.69:0/2835511133 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff478183a10 con 0x7ff4780fa000 2024-02-21T07:43:06.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.976+0000 7ff46ea00640 1 -- 172.21.15.69:0/2835511133 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7ff468004b80 con 0x7ff4780fa000 2024-02-21T07:43:06.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.978+0000 7ff46ea00640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff45809f160 0x7ff4580a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.978+0000 7ff46ea00640 1 -- 172.21.15.69:0/2835511133 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff4680c98e0 con 0x7ff4780fa000 2024-02-21T07:43:06.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.978+0000 7ff475e00640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff45809f160 0x7ff4580a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.979+0000 7ff475e00640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff45809f160 0x7ff4580a1620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff47806ee60 tx=0x7ff464009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.980+0000 7ff480199740 1 Processor -- start 2024-02-21T07:43:06.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.980+0000 7ff480199740 1 -- start start 2024-02-21T07:43:06.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff480199740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c311c0 0x561e53c315a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff480199740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c31ae0 0x561e53c6c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff480199740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c6c890 0x561e53c6d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff480199740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53bb1300 con 0x561e53c6c890 2024-02-21T07:43:06.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff480199740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53b63e50 con 0x561e53c311c0 2024-02-21T07:43:06.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff480199740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53b61380 con 0x561e53c31ae0 2024-02-21T07:43:06.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff476800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c311c0 0x561e53c315a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff475e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c31ae0 0x561e53c6c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff476800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c311c0 0x561e53c315a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38464/0 (socket says 172.21.15.69:38464) 2024-02-21T07:43:06.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff475e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c31ae0 0x561e53c6c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:33338/0 (socket says 172.21.15.69:33338) 2024-02-21T07:43:06.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff476800640 1 -- 172.21.15.69:0/3081547325 learned_addr learned my addr 172.21.15.69:0/3081547325 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:06.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.982+0000 7ff477200640 1 --2- 172.21.15.69:0/3081547325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c6c890 0x561e53c6d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.983+0000 7ff475e00640 1 -- 172.21.15.69:0/3081547325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c311c0 msgr2=0x561e53c315a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:06.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.983+0000 7ff475e00640 1 --2- 172.21.15.69:0/3081547325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c311c0 0x561e53c315a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.983+0000 7ff475e00640 1 -- 172.21.15.69:0/3081547325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c6c890 msgr2=0x561e53c6d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:06.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.983+0000 7ff475e00640 1 --2- 172.21.15.69:0/3081547325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c6c890 0x561e53c6d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.983+0000 7ff475e00640 1 -- 172.21.15.69:0/3081547325 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e53b25c80 con 0x561e53c31ae0 2024-02-21T07:43:06.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.983+0000 7ff476800640 1 --2- 172.21.15.69:0/3081547325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c311c0 0x561e53c315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:06.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.983+0000 7ff477200640 1 --2- 172.21.15.69:0/3081547325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c6c890 0x561e53c6d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:06.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.983+0000 7ff475e00640 1 --2- 172.21.15.69:0/3081547325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c31ae0 0x561e53c6c350 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff46400fb70 tx=0x7ff464012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e5f172370543b91 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.984+0000 7ff463000640 1 -- 172.21.15.69:0/3081547325 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464007030 con 0x561e53c31ae0 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.984+0000 7ff463000640 1 -- 172.21.15.69:0/3081547325 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff464007190 con 0x561e53c31ae0 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.984+0000 7ff463000640 1 -- 172.21.15.69:0/3081547325 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464007500 con 0x561e53c31ae0 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.984+0000 7ff480199740 1 -- 172.21.15.69:0/3081547325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c31ae0 msgr2=0x561e53c6c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.985+0000 7ff480199740 1 --2- 172.21.15.69:0/3081547325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c31ae0 0x561e53c6c350 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff46400fb70 tx=0x7ff464012000 comp rx=0 tx=0).stop 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.985+0000 7ff480199740 1 -- 172.21.15.69:0/3081547325 shutdown_connections 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.985+0000 7ff480199740 1 --2- 172.21.15.69:0/3081547325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c6c890 0x561e53c6d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.985+0000 7ff480199740 1 --2- 172.21.15.69:0/3081547325 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c31ae0 0x561e53c6c350 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.985+0000 7ff480199740 1 --2- 172.21.15.69:0/3081547325 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c311c0 0x561e53c315a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.985+0000 7ff480199740 1 -- 172.21.15.69:0/3081547325 >> 172.21.15.69:0/3081547325 conn(0x561e53bf3790 msgr2=0x561e53bf4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.985+0000 7ff480199740 1 -- 172.21.15.69:0/3081547325 shutdown_connections 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.985+0000 7ff480199740 1 -- 172.21.15.69:0/3081547325 wait complete. 2024-02-21T07:43:06.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.986+0000 7ff480199740 1 -- start start 2024-02-21T07:43:06.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.986+0000 7ff480199740 1 Processor -- start 2024-02-21T07:43:06.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.987+0000 7ff480199740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c76120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.987+0000 7ff480199740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53c2f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff480199740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c1bdb0 0x561e53c76b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff480199740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53b5cb60 con 0x561e53c31ae0 2024-02-21T07:43:06.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff480199740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53b01fd0 con 0x561e53c1bdb0 2024-02-21T07:43:06.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff480199740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53b01c70 con 0x561e53c6c890 2024-02-21T07:43:06.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff480199740 10 client.0 _ll_register_callbacks cb 0x561e5386dc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff476800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c76120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff476800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c76120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36894/0 (socket says 172.21.15.69:36894) 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff476800640 1 -- 172.21.15.69:0/2215747728 learned_addr learned my addr 172.21.15.69:0/2215747728 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff475e00640 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53c2f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff477200640 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c1bdb0 0x561e53c76b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff476800640 1 -- 172.21.15.69:0/2215747728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 msgr2=0x561e53c2f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff476800640 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53c2f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff476800640 1 -- 172.21.15.69:0/2215747728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c1bdb0 msgr2=0x561e53c76b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff476800640 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c1bdb0 0x561e53c76b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff476800640 1 -- 172.21.15.69:0/2215747728 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46400f820 con 0x561e53c31ae0 2024-02-21T07:43:06.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.988+0000 7ff475e00640 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53c2f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:06.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.989+0000 7ff476800640 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c76120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff46800cdd0 tx=0x7ff468097c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706e84510da96dfc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:06.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.989+0000 7ff457400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:06.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.989+0000 7ff457400640 1 -- 172.21.15.69:0/2215747728 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46809b370 con 0x561e53c31ae0 2024-02-21T07:43:06.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.989+0000 7ff457400640 1 -- 172.21.15.69:0/2215747728 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff4680b0020 con 0x561e53c31ae0 2024-02-21T07:43:06.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.989+0000 7ff480199740 1 -- 172.21.15.69:0/2215747728 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e5385c860 con 0x561e53c31ae0 2024-02-21T07:43:06.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.989+0000 7ff457400640 1 -- 172.21.15.69:0/2215747728 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff46809b550 con 0x561e53c31ae0 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.989+0000 7ff480199740 10 client.5043 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.989+0000 7ff480199740 1 -- 172.21.15.69:0/2215747728 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x561e53b5b1e0 con 0x561e53c31ae0 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.990+0000 7ff457400640 1 -- 172.21.15.69:0/2215747728 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561e5385c860 con 0x561e53c31ae0 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.990+0000 7ff457400640 1 -- 172.21.15.69:0/2215747728 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff46801b060 con 0x561e53c31ae0 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.990+0000 7ff480199740 10 client.5043 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.990+0000 7ff480199740 10 client.5043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.990+0000 7ff480199740 20 client.5043 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.990+0000 7ff480199740 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561e53c790e0 0x561e53c794c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.990+0000 7ff480199740 4 client.5043 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.990+0000 7ff480199740 1 -- 172.21.15.69:0/2215747728 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e538ad410 con 0x561e53c790e0 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.990+0000 7ff475e00640 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561e53c790e0 0x561e53c794c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.991+0000 7ff475e00640 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561e53c790e0 0x561e53c794c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9fb75bbaff2ac6e server_cookie=511758dee33b273d in_seq=0 out_seq=0 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.991+0000 7ff457400640 10 client.5043 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:06.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.991+0000 7ff457400640 1 -- 172.21.15.69:0/2215747728 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561e538ad410 con 0x561e53c790e0 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.991+0000 7ff457400640 10 client.5043 handle_command_reply: tid=0 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 client.5043 shutdown 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 -- 172.21.15.69:0/2215747728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 msgr2=0x561e53c76120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c76120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff46800cdd0 tx=0x7ff468097c40 comp rx=0 tx=0).stop 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 -- 172.21.15.69:0/2215747728 shutdown_connections 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561e53c790e0 0x561e53c794c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c1bdb0 0x561e53c76b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53c2f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 --2- 172.21.15.69:0/2215747728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c76120 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 -- 172.21.15.69:0/2215747728 >> 172.21.15.69:0/2215747728 conn(0x561e53c311c0 msgr2=0x561e53bf5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff457400640 0 client.5043 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 -- 172.21.15.69:0/2215747728 shutdown_connections 2024-02-21T07:43:07.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.992+0000 7ff480199740 1 -- 172.21.15.69:0/2215747728 wait complete. 2024-02-21T07:43:07.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:06.993+0000 7ff480199740 20 client.5043 trim_cache size 0 max 16384 2024-02-21T07:43:07.007 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/vshankar/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb 2024-02-21T07:43:07.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.010+0000 7ff480199740 1 Processor -- start 2024-02-21T07:43:07.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.010+0000 7ff480199740 1 -- start start 2024-02-21T07:43:07.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.011+0000 7ff480199740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c1bdb0 0x561e53c6cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.011+0000 7ff480199740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c31ae0 0x561e53bf2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.011+0000 7ff480199740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53c69df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.011+0000 7ff480199740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53c69470 con 0x561e53c1bdb0 2024-02-21T07:43:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.011+0000 7ff480199740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e538a50c0 con 0x561e53c31ae0 2024-02-21T07:43:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.011+0000 7ff480199740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53c1c570 con 0x561e53c6c890 2024-02-21T07:43:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.012+0000 7ff476800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c1bdb0 0x561e53c6cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.012+0000 7ff476800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c1bdb0 0x561e53c6cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36906/0 (socket says 172.21.15.69:36906) 2024-02-21T07:43:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.012+0000 7ff476800640 1 -- 172.21.15.69:0/3498499093 learned_addr learned my addr 172.21.15.69:0/3498499093 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.012+0000 7ff477200640 1 --2- 172.21.15.69:0/3498499093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53c69df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.012+0000 7ff475e00640 1 --2- 172.21.15.69:0/3498499093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c31ae0 0x561e53bf2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.012+0000 7ff476800640 1 -- 172.21.15.69:0/3498499093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 msgr2=0x561e53c69df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.012+0000 7ff476800640 1 --2- 172.21.15.69:0/3498499093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53c69df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.012+0000 7ff476800640 1 -- 172.21.15.69:0/3498499093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c31ae0 msgr2=0x561e53bf2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.012+0000 7ff476800640 1 --2- 172.21.15.69:0/3498499093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c31ae0 0x561e53bf2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.012+0000 7ff476800640 1 -- 172.21.15.69:0/3498499093 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e53af7a90 con 0x561e53c1bdb0 2024-02-21T07:43:07.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.013+0000 7ff476800640 1 --2- 172.21.15.69:0/3498499093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c1bdb0 0x561e53c6cc70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff4680956b0 tx=0x7ff46801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4799ae8656bc54c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:07.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.013+0000 7ff462600640 1 -- 172.21.15.69:0/3498499093 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800e040 con 0x561e53c1bdb0 2024-02-21T07:43:07.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.013+0000 7ff462600640 1 -- 172.21.15.69:0/3498499093 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46809b370 con 0x561e53c1bdb0 2024-02-21T07:43:07.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.013+0000 7ff462600640 1 -- 172.21.15.69:0/3498499093 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46809f880 con 0x561e53c1bdb0 2024-02-21T07:43:07.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.014+0000 7ff480199740 1 -- 172.21.15.69:0/3498499093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c1bdb0 msgr2=0x561e53c6cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.014+0000 7ff480199740 1 --2- 172.21.15.69:0/3498499093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c1bdb0 0x561e53c6cc70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff4680956b0 tx=0x7ff46801f000 comp rx=0 tx=0).stop 2024-02-21T07:43:07.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.014+0000 7ff480199740 1 -- 172.21.15.69:0/3498499093 shutdown_connections 2024-02-21T07:43:07.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.014+0000 7ff480199740 1 --2- 172.21.15.69:0/3498499093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53c69df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.014+0000 7ff480199740 1 --2- 172.21.15.69:0/3498499093 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c31ae0 0x561e53bf2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.014+0000 7ff480199740 1 --2- 172.21.15.69:0/3498499093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c1bdb0 0x561e53c6cc70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.014+0000 7ff480199740 1 -- 172.21.15.69:0/3498499093 >> 172.21.15.69:0/3498499093 conn(0x561e53c311c0 msgr2=0x561e53bf5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:07.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.014+0000 7ff480199740 1 -- 172.21.15.69:0/3498499093 shutdown_connections 2024-02-21T07:43:07.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.014+0000 7ff480199740 1 -- 172.21.15.69:0/3498499093 wait complete. 2024-02-21T07:43:07.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.015+0000 7ff480199740 1 -- start start 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.015+0000 7ff480199740 1 Processor -- start 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff480199740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c1bdb0 0x561e53c15a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff480199740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c61af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff480199740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53cce240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff480199740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53c6ab50 con 0x561e53c31ae0 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff480199740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53c14830 con 0x561e53c1bdb0 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff480199740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e53c14c90 con 0x561e53c6c890 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff480199740 10 client.0 _ll_register_callbacks cb 0x7ff464001d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff475e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c61af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff475e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c61af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36916/0 (socket says 172.21.15.69:36916) 2024-02-21T07:43:07.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff475e00640 1 -- 172.21.15.69:0/211485372 learned_addr learned my addr 172.21.15.69:0/211485372 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:07.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff476800640 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c1bdb0 0x561e53c15a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff477200640 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53cce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff475e00640 1 -- 172.21.15.69:0/211485372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 msgr2=0x561e53cce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff475e00640 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53cce240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff475e00640 1 -- 172.21.15.69:0/211485372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c1bdb0 msgr2=0x561e53c15a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff475e00640 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c1bdb0 0x561e53c15a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.017+0000 7ff475e00640 1 -- 172.21.15.69:0/211485372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e53b5b1e0 con 0x561e53c31ae0 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.018+0000 7ff475e00640 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c61af0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x561e53c31fb0 tx=0x7ff464000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6740bb1ffc1d52 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.018+0000 7ff457400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.018+0000 7ff457400640 1 -- 172.21.15.69:0/211485372 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464031040 con 0x561e53c31ae0 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.018+0000 7ff457400640 1 -- 172.21.15.69:0/211485372 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff46401b050 con 0x561e53c31ae0 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.018+0000 7ff480199740 1 -- 172.21.15.69:0/211485372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e538997b0 con 0x561e53c31ae0 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.018+0000 7ff457400640 1 -- 172.21.15.69:0/211485372 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff464007030 con 0x561e53c31ae0 2024-02-21T07:43:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.018+0000 7ff480199740 10 client.5049 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.018+0000 7ff480199740 1 -- 172.21.15.69:0/211485372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x561e53b1d6a0 con 0x561e53c31ae0 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.019+0000 7ff457400640 1 -- 172.21.15.69:0/211485372 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561e538997b0 con 0x561e53c31ae0 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.019+0000 7ff457400640 1 -- 172.21.15.69:0/211485372 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff464012070 con 0x561e53c31ae0 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.019+0000 7ff480199740 10 client.5049 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.019+0000 7ff480199740 10 client.5049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.019+0000 7ff480199740 20 client.5049 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.019+0000 7ff480199740 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561e53c1b550 0x561e53c85460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.019+0000 7ff480199740 4 client.5049 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.019+0000 7ff480199740 1 -- 172.21.15.69:0/211485372 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561e53808990 con 0x561e53c1b550 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.019+0000 7ff476800640 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561e53c1b550 0x561e53c85460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.020+0000 7ff476800640 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561e53c1b550 0x561e53c85460 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=958d9dfeb2cb8da9 server_cookie=129e62436e1146c3 in_seq=0 out_seq=0 2024-02-21T07:43:07.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.020+0000 7ff457400640 10 client.5049 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:07.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.021+0000 7ff457400640 1 -- 172.21.15.69:0/211485372 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561e53808990 con 0x561e53c1b550 2024-02-21T07:43:07.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.021+0000 7ff457400640 10 client.5049 handle_command_reply: tid=0 2024-02-21T07:43:07.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.021+0000 7ff480199740 1 client.5049 shutdown 2024-02-21T07:43:07.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.021+0000 7ff480199740 1 -- 172.21.15.69:0/211485372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 msgr2=0x561e53c61af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.021+0000 7ff480199740 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c61af0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x561e53c31fb0 tx=0x7ff464000ed0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.022+0000 7ff480199740 1 -- 172.21.15.69:0/211485372 shutdown_connections 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.022+0000 7ff480199740 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561e53c1b550 0x561e53c85460 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.022+0000 7ff480199740 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561e53c6c890 0x561e53cce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.022+0000 7ff480199740 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561e53c31ae0 0x561e53c61af0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.022+0000 7ff480199740 1 --2- 172.21.15.69:0/211485372 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561e53c1bdb0 0x561e53c15a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.022+0000 7ff480199740 1 -- 172.21.15.69:0/211485372 >> 172.21.15.69:0/211485372 conn(0x561e53c311c0 msgr2=0x561e53bf47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.022+0000 7ff457400640 0 client.5049 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.022+0000 7ff480199740 1 -- 172.21.15.69:0/211485372 shutdown_connections 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.022+0000 7ff480199740 1 -- 172.21.15.69:0/211485372 wait complete. 2024-02-21T07:43:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.022+0000 7ff480199740 20 client.5049 trim_cache size 0 max 16384 2024-02-21T07:43:07.030 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:43:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-02-21T07:43:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "3e81d6bb-7df2-43e1-9882-7e7129c93370", 2024-02-21T07:43:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-02-21T07:43:07.030 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:43:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.023+0000 7ff47d400640 1 -- 172.21.15.69:0/2835511133 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff45809f160 msgr2=0x7ff4580a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.023+0000 7ff47d400640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff45809f160 0x7ff4580a1620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff47806ee60 tx=0x7ff464009040 comp rx=0 tx=0).stop 2024-02-21T07:43:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.023+0000 7ff47d400640 1 -- 172.21.15.69:0/2835511133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4780fa000 msgr2=0x7ff478214680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.023+0000 7ff47d400640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4780fa000 0x7ff478214680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff46800c410 tx=0x7ff46800c8d0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.024+0000 7ff47d400640 1 -- 172.21.15.69:0/2835511133 shutdown_connections 2024-02-21T07:43:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.024+0000 7ff47d400640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff45809f160 0x7ff4580a1620 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.024+0000 7ff47d400640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff478186980 0x7ff478220120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.024+0000 7ff47d400640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff47817f6e0 0x7ff478183f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.024+0000 7ff47d400640 1 --2- 172.21.15.69:0/2835511133 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff4780fa000 0x7ff478214680 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.024+0000 7ff47d400640 1 -- 172.21.15.69:0/2835511133 >> 172.21.15.69:0/2835511133 conn(0x7ff4780fc100 msgr2=0x7ff4780fc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.024+0000 7ff47d400640 1 -- 172.21.15.69:0/2835511133 shutdown_connections 2024-02-21T07:43:07.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.024+0000 7ff47d400640 1 -- 172.21.15.69:0/2835511133 wait complete. 2024-02-21T07:43:07.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:43:07.048 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:43:07.052 INFO:tasks.workunit.client.0.smithi069.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-21T07:43:07.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.226+0000 7f21bbc00640 1 Processor -- start 2024-02-21T07:43:07.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.226+0000 7f21bbc00640 1 -- start start 2024-02-21T07:43:07.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.230+0000 7f21bbc00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f21b41863f0 0x7f21b40fa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.230+0000 7f21bbc00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b406e200 con 0x7f21b4186010 2024-02-21T07:43:07.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.230+0000 7f21bbc00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b406e4e0 con 0x7f21b406d550 2024-02-21T07:43:07.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.230+0000 7f21bbc00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b4189a80 con 0x7f21b41863f0 2024-02-21T07:43:07.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.230+0000 7f21b9200640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f21b4186010 0x7f21b41869e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:57324/0 (socket says 172.21.15.69:57324) 2024-02-21T07:43:07.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.230+0000 7f21b9200640 1 -- 172.21.15.69:0/3066266250 learned_addr learned my addr 172.21.15.69:0/3066266250 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:07.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.230+0000 7f21b3e00640 1 --2- 172.21.15.69:0/3066266250 >> v2:172.21.15.174:3300/0 conn(0x7f21b41863f0 0x7f21b40fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.230+0000 7f21b3400640 1 -- 172.21.15.69:0/3066266250 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230676488 0 0) 0x7f21b406e200 con 0x7f21b4186010 2024-02-21T07:43:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.231+0000 7f21b3400640 1 -- 172.21.15.69:0/3066266250 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f219c003520 con 0x7f21b4186010 2024-02-21T07:43:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.231+0000 7f21b3400640 1 -- 172.21.15.69:0/3066266250 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181459030 0 0) 0x7f21b406e4e0 con 0x7f21b406d550 2024-02-21T07:43:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.231+0000 7f21b3400640 1 -- 172.21.15.69:0/3066266250 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b406e200 con 0x7f21b406d550 2024-02-21T07:43:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.231+0000 7f21b3e00640 1 -- 172.21.15.69:0/3066266250 >> v1:172.21.15.174:6789/0 conn(0x7f21b406d550 legacy=0x7f21b406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.231+0000 7f21b3e00640 1 -- 172.21.15.69:0/3066266250 >> v1:172.21.15.69:6789/0 conn(0x7f21b4186010 legacy=0x7f21b41869e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.231+0000 7f21b3e00640 1 -- 172.21.15.69:0/3066266250 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b40f9340 con 0x7f21b41863f0 2024-02-21T07:43:07.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.232+0000 7f21b3e00640 1 --2- 172.21.15.69:0/3066266250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b41863f0 0x7f21b40fa100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f21a00097a0 tx=0x7f21a002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50fa782993e55228 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:07.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.233+0000 7f21b3400640 1 -- 172.21.15.69:0/3066266250 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a002e070 con 0x7f21b41863f0 2024-02-21T07:43:07.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.233+0000 7f21b3400640 1 -- 172.21.15.69:0/3066266250 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a00315a0 con 0x7f21b41863f0 2024-02-21T07:43:07.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.233+0000 7f21b3400640 1 -- 172.21.15.69:0/3066266250 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0031930 con 0x7f21b41863f0 2024-02-21T07:43:07.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.233+0000 7f21bbc00640 1 -- 172.21.15.69:0/3066266250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b41863f0 msgr2=0x7f21b40fa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.233+0000 7f21bbc00640 1 --2- 172.21.15.69:0/3066266250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b41863f0 0x7f21b40fa100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f21a00097a0 tx=0x7f21a002b840 comp rx=0 tx=0).stop 2024-02-21T07:43:07.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.234+0000 7f21bbc00640 1 -- 172.21.15.69:0/3066266250 shutdown_connections 2024-02-21T07:43:07.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.234+0000 7f21bbc00640 1 --2- 172.21.15.69:0/3066266250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b41863f0 0x7f21b40fa100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.234+0000 7f21bbc00640 1 -- 172.21.15.69:0/3066266250 >> 172.21.15.69:0/3066266250 conn(0x7f21b40f7230 msgr2=0x7f21b40f7640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:07.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.234+0000 7f21bbc00640 1 -- 172.21.15.69:0/3066266250 shutdown_connections 2024-02-21T07:43:07.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.234+0000 7f21bbc00640 1 -- 172.21.15.69:0/3066266250 wait complete. 2024-02-21T07:43:07.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.237+0000 7f21bbc00640 1 Processor -- start 2024-02-21T07:43:07.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.237+0000 7f21bbc00640 1 -- start start 2024-02-21T07:43:07.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.239+0000 7f21bbc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b406d550 0x7f21b416be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.239+0000 7f21bbc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b4186010 0x7f21b421e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.239+0000 7f21bbc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21b41863f0 0x7f21b421eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.239+0000 7f21bbc00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b417c130 con 0x7f21b41863f0 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.239+0000 7f21bbc00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b421f9a0 con 0x7f21b4186010 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.239+0000 7f21bbc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b416c3b0 con 0x7f21b406d550 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.239+0000 7f21b3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b4186010 0x7f21b421e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.239+0000 7f21b9c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21b41863f0 0x7f21b421eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.240+0000 7f21b3e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b4186010 0x7f21b421e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38522/0 (socket says 172.21.15.69:38522) 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.240+0000 7f21b3e00640 1 -- 172.21.15.69:0/1254925252 learned_addr learned my addr 172.21.15.69:0/1254925252 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.240+0000 7f21b9200640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b406d550 0x7f21b416be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.240+0000 7f21b3e00640 1 -- 172.21.15.69:0/1254925252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b406d550 msgr2=0x7f21b416be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.240+0000 7f21b3e00640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b406d550 0x7f21b416be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.240+0000 7f21b3e00640 1 -- 172.21.15.69:0/1254925252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21b41863f0 msgr2=0x7f21b421eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.240+0000 7f21b3e00640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21b41863f0 0x7f21b421eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.240+0000 7f21b3e00640 1 -- 172.21.15.69:0/1254925252 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a0009400 con 0x7f21b4186010 2024-02-21T07:43:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.240+0000 7f21b3e00640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b4186010 0x7f21b421e980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f21a002b880 tx=0x7f21a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.241+0000 7f21b0c00640 1 -- 172.21.15.69:0/1254925252 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0032840 con 0x7f21b4186010 2024-02-21T07:43:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.241+0000 7f21b0c00640 1 -- 172.21.15.69:0/1254925252 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a00329a0 con 0x7f21b4186010 2024-02-21T07:43:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.241+0000 7f21b0c00640 1 -- 172.21.15.69:0/1254925252 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a0032d50 con 0x7f21b4186010 2024-02-21T07:43:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.241+0000 7f21bbc00640 1 -- 172.21.15.69:0/1254925252 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b421f400 con 0x7f21b4186010 2024-02-21T07:43:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.241+0000 7f21bbc00640 1 -- 172.21.15.69:0/1254925252 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b417b370 con 0x7f21b4186010 2024-02-21T07:43:07.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.244+0000 7f21b0c00640 1 -- 172.21.15.69:0/1254925252 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f21a004e430 con 0x7f21b4186010 2024-02-21T07:43:07.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.245+0000 7f21b0c00640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f219409f130 0x7f21940a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.245+0000 7f21b0c00640 1 -- 172.21.15.69:0/1254925252 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f21a00ebcc0 con 0x7f21b4186010 2024-02-21T07:43:07.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.246+0000 7f21b9200640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f219409f130 0x7f21940a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.246+0000 7f21b9200640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f219409f130 0x7f21940a15f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f21a8000f60 tx=0x7f21a8007cf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:07.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.247+0000 7f21be7dd740 1 Processor -- start 2024-02-21T07:43:07.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.247+0000 7f21be7dd740 1 -- start start 2024-02-21T07:43:07.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.248+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e1fc0 0x55de42717a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de426e23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e28e0 0x55de426a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21be7dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de42619150 con 0x55de42717f80 2024-02-21T07:43:07.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21be7dd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de42616680 con 0x55de426e28e0 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21be7dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de42611e60 con 0x55de426e1fc0 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de426e23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de426e23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36930/0 (socket says 172.21.15.69:36930) 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b3e00640 1 -- 172.21.15.69:0/3197110609 learned_addr learned my addr 172.21.15.69:0/3197110609 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b9200640 1 --2- 172.21.15.69:0/3197110609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e1fc0 0x55de42717a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b9c00640 1 --2- 172.21.15.69:0/3197110609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e28e0 0x55de426a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b3e00640 1 -- 172.21.15.69:0/3197110609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e1fc0 msgr2=0x55de42717a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b3e00640 1 --2- 172.21.15.69:0/3197110609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e1fc0 0x55de42717a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b3e00640 1 -- 172.21.15.69:0/3197110609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e28e0 msgr2=0x55de426a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b3e00640 1 --2- 172.21.15.69:0/3197110609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e28e0 0x55de426a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b3e00640 1 -- 172.21.15.69:0/3197110609 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de425cb060 con 0x55de42717f80 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.249+0000 7f21b3e00640 1 --2- 172.21.15.69:0/3197110609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de426e23a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f21a00b76c0 tx=0x7f21a0032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125c5b6a917a40c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:07.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.250+0000 7f21a5600640 1 -- 172.21.15.69:0/3197110609 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a00d6ea0 con 0x55de42717f80 2024-02-21T07:43:07.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.250+0000 7f21a5600640 1 -- 172.21.15.69:0/3197110609 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a00b9640 con 0x55de42717f80 2024-02-21T07:43:07.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.250+0000 7f21a5600640 1 -- 172.21.15.69:0/3197110609 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a00bd790 con 0x55de42717f80 2024-02-21T07:43:07.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.251+0000 7f21be7dd740 1 -- 172.21.15.69:0/3197110609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 msgr2=0x55de426e23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.251+0000 7f21be7dd740 1 --2- 172.21.15.69:0/3197110609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de426e23a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f21a00b76c0 tx=0x7f21a0032f30 comp rx=0 tx=0).stop 2024-02-21T07:43:07.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.251+0000 7f21be7dd740 1 -- 172.21.15.69:0/3197110609 shutdown_connections 2024-02-21T07:43:07.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.251+0000 7f21be7dd740 1 --2- 172.21.15.69:0/3197110609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e28e0 0x55de426a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.251+0000 7f21be7dd740 1 --2- 172.21.15.69:0/3197110609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de426e23a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.251+0000 7f21be7dd740 1 --2- 172.21.15.69:0/3197110609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e1fc0 0x55de42717a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.251+0000 7f21be7dd740 1 -- 172.21.15.69:0/3197110609 >> 172.21.15.69:0/3197110609 conn(0x55de426715a0 msgr2=0x55de426a8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:07.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.251+0000 7f21be7dd740 1 -- 172.21.15.69:0/3197110609 shutdown_connections 2024-02-21T07:43:07.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.251+0000 7f21be7dd740 1 -- 172.21.15.69:0/3197110609 wait complete. 2024-02-21T07:43:07.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.252+0000 7f21be7dd740 1 -- start start 2024-02-21T07:43:07.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.252+0000 7f21be7dd740 1 Processor -- start 2024-02-21T07:43:07.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e1fc0 0x55de426a3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e28e0 0x55de426d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 0x55de4270e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21be7dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de425b6ec0 con 0x55de426e28e0 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21be7dd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de425b6b60 con 0x55de42717f80 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21be7dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de423801c0 con 0x55de426e1fc0 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21be7dd740 10 client.0 _ll_register_callbacks cb 0x55de425ca960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21b3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e28e0 0x55de426d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21b3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e28e0 0x55de426d3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36946/0 (socket says 172.21.15.69:36946) 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21b9c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 0x55de4270e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.253+0000 7f21b3e00640 1 -- 172.21.15.69:0/3687054930 learned_addr learned my addr 172.21.15.69:0/3687054930 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f21b9200640 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e1fc0 0x55de426a3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f21b3e00640 1 -- 172.21.15.69:0/3687054930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e1fc0 msgr2=0x55de426a3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f21b3e00640 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e1fc0 0x55de426a3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f21b3e00640 1 -- 172.21.15.69:0/3687054930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 msgr2=0x55de4270e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f21b3e00640 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 0x55de4270e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f21b3e00640 1 -- 172.21.15.69:0/3687054930 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b417b370 con 0x55de426e28e0 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f21b9c00640 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 0x55de4270e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f21b3e00640 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e28e0 0x55de426d3a20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f21a00e9480 tx=0x7f21a00a4070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a87b94a9f0e5424 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f219a000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f219a000640 1 -- 172.21.15.69:0/3687054930 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a00d6ea0 con 0x55de426e28e0 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f219a000640 1 -- 172.21.15.69:0/3687054930 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f21a00c1de0 con 0x55de426e28e0 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.254+0000 7f21be7dd740 1 -- 172.21.15.69:0/3687054930 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de423117e0 con 0x55de426e28e0 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f219a000640 1 -- 172.21.15.69:0/3687054930 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21a00bd790 con 0x55de426e28e0 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f21be7dd740 10 client.5061 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f21be7dd740 1 -- 172.21.15.69:0/3687054930 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55de426104e0 con 0x55de426e28e0 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f219a000640 1 -- 172.21.15.69:0/3687054930 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55de423117e0 con 0x55de426e28e0 2024-02-21T07:43:07.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f219a000640 1 -- 172.21.15.69:0/3687054930 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f21a00b5c20 con 0x55de426e28e0 2024-02-21T07:43:07.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f21be7dd740 10 client.5061 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:07.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f21be7dd740 10 client.5061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:07.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f21be7dd740 20 client.5061 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:07.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f21be7dd740 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55de42729840 0x55de426d1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f21be7dd740 4 client.5061 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:07.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f21be7dd740 1 -- 172.21.15.69:0/3687054930 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de4234e720 con 0x55de42729840 2024-02-21T07:43:07.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.255+0000 7f21b9200640 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55de42729840 0x55de426d1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.256+0000 7f21b9200640 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55de42729840 0x55de426d1960 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cc7bd0f877cfabf server_cookie=99ac5d259f7fc829 in_seq=0 out_seq=0 2024-02-21T07:43:07.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.256+0000 7f219a000640 10 client.5061 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:07.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.256+0000 7f219a000640 1 -- 172.21.15.69:0/3687054930 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55de4234e720 con 0x55de42729840 2024-02-21T07:43:07.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f219a000640 10 client.5061 handle_command_reply: tid=0 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 client.5061 shutdown 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 -- 172.21.15.69:0/3687054930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e28e0 msgr2=0x55de426d3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e28e0 0x55de426d3a20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f21a00e9480 tx=0x7f21a00a4070 comp rx=0 tx=0).stop 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 -- 172.21.15.69:0/3687054930 shutdown_connections 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55de42729840 0x55de426d1960 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 0x55de4270e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e28e0 0x55de426d3a20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 --2- 172.21.15.69:0/3687054930 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e1fc0 0x55de426a3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 -- 172.21.15.69:0/3687054930 >> 172.21.15.69:0/3687054930 conn(0x55de426715a0 msgr2=0x55de42717680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f219a000640 0 client.5061 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 -- 172.21.15.69:0/3687054930 shutdown_connections 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 1 -- 172.21.15.69:0/3687054930 wait complete. 2024-02-21T07:43:07.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.257+0000 7f21be7dd740 20 client.5061 trim_cache size 0 max 16384 2024-02-21T07:43:07.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.287+0000 7f21be7dd740 1 Processor -- start 2024-02-21T07:43:07.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.287+0000 7f21be7dd740 1 -- start start 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.289+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e1fc0 0x55de426e23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.289+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 0x55de426d4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.289+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 0x55de4277e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.289+0000 7f21be7dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de426d4580 con 0x55de426e1fc0 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.289+0000 7f21be7dd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de426a9270 con 0x55de42717f80 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.289+0000 7f21be7dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de426df720 con 0x55de426e28e0 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.289+0000 7f21b9200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e1fc0 0x55de426e23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.289+0000 7f21b9200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e1fc0 0x55de426e23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36954/0 (socket says 172.21.15.69:36954) 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.289+0000 7f21b9200640 1 -- 172.21.15.69:0/94915407 learned_addr learned my addr 172.21.15.69:0/94915407 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.289+0000 7f21b9c00640 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 0x55de4277e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21b3e00640 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 0x55de426d4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21b9200640 1 -- 172.21.15.69:0/94915407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 msgr2=0x55de426d4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21b9200640 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 0x55de426d4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21b9200640 1 -- 172.21.15.69:0/94915407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 msgr2=0x55de4277e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21b9200640 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 0x55de4277e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21b9200640 1 -- 172.21.15.69:0/94915407 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de425ac950 con 0x55de426e1fc0 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21b9c00640 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 0x55de4277e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21b3e00640 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 0x55de426d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21b9200640 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e1fc0 0x55de426e23a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f21a8001790 tx=0x7f21a800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc645f2651f2818 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21a4c00640 1 -- 172.21.15.69:0/94915407 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8029070 con 0x55de426e1fc0 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21a4c00640 1 -- 172.21.15.69:0/94915407 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8005db0 con 0x55de426e1fc0 2024-02-21T07:43:07.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.290+0000 7f21a4c00640 1 -- 172.21.15.69:0/94915407 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8029d00 con 0x55de426e1fc0 2024-02-21T07:43:07.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.291+0000 7f21be7dd740 1 -- 172.21.15.69:0/94915407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e1fc0 msgr2=0x55de426e23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.291+0000 7f21be7dd740 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e1fc0 0x55de426e23a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f21a8001790 tx=0x7f21a800a000 comp rx=0 tx=0).stop 2024-02-21T07:43:07.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.291+0000 7f21be7dd740 1 -- 172.21.15.69:0/94915407 shutdown_connections 2024-02-21T07:43:07.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.291+0000 7f21be7dd740 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de42717f80 0x55de4277e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.291+0000 7f21be7dd740 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 0x55de426d4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.291+0000 7f21be7dd740 1 --2- 172.21.15.69:0/94915407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de426e1fc0 0x55de426e23a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.291+0000 7f21be7dd740 1 -- 172.21.15.69:0/94915407 >> 172.21.15.69:0/94915407 conn(0x55de426715a0 msgr2=0x55de426afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:07.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.291+0000 7f21be7dd740 1 -- 172.21.15.69:0/94915407 shutdown_connections 2024-02-21T07:43:07.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.291+0000 7f21be7dd740 1 -- 172.21.15.69:0/94915407 wait complete. 2024-02-21T07:43:07.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.292+0000 7f21be7dd740 1 -- start start 2024-02-21T07:43:07.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.292+0000 7f21be7dd740 1 Processor -- start 2024-02-21T07:43:07.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.293+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e1fc0 0x55de4273a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.293+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 0x55de426d3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.293+0000 7f21be7dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de4277a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.293+0000 7f21be7dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de4277a7e0 con 0x55de42717f80 2024-02-21T07:43:07.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.293+0000 7f21be7dd740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de42784210 con 0x55de426e1fc0 2024-02-21T07:43:07.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.293+0000 7f21be7dd740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de42725cc0 con 0x55de426e28e0 2024-02-21T07:43:07.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.293+0000 7f21be7dd740 10 client.0 _ll_register_callbacks cb 0x7f21a8017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:07.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de4277a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e1fc0 0x55de4273a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e1fc0 0x55de4273a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38550/0 (socket says 172.21.15.69:38550) 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9200640 1 -- 172.21.15.69:0/4052430103 learned_addr learned my addr 172.21.15.69:0/4052430103 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de4277a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36956/0 (socket says 172.21.15.69:36956) 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b3e00640 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 0x55de426d3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9200640 1 -- 172.21.15.69:0/4052430103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 msgr2=0x55de426d3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9200640 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 0x55de426d3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9200640 1 -- 172.21.15.69:0/4052430103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 msgr2=0x55de4277a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9200640 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de4277a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9200640 1 -- 172.21.15.69:0/4052430103 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219c003520 con 0x55de426e1fc0 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f21b9200640 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e1fc0 0x55de4273a400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f21a8001760 tx=0x7f21a8000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e64ceb7feec2515e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.294+0000 7f219a000640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f219a000640 1 -- 172.21.15.69:0/4052430103 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80049f0 con 0x55de426e1fc0 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f219a000640 1 -- 172.21.15.69:0/4052430103 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f21a801c040 con 0x55de426e1fc0 2024-02-21T07:43:07.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f21be7dd740 1 -- 172.21.15.69:0/4052430103 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de42719720 con 0x55de426e1fc0 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f219a000640 1 -- 172.21.15.69:0/4052430103 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21a8004b50 con 0x55de426e1fc0 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f21be7dd740 10 client.5260 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f21be7dd740 1 -- 172.21.15.69:0/4052430103 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55de425d2430 con 0x55de426e1fc0 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f219a000640 1 -- 172.21.15.69:0/4052430103 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55de42719720 con 0x55de426e1fc0 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f219a000640 1 -- 172.21.15.69:0/4052430103 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f21a8012070 con 0x55de426e1fc0 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f21be7dd740 10 client.5260 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f21be7dd740 10 client.5260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f21be7dd740 20 client.5260 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f21be7dd740 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55de42726150 0x55de4271bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f21be7dd740 4 client.5260 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.295+0000 7f21be7dd740 1 -- 172.21.15.69:0/4052430103 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f21a00b9640 con 0x55de42726150 2024-02-21T07:43:07.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21b3e00640 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55de42726150 0x55de4271bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21b3e00640 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55de42726150 0x55de4271bc20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b583bdc36232ac64 server_cookie=2e7b23fd7303d2c1 in_seq=0 out_seq=0 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f219a000640 10 client.5260 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f219a000640 1 -- 172.21.15.69:0/4052430103 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7f21a00b9640 con 0x55de42726150 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f219a000640 10 client.5260 handle_command_reply: tid=0 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21be7dd740 1 client.5260 shutdown 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21be7dd740 1 -- 172.21.15.69:0/4052430103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e1fc0 msgr2=0x55de4273a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21be7dd740 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e1fc0 0x55de4273a400 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f21a8001760 tx=0x7f21a8000bc0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21be7dd740 1 -- 172.21.15.69:0/4052430103 shutdown_connections 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21be7dd740 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55de42726150 0x55de4271bc20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21be7dd740 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55de42717f80 0x55de4277a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21be7dd740 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55de426e28e0 0x55de426d3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f219a000640 0 client.5260 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21be7dd740 1 --2- 172.21.15.69:0/4052430103 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55de426e1fc0 0x55de4273a400 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.296+0000 7f21be7dd740 1 -- 172.21.15.69:0/4052430103 >> 172.21.15.69:0/4052430103 conn(0x55de426715a0 msgr2=0x55de426a98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21be7dd740 1 -- 172.21.15.69:0/4052430103 shutdown_connections 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21be7dd740 1 -- 172.21.15.69:0/4052430103 wait complete. 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21be7dd740 20 client.5260 trim_cache size 0 max 16384 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "3e81d6bb-7df2-43e1-9882-7e7129c93370": { 2024-02-21T07:43:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2024-02-21T07:43:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "3e81d6bb-7df2-43e1-9882-7e7129c93370", 2024-02-21T07:43:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2024-02-21T07:43:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:43:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:43:07.307 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:43:07.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21bbc00640 1 -- 172.21.15.69:0/1254925252 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f219409f130 msgr2=0x7f21940a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21bbc00640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f219409f130 0x7f21940a15f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f21a8000f60 tx=0x7f21a8007cf0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21bbc00640 1 -- 172.21.15.69:0/1254925252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b4186010 msgr2=0x7f21b421e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21bbc00640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b4186010 0x7f21b421e980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f21a002b880 tx=0x7f21a00046c0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21bbc00640 1 -- 172.21.15.69:0/1254925252 shutdown_connections 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21bbc00640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f219409f130 0x7f21940a15f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21bbc00640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21b41863f0 0x7f21b421eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21bbc00640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f21b4186010 0x7f21b421e980 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21bbc00640 1 --2- 172.21.15.69:0/1254925252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f21b406d550 0x7f21b416be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.297+0000 7f21bbc00640 1 -- 172.21.15.69:0/1254925252 >> 172.21.15.69:0/1254925252 conn(0x7f21b40f7230 msgr2=0x7f21b4183830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.298+0000 7f21bbc00640 1 -- 172.21.15.69:0/1254925252 shutdown_connections 2024-02-21T07:43:07.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:07.298+0000 7f21bbc00640 1 -- 172.21.15.69:0/1254925252 wait complete. 2024-02-21T07:43:07.319 INFO:tasks.cephfs.filesystem:scrub status for tag:3e81d6bb-7df2-43e1-9882-7e7129c93370 - {'path': '/', 'tag': '3e81d6bb-7df2-43e1-9882-7e7129c93370', 'options': 'recursive,force'} 2024-02-21T07:43:12.387 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:43:12.394 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:43:12.397 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:43:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.005+0000 7fe16e800640 1 Processor -- start 2024-02-21T07:43:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.005+0000 7fe16e800640 1 -- start start 2024-02-21T07:43:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.007+0000 7fe16e800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe168072b20 0x7fe168072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.007+0000 7fe16e800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe16818a4f0 0x7fe16818a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.007+0000 7fe16e800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe168071e00 con 0x7fe168072740 2024-02-21T07:43:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.007+0000 7fe16e800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe168189950 con 0x7fe168072b20 2024-02-21T07:43:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.007+0000 7fe16e800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16818a060 con 0x7fe16818a4f0 2024-02-21T07:43:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.008+0000 7fe167400640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe168072740 0x7fe168070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:57086/0 (socket says 172.21.15.69:57086) 2024-02-21T07:43:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.008+0000 7fe167400640 1 -- 172.21.15.69:0/1375808824 learned_addr learned my addr 172.21.15.69:0/1375808824 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.008+0000 7fe15ea00640 1 --2- 172.21.15.69:0/1375808824 >> v2:172.21.15.69:3300/0 conn(0x7fe168072b20 0x7fe168072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.008+0000 7fe167e00640 1 --2- 172.21.15.69:0/1375808824 >> v2:172.21.15.174:3300/0 conn(0x7fe16818a4f0 0x7fe16818a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.008+0000 7fe166a00640 1 -- 172.21.15.69:0/1375808824 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480312182 0 0) 0x7fe158001490 con 0x7fe168072740 2024-02-21T07:43:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.008+0000 7fe166a00640 1 -- 172.21.15.69:0/1375808824 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe14c003520 con 0x7fe168072740 2024-02-21T07:43:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.008+0000 7fe15ea00640 1 -- 172.21.15.69:0/1375808824 >> v2:172.21.15.174:3300/0 conn(0x7fe16818a4f0 msgr2=0x7fe16818a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.008+0000 7fe15ea00640 1 --2- 172.21.15.69:0/1375808824 >> v2:172.21.15.174:3300/0 conn(0x7fe16818a4f0 0x7fe16818a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.008+0000 7fe15ea00640 1 -- 172.21.15.69:0/1375808824 >> v1:172.21.15.184:6789/0 conn(0x7fe168072740 legacy=0x7fe168070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.008+0000 7fe15ea00640 1 -- 172.21.15.69:0/1375808824 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168071280 con 0x7fe168072b20 2024-02-21T07:43:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.010+0000 7fe15ea00640 1 --2- 172.21.15.69:0/1375808824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe168072b20 0x7fe168072f80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe16808fb40 tx=0x7fe15002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc55a79ce58b2c78 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.010+0000 7fe166a00640 1 -- 172.21.15.69:0/1375808824 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15002e070 con 0x7fe168072b20 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.010+0000 7fe166a00640 1 -- 172.21.15.69:0/1375808824 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1500315a0 con 0x7fe168072b20 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.010+0000 7fe166a00640 1 -- 172.21.15.69:0/1375808824 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150031930 con 0x7fe168072b20 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.010+0000 7fe16e800640 1 -- 172.21.15.69:0/1375808824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe168072b20 msgr2=0x7fe168072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.010+0000 7fe16e800640 1 --2- 172.21.15.69:0/1375808824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe168072b20 0x7fe168072f80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe16808fb40 tx=0x7fe15002b840 comp rx=0 tx=0).stop 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.011+0000 7fe16e800640 1 -- 172.21.15.69:0/1375808824 shutdown_connections 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.011+0000 7fe16e800640 1 --2- 172.21.15.69:0/1375808824 >> v2:172.21.15.174:3300/0 conn(0x7fe16818a4f0 0x7fe16818a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.011+0000 7fe16e800640 1 --2- 172.21.15.69:0/1375808824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe168072b20 0x7fe168072f80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.011+0000 7fe16e800640 1 -- 172.21.15.69:0/1375808824 >> 172.21.15.69:0/1375808824 conn(0x7fe1680f8990 msgr2=0x7fe1680f8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.011+0000 7fe16e800640 1 -- 172.21.15.69:0/1375808824 shutdown_connections 2024-02-21T07:43:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.011+0000 7fe16e800640 1 -- 172.21.15.69:0/1375808824 wait complete. 2024-02-21T07:43:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.013+0000 7fe16e800640 1 Processor -- start 2024-02-21T07:43:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.013+0000 7fe16e800640 1 -- start start 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe16e800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe168072740 0x7fe16817f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe16e800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe168072b20 0x7fe168176340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe16e800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe16818a4f0 0x7fe1680f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe16e800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680f7140 con 0x7fe168072b20 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe16e800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16817c4f0 con 0x7fe168072740 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe16e800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16817bf30 con 0x7fe16818a4f0 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe15ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe168072b20 0x7fe168176340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe167e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe16818a4f0 0x7fe1680f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe167e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe16818a4f0 0x7fe1680f75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:45238/0 (socket says 172.21.15.69:45238) 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe167e00640 1 -- 172.21.15.69:0/2632984867 learned_addr learned my addr 172.21.15.69:0/2632984867 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.015+0000 7fe167400640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe168072740 0x7fe16817f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.016+0000 7fe167e00640 1 -- 172.21.15.69:0/2632984867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe168072740 msgr2=0x7fe16817f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.016+0000 7fe167e00640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe168072740 0x7fe16817f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.016+0000 7fe167e00640 1 -- 172.21.15.69:0/2632984867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe168072b20 msgr2=0x7fe168176340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.016+0000 7fe167e00640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe168072b20 0x7fe168176340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.016+0000 7fe167e00640 1 -- 172.21.15.69:0/2632984867 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009400 con 0x7fe16818a4f0 2024-02-21T07:43:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.016+0000 7fe167e00640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe16818a4f0 0x7fe1680f75d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe16000e960 tx=0x7fe16000ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.016+0000 7fe15fe00640 1 -- 172.21.15.69:0/2632984867 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16000c980 con 0x7fe16818a4f0 2024-02-21T07:43:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.017+0000 7fe15fe00640 1 -- 172.21.15.69:0/2632984867 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16000cae0 con 0x7fe16818a4f0 2024-02-21T07:43:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.017+0000 7fe15fe00640 1 -- 172.21.15.69:0/2632984867 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16000ce90 con 0x7fe16818a4f0 2024-02-21T07:43:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.017+0000 7fe16e800640 1 -- 172.21.15.69:0/2632984867 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16817c210 con 0x7fe16818a4f0 2024-02-21T07:43:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.017+0000 7fe16e800640 1 -- 172.21.15.69:0/2632984867 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1680f6dd0 con 0x7fe16818a4f0 2024-02-21T07:43:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.020+0000 7fe15fe00640 1 -- 172.21.15.69:0/2632984867 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe160013470 con 0x7fe16818a4f0 2024-02-21T07:43:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.021+0000 7fe15fe00640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe14409f130 0x7fe1440a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.022+0000 7fe15fe00640 1 -- 172.21.15.69:0/2632984867 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe1600ca0c0 con 0x7fe16818a4f0 2024-02-21T07:43:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.022+0000 7fe167400640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe14409f130 0x7fe1440a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.023+0000 7fe167400640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe14409f130 0x7fe1440a15f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe158005c00 tx=0x7fe158009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.023+0000 7fe1715c4740 1 Processor -- start 2024-02-21T07:43:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.023+0000 7fe1715c4740 1 -- start start 2024-02-21T07:43:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d98070 0x557255d57440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255dcc4d0 0x557255d5ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255d5cf90 0x557255d98450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe1715c4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255d18620 con 0x557255d98070 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe1715c4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255cca8c0 con 0x557255d5cf90 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe1715c4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255cc7df0 con 0x557255dcc4d0 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe15ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255dcc4d0 0x557255d5ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe167400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d98070 0x557255d57440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe15ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255dcc4d0 0x557255d5ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:45244/0 (socket says 172.21.15.69:45244) 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe15ea00640 1 -- 172.21.15.69:0/522347677 learned_addr learned my addr 172.21.15.69:0/522347677 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe167e00640 1 --2- 172.21.15.69:0/522347677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255d5cf90 0x557255d98450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe15ea00640 1 -- 172.21.15.69:0/522347677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255d5cf90 msgr2=0x557255d98450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe15ea00640 1 --2- 172.21.15.69:0/522347677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255d5cf90 0x557255d98450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe15ea00640 1 -- 172.21.15.69:0/522347677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d98070 msgr2=0x557255d57440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe15ea00640 1 --2- 172.21.15.69:0/522347677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d98070 0x557255d57440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe15ea00640 1 -- 172.21.15.69:0/522347677 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557255c44b00 con 0x557255dcc4d0 2024-02-21T07:43:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.025+0000 7fe167e00640 1 --2- 172.21.15.69:0/522347677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255d5cf90 0x557255d98450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.026+0000 7fe15ea00640 1 --2- 172.21.15.69:0/522347677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255dcc4d0 0x557255d5ca50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe15002be50 tx=0x7fe150008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9c5601053395414 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.026+0000 7fe157e00640 1 -- 172.21.15.69:0/522347677 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150031a50 con 0x557255dcc4d0 2024-02-21T07:43:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.026+0000 7fe157e00640 1 -- 172.21.15.69:0/522347677 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150031bb0 con 0x557255dcc4d0 2024-02-21T07:43:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.026+0000 7fe157e00640 1 -- 172.21.15.69:0/522347677 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150046480 con 0x557255dcc4d0 2024-02-21T07:43:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.027+0000 7fe1715c4740 1 -- 172.21.15.69:0/522347677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255dcc4d0 msgr2=0x557255d5ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.027+0000 7fe1715c4740 1 --2- 172.21.15.69:0/522347677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255dcc4d0 0x557255d5ca50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe15002be50 tx=0x7fe150008030 comp rx=0 tx=0).stop 2024-02-21T07:43:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.027+0000 7fe1715c4740 1 -- 172.21.15.69:0/522347677 shutdown_connections 2024-02-21T07:43:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.027+0000 7fe1715c4740 1 --2- 172.21.15.69:0/522347677 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255d5cf90 0x557255d98450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.027+0000 7fe1715c4740 1 --2- 172.21.15.69:0/522347677 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255dcc4d0 0x557255d5ca50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.027+0000 7fe1715c4740 1 --2- 172.21.15.69:0/522347677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d98070 0x557255d57440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.027+0000 7fe1715c4740 1 -- 172.21.15.69:0/522347677 >> 172.21.15.69:0/522347677 conn(0x557255d244b0 msgr2=0x557255d5bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.027+0000 7fe1715c4740 1 -- 172.21.15.69:0/522347677 shutdown_connections 2024-02-21T07:43:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.027+0000 7fe1715c4740 1 -- 172.21.15.69:0/522347677 wait complete. 2024-02-21T07:43:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.028+0000 7fe1715c4740 1 -- start start 2024-02-21T07:43:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.028+0000 7fe1715c4740 1 Processor -- start 2024-02-21T07:43:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d91360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d8d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255dc1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe1715c4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255cc35d0 con 0x557255d5cf90 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe1715c4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255c68b50 con 0x557255dcc4d0 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe1715c4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255c687f0 con 0x557255d98070 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe1715c4740 10 client.0 _ll_register_callbacks cb 0x557255c7c550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe167400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d91360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe167e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255dc1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe167400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d91360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51248/0 (socket says 172.21.15.69:51248) 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe167400640 1 -- 172.21.15.69:0/1096496958 learned_addr learned my addr 172.21.15.69:0/1096496958 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe15ea00640 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d8d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe167e00640 1 -- 172.21.15.69:0/1096496958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 msgr2=0x557255d8d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe167e00640 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d8d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe167e00640 1 -- 172.21.15.69:0/1096496958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 msgr2=0x557255d91360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe167e00640 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d91360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe167e00640 1 -- 172.21.15.69:0/1096496958 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe168071280 con 0x557255dcc4d0 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.030+0000 7fe167400640 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d91360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.031+0000 7fe167e00640 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255dc1310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe1600c79f0 tx=0x7fe16009bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cf850ac31115fcc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.031+0000 7fe154c00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.031+0000 7fe154c00640 1 -- 172.21.15.69:0/1096496958 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160097050 con 0x557255dcc4d0 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.031+0000 7fe1715c4740 1 -- 172.21.15.69:0/1096496958 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557255c95cd0 con 0x557255dcc4d0 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.031+0000 7fe154c00640 1 -- 172.21.15.69:0/1096496958 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe1600971b0 con 0x557255dcc4d0 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.031+0000 7fe154c00640 1 -- 172.21.15.69:0/1096496958 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe160097370 con 0x557255dcc4d0 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.031+0000 7fe1715c4740 10 client.5272 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.031+0000 7fe1715c4740 1 -- 172.21.15.69:0/1096496958 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x557255cc1c50 con 0x557255dcc4d0 2024-02-21T07:43:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.031+0000 7fe154c00640 1 -- 172.21.15.69:0/1096496958 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1600c5080 con 0x557255dcc4d0 2024-02-21T07:43:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.032+0000 7fe154c00640 1 -- 172.21.15.69:0/1096496958 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe160011070 con 0x557255dcc4d0 2024-02-21T07:43:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.032+0000 7fe1715c4740 10 client.5272 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.032+0000 7fe1715c4740 10 client.5272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.032+0000 7fe1715c4740 20 client.5272 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.032+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x557255d8cfb0 0x557255dcd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.032+0000 7fe1715c4740 4 client.5272 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.032+0000 7fe1715c4740 1 -- 172.21.15.69:0/1096496958 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557255cb9ce0 con 0x557255d8cfb0 2024-02-21T07:43:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.032+0000 7fe167400640 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x557255d8cfb0 0x557255dcd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.033+0000 7fe167400640 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x557255d8cfb0 0x557255dcd140 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a08a66a53a8acc8f server_cookie=f09d0e83ebd7871a in_seq=0 out_seq=0 2024-02-21T07:43:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.033+0000 7fe154c00640 10 client.5272 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.033+0000 7fe154c00640 1 -- 172.21.15.69:0/1096496958 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557255cb9ce0 con 0x557255d8cfb0 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.033+0000 7fe154c00640 10 client.5272 handle_command_reply: tid=0 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.033+0000 7fe1715c4740 1 client.5272 shutdown 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 1 -- 172.21.15.69:0/1096496958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 msgr2=0x557255dc1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255dc1310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe1600c79f0 tx=0x7fe16009bde0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 1 -- 172.21.15.69:0/1096496958 shutdown_connections 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x557255d8cfb0 0x557255dcd140 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255dc1310 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d8d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1096496958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d91360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe154c00640 0 client.5272 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 1 -- 172.21.15.69:0/1096496958 >> 172.21.15.69:0/1096496958 conn(0x557255d244b0 msgr2=0x557255dcc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 1 -- 172.21.15.69:0/1096496958 shutdown_connections 2024-02-21T07:43:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 1 -- 172.21.15.69:0/1096496958 wait complete. 2024-02-21T07:43:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.034+0000 7fe1715c4740 20 client.5272 trim_cache size 0 max 16384 2024-02-21T07:43:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.050+0000 7fe1715c4740 1 Processor -- start 2024-02-21T07:43:20.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.050+0000 7fe1715c4740 1 -- start start 2024-02-21T07:43:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255db3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d9da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255d52bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe1715c4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255a0be60 con 0x557255d5cf90 2024-02-21T07:43:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe1715c4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255dcbd00 con 0x557255dcc4d0 2024-02-21T07:43:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe1715c4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255d626e0 con 0x557255d98070 2024-02-21T07:43:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe167400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255db3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe167400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255db3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51262/0 (socket says 172.21.15.69:51262) 2024-02-21T07:43:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe167400640 1 -- 172.21.15.69:0/3606506791 learned_addr learned my addr 172.21.15.69:0/3606506791 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe167e00640 1 --2- 172.21.15.69:0/3606506791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255d52bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.051+0000 7fe15ea00640 1 --2- 172.21.15.69:0/3606506791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d9da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.052+0000 7fe167400640 1 -- 172.21.15.69:0/3606506791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 msgr2=0x557255d9da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.052+0000 7fe167400640 1 --2- 172.21.15.69:0/3606506791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d9da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.052+0000 7fe167400640 1 -- 172.21.15.69:0/3606506791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 msgr2=0x557255d52bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.052+0000 7fe167400640 1 --2- 172.21.15.69:0/3606506791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255d52bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.052+0000 7fe167400640 1 -- 172.21.15.69:0/3606506791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557255c5e530 con 0x557255d5cf90 2024-02-21T07:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.052+0000 7fe167e00640 1 --2- 172.21.15.69:0/3606506791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255d52bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.052+0000 7fe167400640 1 --2- 172.21.15.69:0/3606506791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255db3d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe158002230 tx=0x7fe158012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8de6fcde39a1ab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.052+0000 7fe157400640 1 -- 172.21.15.69:0/3606506791 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158028070 con 0x557255d5cf90 2024-02-21T07:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.052+0000 7fe157400640 1 -- 172.21.15.69:0/3606506791 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe158014920 con 0x557255d5cf90 2024-02-21T07:43:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.052+0000 7fe157400640 1 -- 172.21.15.69:0/3606506791 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158014a90 con 0x557255d5cf90 2024-02-21T07:43:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.053+0000 7fe1715c4740 1 -- 172.21.15.69:0/3606506791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 msgr2=0x557255db3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.053+0000 7fe1715c4740 1 --2- 172.21.15.69:0/3606506791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255db3d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe158002230 tx=0x7fe158012000 comp rx=0 tx=0).stop 2024-02-21T07:43:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.053+0000 7fe1715c4740 1 -- 172.21.15.69:0/3606506791 shutdown_connections 2024-02-21T07:43:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.053+0000 7fe1715c4740 1 --2- 172.21.15.69:0/3606506791 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255d52bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.053+0000 7fe1715c4740 1 --2- 172.21.15.69:0/3606506791 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d9da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.053+0000 7fe1715c4740 1 --2- 172.21.15.69:0/3606506791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255db3d30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.053+0000 7fe1715c4740 1 -- 172.21.15.69:0/3606506791 >> 172.21.15.69:0/3606506791 conn(0x557255d244b0 msgr2=0x557255d5bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.053+0000 7fe1715c4740 1 -- 172.21.15.69:0/3606506791 shutdown_connections 2024-02-21T07:43:20.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.053+0000 7fe1715c4740 1 -- 172.21.15.69:0/3606506791 wait complete. 2024-02-21T07:43:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.054+0000 7fe1715c4740 1 -- start start 2024-02-21T07:43:20.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.054+0000 7fe1715c4740 1 Processor -- start 2024-02-21T07:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d8d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d9b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe1715c4740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255e2d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe1715c4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255d94920 con 0x557255d5cf90 2024-02-21T07:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe1715c4740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255d8dab0 con 0x557255dcc4d0 2024-02-21T07:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe1715c4740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557255d9ba60 con 0x557255d98070 2024-02-21T07:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe1715c4740 10 client.0 _ll_register_callbacks cb 0x7fe160009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe167400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d8d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe167400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d8d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51272/0 (socket says 172.21.15.69:51272) 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe167400640 1 -- 172.21.15.69:0/1171053749 learned_addr learned my addr 172.21.15.69:0/1171053749 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe15ea00640 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d9b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe167e00640 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255e2d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe167400640 1 -- 172.21.15.69:0/1171053749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 msgr2=0x557255d9b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe167400640 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d9b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe167400640 1 -- 172.21.15.69:0/1171053749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 msgr2=0x557255e2d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe167400640 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255e2d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe167400640 1 -- 172.21.15.69:0/1171053749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557255cc1c50 con 0x557255d5cf90 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe15ea00640 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d9b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.056+0000 7fe167e00640 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255e2d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.057+0000 7fe167400640 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d8d570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe158002230 tx=0x7fe158000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cf9c967f259743 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.057+0000 7fe154c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.057+0000 7fe154c00640 1 -- 172.21.15.69:0/1171053749 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158004d60 con 0x557255d5cf90 2024-02-21T07:43:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.057+0000 7fe1715c4740 1 -- 172.21.15.69:0/1171053749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557255ce8d30 con 0x557255d5cf90 2024-02-21T07:43:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.057+0000 7fe154c00640 1 -- 172.21.15.69:0/1171053749 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe15801c040 con 0x557255d5cf90 2024-02-21T07:43:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.057+0000 7fe154c00640 1 -- 172.21.15.69:0/1171053749 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1580160d0 con 0x557255d5cf90 2024-02-21T07:43:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.057+0000 7fe1715c4740 10 client.5085 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.057+0000 7fe1715c4740 1 -- 172.21.15.69:0/1171053749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x7fe14c003520 con 0x557255d5cf90 2024-02-21T07:43:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.058+0000 7fe154c00640 1 -- 172.21.15.69:0/1171053749 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557255ce8d30 con 0x557255d5cf90 2024-02-21T07:43:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.058+0000 7fe154c00640 1 -- 172.21.15.69:0/1171053749 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe158012070 con 0x557255d5cf90 2024-02-21T07:43:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.058+0000 7fe1715c4740 10 client.5085 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.058+0000 7fe1715c4740 10 client.5085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.058+0000 7fe1715c4740 20 client.5085 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.058+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x557255d914c0 0x557255dccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.058+0000 7fe1715c4740 4 client.5085 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:43:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.058+0000 7fe1715c4740 1 -- 172.21.15.69:0/1171053749 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5572559c3600 con 0x557255d914c0 2024-02-21T07:43:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.058+0000 7fe15ea00640 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x557255d914c0 0x557255dccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.059+0000 7fe15ea00640 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x557255d914c0 0x557255dccdb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d64af43bcca8b9a5 server_cookie=c3a8111b0f591bfd in_seq=0 out_seq=0 2024-02-21T07:43:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.059+0000 7fe154c00640 10 client.5085 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.077+0000 7fe154c00640 1 -- 172.21.15.69:0/1171053749 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5572559c3600 con 0x557255d914c0 2024-02-21T07:43:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.077+0000 7fe154c00640 10 client.5085 handle_command_reply: tid=0 2024-02-21T07:43:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.077+0000 7fe1715c4740 1 client.5085 shutdown 2024-02-21T07:43:20.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe1715c4740 1 -- 172.21.15.69:0/1171053749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 msgr2=0x557255d8d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d8d570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe158002230 tx=0x7fe158000f40 comp rx=0 tx=0).stop 2024-02-21T07:43:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe1715c4740 1 -- 172.21.15.69:0/1171053749 shutdown_connections 2024-02-21T07:43:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x557255d914c0 0x557255dccdb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557255dcc4d0 0x557255e2d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557255d98070 0x557255d9b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe1715c4740 1 --2- 172.21.15.69:0/1171053749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557255d5cf90 0x557255d8d570 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe154c00640 0 client.5085 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:20.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe1715c4740 1 -- 172.21.15.69:0/1171053749 >> 172.21.15.69:0/1171053749 conn(0x557255d244b0 msgr2=0x557255dcdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe1715c4740 1 -- 172.21.15.69:0/1171053749 shutdown_connections 2024-02-21T07:43:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.078+0000 7fe1715c4740 1 -- 172.21.15.69:0/1171053749 wait complete. 2024-02-21T07:43:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe1715c4740 20 client.5085 trim_cache size 0 max 16384 2024-02-21T07:43:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-02-21T07:43:20.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-02-21T07:43:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-02-21T07:43:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-02-21T07:43:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe16e800640 1 -- 172.21.15.69:0/2632984867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe14409f130 msgr2=0x7fe1440a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:20.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe16e800640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe14409f130 0x7fe1440a15f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe158005c00 tx=0x7fe158009040 comp rx=0 tx=0).stop 2024-02-21T07:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe16e800640 1 -- 172.21.15.69:0/2632984867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe16818a4f0 msgr2=0x7fe1680f75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe16e800640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe16818a4f0 0x7fe1680f75d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe16000e960 tx=0x7fe16000ee20 comp rx=0 tx=0).stop 2024-02-21T07:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe16e800640 1 -- 172.21.15.69:0/2632984867 shutdown_connections 2024-02-21T07:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe16e800640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe14409f130 0x7fe1440a15f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe16e800640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe16818a4f0 0x7fe1680f75d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe16e800640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe168072b20 0x7fe168176340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe16e800640 1 --2- 172.21.15.69:0/2632984867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe168072740 0x7fe16817f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.079+0000 7fe16e800640 1 -- 172.21.15.69:0/2632984867 >> 172.21.15.69:0/2632984867 conn(0x7fe1680f8990 msgr2=0x7fe1680faf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.080+0000 7fe16e800640 1 -- 172.21.15.69:0/2632984867 shutdown_connections 2024-02-21T07:43:20.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:20.080+0000 7fe16e800640 1 -- 172.21.15.69:0/2632984867 wait complete. 2024-02-21T07:43:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.224+0000 7f77ebe00640 1 Processor -- start 2024-02-21T07:43:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.224+0000 7f77ebe00640 1 -- start start 2024-02-21T07:43:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.227+0000 7f77ebe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f77ec0fb210 0x7f77ec0cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.227+0000 7f77ebe00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ec0fb670 con 0x7f77ec0cfc90 2024-02-21T07:43:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.227+0000 7f77ebe00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ec0fb900 con 0x7f77ec15a540 2024-02-21T07:43:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.227+0000 7f77ebe00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ec0ce990 con 0x7f77ec0fb210 2024-02-21T07:43:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.227+0000 7f77eb400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f77ec0cfc90 0x7f77ec1604d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:48578/0 (socket says 172.21.15.69:48578) 2024-02-21T07:43:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.227+0000 7f77eb400640 1 -- 172.21.15.69:0/2283751739 learned_addr learned my addr 172.21.15.69:0/2283751739 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.227+0000 7f77ea000640 1 --2- 172.21.15.69:0/2283751739 >> v2:172.21.15.69:3300/0 conn(0x7f77ec0fb210 0x7f77ec0cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.228+0000 7f77ea000640 1 -- 172.21.15.69:0/2283751739 >> v1:172.21.15.184:6789/0 conn(0x7f77ec15a540 legacy=0x7f77ec0fab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.228+0000 7f77ea000640 1 -- 172.21.15.69:0/2283751739 >> v1:172.21.15.69:6789/0 conn(0x7f77ec0cfc90 legacy=0x7f77ec1604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.228+0000 7f77e9600640 1 -- 172.21.15.69:0/2283751739 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818184101 0 0) 0x7f77ec0fb900 con 0x7f77ec15a540 2024-02-21T07:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.228+0000 7f77ea000640 1 -- 172.21.15.69:0/2283751739 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec0cec70 con 0x7f77ec0fb210 2024-02-21T07:43:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.229+0000 7f77ea000640 1 --2- 172.21.15.69:0/2283751739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 0x7f77ec0cf750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77d80097a0 tx=0x7f77d802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4c892b6c545d96 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.229+0000 7f77e9600640 1 -- 172.21.15.69:0/2283751739 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8030710 con 0x7f77ec0fb210 2024-02-21T07:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.229+0000 7f77e9600640 1 -- 172.21.15.69:0/2283751739 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d802e050 con 0x7f77ec0fb210 2024-02-21T07:43:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.229+0000 7f77e9600640 1 -- 172.21.15.69:0/2283751739 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8030a90 con 0x7f77ec0fb210 2024-02-21T07:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.230+0000 7f77ebe00640 1 -- 172.21.15.69:0/2283751739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 msgr2=0x7f77ec0cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.230+0000 7f77ebe00640 1 --2- 172.21.15.69:0/2283751739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 0x7f77ec0cf750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77d80097a0 tx=0x7f77d802b790 comp rx=0 tx=0).stop 2024-02-21T07:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.230+0000 7f77ebe00640 1 -- 172.21.15.69:0/2283751739 shutdown_connections 2024-02-21T07:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.230+0000 7f77ebe00640 1 --2- 172.21.15.69:0/2283751739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 0x7f77ec0cf750 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.230+0000 7f77ebe00640 1 -- 172.21.15.69:0/2283751739 >> 172.21.15.69:0/2283751739 conn(0x7f77ec0619b0 msgr2=0x7f77ec061dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.230+0000 7f77ebe00640 1 -- 172.21.15.69:0/2283751739 shutdown_connections 2024-02-21T07:43:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.230+0000 7f77ebe00640 1 -- 172.21.15.69:0/2283751739 wait complete. 2024-02-21T07:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.232+0000 7f77ebe00640 1 Processor -- start 2024-02-21T07:43:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.232+0000 7f77ebe00640 1 -- start start 2024-02-21T07:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.233+0000 7f77ebe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77ec0cfc90 0x7f77ec1859e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.233+0000 7f77ebe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 0x7f77ec145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.233+0000 7f77ebe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec15a540 0x7f77ec2211d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.233+0000 7f77ebe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec21fe50 con 0x7f77ec0fb210 2024-02-21T07:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.233+0000 7f77ebe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec220130 con 0x7f77ec15a540 2024-02-21T07:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.233+0000 7f77ebe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec220410 con 0x7f77ec0cfc90 2024-02-21T07:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.233+0000 7f77ea000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 0x7f77ec145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.233+0000 7f77ea000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 0x7f77ec145d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58538/0 (socket says 172.21.15.69:58538) 2024-02-21T07:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.233+0000 7f77ea000640 1 -- 172.21.15.69:0/9683456 learned_addr learned my addr 172.21.15.69:0/9683456 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.234+0000 7f77eaa00640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77ec0cfc90 0x7f77ec1859e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.234+0000 7f77eb400640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec15a540 0x7f77ec2211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.234+0000 7f77ea000640 1 -- 172.21.15.69:0/9683456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77ec0cfc90 msgr2=0x7f77ec1859e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.234+0000 7f77ea000640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77ec0cfc90 0x7f77ec1859e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.234+0000 7f77ea000640 1 -- 172.21.15.69:0/9683456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec15a540 msgr2=0x7f77ec2211d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.234+0000 7f77ea000640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec15a540 0x7f77ec2211d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.234+0000 7f77ea000640 1 -- 172.21.15.69:0/9683456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009400 con 0x7f77ec0fb210 2024-02-21T07:43:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.234+0000 7f77ea000640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 0x7f77ec145d40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f77d80097a0 tx=0x7f77d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.235+0000 7f77e2a00640 1 -- 172.21.15.69:0/9683456 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8004230 con 0x7f77ec0fb210 2024-02-21T07:43:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.235+0000 7f77e2a00640 1 -- 172.21.15.69:0/9683456 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d80043b0 con 0x7f77ec0fb210 2024-02-21T07:43:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.235+0000 7f77e2a00640 1 -- 172.21.15.69:0/9683456 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8004520 con 0x7f77ec0fb210 2024-02-21T07:43:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.235+0000 7f77ebe00640 1 -- 172.21.15.69:0/9683456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ec2206f0 con 0x7f77ec0fb210 2024-02-21T07:43:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.235+0000 7f77ebe00640 1 -- 172.21.15.69:0/9683456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ec220cb0 con 0x7f77ec0fb210 2024-02-21T07:43:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.238+0000 7f77e2a00640 1 -- 172.21.15.69:0/9683456 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f77d8039050 con 0x7f77ec0fb210 2024-02-21T07:43:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.239+0000 7f77e2a00640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f77cc09f130 0x7f77cc0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.239+0000 7f77e2a00640 1 -- 172.21.15.69:0/9683456 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f77d80eb6f0 con 0x7f77ec0fb210 2024-02-21T07:43:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.239+0000 7f77eaa00640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f77cc09f130 0x7f77cc0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.240+0000 7f77eaa00640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f77cc09f130 0x7f77cc0a15f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f77dc000f60 tx=0x7f77dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.241+0000 7f77f45d0740 1 Processor -- start 2024-02-21T07:43:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.241+0000 7f77f45d0740 1 -- start start 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.243+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335430f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.243+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543846e0 0x563354314c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.243+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543151a0 0x563354350660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77f45d0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633542d0620 con 0x5633543151a0 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77f45d0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633542828c0 con 0x5633543846e0 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77f45d0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56335427fdf0 con 0x563354350280 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335430f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335430f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:45942/0 (socket says 172.21.15.69:45942) 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77eaa00640 1 -- 172.21.15.69:0/2295931119 learned_addr learned my addr 172.21.15.69:0/2295931119 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77ea000640 1 --2- 172.21.15.69:0/2295931119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543846e0 0x563354314c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77eb400640 1 --2- 172.21.15.69:0/2295931119 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543151a0 0x563354350660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77eaa00640 1 -- 172.21.15.69:0/2295931119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543846e0 msgr2=0x563354314c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77eaa00640 1 --2- 172.21.15.69:0/2295931119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543846e0 0x563354314c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77eaa00640 1 -- 172.21.15.69:0/2295931119 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543151a0 msgr2=0x563354350660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77eaa00640 1 --2- 172.21.15.69:0/2295931119 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543151a0 0x563354350660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77eaa00640 1 -- 172.21.15.69:0/2295931119 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633541fcb00 con 0x563354350280 2024-02-21T07:43:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.244+0000 7f77eaa00640 1 --2- 172.21.15.69:0/2295931119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335430f650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00fb80 tx=0x7f77dc012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2becf92af7a020 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.245+0000 7f77d7400640 1 -- 172.21.15.69:0/2295931119 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc014be0 con 0x563354350280 2024-02-21T07:43:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.245+0000 7f77d7400640 1 -- 172.21.15.69:0/2295931119 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc014d40 con 0x563354350280 2024-02-21T07:43:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.245+0000 7f77d7400640 1 -- 172.21.15.69:0/2295931119 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc020610 con 0x563354350280 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.246+0000 7f77f45d0740 1 -- 172.21.15.69:0/2295931119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 msgr2=0x56335430f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.246+0000 7f77f45d0740 1 --2- 172.21.15.69:0/2295931119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335430f650 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f77dc00fb80 tx=0x7f77dc012000 comp rx=0 tx=0).stop 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.246+0000 7f77f45d0740 1 -- 172.21.15.69:0/2295931119 shutdown_connections 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.246+0000 7f77f45d0740 1 --2- 172.21.15.69:0/2295931119 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543151a0 0x563354350660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.246+0000 7f77f45d0740 1 --2- 172.21.15.69:0/2295931119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543846e0 0x563354314c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.246+0000 7f77f45d0740 1 --2- 172.21.15.69:0/2295931119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335430f650 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.246+0000 7f77f45d0740 1 -- 172.21.15.69:0/2295931119 >> 172.21.15.69:0/2295931119 conn(0x5633542dc4b0 msgr2=0x563354313eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.246+0000 7f77f45d0740 1 -- 172.21.15.69:0/2295931119 shutdown_connections 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.246+0000 7f77f45d0740 1 -- 172.21.15.69:0/2295931119 wait complete. 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.247+0000 7f77f45d0740 1 -- start start 2024-02-21T07:43:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.247+0000 7f77f45d0740 1 Processor -- start 2024-02-21T07:43:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 0x5633543859a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563354350280 0x563354344ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543846e0 0x56335437a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77f45d0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56335427b5d0 con 0x563354350280 2024-02-21T07:43:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77f45d0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x563354220b50 con 0x5633543151a0 2024-02-21T07:43:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77f45d0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633542207f0 con 0x5633543846e0 2024-02-21T07:43:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77f45d0740 10 client.0 _ll_register_callbacks cb 0x563354234550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77ea000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563354350280 0x563354344ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 0x5633543859a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77ea000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563354350280 0x563354344ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58554/0 (socket says 172.21.15.69:58554) 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.248+0000 7f77ea000640 1 -- 172.21.15.69:0/3479698582 learned_addr learned my addr 172.21.15.69:0/3479698582 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77eb400640 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543846e0 0x56335437a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77ea000640 1 -- 172.21.15.69:0/3479698582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543846e0 msgr2=0x56335437a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77ea000640 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543846e0 0x56335437a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77ea000640 1 -- 172.21.15.69:0/3479698582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 msgr2=0x5633543859a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77ea000640 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 0x5633543859a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77ea000640 1 -- 172.21.15.69:0/3479698582 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77dc00f7d0 con 0x563354350280 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77eaa00640 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 0x5633543859a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77ea000640 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563354350280 0x563354344ea0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f77d80b8e80 tx=0x7f77d80bd2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63130d0ae32fd267 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77cbe00640 1 -- 172.21.15.69:0/3479698582 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d80e92b0 con 0x563354350280 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77cbe00640 1 -- 172.21.15.69:0/3479698582 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f77d80b85d0 con 0x563354350280 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.249+0000 7f77f45d0740 1 -- 172.21.15.69:0/3479698582 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56335424dcd0 con 0x563354350280 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77cbe00640 1 -- 172.21.15.69:0/3479698582 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77d80b8790 con 0x563354350280 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77f45d0740 10 client.5100 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77f45d0740 1 -- 172.21.15.69:0/3479698582 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x563354279c50 con 0x563354350280 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77cbe00640 1 -- 172.21.15.69:0/3479698582 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d80e6080 con 0x563354350280 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77cbe00640 1 -- 172.21.15.69:0/3479698582 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f77d80e2b30 con 0x563354350280 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77f45d0740 10 client.5100 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77f45d0740 10 client.5100 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77f45d0740 20 client.5100 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77f45d0740 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563354343d10 0x563354344110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77f45d0740 4 client.5100 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77f45d0740 1 -- 172.21.15.69:0/3479698582 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563354271ce0 con 0x563354343d10 2024-02-21T07:43:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.250+0000 7f77eaa00640 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563354343d10 0x563354344110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.251+0000 7f77cbe00640 10 client.5100 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.251+0000 7f77eaa00640 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563354343d10 0x563354344110 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bc517cd2228d11b server_cookie=d6aed37084bf1cb8 in_seq=0 out_seq=0 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77cbe00640 1 -- 172.21.15.69:0/3479698582 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563354271ce0 con 0x563354343d10 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77cbe00640 10 client.5100 handle_command_reply: tid=0 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 client.5100 shutdown 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 -- 172.21.15.69:0/3479698582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563354350280 msgr2=0x563354344ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563354350280 0x563354344ea0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f77d80b8e80 tx=0x7f77d80bd2e0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 -- 172.21.15.69:0/3479698582 shutdown_connections 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563354343d10 0x563354344110 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543846e0 0x56335437a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563354350280 0x563354344ea0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 --2- 172.21.15.69:0/3479698582 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 0x5633543859a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 -- 172.21.15.69:0/3479698582 >> 172.21.15.69:0/3479698582 conn(0x5633542dc4b0 msgr2=0x56335431b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77cbe00640 0 client.5100 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 -- 172.21.15.69:0/3479698582 shutdown_connections 2024-02-21T07:43:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 1 -- 172.21.15.69:0/3479698582 wait complete. 2024-02-21T07:43:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.252+0000 7f77f45d0740 20 client.5100 trim_cache size 0 max 16384 2024-02-21T07:43:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.267+0000 7f77f45d0740 1 Processor -- start 2024-02-21T07:43:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.267+0000 7f77f45d0740 1 -- start start 2024-02-21T07:43:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543151a0 0x563354384d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563354350280 0x5633543e4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 0x5633543e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.274 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77f45d0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563353fc3e60 con 0x5633543846e0 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77f45d0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x563354342ed0 con 0x563354350280 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77f45d0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56335434a620 con 0x5633543151a0 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77eb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 0x5633543e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77eb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 0x5633543e4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58566/0 (socket says 172.21.15.69:58566) 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77eb400640 1 -- 172.21.15.69:0/319690898 learned_addr learned my addr 172.21.15.69:0/319690898 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77eaa00640 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543151a0 0x563354384d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.268+0000 7f77ea000640 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563354350280 0x5633543e4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.269+0000 7f77eaa00640 1 -- 172.21.15.69:0/319690898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563354350280 msgr2=0x5633543e4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.269+0000 7f77eaa00640 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563354350280 0x5633543e4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.269+0000 7f77eaa00640 1 -- 172.21.15.69:0/319690898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 msgr2=0x5633543e4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.269+0000 7f77eaa00640 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 0x5633543e4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.269+0000 7f77eaa00640 1 -- 172.21.15.69:0/319690898 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563354216530 con 0x5633543151a0 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.269+0000 7f77eb400640 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 0x5633543e4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:33.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.269+0000 7f77ea000640 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563354350280 0x5633543e4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:33.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.269+0000 7f77eaa00640 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543151a0 0x563354384d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77dc022000 tx=0x7f77dc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=723b787c73da46e8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:33.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.269+0000 7f77d6a00640 1 -- 172.21.15.69:0/319690898 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc030070 con 0x5633543151a0 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.270+0000 7f77d6a00640 1 -- 172.21.15.69:0/319690898 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc033b00 con 0x5633543151a0 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.270+0000 7f77d6a00640 1 -- 172.21.15.69:0/319690898 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc0079c0 con 0x5633543151a0 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.270+0000 7f77f45d0740 1 -- 172.21.15.69:0/319690898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543151a0 msgr2=0x563354384d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.270+0000 7f77f45d0740 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543151a0 0x563354384d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77dc022000 tx=0x7f77dc014000 comp rx=0 tx=0).stop 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.270+0000 7f77f45d0740 1 -- 172.21.15.69:0/319690898 shutdown_connections 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.270+0000 7f77f45d0740 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 0x5633543e4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.270+0000 7f77f45d0740 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563354350280 0x5633543e4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.270+0000 7f77f45d0740 1 --2- 172.21.15.69:0/319690898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5633543151a0 0x563354384d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.270+0000 7f77f45d0740 1 -- 172.21.15.69:0/319690898 >> 172.21.15.69:0/319690898 conn(0x5633542dc4b0 msgr2=0x56335430ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.271+0000 7f77f45d0740 1 -- 172.21.15.69:0/319690898 shutdown_connections 2024-02-21T07:43:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.271+0000 7f77f45d0740 1 -- 172.21.15.69:0/319690898 wait complete. 2024-02-21T07:43:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.272+0000 7f77f45d0740 1 -- start start 2024-02-21T07:43:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.272+0000 7f77f45d0740 1 Processor -- start 2024-02-21T07:43:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 0x5633543131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335431b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77f45d0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 0x5633543e32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77f45d0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633543e3f60 con 0x5633543846e0 2024-02-21T07:43:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77f45d0740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x563354376930 con 0x5633543151a0 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77f45d0740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56335431b880 con 0x563354350280 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77f45d0740 10 client.0 _ll_register_callbacks cb 0x7f77dc017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77ea000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335431b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77eb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 0x5633543e32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77eaa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 0x5633543131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77ea000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335431b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:45968/0 (socket says 172.21.15.69:45968) 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.274+0000 7f77ea000640 1 -- 172.21.15.69:0/423301089 learned_addr learned my addr 172.21.15.69:0/423301089 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77ea000640 1 -- 172.21.15.69:0/423301089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 msgr2=0x5633543131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77ea000640 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 0x5633543131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77ea000640 1 -- 172.21.15.69:0/423301089 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 msgr2=0x5633543e32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77ea000640 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 0x5633543e32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77ea000640 1 -- 172.21.15.69:0/423301089 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e4001a20 con 0x563354350280 2024-02-21T07:43:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77ea000640 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335431b340 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77d802bda0 tx=0x7f77d802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ffebd3bba79e0d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:43:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77cbe00640 1 -- 172.21.15.69:0/423301089 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d80b8cc0 con 0x563354350280 2024-02-21T07:43:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77cbe00640 1 -- 172.21.15.69:0/423301089 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f77d80b9180 con 0x563354350280 2024-02-21T07:43:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77f45d0740 1 -- 172.21.15.69:0/423301089 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633542a0d30 con 0x563354350280 2024-02-21T07:43:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77cbe00640 1 -- 172.21.15.69:0/423301089 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77d80c1870 con 0x563354350280 2024-02-21T07:43:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77f45d0740 10 client.5258 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.275+0000 7f77f45d0740 1 -- 172.21.15.69:0/423301089 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5633541fcb00 con 0x563354350280 2024-02-21T07:43:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.276+0000 7f77cbe00640 1 -- 172.21.15.69:0/423301089 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633542a0d30 con 0x563354350280 2024-02-21T07:43:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.276+0000 7f77cbe00640 1 -- 172.21.15.69:0/423301089 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f77d80e2b30 con 0x563354350280 2024-02-21T07:43:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.276+0000 7f77f45d0740 10 client.5258 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.276+0000 7f77f45d0740 10 client.5258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.276+0000 7f77f45d0740 20 client.5258 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.276+0000 7f77f45d0740 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563354345000 0x5633543e3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.276+0000 7f77f45d0740 4 client.5258 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:43:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.276+0000 7f77f45d0740 1 -- 172.21.15.69:0/423301089 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563353f7b600 con 0x563354345000 2024-02-21T07:43:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.276+0000 7f77eaa00640 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563354345000 0x5633543e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.277+0000 7f77eaa00640 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563354345000 0x5633543e3800 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eee6e43bb58c32e3 server_cookie=cb79df05ae5da94b in_seq=0 out_seq=0 2024-02-21T07:43:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.277+0000 7f77cbe00640 10 client.5258 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77cbe00640 1 -- 172.21.15.69:0/423301089 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563353f7b600 con 0x563354345000 2024-02-21T07:43:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77cbe00640 10 client.5258 handle_command_reply: tid=0 2024-02-21T07:43:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 client.5258 shutdown 2024-02-21T07:43:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 -- 172.21.15.69:0/423301089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 msgr2=0x56335431b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335431b340 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77d802bda0 tx=0x7f77d802b790 comp rx=0 tx=0).stop 2024-02-21T07:43:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 -- 172.21.15.69:0/423301089 shutdown_connections 2024-02-21T07:43:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563354345000 0x5633543e3800 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633543846e0 0x5633543e32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563354350280 0x56335431b340 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 --2- 172.21.15.69:0/423301089 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5633543151a0 0x5633543131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77cbe00640 0 client.5258 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 -- 172.21.15.69:0/423301089 >> 172.21.15.69:0/423301089 conn(0x5633542dc4b0 msgr2=0x563354387ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 -- 172.21.15.69:0/423301089 shutdown_connections 2024-02-21T07:43:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.281+0000 7f77f45d0740 1 -- 172.21.15.69:0/423301089 wait complete. 2024-02-21T07:43:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77f45d0740 20 client.5258 trim_cache size 0 max 16384 2024-02-21T07:43:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-02-21T07:43:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-02-21T07:43:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-02-21T07:43:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77ebe00640 1 -- 172.21.15.69:0/9683456 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f77cc09f130 msgr2=0x7f77cc0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77ebe00640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f77cc09f130 0x7f77cc0a15f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f77dc000f60 tx=0x7f77dc009040 comp rx=0 tx=0).stop 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77ebe00640 1 -- 172.21.15.69:0/9683456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 msgr2=0x7f77ec145d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77ebe00640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 0x7f77ec145d40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f77d80097a0 tx=0x7f77d80046c0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77ebe00640 1 -- 172.21.15.69:0/9683456 shutdown_connections 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77ebe00640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f77cc09f130 0x7f77cc0a15f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77ebe00640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f77ec15a540 0x7f77ec2211d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77ebe00640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77ec0fb210 0x7f77ec145d40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77ebe00640 1 --2- 172.21.15.69:0/9683456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f77ec0cfc90 0x7f77ec1859e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.282+0000 7f77ebe00640 1 -- 172.21.15.69:0/9683456 >> 172.21.15.69:0/9683456 conn(0x7f77ec0619b0 msgr2=0x7f77ec157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.283+0000 7f77ebe00640 1 -- 172.21.15.69:0/9683456 shutdown_connections 2024-02-21T07:43:33.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:33.283+0000 7f77ebe00640 1 -- 172.21.15.69:0/9683456 wait complete. 2024-02-21T07:43:37.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:43:37.320 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:43:37.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.503+0000 7f0d65200640 1 Processor -- start 2024-02-21T07:43:37.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.504+0000 7f0d65200640 1 -- start start 2024-02-21T07:43:37.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.505+0000 7f0d65200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0d6018b3a0 0x7f0d600ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.505+0000 7f0d65200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6018a800 con 0x7f0d6017f2a0 2024-02-21T07:43:37.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.505+0000 7f0d65200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d600fde70 con 0x7f0d600fe870 2024-02-21T07:43:37.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.505+0000 7f0d65200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600ff160 con 0x7f0d6018b3a0 2024-02-21T07:43:37.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.506+0000 7f0d5ea00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0d600fe870 0x7f0d6018ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:40032/0 (socket says 172.21.15.69:40032) 2024-02-21T07:43:37.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.506+0000 7f0d5ea00640 1 -- 172.21.15.69:0/1631156025 learned_addr learned my addr 172.21.15.69:0/1631156025 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:37.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.506+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/1631156025 >> v2:172.21.15.174:3300/0 conn(0x7f0d6018b3a0 0x7f0d600ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.506+0000 7f0d5e000640 1 -- 172.21.15.69:0/1631156025 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968757833 0 0) 0x7f0d600fde70 con 0x7f0d600fe870 2024-02-21T07:43:37.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.506+0000 7f0d5e000640 1 -- 172.21.15.69:0/1631156025 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d44003520 con 0x7f0d600fe870 2024-02-21T07:43:37.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.506+0000 7f0d5fe00640 1 -- 172.21.15.69:0/1631156025 >> v1:172.21.15.184:6789/0 conn(0x7f0d600fe870 legacy=0x7f0d6018ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.506+0000 7f0d5fe00640 1 -- 172.21.15.69:0/1631156025 >> v1:172.21.15.69:6789/0 conn(0x7f0d6017f2a0 legacy=0x7f0d600fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.506+0000 7f0d5fe00640 1 -- 172.21.15.69:0/1631156025 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60189f10 con 0x7f0d6018b3a0 2024-02-21T07:43:37.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.507+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/1631156025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d6018b3a0 0x7f0d600ce9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009d90 tx=0x7f0d5802bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85bba26e2c5d9284 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:37.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.508+0000 7f0d5e000640 1 -- 172.21.15.69:0/1631156025 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5802ccf0 con 0x7f0d6018b3a0 2024-02-21T07:43:37.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.508+0000 7f0d5e000640 1 -- 172.21.15.69:0/1631156025 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5802ce50 con 0x7f0d6018b3a0 2024-02-21T07:43:37.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.509+0000 7f0d65200640 1 -- 172.21.15.69:0/1631156025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d6018b3a0 msgr2=0x7f0d600ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.509+0000 7f0d65200640 1 --2- 172.21.15.69:0/1631156025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d6018b3a0 0x7f0d600ce9c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009d90 tx=0x7f0d5802bf40 comp rx=0 tx=0).stop 2024-02-21T07:43:37.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.509+0000 7f0d65200640 1 -- 172.21.15.69:0/1631156025 shutdown_connections 2024-02-21T07:43:37.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.509+0000 7f0d65200640 1 --2- 172.21.15.69:0/1631156025 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d6018b3a0 0x7f0d600ce9c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.509+0000 7f0d65200640 1 -- 172.21.15.69:0/1631156025 >> 172.21.15.69:0/1631156025 conn(0x7f0d600d2b00 msgr2=0x7f0d600d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:37.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.509+0000 7f0d65200640 1 -- 172.21.15.69:0/1631156025 shutdown_connections 2024-02-21T07:43:37.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.509+0000 7f0d65200640 1 -- 172.21.15.69:0/1631156025 wait complete. 2024-02-21T07:43:37.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.511+0000 7f0d65200640 1 Processor -- start 2024-02-21T07:43:37.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.511+0000 7f0d65200640 1 -- start start 2024-02-21T07:43:37.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.512+0000 7f0d65200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d600fe870 0x7f0d60222770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.512+0000 7f0d65200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d6017f2a0 0x7f0d60169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.512+0000 7f0d65200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d6018b3a0 0x7f0d6017de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.512+0000 7f0d65200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6017da20 con 0x7f0d600fe870 2024-02-21T07:43:37.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.512+0000 7f0d65200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6017cb30 con 0x7f0d6018b3a0 2024-02-21T07:43:37.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.512+0000 7f0d65200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6017cda0 con 0x7f0d6017f2a0 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d600fe870 0x7f0d60222770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d6017f2a0 0x7f0d60169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d600fe870 0x7f0d60222770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58588/0 (socket says 172.21.15.69:58588) 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5f400640 1 -- 172.21.15.69:0/519734344 learned_addr learned my addr 172.21.15.69:0/519734344 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d6017f2a0 0x7f0d60169db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:45982/0 (socket says 172.21.15.69:45982) 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d6018b3a0 0x7f0d6017de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5ea00640 1 -- 172.21.15.69:0/519734344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d6018b3a0 msgr2=0x7f0d6017de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d6018b3a0 0x7f0d6017de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5ea00640 1 -- 172.21.15.69:0/519734344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d600fe870 msgr2=0x7f0d60222770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d600fe870 0x7f0d60222770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5ea00640 1 -- 172.21.15.69:0/519734344 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58009a70 con 0x7f0d6017f2a0 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.513+0000 7f0d5f400640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d600fe870 0x7f0d60222770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:37.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.514+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d6017f2a0 0x7f0d60169db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c400 tx=0x7f0d4c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:37.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.514+0000 7f0d57400640 1 -- 172.21.15.69:0/519734344 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c005ce0 con 0x7f0d6017f2a0 2024-02-21T07:43:37.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.514+0000 7f0d57400640 1 -- 172.21.15.69:0/519734344 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c005e40 con 0x7f0d6017f2a0 2024-02-21T07:43:37.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.514+0000 7f0d57400640 1 -- 172.21.15.69:0/519734344 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0072f0 con 0x7f0d6017f2a0 2024-02-21T07:43:37.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.514+0000 7f0d65200640 1 -- 172.21.15.69:0/519734344 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6017d080 con 0x7f0d6017f2a0 2024-02-21T07:43:37.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.514+0000 7f0d65200640 1 -- 172.21.15.69:0/519734344 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6017d640 con 0x7f0d6017f2a0 2024-02-21T07:43:37.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.518+0000 7f0d695d7740 1 Processor -- start 2024-02-21T07:43:37.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.518+0000 7f0d695d7740 1 -- start start 2024-02-21T07:43:37.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.519+0000 7f0d57400640 1 -- 172.21.15.69:0/519734344 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f0d4c007450 con 0x7f0d6017f2a0 2024-02-21T07:43:37.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.520+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 0x55beb5308c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.520+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb5309150 0x55beb52d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.520+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 0x55beb52960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.520+0000 7f0d695d7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb520a150 con 0x55beb5309150 2024-02-21T07:43:37.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.520+0000 7f0d695d7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb5207680 con 0x55beb52d3ab0 2024-02-21T07:43:37.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.520+0000 7f0d695d7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb5202e60 con 0x55beb52d3190 2024-02-21T07:43:37.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.520+0000 7f0d5ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 0x55beb52960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.520+0000 7f0d5ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 0x55beb52960c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:57348/0 (socket says 172.21.15.69:57348) 2024-02-21T07:43:37.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.520+0000 7f0d5ea00640 1 -- 172.21.15.69:0/3956222460 learned_addr learned my addr 172.21.15.69:0/3956222460 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:37.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.520+0000 7f0d5f400640 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb5309150 0x55beb52d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.521+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 0x55beb5308c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.521+0000 7f0d57400640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0d4009f130 0x7f0d400a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.521+0000 7f0d5f400640 1 -- 172.21.15.69:0/3956222460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 msgr2=0x55beb5308c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:37.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.521+0000 7f0d5f400640 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 0x55beb5308c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.521+0000 7f0d5f400640 1 -- 172.21.15.69:0/3956222460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 msgr2=0x55beb52960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:37.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.521+0000 7f0d5f400640 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 0x55beb52960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.521+0000 7f0d5f400640 1 -- 172.21.15.69:0/3956222460 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55beb51bc060 con 0x55beb5309150 2024-02-21T07:43:37.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.521+0000 7f0d57400640 1 -- 172.21.15.69:0/519734344 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0d4c0c9090 con 0x7f0d6017f2a0 2024-02-21T07:43:37.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.521+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 0x55beb5308c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:37.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.521+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 0x55beb52960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:37.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.522+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0d4009f130 0x7f0d400a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.522+0000 7f0d5f400640 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb5309150 0x55beb52d3570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d50001ab0 tx=0x7f0d50007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73e49ec57dc477 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:37.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.522+0000 7f0d4be00640 1 -- 172.21.15.69:0/3956222460 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5000fc40 con 0x55beb5309150 2024-02-21T07:43:37.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.522+0000 7f0d4be00640 1 -- 172.21.15.69:0/3956222460 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5000fda0 con 0x55beb5309150 2024-02-21T07:43:37.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.522+0000 7f0d4be00640 1 -- 172.21.15.69:0/3956222460 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d500052f0 con 0x55beb5309150 2024-02-21T07:43:37.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.523+0000 7f0d695d7740 1 -- 172.21.15.69:0/3956222460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb5309150 msgr2=0x55beb52d3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.523+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0d4009f130 0x7f0d400a15f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d58036000 tx=0x7f0d58030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:37.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.523+0000 7f0d695d7740 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb5309150 0x55beb52d3570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d50001ab0 tx=0x7f0d50007f10 comp rx=0 tx=0).stop 2024-02-21T07:43:37.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.523+0000 7f0d695d7740 1 -- 172.21.15.69:0/3956222460 shutdown_connections 2024-02-21T07:43:37.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.523+0000 7f0d695d7740 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 0x55beb52960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.523+0000 7f0d695d7740 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb5309150 0x55beb52d3570 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.523+0000 7f0d695d7740 1 --2- 172.21.15.69:0/3956222460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 0x55beb5308c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.523+0000 7f0d695d7740 1 -- 172.21.15.69:0/3956222460 >> 172.21.15.69:0/3956222460 conn(0x55beb52625a0 msgr2=0x55beb529a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:37.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.523+0000 7f0d695d7740 1 -- 172.21.15.69:0/3956222460 shutdown_connections 2024-02-21T07:43:37.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.523+0000 7f0d695d7740 1 -- 172.21.15.69:0/3956222460 wait complete. 2024-02-21T07:43:37.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.524+0000 7f0d695d7740 1 -- start start 2024-02-21T07:43:37.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.524+0000 7f0d695d7740 1 Processor -- start 2024-02-21T07:43:37.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 0x55beb52c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3ab0 0x55beb5304ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 0x55beb5307590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d695d7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb51a7ec0 con 0x55beb52d3ab0 2024-02-21T07:43:37.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d695d7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb51a7b60 con 0x55beb5309150 2024-02-21T07:43:37.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d695d7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb4f711c0 con 0x55beb52d3190 2024-02-21T07:43:37.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d695d7740 10 client.0 _ll_register_callbacks cb 0x55beb51bb960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:37.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d5fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 0x55beb5307590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d5fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 0x55beb5307590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:57352/0 (socket says 172.21.15.69:57352) 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d5fe00640 1 -- 172.21.15.69:0/2688366945 learned_addr learned my addr 172.21.15.69:0/2688366945 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d5f400640 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 0x55beb52c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3ab0 0x55beb5304ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d5fe00640 1 -- 172.21.15.69:0/2688366945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 msgr2=0x55beb52c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 0x55beb52c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.526+0000 7f0d5fe00640 1 -- 172.21.15.69:0/2688366945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3ab0 msgr2=0x55beb5304ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3ab0 0x55beb5304ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d5fe00640 1 -- 172.21.15.69:0/2688366945 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6018a800 con 0x55beb5309150 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3ab0 0x55beb5304ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 0x55beb5307590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009e80 tx=0x7f0d58004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8d01639a78989a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d48c00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d48c00640 1 -- 172.21.15.69:0/2688366945 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58040460 con 0x55beb5309150 2024-02-21T07:43:37.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d695d7740 1 -- 172.21.15.69:0/2688366945 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55beb4f027e0 con 0x55beb5309150 2024-02-21T07:43:37.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d48c00640 1 -- 172.21.15.69:0/2688366945 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0d58034440 con 0x55beb5309150 2024-02-21T07:43:37.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d48c00640 1 -- 172.21.15.69:0/2688366945 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d58034600 con 0x55beb5309150 2024-02-21T07:43:37.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d695d7740 10 client.5305 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:37.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.527+0000 7f0d695d7740 1 -- 172.21.15.69:0/2688366945 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55beb52014e0 con 0x55beb5309150 2024-02-21T07:43:37.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.528+0000 7f0d48c00640 1 -- 172.21.15.69:0/2688366945 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55beb4f027e0 con 0x55beb5309150 2024-02-21T07:43:37.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.528+0000 7f0d48c00640 1 -- 172.21.15.69:0/2688366945 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0d58034760 con 0x55beb5309150 2024-02-21T07:43:37.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.528+0000 7f0d695d7740 10 client.5305 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:37.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.528+0000 7f0d695d7740 10 client.5305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:37.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.528+0000 7f0d695d7740 20 client.5305 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:37.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.528+0000 7f0d695d7740 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55beb531d840 0x55beb53066c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.528+0000 7f0d695d7740 4 client.5305 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:37.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.528+0000 7f0d695d7740 1 -- 172.21.15.69:0/2688366945 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55beb4f3f720 con 0x55beb531d840 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.528+0000 7f0d5f400640 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55beb531d840 0x55beb53066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.529+0000 7f0d5f400640 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55beb531d840 0x55beb53066c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80898d358b07815b server_cookie=966a002c38bd3832 in_seq=0 out_seq=0 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.529+0000 7f0d48c00640 10 client.5305 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d48c00640 1 -- 172.21.15.69:0/2688366945 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55beb4f3f720 con 0x55beb531d840 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d48c00640 10 client.5305 handle_command_reply: tid=0 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 client.5305 shutdown 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 -- 172.21.15.69:0/2688366945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 msgr2=0x55beb5307590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 0x55beb5307590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009e80 tx=0x7f0d58004ab0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 -- 172.21.15.69:0/2688366945 shutdown_connections 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55beb531d840 0x55beb53066c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 0x55beb5307590 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3ab0 0x55beb5304ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 --2- 172.21.15.69:0/2688366945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3190 0x55beb52c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 -- 172.21.15.69:0/2688366945 >> 172.21.15.69:0/2688366945 conn(0x55beb52625a0 msgr2=0x55beb52a14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:37.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d48c00640 0 client.5305 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:37.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 -- 172.21.15.69:0/2688366945 shutdown_connections 2024-02-21T07:43:37.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.530+0000 7f0d695d7740 1 -- 172.21.15.69:0/2688366945 wait complete. 2024-02-21T07:43:37.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.531+0000 7f0d695d7740 20 client.5305 trim_cache size 0 max 16384 2024-02-21T07:43:37.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.546+0000 7f0d695d7740 1 Processor -- start 2024-02-21T07:43:37.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.547+0000 7f0d695d7740 1 -- start start 2024-02-21T07:43:37.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb530aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 0x55beb5308820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb5309150 0x55beb53072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d695d7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb53066c0 con 0x55beb52d3190 2024-02-21T07:43:37.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d695d7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb5318260 con 0x55beb52d3ab0 2024-02-21T07:43:37.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d695d7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb5294770 con 0x55beb5309150 2024-02-21T07:43:37.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb530aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb530aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58618/0 (socket says 172.21.15.69:58618) 2024-02-21T07:43:37.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5f400640 1 -- 172.21.15.69:0/3668916576 learned_addr learned my addr 172.21.15.69:0/3668916576 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:37.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/3668916576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb5309150 0x55beb53072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/3668916576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 0x55beb5308820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5fe00640 1 -- 172.21.15.69:0/3668916576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 msgr2=0x55beb5308820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:37.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/3668916576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 0x55beb5308820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5fe00640 1 -- 172.21.15.69:0/3668916576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 msgr2=0x55beb530aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:37.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/3668916576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb530aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5fe00640 1 -- 172.21.15.69:0/3668916576 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55beb519d950 con 0x55beb5309150 2024-02-21T07:43:37.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.548+0000 7f0d5f400640 1 --2- 172.21.15.69:0/3668916576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb530aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:37.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.549+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/3668916576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb5309150 0x55beb53072b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55beb52dcaf0 tx=0x7f0d5804e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e76286ae4d722e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:37.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.549+0000 7f0d4b400640 1 -- 172.21.15.69:0/3668916576 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58004000 con 0x55beb5309150 2024-02-21T07:43:37.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.549+0000 7f0d4b400640 1 -- 172.21.15.69:0/3668916576 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58050070 con 0x55beb5309150 2024-02-21T07:43:37.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.549+0000 7f0d4b400640 1 -- 172.21.15.69:0/3668916576 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58034640 con 0x55beb5309150 2024-02-21T07:43:37.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.550+0000 7f0d695d7740 1 -- 172.21.15.69:0/3668916576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb5309150 msgr2=0x55beb53072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.550+0000 7f0d695d7740 1 --2- 172.21.15.69:0/3668916576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb5309150 0x55beb53072b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55beb52dcaf0 tx=0x7f0d5804e070 comp rx=0 tx=0).stop 2024-02-21T07:43:37.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.550+0000 7f0d695d7740 1 -- 172.21.15.69:0/3668916576 shutdown_connections 2024-02-21T07:43:37.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.550+0000 7f0d695d7740 1 --2- 172.21.15.69:0/3668916576 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb5309150 0x55beb53072b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.550+0000 7f0d695d7740 1 --2- 172.21.15.69:0/3668916576 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb52d3ab0 0x55beb5308820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.550+0000 7f0d695d7740 1 --2- 172.21.15.69:0/3668916576 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb530aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.550+0000 7f0d695d7740 1 -- 172.21.15.69:0/3668916576 >> 172.21.15.69:0/3668916576 conn(0x55beb52625a0 msgr2=0x55beb52c8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:37.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.550+0000 7f0d695d7740 1 -- 172.21.15.69:0/3668916576 shutdown_connections 2024-02-21T07:43:37.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.550+0000 7f0d695d7740 1 -- 172.21.15.69:0/3668916576 wait complete. 2024-02-21T07:43:37.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.551+0000 7f0d695d7740 1 -- start start 2024-02-21T07:43:37.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.551+0000 7f0d695d7740 1 Processor -- start 2024-02-21T07:43:37.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.552+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb5304ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.552+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3ab0 0x55beb5375e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.552+0000 7f0d695d7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 0x55beb5296e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.552+0000 7f0d695d7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb530d490 con 0x55beb52d3190 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.552+0000 7f0d695d7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb5378f60 con 0x55beb5309150 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.552+0000 7f0d695d7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55beb5305000 con 0x55beb52d3ab0 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d695d7740 10 client.0 _ll_register_callbacks cb 0x55beb5295620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d5f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb5304ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d5ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3ab0 0x55beb5375e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d5ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3ab0 0x55beb5375e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:46016/0 (socket says 172.21.15.69:46016) 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d5ea00640 1 -- 172.21.15.69:0/437054945 learned_addr learned my addr 172.21.15.69:0/437054945 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d5fe00640 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 0x55beb5296e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d5ea00640 1 -- 172.21.15.69:0/437054945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 msgr2=0x55beb5296e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 0x55beb5296e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d5ea00640 1 -- 172.21.15.69:0/437054945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 msgr2=0x55beb5304ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb5304ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.553+0000 7f0d5ea00640 1 -- 172.21.15.69:0/437054945 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55beb51bc060 con 0x55beb52d3ab0 2024-02-21T07:43:37.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.554+0000 7f0d5f400640 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb5304ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:37.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.554+0000 7f0d5ea00640 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3ab0 0x55beb5375e70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0010e0 tx=0x7f0d4c096b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce98cf936a67df8b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:37.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.554+0000 7f0d48c00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:43:37.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.554+0000 7f0d48c00640 1 -- 172.21.15.69:0/437054945 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0cce70 con 0x55beb52d3ab0 2024-02-21T07:43:37.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.554+0000 7f0d48c00640 1 -- 172.21.15.69:0/437054945 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0d4c096c60 con 0x55beb52d3ab0 2024-02-21T07:43:37.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.554+0000 7f0d695d7740 1 -- 172.21.15.69:0/437054945 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55beb52d2e30 con 0x55beb52d3ab0 2024-02-21T07:43:37.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.554+0000 7f0d48c00640 1 -- 172.21.15.69:0/437054945 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d4c09ad00 con 0x55beb52d3ab0 2024-02-21T07:43:37.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.554+0000 7f0d695d7740 10 client.5276 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:37.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.554+0000 7f0d695d7740 1 -- 172.21.15.69:0/437054945 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55beb52014e0 con 0x55beb52d3ab0 2024-02-21T07:43:37.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.555+0000 7f0d48c00640 1 -- 172.21.15.69:0/437054945 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0b2030 con 0x55beb52d3ab0 2024-02-21T07:43:37.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.555+0000 7f0d48c00640 1 -- 172.21.15.69:0/437054945 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0d4c09ee30 con 0x55beb52d3ab0 2024-02-21T07:43:37.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.555+0000 7f0d695d7740 10 client.5276 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:37.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.555+0000 7f0d695d7740 10 client.5276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:37.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.555+0000 7f0d695d7740 20 client.5276 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:37.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.555+0000 7f0d695d7740 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55beb52da190 0x55beb5309530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.555+0000 7f0d695d7740 4 client.5276 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:43:37.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.555+0000 7f0d695d7740 1 -- 172.21.15.69:0/437054945 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f0d5000fda0 con 0x55beb52da190 2024-02-21T07:43:37.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.556+0000 7f0d5f400640 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55beb52da190 0x55beb5309530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d48c00640 10 client.5276 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d5f400640 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55beb52da190 0x55beb5309530 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef590c5ec115b676 server_cookie=8bf1bf7a28df225b in_seq=0 out_seq=0 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d48c00640 1 -- 172.21.15.69:0/437054945 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f0d5000fda0 con 0x55beb52da190 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d48c00640 10 client.5276 handle_command_reply: tid=0 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d695d7740 1 client.5276 shutdown 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d695d7740 1 -- 172.21.15.69:0/437054945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3ab0 msgr2=0x55beb5375e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d695d7740 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3ab0 0x55beb5375e70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c0010e0 tx=0x7f0d4c096b20 comp rx=0 tx=0).stop 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d695d7740 1 -- 172.21.15.69:0/437054945 shutdown_connections 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d695d7740 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55beb52da190 0x55beb5309530 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d695d7740 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55beb5309150 0x55beb5296e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d695d7740 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55beb52d3ab0 0x55beb5375e70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d48c00640 0 client.5276 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d695d7740 1 --2- 172.21.15.69:0/437054945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55beb52d3190 0x55beb5304ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d695d7740 1 -- 172.21.15.69:0/437054945 >> 172.21.15.69:0/437054945 conn(0x55beb52625a0 msgr2=0x55beb529a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:37.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.557+0000 7f0d695d7740 1 -- 172.21.15.69:0/437054945 shutdown_connections 2024-02-21T07:43:37.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d695d7740 1 -- 172.21.15.69:0/437054945 wait complete. 2024-02-21T07:43:37.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d695d7740 20 client.5276 trim_cache size 0 max 16384 2024-02-21T07:43:37.566 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:43:37.566 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-02-21T07:43:37.566 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-02-21T07:43:37.566 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:43:37.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d65200640 1 -- 172.21.15.69:0/519734344 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0d4009f130 msgr2=0x7f0d400a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d65200640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0d4009f130 0x7f0d400a15f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d58036000 tx=0x7f0d58030000 comp rx=0 tx=0).stop 2024-02-21T07:43:37.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d65200640 1 -- 172.21.15.69:0/519734344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d6017f2a0 msgr2=0x7f0d60169db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d65200640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d6017f2a0 0x7f0d60169db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c400 tx=0x7f0d4c00c8c0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d65200640 1 -- 172.21.15.69:0/519734344 shutdown_connections 2024-02-21T07:43:37.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d65200640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0d4009f130 0x7f0d400a15f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d65200640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0d6018b3a0 0x7f0d6017de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d65200640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0d6017f2a0 0x7f0d60169db0 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c400 tx=0x7f0d4c00c8c0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d65200640 1 --2- 172.21.15.69:0/519734344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d600fe870 0x7f0d60222770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.558+0000 7f0d65200640 1 -- 172.21.15.69:0/519734344 >> 172.21.15.69:0/519734344 conn(0x7f0d600d2b00 msgr2=0x7f0d600fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:37.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.559+0000 7f0d65200640 1 -- 172.21.15.69:0/519734344 shutdown_connections 2024-02-21T07:43:37.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.559+0000 7f0d65200640 1 -- 172.21.15.69:0/519734344 wait complete. 2024-02-21T07:43:37.581 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:43:37.581 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:43:37.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.751+0000 7f0c81e00640 1 Processor -- start 2024-02-21T07:43:37.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.751+0000 7f0c81e00640 1 -- start start 2024-02-21T07:43:37.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.753+0000 7f0c81e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f0c7c06e2e0 0x7f0c7c06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.753+0000 7f0c81e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c185df0 con 0x7f0c7c067170 2024-02-21T07:43:37.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.753+0000 7f0c81e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c1862d0 con 0x7f0c7c066d30 2024-02-21T07:43:37.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.753+0000 7f0c81e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7c071bb0 con 0x7f0c7c06e2e0 2024-02-21T07:43:37.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.753+0000 7f0c7a000640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0c7c066d30 0x7f0c7c186d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:40034/0 (socket says 172.21.15.69:40034) 2024-02-21T07:43:37.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.753+0000 7f0c7a000640 1 -- 172.21.15.69:0/167837342 learned_addr learned my addr 172.21.15.69:0/167837342 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:37.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.753+0000 7f0c7aa00640 1 --2- 172.21.15.69:0/167837342 >> v2:172.21.15.174:3300/0 conn(0x7f0c7c06e2e0 0x7f0c7c06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.753+0000 7f0c79600640 1 -- 172.21.15.69:0/167837342 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614885860 0 0) 0x7f0c7c1862d0 con 0x7f0c7c066d30 2024-02-21T07:43:37.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.754+0000 7f0c7aa00640 1 -- 172.21.15.69:0/167837342 >> v1:172.21.15.184:6789/0 conn(0x7f0c7c066d30 legacy=0x7f0c7c186d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.754+0000 7f0c7aa00640 1 -- 172.21.15.69:0/167837342 >> v1:172.21.15.69:6789/0 conn(0x7f0c7c067170 legacy=0x7f0c7c187430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.754+0000 7f0c7aa00640 1 -- 172.21.15.69:0/167837342 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c06f6b0 con 0x7f0c7c06e2e0 2024-02-21T07:43:37.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.755+0000 7f0c7aa00640 1 --2- 172.21.15.69:0/167837342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7c06e2e0 0x7f0c7c06ee10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0097a0 tx=0x7f0c6c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=465a523b8e318676 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:37.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.755+0000 7f0c79600640 1 -- 172.21.15.69:0/167837342 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c031830 con 0x7f0c7c06e2e0 2024-02-21T07:43:37.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.755+0000 7f0c79600640 1 -- 172.21.15.69:0/167837342 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c031990 con 0x7f0c7c06e2e0 2024-02-21T07:43:37.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.755+0000 7f0c79600640 1 -- 172.21.15.69:0/167837342 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c031d20 con 0x7f0c7c06e2e0 2024-02-21T07:43:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.756+0000 7f0c81e00640 1 -- 172.21.15.69:0/167837342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7c06e2e0 msgr2=0x7f0c7c06ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.756+0000 7f0c81e00640 1 --2- 172.21.15.69:0/167837342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7c06e2e0 0x7f0c7c06ee10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c0097a0 tx=0x7f0c6c02b8d0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.756+0000 7f0c81e00640 1 -- 172.21.15.69:0/167837342 shutdown_connections 2024-02-21T07:43:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.756+0000 7f0c81e00640 1 --2- 172.21.15.69:0/167837342 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7c06e2e0 0x7f0c7c06ee10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.756+0000 7f0c81e00640 1 -- 172.21.15.69:0/167837342 >> 172.21.15.69:0/167837342 conn(0x7f0c7c0f71f0 msgr2=0x7f0c7c0f7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.756+0000 7f0c81e00640 1 -- 172.21.15.69:0/167837342 shutdown_connections 2024-02-21T07:43:37.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.756+0000 7f0c81e00640 1 -- 172.21.15.69:0/167837342 wait complete. 2024-02-21T07:43:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.758+0000 7f0c81e00640 1 Processor -- start 2024-02-21T07:43:37.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.758+0000 7f0c81e00640 1 -- start start 2024-02-21T07:43:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.759+0000 7f0c81e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c7c066d30 0x7f0c7c0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.759+0000 7f0c81e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7c067170 0x7f0c7c0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.759+0000 7f0c81e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c7c1562e0 0x7f0c7c0f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.759+0000 7f0c81e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0cbea0 con 0x7f0c7c1562e0 2024-02-21T07:43:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.759+0000 7f0c81e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0f6fb0 con 0x7f0c7c067170 2024-02-21T07:43:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.759+0000 7f0c81e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0f69f0 con 0x7f0c7c066d30 2024-02-21T07:43:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c7c066d30 0x7f0c7c0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c7c066d30 0x7f0c7c0cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:46020/0 (socket says 172.21.15.69:46020) 2024-02-21T07:43:37.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7aa00640 1 -- 172.21.15.69:0/118968017 learned_addr learned my addr 172.21.15.69:0/118968017 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7b400640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c7c1562e0 0x7f0c7c0f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7a000640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7c067170 0x7f0c7c0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7aa00640 1 -- 172.21.15.69:0/118968017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7c067170 msgr2=0x7f0c7c0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7aa00640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7c067170 0x7f0c7c0cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7aa00640 1 -- 172.21.15.69:0/118968017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c7c1562e0 msgr2=0x7f0c7c0f5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7aa00640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c7c1562e0 0x7f0c7c0f5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7aa00640 1 -- 172.21.15.69:0/118968017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009400 con 0x7f0c7c066d30 2024-02-21T07:43:37.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.760+0000 7f0c7b400640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c7c1562e0 0x7f0c7c0f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:37.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.761+0000 7f0c7aa00640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c7c066d30 0x7f0c7c0cf150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c02bee0 tx=0x7f0c6c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:37.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.761+0000 7f0c73400640 1 -- 172.21.15.69:0/118968017 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c03ba70 con 0x7f0c7c066d30 2024-02-21T07:43:37.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.761+0000 7f0c73400640 1 -- 172.21.15.69:0/118968017 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c03bbf0 con 0x7f0c7c066d30 2024-02-21T07:43:37.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.761+0000 7f0c73400640 1 -- 172.21.15.69:0/118968017 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c0453f0 con 0x7f0c7c066d30 2024-02-21T07:43:37.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.761+0000 7f0c81e00640 1 -- 172.21.15.69:0/118968017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c0f6cd0 con 0x7f0c7c066d30 2024-02-21T07:43:37.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.761+0000 7f0c81e00640 1 -- 172.21.15.69:0/118968017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c1769c0 con 0x7f0c7c066d30 2024-02-21T07:43:37.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.763+0000 7f0c81e00640 1 -- 172.21.15.69:0/118968017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7c1829e0 con 0x7f0c7c066d30 2024-02-21T07:43:37.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.764+0000 7f0c73400640 1 -- 172.21.15.69:0/118968017 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f0c6c04e450 con 0x7f0c7c066d30 2024-02-21T07:43:37.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.765+0000 7f0c73400640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0c5c09f160 0x7f0c5c0a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:37.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.766+0000 7f0c73400640 1 -- 172.21.15.69:0/118968017 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0c6c0ebfe0 con 0x7f0c7c066d30 2024-02-21T07:43:37.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.766+0000 7f0c7a000640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0c5c09f160 0x7f0c5c0a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:37.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.766+0000 7f0c7a000640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0c5c09f160 0x7f0c5c0a1620 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c171ea0 tx=0x7f0c68007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:37.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.769+0000 7f0c73400640 1 -- 172.21.15.69:0/118968017 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0c6c0b5bd0 con 0x7f0c7c066d30 2024-02-21T07:43:38.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.995+0000 7f0c81e00640 1 -- 172.21.15.69:0/118968017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c7c069d50 con 0x7f0c7c066d30 2024-02-21T07:43:38.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.996+0000 7f0c73400640 1 -- 172.21.15.69:0/118968017 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f0c6c035020 con 0x7f0c7c066d30 2024-02-21T07:43:38.002 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:43:38.002 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:56.243830+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:43:38.003 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 19 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 -- 172.21.15.69:0/118968017 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0c5c09f160 msgr2=0x7f0c5c0a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0c5c09f160 0x7f0c5c0a1620 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c171ea0 tx=0x7f0c68007de0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 -- 172.21.15.69:0/118968017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c7c066d30 msgr2=0x7f0c7c0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c7c066d30 0x7f0c7c0cf150 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c02bee0 tx=0x7f0c6c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 -- 172.21.15.69:0/118968017 shutdown_connections 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f0c5c09f160 0x7f0c5c0a1620 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c7c1562e0 0x7f0c7c0f5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f0c7c067170 0x7f0c7c0cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 --2- 172.21.15.69:0/118968017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c7c066d30 0x7f0c7c0cf150 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 -- 172.21.15.69:0/118968017 >> 172.21.15.69:0/118968017 conn(0x7f0c7c0f71f0 msgr2=0x7f0c7c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 -- 172.21.15.69:0/118968017 shutdown_connections 2024-02-21T07:43:38.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:37.999+0000 7f0c81e00640 1 -- 172.21.15.69:0/118968017 wait complete. 2024-02-21T07:43:38.021 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:43:38.021 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-02-21T07:43:38.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.187+0000 7efe85c00640 1 Processor -- start 2024-02-21T07:43:38.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.187+0000 7efe85c00640 1 -- start start 2024-02-21T07:43:38.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.188+0000 7efe85c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efe800fe870 0x7efe8018ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.188+0000 7efe85c00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8018a800 con 0x7efe8018b1d0 2024-02-21T07:43:38.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.189+0000 7efe85c00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe800fde70 con 0x7efe8017f2a0 2024-02-21T07:43:38.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.189+0000 7efe85c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800ff160 con 0x7efe800fe870 2024-02-21T07:43:38.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.189+0000 7efe7fe00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7efe8017f2a0 0x7efe800fe160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:53944/0 (socket says 172.21.15.69:53944) 2024-02-21T07:43:38.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.189+0000 7efe7fe00640 1 -- 172.21.15.69:0/3847621612 learned_addr learned my addr 172.21.15.69:0/3847621612 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:38.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.189+0000 7efe7f400640 1 --2- 172.21.15.69:0/3847621612 >> v2:172.21.15.174:3300/0 conn(0x7efe800fe870 0x7efe8018ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.189+0000 7efe7ea00640 1 -- 172.21.15.69:0/3847621612 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946198503 0 0) 0x7efe800fde70 con 0x7efe8017f2a0 2024-02-21T07:43:38.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.189+0000 7efe7ea00640 1 -- 172.21.15.69:0/3847621612 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe64003520 con 0x7efe8017f2a0 2024-02-21T07:43:38.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.189+0000 7efe7f400640 1 -- 172.21.15.69:0/3847621612 >> v1:172.21.15.174:6789/0 conn(0x7efe8017f2a0 legacy=0x7efe800fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.189+0000 7efe7f400640 1 -- 172.21.15.69:0/3847621612 >> v1:172.21.15.69:6789/0 conn(0x7efe8018b1d0 legacy=0x7efe800ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.189+0000 7efe7f400640 1 -- 172.21.15.69:0/3847621612 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe80189f10 con 0x7efe800fe870 2024-02-21T07:43:38.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.191+0000 7efe7f400640 1 --2- 172.21.15.69:0/3847621612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe800fe870 0x7efe8018ac90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0097a0 tx=0x7efe6c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed619d5511bdbf33 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.191+0000 7efe7ea00640 1 -- 172.21.15.69:0/3847621612 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c031830 con 0x7efe800fe870 2024-02-21T07:43:38.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.191+0000 7efe7ea00640 1 -- 172.21.15.69:0/3847621612 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c031990 con 0x7efe800fe870 2024-02-21T07:43:38.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.191+0000 7efe7ea00640 1 -- 172.21.15.69:0/3847621612 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c031d20 con 0x7efe800fe870 2024-02-21T07:43:38.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.191+0000 7efe85c00640 1 -- 172.21.15.69:0/3847621612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe800fe870 msgr2=0x7efe8018ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.191+0000 7efe85c00640 1 --2- 172.21.15.69:0/3847621612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe800fe870 0x7efe8018ac90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0097a0 tx=0x7efe6c02b8d0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.192+0000 7efe85c00640 1 -- 172.21.15.69:0/3847621612 shutdown_connections 2024-02-21T07:43:38.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.192+0000 7efe85c00640 1 --2- 172.21.15.69:0/3847621612 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe800fe870 0x7efe8018ac90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.192+0000 7efe85c00640 1 -- 172.21.15.69:0/3847621612 >> 172.21.15.69:0/3847621612 conn(0x7efe800d2b00 msgr2=0x7efe800d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.192+0000 7efe85c00640 1 -- 172.21.15.69:0/3847621612 shutdown_connections 2024-02-21T07:43:38.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.192+0000 7efe85c00640 1 -- 172.21.15.69:0/3847621612 wait complete. 2024-02-21T07:43:38.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.194+0000 7efe85c00640 1 Processor -- start 2024-02-21T07:43:38.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.194+0000 7efe85c00640 1 -- start start 2024-02-21T07:43:38.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe85c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe800fe870 0x7efe801643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe85c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe8017f2a0 0x7efe8016bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe85c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe8018b1d0 0x7efe8016c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe85c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe80182980 con 0x7efe800fe870 2024-02-21T07:43:38.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe85c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe801759b0 con 0x7efe8018b1d0 2024-02-21T07:43:38.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe85c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8016ca60 con 0x7efe8017f2a0 2024-02-21T07:43:38.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe7fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe800fe870 0x7efe801643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe85200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe8018b1d0 0x7efe8016c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe7fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe800fe870 0x7efe801643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58646/0 (socket says 172.21.15.69:58646) 2024-02-21T07:43:38.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe7f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe8017f2a0 0x7efe8016bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe85200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe8018b1d0 0x7efe8016c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:57396/0 (socket says 172.21.15.69:57396) 2024-02-21T07:43:38.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.195+0000 7efe7fe00640 1 -- 172.21.15.69:0/1616130175 learned_addr learned my addr 172.21.15.69:0/1616130175 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.196+0000 7efe85200640 1 -- 172.21.15.69:0/1616130175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe8017f2a0 msgr2=0x7efe8016bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.196+0000 7efe85200640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe8017f2a0 0x7efe8016bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.196+0000 7efe85200640 1 -- 172.21.15.69:0/1616130175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe800fe870 msgr2=0x7efe801643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.196+0000 7efe85200640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe800fe870 0x7efe801643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.196+0000 7efe85200640 1 -- 172.21.15.69:0/1616130175 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c009400 con 0x7efe8018b1d0 2024-02-21T07:43:38.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.196+0000 7efe7f400640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe8017f2a0 0x7efe8016bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:43:38.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.196+0000 7efe85200640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe8018b1d0 0x7efe8016c440 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe7800c730 tx=0x7efe7800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.196+0000 7efe77e00640 1 -- 172.21.15.69:0/1616130175 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78006d50 con 0x7efe8018b1d0 2024-02-21T07:43:38.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.196+0000 7efe77e00640 1 -- 172.21.15.69:0/1616130175 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78003970 con 0x7efe8018b1d0 2024-02-21T07:43:38.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.197+0000 7efe77e00640 1 -- 172.21.15.69:0/1616130175 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78003d60 con 0x7efe8018b1d0 2024-02-21T07:43:38.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.197+0000 7efe85c00640 1 -- 172.21.15.69:0/1616130175 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8016cd40 con 0x7efe8018b1d0 2024-02-21T07:43:38.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.197+0000 7efe85c00640 1 -- 172.21.15.69:0/1616130175 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8016d300 con 0x7efe8018b1d0 2024-02-21T07:43:38.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.200+0000 7efe77e00640 1 -- 172.21.15.69:0/1616130175 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7efe780050d0 con 0x7efe8018b1d0 2024-02-21T07:43:38.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.202+0000 7efe77e00640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe6009f130 0x7efe600a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.202+0000 7efe77e00640 1 -- 172.21.15.69:0/1616130175 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efe780c95e0 con 0x7efe8018b1d0 2024-02-21T07:43:38.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.203+0000 7efe89f86740 1 Processor -- start 2024-02-21T07:43:38.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.203+0000 7efe7fe00640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe6009f130 0x7efe600a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.203+0000 7efe89f86740 1 -- start start 2024-02-21T07:43:38.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.203+0000 7efe7fe00640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe6009f130 0x7efe600a15f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe70007630 tx=0x7efe70007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe89f86740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e070 0x55a43610e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe89f86740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a43610e990 0x55a436149200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe89f86740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a436149740 0x55a43614a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe89f86740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a436041210 con 0x55a43610e990 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe89f86740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43603e740 con 0x55a43610e070 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe89f86740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a436039f20 con 0x55a436149740 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe7fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e070 0x55a43610e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe7fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e070 0x55a43610e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:57412/0 (socket says 172.21.15.69:57412) 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe7fe00640 1 -- 172.21.15.69:0/1268169468 learned_addr learned my addr 172.21.15.69:0/1268169468 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe7f400640 1 --2- 172.21.15.69:0/1268169468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a43610e990 0x55a436149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.204+0000 7efe85200640 1 --2- 172.21.15.69:0/1268169468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a436149740 0x55a43614a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.205+0000 7efe7fe00640 1 -- 172.21.15.69:0/1268169468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a436149740 msgr2=0x55a43614a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.205+0000 7efe7fe00640 1 --2- 172.21.15.69:0/1268169468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a436149740 0x55a43614a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.205+0000 7efe7fe00640 1 -- 172.21.15.69:0/1268169468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a43610e990 msgr2=0x55a436149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.205+0000 7efe7fe00640 1 --2- 172.21.15.69:0/1268169468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a43610e990 0x55a436149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.205+0000 7efe7fe00640 1 -- 172.21.15.69:0/1268169468 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a435ffbdf0 con 0x55a43610e070 2024-02-21T07:43:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.205+0000 7efe7fe00640 1 --2- 172.21.15.69:0/1268169468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e070 0x55a43610e450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe70004fb0 tx=0x7efe70012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=266fbac8c8e1422e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.205+0000 7efe74c00640 1 -- 172.21.15.69:0/1268169468 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70013b80 con 0x55a43610e070 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.205+0000 7efe74c00640 1 -- 172.21.15.69:0/1268169468 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70013ce0 con 0x55a43610e070 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.205+0000 7efe74c00640 1 -- 172.21.15.69:0/1268169468 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70012550 con 0x55a43610e070 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.206+0000 7efe89f86740 1 -- 172.21.15.69:0/1268169468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e070 msgr2=0x55a43610e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.206+0000 7efe89f86740 1 --2- 172.21.15.69:0/1268169468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e070 0x55a43610e450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efe70004fb0 tx=0x7efe70012000 comp rx=0 tx=0).stop 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.206+0000 7efe89f86740 1 -- 172.21.15.69:0/1268169468 shutdown_connections 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.206+0000 7efe89f86740 1 --2- 172.21.15.69:0/1268169468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a436149740 0x55a43614a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.206+0000 7efe89f86740 1 --2- 172.21.15.69:0/1268169468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a43610e990 0x55a436149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.206+0000 7efe89f86740 1 --2- 172.21.15.69:0/1268169468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e070 0x55a43610e450 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.206+0000 7efe89f86740 1 -- 172.21.15.69:0/1268169468 >> 172.21.15.69:0/1268169468 conn(0x55a4360d0640 msgr2=0x55a4360d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.206+0000 7efe89f86740 1 -- 172.21.15.69:0/1268169468 shutdown_connections 2024-02-21T07:43:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.206+0000 7efe89f86740 1 -- 172.21.15.69:0/1268169468 wait complete. 2024-02-21T07:43:38.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.207+0000 7efe89f86740 1 -- start start 2024-02-21T07:43:38.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.207+0000 7efe89f86740 1 Processor -- start 2024-02-21T07:43:38.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe89f86740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a43610e990 0x55a436144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe89f86740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a436149740 0x55a4360f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe89f86740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 0x55a4360f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe89f86740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435fdf150 con 0x55a43610e990 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe89f86740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435fdedf0 con 0x55a436149740 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe89f86740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a435da81c0 con 0x55a4360f67d0 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe89f86740 10 client.0 _ll_register_callbacks cb 0x55a43602e2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe7f400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a436149740 0x55a4360f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe7f400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a436149740 0x55a4360f8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:57416/0 (socket says 172.21.15.69:57416) 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe7f400640 1 -- 172.21.15.69:0/800977373 learned_addr learned my addr 172.21.15.69:0/800977373 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe7fe00640 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a43610e990 0x55a436144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.209+0000 7efe85200640 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 0x55a4360f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.210+0000 7efe7f400640 1 -- 172.21.15.69:0/800977373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 msgr2=0x55a4360f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.210+0000 7efe7f400640 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 0x55a4360f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.210+0000 7efe7f400640 1 -- 172.21.15.69:0/800977373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a43610e990 msgr2=0x55a436144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.210+0000 7efe7f400640 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a43610e990 0x55a436144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.210+0000 7efe7f400640 1 -- 172.21.15.69:0/800977373 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe70004c90 con 0x55a436149740 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.210+0000 7efe7f400640 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a436149740 0x55a4360f8f60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0098c0 tx=0x7efe6c02e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dab36fb78a0ca25d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.210+0000 7efe69600640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.210+0000 7efe69600640 1 -- 172.21.15.69:0/800977373 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c03f040 con 0x55a436149740 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.210+0000 7efe69600640 1 -- 172.21.15.69:0/800977373 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efe6c03a830 con 0x55a436149740 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe89f86740 1 -- 172.21.15.69:0/800977373 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a435d397e0 con 0x55a436149740 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe69600640 1 -- 172.21.15.69:0/800977373 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe6c03a9f0 con 0x55a436149740 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe89f86740 10 client.5332 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe89f86740 1 -- 172.21.15.69:0/800977373 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55a4360385a0 con 0x55a436149740 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe69600640 1 -- 172.21.15.69:0/800977373 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c051020 con 0x55a436149740 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe69600640 1 -- 172.21.15.69:0/800977373 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efe6c03ab50 con 0x55a436149740 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe89f86740 10 client.5332 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe89f86740 10 client.5332 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.b 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe89f86740 20 client.5332 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:38.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe89f86740 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55a436147040 0x55a436147450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe89f86740 4 client.5332 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.211+0000 7efe89f86740 1 -- 172.21.15.69:0/800977373 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a435d76720 con 0x55a436147040 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.212+0000 7efe7fe00640 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55a436147040 0x55a436147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.212+0000 7efe7fe00640 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55a436147040 0x55a436147450 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=31c3c1cf8ec3ead3 server_cookie=7e6a3aa9e6bbbd0e in_seq=0 out_seq=0 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.212+0000 7efe69600640 10 client.5332 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe69600640 1 -- 172.21.15.69:0/800977373 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a435d76720 con 0x55a436147040 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe69600640 10 client.5332 handle_command_reply: tid=0 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 client.5332 shutdown 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 -- 172.21.15.69:0/800977373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a436149740 msgr2=0x55a4360f8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a436149740 0x55a4360f8f60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0098c0 tx=0x7efe6c02e000 comp rx=0 tx=0).stop 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 -- 172.21.15.69:0/800977373 shutdown_connections 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55a436147040 0x55a436147450 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 0x55a4360f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a436149740 0x55a4360f8f60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 --2- 172.21.15.69:0/800977373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a43610e990 0x55a436144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 -- 172.21.15.69:0/800977373 >> 172.21.15.69:0/800977373 conn(0x55a43610e070 msgr2=0x55a4360d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe69600640 0 client.5332 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:43:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 -- 172.21.15.69:0/800977373 shutdown_connections 2024-02-21T07:43:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.213+0000 7efe89f86740 1 -- 172.21.15.69:0/800977373 wait complete. 2024-02-21T07:43:38.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.214+0000 7efe89f86740 20 client.5332 trim_cache size 0 max 16384 2024-02-21T07:43:38.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.226+0000 7efe89f86740 1 Processor -- start 2024-02-21T07:43:38.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.226+0000 7efe89f86740 1 -- start start 2024-02-21T07:43:38.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.227+0000 7efe89f86740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 0x55a4360fbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.227+0000 7efe89f86740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 0x55a436143230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.227+0000 7efe89f86740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a436149740 0x55a43616c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.227+0000 7efe89f86740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a43616be20 con 0x55a436149740 2024-02-21T07:43:38.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.227+0000 7efe89f86740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4360cc0f0 con 0x55a43610e990 2024-02-21T07:43:38.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.227+0000 7efe89f86740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4360cc600 con 0x55a4360f67d0 2024-02-21T07:43:38.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe85200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a436149740 0x55a43616c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 0x55a4360fbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 0x55a4360fbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:46052/0 (socket says 172.21.15.69:46052) 2024-02-21T07:43:38.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7fe00640 1 -- 172.21.15.69:0/946059083 learned_addr learned my addr 172.21.15.69:0/946059083 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7f400640 1 --2- 172.21.15.69:0/946059083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 0x55a436143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7f400640 1 -- 172.21.15.69:0/946059083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 msgr2=0x55a4360fbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7f400640 1 --2- 172.21.15.69:0/946059083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 0x55a4360fbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7f400640 1 -- 172.21.15.69:0/946059083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a436149740 msgr2=0x55a43616c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7f400640 1 --2- 172.21.15.69:0/946059083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a436149740 0x55a43616c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7f400640 1 -- 172.21.15.69:0/946059083 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a435fd4ab0 con 0x55a43610e990 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe85200640 1 --2- 172.21.15.69:0/946059083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a436149740 0x55a43616c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7fe00640 1 --2- 172.21.15.69:0/946059083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 0x55a4360fbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.228+0000 7efe7f400640 1 --2- 172.21.15.69:0/946059083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 0x55a436143230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009890 tx=0x7efe6c031000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96649cd0f556ad39 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.229+0000 7efe6be00640 1 -- 172.21.15.69:0/946059083 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c03f050 con 0x55a43610e990 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.229+0000 7efe6be00640 1 -- 172.21.15.69:0/946059083 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c051040 con 0x55a43610e990 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.229+0000 7efe6be00640 1 -- 172.21.15.69:0/946059083 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c004270 con 0x55a43610e990 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.229+0000 7efe89f86740 1 -- 172.21.15.69:0/946059083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 msgr2=0x55a436143230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.229+0000 7efe89f86740 1 --2- 172.21.15.69:0/946059083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 0x55a436143230 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009890 tx=0x7efe6c031000 comp rx=0 tx=0).stop 2024-02-21T07:43:38.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.229+0000 7efe89f86740 1 -- 172.21.15.69:0/946059083 shutdown_connections 2024-02-21T07:43:38.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.229+0000 7efe89f86740 1 --2- 172.21.15.69:0/946059083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a436149740 0x55a43616c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.229+0000 7efe89f86740 1 --2- 172.21.15.69:0/946059083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 0x55a436143230 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.229+0000 7efe89f86740 1 --2- 172.21.15.69:0/946059083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a4360f67d0 0x55a4360fbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.229+0000 7efe89f86740 1 -- 172.21.15.69:0/946059083 >> 172.21.15.69:0/946059083 conn(0x55a43610e070 msgr2=0x55a4360c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.230+0000 7efe89f86740 1 -- 172.21.15.69:0/946059083 shutdown_connections 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.230+0000 7efe89f86740 1 -- 172.21.15.69:0/946059083 wait complete. 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.231+0000 7efe89f86740 1 -- start start 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.231+0000 7efe89f86740 1 Processor -- start 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe89f86740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a4360f67d0 0x55a436113320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe89f86740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 0x55a4361b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe89f86740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a436149740 0x55a4360fa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe89f86740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a436113860 con 0x55a4360f67d0 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe89f86740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4361b9a30 con 0x55a43610e990 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe89f86740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4361ba400 con 0x55a436149740 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe89f86740 10 client.0 _ll_register_callbacks cb 0x7efe70007280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe7fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a4360f67d0 0x55a436113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe7f400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 0x55a4361b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe7fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a4360f67d0 0x55a436113320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58688/0 (socket says 172.21.15.69:58688) 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.232+0000 7efe7fe00640 1 -- 172.21.15.69:0/3760088675 learned_addr learned my addr 172.21.15.69:0/3760088675 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe85200640 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a436149740 0x55a4360fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe7f400640 1 -- 172.21.15.69:0/3760088675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a436149740 msgr2=0x55a4360fa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe7f400640 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a436149740 0x55a4360fa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe7f400640 1 -- 172.21.15.69:0/3760088675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a4360f67d0 msgr2=0x55a436113320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe7f400640 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a4360f67d0 0x55a436113320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe7f400640 1 -- 172.21.15.69:0/3760088675 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a435ffbdf0 con 0x55a43610e990 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe7fe00640 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a4360f67d0 0x55a436113320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe7f400640 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 0x55a4361b9ec0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efe6c02be10 tx=0x7efe6c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78108b14abf5b679 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe69600640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe69600640 1 -- 172.21.15.69:0/3760088675 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c03f040 con 0x55a43610e990 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe89f86740 1 -- 172.21.15.69:0/3760088675 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe70013ce0 con 0x55a43610e990 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.233+0000 7efe69600640 1 -- 172.21.15.69:0/3760088675 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efe6c000e40 con 0x55a43610e990 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe69600640 1 -- 172.21.15.69:0/3760088675 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe6c02bf50 con 0x55a43610e990 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe89f86740 10 client.5338 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe89f86740 1 -- 172.21.15.69:0/3760088675 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x7efe8016d300 con 0x55a43610e990 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe69600640 1 -- 172.21.15.69:0/3760088675 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70013ce0 con 0x55a43610e990 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe69600640 1 -- 172.21.15.69:0/3760088675 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efe6c03a830 con 0x55a43610e990 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe89f86740 10 client.5338 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe89f86740 10 client.5338 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.b 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe89f86740 20 client.5338 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe89f86740 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55a436144740 0x55a4360fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe89f86740 4 client.5338 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.234+0000 7efe89f86740 1 -- 172.21.15.69:0/3760088675 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a435dc5890 con 0x55a436144740 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.235+0000 7efe7fe00640 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55a436144740 0x55a4360fdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.235+0000 7efe7fe00640 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55a436144740 0x55a4360fdbc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5c889348a2da539e server_cookie=3241242a5c56eaa2 in_seq=0 out_seq=0 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.235+0000 7efe69600640 10 client.5338 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.235+0000 7efe69600640 1 -- 172.21.15.69:0/3760088675 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a435dc5890 con 0x55a436144740 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.235+0000 7efe69600640 10 client.5338 handle_command_reply: tid=0 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 client.5338 shutdown 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 -- 172.21.15.69:0/3760088675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 msgr2=0x55a4361b9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 0x55a4361b9ec0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efe6c02be10 tx=0x7efe6c004730 comp rx=0 tx=0).stop 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 -- 172.21.15.69:0/3760088675 shutdown_connections 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55a436144740 0x55a4360fdbc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a436149740 0x55a4360fa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a43610e990 0x55a4361b9ec0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 --2- 172.21.15.69:0/3760088675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a4360f67d0 0x55a436113320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 -- 172.21.15.69:0/3760088675 >> 172.21.15.69:0/3760088675 conn(0x55a43610e070 msgr2=0x55a436145a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe69600640 0 client.5338 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:43:38.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 -- 172.21.15.69:0/3760088675 shutdown_connections 2024-02-21T07:43:38.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 1 -- 172.21.15.69:0/3760088675 wait complete. 2024-02-21T07:43:38.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.236+0000 7efe89f86740 20 client.5338 trim_cache size 0 max 16384 2024-02-21T07:43:38.245 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:43:38.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 -- 172.21.15.69:0/1616130175 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe6009f130 msgr2=0x7efe600a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe6009f130 0x7efe600a15f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe70007630 tx=0x7efe70007e10 comp rx=0 tx=0).stop 2024-02-21T07:43:38.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 -- 172.21.15.69:0/1616130175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe8018b1d0 msgr2=0x7efe8016c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe8018b1d0 0x7efe8016c440 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7efe7800c730 tx=0x7efe7800cbf0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 -- 172.21.15.69:0/1616130175 shutdown_connections 2024-02-21T07:43:38.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe6009f130 0x7efe600a15f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe8018b1d0 0x7efe8016c440 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe8017f2a0 0x7efe8016bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 --2- 172.21.15.69:0/1616130175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe800fe870 0x7efe801643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 -- 172.21.15.69:0/1616130175 >> 172.21.15.69:0/1616130175 conn(0x7efe800d2b00 msgr2=0x7efe8018b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 -- 172.21.15.69:0/1616130175 shutdown_connections 2024-02-21T07:43:38.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.237+0000 7efe85c00640 1 -- 172.21.15.69:0/1616130175 wait complete. 2024-02-21T07:43:38.258 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:43:38.258 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-02-21T07:43:38.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.429+0000 7f2bfca00640 1 Processor -- start 2024-02-21T07:43:38.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.429+0000 7f2bfca00640 1 -- start start 2024-02-21T07:43:38.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.431+0000 7f2bfca00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2bf80fe870 0x7f2bf818ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.431+0000 7f2bfca00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf818a800 con 0x7f2bf818b1d0 2024-02-21T07:43:38.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.431+0000 7f2bfca00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf80fde70 con 0x7f2bf817f2a0 2024-02-21T07:43:38.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.431+0000 7f2bfca00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf80ff160 con 0x7f2bf80fe870 2024-02-21T07:43:38.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.431+0000 7f2bf7400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f2bf817f2a0 0x7f2bf80fe160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:53954/0 (socket says 172.21.15.69:53954) 2024-02-21T07:43:38.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.431+0000 7f2bf7400640 1 -- 172.21.15.69:0/2206970609 learned_addr learned my addr 172.21.15.69:0/2206970609 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:38.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.431+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/2206970609 >> v2:172.21.15.69:3300/0 conn(0x7f2bf80fe870 0x7f2bf818ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.432+0000 7f2bf6000640 1 -- 172.21.15.69:0/2206970609 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431909862 0 0) 0x7f2bf80fde70 con 0x7f2bf817f2a0 2024-02-21T07:43:38.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.432+0000 7f2bf6000640 1 -- 172.21.15.69:0/2206970609 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bdc003520 con 0x7f2bf817f2a0 2024-02-21T07:43:38.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.432+0000 7f2bf6000640 1 -- 172.21.15.69:0/2206970609 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402266139 0 0) 0x7f2bf818a800 con 0x7f2bf818b1d0 2024-02-21T07:43:38.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.432+0000 7f2bf6000640 1 -- 172.21.15.69:0/2206970609 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf80fde70 con 0x7f2bf818b1d0 2024-02-21T07:43:38.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.432+0000 7f2bf6a00640 1 -- 172.21.15.69:0/2206970609 >> v1:172.21.15.174:6789/0 conn(0x7f2bf817f2a0 legacy=0x7f2bf80fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.432+0000 7f2bf6a00640 1 -- 172.21.15.69:0/2206970609 >> v1:172.21.15.69:6789/0 conn(0x7f2bf818b1d0 legacy=0x7f2bf80ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.432+0000 7f2bf6a00640 1 -- 172.21.15.69:0/2206970609 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf8189f10 con 0x7f2bf80fe870 2024-02-21T07:43:38.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.433+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/2206970609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf80fe870 0x7f2bf818ac90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2be40097a0 tx=0x7f2be402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3116588c1fc5f21e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.433+0000 7f2bf6000640 1 -- 172.21.15.69:0/2206970609 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be4031830 con 0x7f2bf80fe870 2024-02-21T07:43:38.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.433+0000 7f2bf6000640 1 -- 172.21.15.69:0/2206970609 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be4031990 con 0x7f2bf80fe870 2024-02-21T07:43:38.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.433+0000 7f2bf6000640 1 -- 172.21.15.69:0/2206970609 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be4031d20 con 0x7f2bf80fe870 2024-02-21T07:43:38.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.434+0000 7f2bfca00640 1 -- 172.21.15.69:0/2206970609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf80fe870 msgr2=0x7f2bf818ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.434+0000 7f2bfca00640 1 --2- 172.21.15.69:0/2206970609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf80fe870 0x7f2bf818ac90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2be40097a0 tx=0x7f2be402b8d0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.434+0000 7f2bfca00640 1 -- 172.21.15.69:0/2206970609 shutdown_connections 2024-02-21T07:43:38.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.434+0000 7f2bfca00640 1 --2- 172.21.15.69:0/2206970609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf80fe870 0x7f2bf818ac90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.434+0000 7f2bfca00640 1 -- 172.21.15.69:0/2206970609 >> 172.21.15.69:0/2206970609 conn(0x7f2bf80d2b00 msgr2=0x7f2bf80d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.434+0000 7f2bfca00640 1 -- 172.21.15.69:0/2206970609 shutdown_connections 2024-02-21T07:43:38.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.434+0000 7f2bfca00640 1 -- 172.21.15.69:0/2206970609 wait complete. 2024-02-21T07:43:38.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.436+0000 7f2bfca00640 1 Processor -- start 2024-02-21T07:43:38.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.436+0000 7f2bfca00640 1 -- start start 2024-02-21T07:43:38.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.437+0000 7f2bfca00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80fe870 0x7f2bf81835e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.437+0000 7f2bfca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bf817f2a0 0x7f2bf80d1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.437+0000 7f2bfca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf818b1d0 0x7f2bf816b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.437+0000 7f2bfca00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf8183b20 con 0x7f2bf818b1d0 2024-02-21T07:43:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.437+0000 7f2bfca00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80d4ce0 con 0x7f2bf80fe870 2024-02-21T07:43:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.437+0000 7f2bfca00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80d06d0 con 0x7f2bf817f2a0 2024-02-21T07:43:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf818b1d0 0x7f2bf816b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80fe870 0x7f2bf81835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf818b1d0 0x7f2bf816b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58694/0 (socket says 172.21.15.69:58694) 2024-02-21T07:43:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7e00640 1 -- 172.21.15.69:0/3815552645 learned_addr learned my addr 172.21.15.69:0/3815552645 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80fe870 0x7f2bf81835e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:57434/0 (socket says 172.21.15.69:57434) 2024-02-21T07:43:38.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bf817f2a0 0x7f2bf80d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7400640 1 -- 172.21.15.69:0/3815552645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bf817f2a0 msgr2=0x7f2bf80d1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7400640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bf817f2a0 0x7f2bf80d1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7400640 1 -- 172.21.15.69:0/3815552645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf818b1d0 msgr2=0x7f2bf816b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7400640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf818b1d0 0x7f2bf816b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7400640 1 -- 172.21.15.69:0/3815552645 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be4009400 con 0x7f2bf80fe870 2024-02-21T07:43:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.438+0000 7f2bf7e00640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf818b1d0 0x7f2bf816b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.439+0000 7f2bf7400640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80fe870 0x7f2bf81835e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2be800c410 tx=0x7f2be800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.439+0000 7f2bef400640 1 -- 172.21.15.69:0/3815552645 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be80074e0 con 0x7f2bf80fe870 2024-02-21T07:43:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.439+0000 7f2bef400640 1 -- 172.21.15.69:0/3815552645 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be8007640 con 0x7f2bf80fe870 2024-02-21T07:43:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.439+0000 7f2bef400640 1 -- 172.21.15.69:0/3815552645 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8004a00 con 0x7f2bf80fe870 2024-02-21T07:43:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.439+0000 7f2bfca00640 1 -- 172.21.15.69:0/3815552645 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf80d09b0 con 0x7f2bf80fe870 2024-02-21T07:43:38.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.439+0000 7f2bfca00640 1 -- 172.21.15.69:0/3815552645 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf80d0f70 con 0x7f2bf80fe870 2024-02-21T07:43:38.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.444+0000 7f2c00be3740 1 Processor -- start 2024-02-21T07:43:38.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.444+0000 7f2bef400640 1 -- 172.21.15.69:0/3815552645 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f2be8004b60 con 0x7f2bf80fe870 2024-02-21T07:43:38.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.445+0000 7f2c00be3740 1 -- start start 2024-02-21T07:43:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.446+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf070 0x55b08e3bf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.446+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 0x55b08e3fa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.446+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3fb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.446+0000 7f2c00be3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e2f2210 con 0x55b08e3fa740 2024-02-21T07:43:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.446+0000 7f2c00be3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e2ef740 con 0x55b08e3bf990 2024-02-21T07:43:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.446+0000 7f2c00be3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e2eaf20 con 0x55b08e3bf070 2024-02-21T07:43:38.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bef400640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2bd809f1b0 0x7f2bd80a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bef400640 1 -- 172.21.15.69:0/3815552645 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2be80c9ae0 con 0x7f2bf80fe870 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf070 0x55b08e3bf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf070 0x55b08e3bf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:46068/0 (socket says 172.21.15.69:46068) 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf7e00640 1 -- 172.21.15.69:0/3458224100 learned_addr learned my addr 172.21.15.69:0/3458224100 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf7e00640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2bd809f1b0 0x7f2bd80a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/3458224100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3fb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf7400640 1 --2- 172.21.15.69:0/3458224100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 0x55b08e3fa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf7e00640 1 -- 172.21.15.69:0/3458224100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 msgr2=0x55b08e3fa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf7e00640 1 --2- 172.21.15.69:0/3458224100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 0x55b08e3fa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf7e00640 1 -- 172.21.15.69:0/3458224100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 msgr2=0x55b08e3fb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf7e00640 1 --2- 172.21.15.69:0/3458224100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3fb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf7e00640 1 -- 172.21.15.69:0/3458224100 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b08e2acdf0 con 0x55b08e3bf070 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.447+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/3458224100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3fb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:43:38.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.448+0000 7f2bf7e00640 1 --2- 172.21.15.69:0/3458224100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf070 0x55b08e3bf450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00138f0 tx=0x7f2bf0013db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65d5cdc6581b7def server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.448+0000 7f2bf7e00640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2bd809f1b0 0x7f2bd80a1670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005000 tx=0x7f2bf001b000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.448+0000 7f2be3400640 1 -- 172.21.15.69:0/3458224100 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf00052b0 con 0x55b08e3bf070 2024-02-21T07:43:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.448+0000 7f2be3400640 1 -- 172.21.15.69:0/3458224100 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0005470 con 0x55b08e3bf070 2024-02-21T07:43:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.448+0000 7f2be3400640 1 -- 172.21.15.69:0/3458224100 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0005820 con 0x55b08e3bf070 2024-02-21T07:43:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.449+0000 7f2c00be3740 1 -- 172.21.15.69:0/3458224100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf070 msgr2=0x55b08e3bf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.449+0000 7f2c00be3740 1 --2- 172.21.15.69:0/3458224100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf070 0x55b08e3bf450 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00138f0 tx=0x7f2bf0013db0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.449+0000 7f2c00be3740 1 -- 172.21.15.69:0/3458224100 shutdown_connections 2024-02-21T07:43:38.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.449+0000 7f2c00be3740 1 --2- 172.21.15.69:0/3458224100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3fb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.449+0000 7f2c00be3740 1 --2- 172.21.15.69:0/3458224100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 0x55b08e3fa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.449+0000 7f2c00be3740 1 --2- 172.21.15.69:0/3458224100 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf070 0x55b08e3bf450 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.449+0000 7f2c00be3740 1 -- 172.21.15.69:0/3458224100 >> 172.21.15.69:0/3458224100 conn(0x55b08e381640 msgr2=0x55b08e3826c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.449+0000 7f2c00be3740 1 -- 172.21.15.69:0/3458224100 shutdown_connections 2024-02-21T07:43:38.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.449+0000 7f2c00be3740 1 -- 172.21.15.69:0/3458224100 wait complete. 2024-02-21T07:43:38.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.450+0000 7f2c00be3740 1 -- start start 2024-02-21T07:43:38.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.450+0000 7f2c00be3740 1 Processor -- start 2024-02-21T07:43:38.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf990 0x55b08e3b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3fa740 0x55b08e3bbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 0x55b08e3be4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2c00be3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e290150 con 0x55b08e3c9050 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2c00be3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e28fdf0 con 0x55b08e3fa740 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2c00be3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e0591c0 con 0x55b08e3bf990 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2c00be3740 10 client.0 _ll_register_callbacks cb 0x55b08e2df2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2bf6a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3fa740 0x55b08e3bbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2bf6a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3fa740 0x55b08e3bbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:57462/0 (socket says 172.21.15.69:57462) 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2bf6a00640 1 -- 172.21.15.69:0/1396817663 learned_addr learned my addr 172.21.15.69:0/1396817663 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2bf7400640 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf990 0x55b08e3b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.452+0000 7f2bf7e00640 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 0x55b08e3be4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2bf6a00640 1 -- 172.21.15.69:0/1396817663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf990 msgr2=0x55b08e3b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf990 0x55b08e3b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2bf6a00640 1 -- 172.21.15.69:0/1396817663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 msgr2=0x55b08e3be4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 0x55b08e3be4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2bf6a00640 1 -- 172.21.15.69:0/1396817663 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf80fde70 con 0x55b08e3fa740 2024-02-21T07:43:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2bf7e00640 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 0x55b08e3be4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3fa740 0x55b08e3bbb50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2be402bee0 tx=0x7f2be402e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaeac4728a6723b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2bd7e00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2bd7e00640 1 -- 172.21.15.69:0/1396817663 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be403f040 con 0x55b08e3fa740 2024-02-21T07:43:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2bd7e00640 1 -- 172.21.15.69:0/1396817663 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2be4044480 con 0x55b08e3fa740 2024-02-21T07:43:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.453+0000 7f2c00be3740 1 -- 172.21.15.69:0/1396817663 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b08dfea7e0 con 0x55b08e3fa740 2024-02-21T07:43:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.454+0000 7f2bd7e00640 1 -- 172.21.15.69:0/1396817663 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2be4044640 con 0x55b08e3fa740 2024-02-21T07:43:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.454+0000 7f2c00be3740 10 client.5347 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.454+0000 7f2c00be3740 1 -- 172.21.15.69:0/1396817663 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55b08e2e95a0 con 0x55b08e3fa740 2024-02-21T07:43:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.454+0000 7f2bd7e00640 1 -- 172.21.15.69:0/1396817663 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b08dfea7e0 con 0x55b08e3fa740 2024-02-21T07:43:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.454+0000 7f2bd7e00640 1 -- 172.21.15.69:0/1396817663 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2be404c070 con 0x55b08e3fa740 2024-02-21T07:43:38.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.454+0000 7f2c00be3740 10 client.5347 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.454+0000 7f2c00be3740 10 client.5347 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.d 2024-02-21T07:43:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.454+0000 7f2c00be3740 20 client.5347 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.454+0000 7f2c00be3740 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55b08e37d7a0 0x55b08e406a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.455+0000 7f2c00be3740 4 client.5347 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.455+0000 7f2c00be3740 1 -- 172.21.15.69:0/1396817663 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b08e027720 con 0x55b08e37d7a0 2024-02-21T07:43:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.455+0000 7f2bf7400640 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55b08e37d7a0 0x55b08e406a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.455+0000 7f2bd7e00640 10 client.5347 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:43:38.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.455+0000 7f2bf7400640 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55b08e37d7a0 0x55b08e406a50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4b01d74c9fb5b526 server_cookie=7728c6f8cf9cb173 in_seq=0 out_seq=0 2024-02-21T07:43:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2bd7e00640 1 -- 172.21.15.69:0/1396817663 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b08e027720 con 0x55b08e37d7a0 2024-02-21T07:43:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2bd7e00640 10 client.5347 handle_command_reply: tid=0 2024-02-21T07:43:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2c00be3740 1 client.5347 shutdown 2024-02-21T07:43:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2c00be3740 1 -- 172.21.15.69:0/1396817663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3fa740 msgr2=0x55b08e3bbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2c00be3740 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3fa740 0x55b08e3bbb50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2be402bee0 tx=0x7f2be402e000 comp rx=0 tx=0).stop 2024-02-21T07:43:38.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2c00be3740 1 -- 172.21.15.69:0/1396817663 shutdown_connections 2024-02-21T07:43:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2c00be3740 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55b08e37d7a0 0x55b08e406a50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2bd7e00640 0 client.5347 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:43:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2c00be3740 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 0x55b08e3be4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2c00be3740 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3fa740 0x55b08e3bbb50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2c00be3740 1 --2- 172.21.15.69:0/1396817663 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf990 0x55b08e3b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.456+0000 7f2c00be3740 1 -- 172.21.15.69:0/1396817663 >> 172.21.15.69:0/1396817663 conn(0x55b08e3bf070 msgr2=0x55b08e3830b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.457+0000 7f2c00be3740 1 -- 172.21.15.69:0/1396817663 shutdown_connections 2024-02-21T07:43:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.457+0000 7f2c00be3740 1 -- 172.21.15.69:0/1396817663 wait complete. 2024-02-21T07:43:38.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.457+0000 7f2c00be3740 20 client.5347 trim_cache size 0 max 16384 2024-02-21T07:43:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.470+0000 7f2c00be3740 1 Processor -- start 2024-02-21T07:43:38.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.470+0000 7f2c00be3740 1 -- start start 2024-02-21T07:43:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf990 0x55b08e3c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3c9050 0x55b08e3faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2c00be3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e3c7950 con 0x55b08e3fa740 2024-02-21T07:43:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2c00be3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e379550 con 0x55b08e3c9050 2024-02-21T07:43:38.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2c00be3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e3b3b20 con 0x55b08e3bf990 2024-02-21T07:43:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2bf7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2bf6a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3c9050 0x55b08e3faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2bf7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58712/0 (socket says 172.21.15.69:58712) 2024-02-21T07:43:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2bf7e00640 1 -- 172.21.15.69:0/1622771194 learned_addr learned my addr 172.21.15.69:0/1622771194 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.471+0000 7f2bf6a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3c9050 0x55b08e3faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:57474/0 (socket says 172.21.15.69:57474) 2024-02-21T07:43:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.472+0000 7f2bf7400640 1 --2- 172.21.15.69:0/1622771194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf990 0x55b08e3c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.472+0000 7f2bf6a00640 1 -- 172.21.15.69:0/1622771194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf990 msgr2=0x55b08e3c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.472+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/1622771194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf990 0x55b08e3c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.472+0000 7f2bf6a00640 1 -- 172.21.15.69:0/1622771194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 msgr2=0x55b08e3c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.472+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/1622771194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.472+0000 7f2bf6a00640 1 -- 172.21.15.69:0/1622771194 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b08e285ab0 con 0x55b08e3c9050 2024-02-21T07:43:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.472+0000 7f2bf7e00640 1 --2- 172.21.15.69:0/1622771194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.472+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/1622771194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3c9050 0x55b08e3faea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2be4000c00 tx=0x7f2be4031000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60f79d3fbd0c9e90 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2be2a00640 1 -- 172.21.15.69:0/1622771194 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be403f040 con 0x55b08e3c9050 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2be2a00640 1 -- 172.21.15.69:0/1622771194 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be40447f0 con 0x55b08e3c9050 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2be2a00640 1 -- 172.21.15.69:0/1622771194 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be4044a70 con 0x55b08e3c9050 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2c00be3740 1 -- 172.21.15.69:0/1622771194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3c9050 msgr2=0x55b08e3faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2c00be3740 1 --2- 172.21.15.69:0/1622771194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3c9050 0x55b08e3faea0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2be4000c00 tx=0x7f2be4031000 comp rx=0 tx=0).stop 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2c00be3740 1 -- 172.21.15.69:0/1622771194 shutdown_connections 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2c00be3740 1 --2- 172.21.15.69:0/1622771194 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3fa740 0x55b08e3c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2c00be3740 1 --2- 172.21.15.69:0/1622771194 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3c9050 0x55b08e3faea0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2c00be3740 1 --2- 172.21.15.69:0/1622771194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3bf990 0x55b08e3c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2c00be3740 1 -- 172.21.15.69:0/1622771194 >> 172.21.15.69:0/1622771194 conn(0x55b08e3bf070 msgr2=0x55b08e3830b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2c00be3740 1 -- 172.21.15.69:0/1622771194 shutdown_connections 2024-02-21T07:43:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.473+0000 7f2c00be3740 1 -- 172.21.15.69:0/1622771194 wait complete. 2024-02-21T07:43:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.474+0000 7f2c00be3740 1 -- start start 2024-02-21T07:43:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.474+0000 7f2c00be3740 1 Processor -- start 2024-02-21T07:43:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 0x55b08e382720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 0x55b08e3bbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2c00be3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3fa740 0x55b08e3e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2c00be3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e382c60 con 0x55b08e3c9050 2024-02-21T07:43:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2c00be3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e3e7c40 con 0x55b08e3bf990 2024-02-21T07:43:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2c00be3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b08e3bc000 con 0x55b08e3fa740 2024-02-21T07:43:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2c00be3740 10 client.0 _ll_register_callbacks cb 0x7f2bf0001e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 0x55b08e382720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 0x55b08e382720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:57476/0 (socket says 172.21.15.69:57476) 2024-02-21T07:43:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf7400640 1 -- 172.21.15.69:0/2834644421 learned_addr learned my addr 172.21.15.69:0/2834644421 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 0x55b08e3bbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf7e00640 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3fa740 0x55b08e3e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf7400640 1 -- 172.21.15.69:0/2834644421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3fa740 msgr2=0x55b08e3e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf7400640 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3fa740 0x55b08e3e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf7400640 1 -- 172.21.15.69:0/2834644421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 msgr2=0x55b08e3bbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf7400640 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 0x55b08e3bbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf7400640 1 -- 172.21.15.69:0/2834644421 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b08e2acdf0 con 0x55b08e3bf990 2024-02-21T07:43:38.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.476+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 0x55b08e3bbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.477+0000 7f2bf7400640 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 0x55b08e382720 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2be80938f0 tx=0x7f2be801f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f164c3f457b361 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.477+0000 7f2bd7e00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.477+0000 7f2bd7e00640 1 -- 172.21.15.69:0/2834644421 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8093b50 con 0x55b08e3bf990 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.477+0000 7f2bd7e00640 1 -- 172.21.15.69:0/2834644421 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2be8093cb0 con 0x55b08e3bf990 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.477+0000 7f2c00be3740 1 -- 172.21.15.69:0/2834644421 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2bf0005470 con 0x55b08e3bf990 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.477+0000 7f2bd7e00640 1 -- 172.21.15.69:0/2834644421 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2be80c7580 con 0x55b08e3bf990 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.477+0000 7f2c00be3740 10 client.5353 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.477+0000 7f2c00be3740 1 -- 172.21.15.69:0/2834644421 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55b08e2e95a0 con 0x55b08e3bf990 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.478+0000 7f2bd7e00640 1 -- 172.21.15.69:0/2834644421 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0005470 con 0x55b08e3bf990 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.478+0000 7f2bd7e00640 1 -- 172.21.15.69:0/2834644421 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2be801b060 con 0x55b08e3bf990 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.478+0000 7f2c00be3740 10 client.5353 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.478+0000 7f2c00be3740 10 client.5353 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.d 2024-02-21T07:43:38.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.478+0000 7f2c00be3740 20 client.5353 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.478+0000 7f2c00be3740 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55b08e3c3760 0x55b08e4638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.478+0000 7f2c00be3740 4 client.5353 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.478+0000 7f2c00be3740 1 -- 172.21.15.69:0/2834644421 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b08e076890 con 0x55b08e3c3760 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.478+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55b08e3c3760 0x55b08e4638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.479+0000 7f2bf6a00640 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55b08e3c3760 0x55b08e4638f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5a246b4c31708cad server_cookie=f13b7a172ab0a4d in_seq=0 out_seq=0 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.479+0000 7f2bd7e00640 10 client.5353 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.479+0000 7f2bd7e00640 1 -- 172.21.15.69:0/2834644421 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b08e076890 con 0x55b08e3c3760 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.479+0000 7f2bd7e00640 10 client.5353 handle_command_reply: tid=0 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.479+0000 7f2c00be3740 1 client.5353 shutdown 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.479+0000 7f2c00be3740 1 -- 172.21.15.69:0/2834644421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 msgr2=0x55b08e382720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.479+0000 7f2c00be3740 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 0x55b08e382720 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2be80938f0 tx=0x7f2be801f040 comp rx=0 tx=0).stop 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.480+0000 7f2c00be3740 1 -- 172.21.15.69:0/2834644421 shutdown_connections 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.480+0000 7f2c00be3740 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55b08e3c3760 0x55b08e4638f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.480+0000 7f2c00be3740 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b08e3fa740 0x55b08e3e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.480+0000 7f2c00be3740 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b08e3c9050 0x55b08e3bbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.480+0000 7f2c00be3740 1 --2- 172.21.15.69:0/2834644421 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b08e3bf990 0x55b08e382720 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.480+0000 7f2bd7e00640 0 client.5353 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:43:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.480+0000 7f2c00be3740 1 -- 172.21.15.69:0/2834644421 >> 172.21.15.69:0/2834644421 conn(0x55b08e3bf070 msgr2=0x55b08e3c7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.480+0000 7f2c00be3740 1 -- 172.21.15.69:0/2834644421 shutdown_connections 2024-02-21T07:43:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.480+0000 7f2c00be3740 1 -- 172.21.15.69:0/2834644421 wait complete. 2024-02-21T07:43:38.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.480+0000 7f2c00be3740 20 client.5353 trim_cache size 0 max 16384 2024-02-21T07:43:38.488 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:43:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 -- 172.21.15.69:0/3815552645 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2bd809f1b0 msgr2=0x7f2bd80a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2bd809f1b0 0x7f2bd80a1670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0005000 tx=0x7f2bf001b000 comp rx=0 tx=0).stop 2024-02-21T07:43:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 -- 172.21.15.69:0/3815552645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80fe870 msgr2=0x7f2bf81835e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80fe870 0x7f2bf81835e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2be800c410 tx=0x7f2be800c8d0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 -- 172.21.15.69:0/3815552645 shutdown_connections 2024-02-21T07:43:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2bd809f1b0 0x7f2bd80a1670 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf818b1d0 0x7f2bf816b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2bf817f2a0 0x7f2bf80d1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 --2- 172.21.15.69:0/3815552645 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2bf80fe870 0x7f2bf81835e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 -- 172.21.15.69:0/3815552645 >> 172.21.15.69:0/3815552645 conn(0x7f2bf80d2b00 msgr2=0x7f2bf818b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 -- 172.21.15.69:0/3815552645 shutdown_connections 2024-02-21T07:43:38.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.481+0000 7f2bfca00640 1 -- 172.21.15.69:0/3815552645 wait complete. 2024-02-21T07:43:38.502 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:43:38.503 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:43:38.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.671+0000 7fa861800640 1 Processor -- start 2024-02-21T07:43:38.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.671+0000 7fa861800640 1 -- start start 2024-02-21T07:43:38.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.673+0000 7fa861800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa85c183ea0 0x7fa85c1846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.673+0000 7fa861800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa85c0eed50 0x7fa85c186bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.673+0000 7fa861800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85c1850b0 con 0x7fa85c184c20 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.673+0000 7fa861800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85c186010 con 0x7fa85c183ea0 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.673+0000 7fa861800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85c185390 con 0x7fa85c0eed50 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.673+0000 7fa85aa00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa85c183ea0 0x7fa85c1846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.673+0000 7fa85aa00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa85c183ea0 0x7fa85c1846e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58738/0 (socket says 172.21.15.69:58738) 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.673+0000 7fa85aa00640 1 -- 172.21.15.69:0/2848370058 learned_addr learned my addr 172.21.15.69:0/2848370058 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.673+0000 7fa85a000640 1 --1- 172.21.15.69:0/2848370058 >> v1:172.21.15.184:6789/0 conn(0x7fa85c184c20 0x7fa85c0ee640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:40040/0 (socket says 172.21.15.69:40040) 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.673+0000 7fa85b400640 1 --2- 172.21.15.69:0/2848370058 >> v2:172.21.15.184:3300/0 conn(0x7fa85c0eed50 0x7fa85c186bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.674+0000 7fa859600640 1 -- 172.21.15.69:0/2848370058 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102911090 0 0) 0x7fa85c1850b0 con 0x7fa85c184c20 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.674+0000 7fa859600640 1 -- 172.21.15.69:0/2848370058 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa840003520 con 0x7fa85c184c20 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.674+0000 7fa85b400640 1 -- 172.21.15.69:0/2848370058 >> v2:172.21.15.69:3300/0 conn(0x7fa85c183ea0 msgr2=0x7fa85c1846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.674+0000 7fa85b400640 1 --2- 172.21.15.69:0/2848370058 >> v2:172.21.15.69:3300/0 conn(0x7fa85c183ea0 0x7fa85c1846e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.674+0000 7fa85b400640 1 -- 172.21.15.69:0/2848370058 >> v1:172.21.15.184:6789/0 conn(0x7fa85c184c20 legacy=0x7fa85c0ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.674+0000 7fa85b400640 1 -- 172.21.15.69:0/2848370058 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c185670 con 0x7fa85c0eed50 2024-02-21T07:43:38.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.674+0000 7fa85aa00640 1 --2- 172.21.15.69:0/2848370058 >> v2:172.21.15.69:3300/0 conn(0x7fa85c183ea0 0x7fa85c1846e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.676+0000 7fa85b400640 1 --2- 172.21.15.69:0/2848370058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 0x7fa85c186bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0cbf50 tx=0x7fa85402be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f026d228c8c78353 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.676+0000 7fa859600640 1 -- 172.21.15.69:0/2848370058 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85402cbe0 con 0x7fa85c0eed50 2024-02-21T07:43:38.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.676+0000 7fa859600640 1 -- 172.21.15.69:0/2848370058 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85402cd40 con 0x7fa85c0eed50 2024-02-21T07:43:38.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.676+0000 7fa859600640 1 -- 172.21.15.69:0/2848370058 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854034640 con 0x7fa85c0eed50 2024-02-21T07:43:38.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.677+0000 7fa861800640 1 -- 172.21.15.69:0/2848370058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 msgr2=0x7fa85c186bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.677+0000 7fa861800640 1 --2- 172.21.15.69:0/2848370058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 0x7fa85c186bc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0cbf50 tx=0x7fa85402be30 comp rx=0 tx=0).stop 2024-02-21T07:43:38.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.677+0000 7fa861800640 1 -- 172.21.15.69:0/2848370058 shutdown_connections 2024-02-21T07:43:38.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.677+0000 7fa861800640 1 --2- 172.21.15.69:0/2848370058 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 0x7fa85c186bc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.677+0000 7fa861800640 1 --2- 172.21.15.69:0/2848370058 >> v2:172.21.15.69:3300/0 conn(0x7fa85c183ea0 0x7fa85c1846e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.677+0000 7fa861800640 1 -- 172.21.15.69:0/2848370058 >> 172.21.15.69:0/2848370058 conn(0x7fa85c0ce3d0 msgr2=0x7fa85c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.677+0000 7fa861800640 1 -- 172.21.15.69:0/2848370058 shutdown_connections 2024-02-21T07:43:38.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.677+0000 7fa861800640 1 -- 172.21.15.69:0/2848370058 wait complete. 2024-02-21T07:43:38.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.679+0000 7fa861800640 1 Processor -- start 2024-02-21T07:43:38.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.679+0000 7fa861800640 1 -- start start 2024-02-21T07:43:38.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.680+0000 7fa861800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 0x7fa85c21a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.680+0000 7fa861800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa85c183ea0 0x7fa85c21b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.680+0000 7fa861800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa85c21b850 0x7fa85c16d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.680+0000 7fa861800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c21cf00 con 0x7fa85c183ea0 2024-02-21T07:43:38.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.680+0000 7fa861800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c21c010 con 0x7fa85c21b850 2024-02-21T07:43:38.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.680+0000 7fa861800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85c21c2f0 con 0x7fa85c0eed50 2024-02-21T07:43:38.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 0x7fa85c21a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 0x7fa85c21a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:46106/0 (socket says 172.21.15.69:46106) 2024-02-21T07:43:38.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85aa00640 1 -- 172.21.15.69:0/2349598243 learned_addr learned my addr 172.21.15.69:0/2349598243 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85b400640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa85c21b850 0x7fa85c16d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85a000640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa85c183ea0 0x7fa85c21b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85b400640 1 -- 172.21.15.69:0/2349598243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 msgr2=0x7fa85c21a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85b400640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 0x7fa85c21a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85b400640 1 -- 172.21.15.69:0/2349598243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa85c183ea0 msgr2=0x7fa85c21b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85b400640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa85c183ea0 0x7fa85c21b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85b400640 1 -- 172.21.15.69:0/2349598243 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c00d970 con 0x7fa85c21b850 2024-02-21T07:43:38.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85aa00640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 0x7fa85c21a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.681+0000 7fa85a000640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa85c183ea0 0x7fa85c21b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.682+0000 7fa85b400640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa85c21b850 0x7fa85c16d000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa854033000 tx=0x7fa854004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.682+0000 7fa852a00640 1 -- 172.21.15.69:0/2349598243 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854004800 con 0x7fa85c21b850 2024-02-21T07:43:38.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.682+0000 7fa852a00640 1 -- 172.21.15.69:0/2349598243 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa854009450 con 0x7fa85c21b850 2024-02-21T07:43:38.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.682+0000 7fa852a00640 1 -- 172.21.15.69:0/2349598243 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854034680 con 0x7fa85c21b850 2024-02-21T07:43:38.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.683+0000 7fa861800640 1 -- 172.21.15.69:0/2349598243 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa854009a70 con 0x7fa85c21b850 2024-02-21T07:43:38.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.683+0000 7fa861800640 1 -- 172.21.15.69:0/2349598243 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85c1865b0 con 0x7fa85c21b850 2024-02-21T07:43:38.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.687+0000 7fa86442d740 1 Processor -- start 2024-02-21T07:43:38.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.687+0000 7fa852a00640 1 -- 172.21.15.69:0/2349598243 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fa8540347e0 con 0x7fa85c21b850 2024-02-21T07:43:38.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.687+0000 7fa86442d740 1 -- start start 2024-02-21T07:43:38.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.688+0000 7fa852a00640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa83c09f130 0x7fa83c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.688+0000 7fa852a00640 1 -- 172.21.15.69:0/2349598243 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa8540ec860 con 0x7fa85c21b850 2024-02-21T07:43:38.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.689+0000 7fa85a000640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa83c09f130 0x7fa83c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.689+0000 7fa86442d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce932ec0 0x557bce9332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.689+0000 7fa86442d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.689+0000 7fa86442d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce96e590 0x557bce96f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.689+0000 7fa86442d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce866210 con 0x557bce96e590 2024-02-21T07:43:38.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.689+0000 7fa86442d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce863740 con 0x557bce932ec0 2024-02-21T07:43:38.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.689+0000 7fa86442d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce85ef20 con 0x557bce9337e0 2024-02-21T07:43:38.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.689+0000 7fa85a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.689+0000 7fa85a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:46116/0 (socket says 172.21.15.69:46116) 2024-02-21T07:43:38.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.689+0000 7fa85a000640 1 -- 172.21.15.69:0/2301799953 learned_addr learned my addr 172.21.15.69:0/2301799953 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.690+0000 7fa85b400640 1 --2- 172.21.15.69:0/2301799953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce96e590 0x557bce96f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.690+0000 7fa85a000640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa83c09f130 0x7fa83c0a15f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa85c17b9d0 tx=0x7fa848004bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.690+0000 7fa85aa00640 1 --2- 172.21.15.69:0/2301799953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce932ec0 0x557bce9332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.690+0000 7fa85a000640 1 -- 172.21.15.69:0/2301799953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce932ec0 msgr2=0x557bce9332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.690+0000 7fa85a000640 1 --2- 172.21.15.69:0/2301799953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce932ec0 0x557bce9332a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.690+0000 7fa85a000640 1 -- 172.21.15.69:0/2301799953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce96e590 msgr2=0x557bce96f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.690+0000 7fa85a000640 1 --2- 172.21.15.69:0/2301799953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce96e590 0x557bce96f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.690+0000 7fa85a000640 1 -- 172.21.15.69:0/2301799953 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bce820df0 con 0x557bce9337e0 2024-02-21T07:43:38.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.690+0000 7fa85a000640 1 --2- 172.21.15.69:0/2301799953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96e050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa848001ea0 tx=0x7fa84801a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=794715e56ec2897c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.690+0000 7fa847400640 1 -- 172.21.15.69:0/2301799953 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848004ce0 con 0x557bce9337e0 2024-02-21T07:43:38.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.691+0000 7fa847400640 1 -- 172.21.15.69:0/2301799953 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa848004e40 con 0x557bce9337e0 2024-02-21T07:43:38.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.691+0000 7fa847400640 1 -- 172.21.15.69:0/2301799953 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84801f610 con 0x557bce9337e0 2024-02-21T07:43:38.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.691+0000 7fa86442d740 1 -- 172.21.15.69:0/2301799953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 msgr2=0x557bce96e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.691+0000 7fa86442d740 1 --2- 172.21.15.69:0/2301799953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96e050 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa848001ea0 tx=0x7fa84801a000 comp rx=0 tx=0).stop 2024-02-21T07:43:38.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.692+0000 7fa86442d740 1 -- 172.21.15.69:0/2301799953 shutdown_connections 2024-02-21T07:43:38.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.692+0000 7fa86442d740 1 --2- 172.21.15.69:0/2301799953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce96e590 0x557bce96f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.692+0000 7fa86442d740 1 --2- 172.21.15.69:0/2301799953 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96e050 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.692+0000 7fa86442d740 1 --2- 172.21.15.69:0/2301799953 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce932ec0 0x557bce9332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.692+0000 7fa86442d740 1 -- 172.21.15.69:0/2301799953 >> 172.21.15.69:0/2301799953 conn(0x557bce8f5490 msgr2=0x557bce8f6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.692+0000 7fa86442d740 1 -- 172.21.15.69:0/2301799953 shutdown_connections 2024-02-21T07:43:38.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.692+0000 7fa86442d740 1 -- 172.21.15.69:0/2301799953 wait complete. 2024-02-21T07:43:38.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.693+0000 7fa86442d740 1 -- start start 2024-02-21T07:43:38.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.693+0000 7fa86442d740 1 Processor -- start 2024-02-21T07:43:38.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa86442d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce924140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa86442d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce96e590 0x557bce928d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa86442d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce91de50 0x557bce9249f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa86442d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce804150 con 0x557bce91de50 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa86442d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce803df0 con 0x557bce96e590 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa86442d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce5cd1c0 con 0x557bce9337e0 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa86442d740 10 client.0 _ll_register_callbacks cb 0x557bce8532b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce924140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce924140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:46130/0 (socket says 172.21.15.69:46130) 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85aa00640 1 -- 172.21.15.69:0/1238087958 learned_addr learned my addr 172.21.15.69:0/1238087958 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85a000640 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce96e590 0x557bce928d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85b400640 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce91de50 0x557bce9249f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85a000640 1 -- 172.21.15.69:0/1238087958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 msgr2=0x557bce924140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85a000640 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce924140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85a000640 1 -- 172.21.15.69:0/1238087958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce91de50 msgr2=0x557bce9249f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85a000640 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce91de50 0x557bce9249f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85a000640 1 -- 172.21.15.69:0/1238087958 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa840003520 con 0x557bce96e590 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.696+0000 7fa85b400640 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce91de50 0x557bce9249f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.697+0000 7fa85a000640 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce96e590 0x557bce928d50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa848021000 tx=0x7fa848000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af29a987f3ce5a2d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.697+0000 7fa83be00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.697+0000 7fa83be00640 1 -- 172.21.15.69:0/1238087958 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84801fa50 con 0x557bce96e590 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.697+0000 7fa83be00640 1 -- 172.21.15.69:0/1238087958 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa84801fbb0 con 0x557bce96e590 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.697+0000 7fa86442d740 1 -- 172.21.15.69:0/1238087958 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557bce55e7e0 con 0x557bce96e590 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.697+0000 7fa83be00640 1 -- 172.21.15.69:0/1238087958 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa84801fd70 con 0x557bce96e590 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.697+0000 7fa86442d740 10 client.5359 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.697+0000 7fa86442d740 1 -- 172.21.15.69:0/1238087958 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x557bce85d5a0 con 0x557bce96e590 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.698+0000 7fa83be00640 1 -- 172.21.15.69:0/1238087958 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557bce55e7e0 con 0x557bce96e590 2024-02-21T07:43:38.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.698+0000 7fa83be00640 1 -- 172.21.15.69:0/1238087958 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa848031440 con 0x557bce96e590 2024-02-21T07:43:38.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.698+0000 7fa86442d740 10 client.5359 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:38.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.698+0000 7fa86442d740 10 client.5359 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.g 2024-02-21T07:43:38.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.698+0000 7fa86442d740 20 client.5359 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:38.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.698+0000 7fa86442d740 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x557bce927030 0x557bce97ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.698+0000 7fa86442d740 4 client.5359 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:38.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.698+0000 7fa86442d740 1 -- 172.21.15.69:0/1238087958 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557bce59b720 con 0x557bce927030 2024-02-21T07:43:38.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.698+0000 7fa85aa00640 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x557bce927030 0x557bce97ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.699+0000 7fa85aa00640 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x557bce927030 0x557bce97ade0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ec1b656a44eb25b server_cookie=a3ea4965454a9b85 in_seq=0 out_seq=0 2024-02-21T07:43:38.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.699+0000 7fa83be00640 10 client.5359 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:43:38.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa83be00640 1 -- 172.21.15.69:0/1238087958 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557bce59b720 con 0x557bce927030 2024-02-21T07:43:38.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa83be00640 10 client.5359 handle_command_reply: tid=0 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa86442d740 1 client.5359 shutdown 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa86442d740 1 -- 172.21.15.69:0/1238087958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce96e590 msgr2=0x557bce928d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa86442d740 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce96e590 0x557bce928d50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa848021000 tx=0x7fa848000ed0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa86442d740 1 -- 172.21.15.69:0/1238087958 shutdown_connections 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa86442d740 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x557bce927030 0x557bce97ade0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa86442d740 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce91de50 0x557bce9249f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa86442d740 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce96e590 0x557bce928d50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa86442d740 1 --2- 172.21.15.69:0/1238087958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce924140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa86442d740 1 -- 172.21.15.69:0/1238087958 >> 172.21.15.69:0/1238087958 conn(0x557bce932ec0 msgr2=0x557bce937380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.700+0000 7fa83be00640 0 client.5359 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.701+0000 7fa86442d740 1 -- 172.21.15.69:0/1238087958 shutdown_connections 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.701+0000 7fa86442d740 1 -- 172.21.15.69:0/1238087958 wait complete. 2024-02-21T07:43:38.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.701+0000 7fa86442d740 20 client.5359 trim_cache size 0 max 16384 2024-02-21T07:43:38.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.725+0000 7fa86442d740 1 Processor -- start 2024-02-21T07:43:38.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.726+0000 7fa86442d740 1 -- start start 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.727+0000 7fa86442d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.727+0000 7fa86442d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.727+0000 7fa86442d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce96e590 0x557bce9c8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa86442d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce8f6f90 con 0x557bce96e590 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa86442d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce8f0ff0 con 0x557bce91de50 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa86442d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce9c6b00 con 0x557bce9337e0 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85aa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85aa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:57534/0 (socket says 172.21.15.69:57534) 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85aa00640 1 -- 172.21.15.69:0/1882803796 learned_addr learned my addr 172.21.15.69:0/1882803796 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85b400640 1 --2- 172.21.15.69:0/1882803796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce96e590 0x557bce9c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85a000640 1 --2- 172.21.15.69:0/1882803796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85aa00640 1 -- 172.21.15.69:0/1882803796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 msgr2=0x557bce96d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85aa00640 1 --2- 172.21.15.69:0/1882803796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85aa00640 1 -- 172.21.15.69:0/1882803796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce96e590 msgr2=0x557bce9c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85aa00640 1 --2- 172.21.15.69:0/1882803796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce96e590 0x557bce9c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85aa00640 1 -- 172.21.15.69:0/1882803796 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bce7f9ab0 con 0x557bce91de50 2024-02-21T07:43:38.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.728+0000 7fa85a000640 1 --2- 172.21.15.69:0/1882803796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:43:38.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.729+0000 7fa85aa00640 1 --2- 172.21.15.69:0/1882803796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f2d20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0044f0 tx=0x7fa84c00f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42696305a023bacf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.729+0000 7fa846a00640 1 -- 172.21.15.69:0/1882803796 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c020070 con 0x557bce91de50 2024-02-21T07:43:38.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.729+0000 7fa846a00640 1 -- 172.21.15.69:0/1882803796 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c025070 con 0x557bce91de50 2024-02-21T07:43:38.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.729+0000 7fa846a00640 1 -- 172.21.15.69:0/1882803796 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c021470 con 0x557bce91de50 2024-02-21T07:43:38.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.730+0000 7fa86442d740 1 -- 172.21.15.69:0/1882803796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 msgr2=0x557bce8f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.730+0000 7fa86442d740 1 --2- 172.21.15.69:0/1882803796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f2d20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0044f0 tx=0x7fa84c00f040 comp rx=0 tx=0).stop 2024-02-21T07:43:38.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.730+0000 7fa86442d740 1 -- 172.21.15.69:0/1882803796 shutdown_connections 2024-02-21T07:43:38.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.730+0000 7fa86442d740 1 --2- 172.21.15.69:0/1882803796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce96e590 0x557bce9c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.730+0000 7fa86442d740 1 --2- 172.21.15.69:0/1882803796 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce9337e0 0x557bce96d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.730+0000 7fa86442d740 1 --2- 172.21.15.69:0/1882803796 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f2d20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.730+0000 7fa86442d740 1 -- 172.21.15.69:0/1882803796 >> 172.21.15.69:0/1882803796 conn(0x557bce932ec0 msgr2=0x557bce93edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.730+0000 7fa86442d740 1 -- 172.21.15.69:0/1882803796 shutdown_connections 2024-02-21T07:43:38.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.730+0000 7fa86442d740 1 -- 172.21.15.69:0/1882803796 wait complete. 2024-02-21T07:43:38.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.731+0000 7fa86442d740 1 -- start start 2024-02-21T07:43:38.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.732+0000 7fa86442d740 1 Processor -- start 2024-02-21T07:43:38.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa86442d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa86442d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce9337e0 0x557bce9be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa86442d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce96e590 0x557bce9c5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa86442d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce9777f0 con 0x557bce9337e0 2024-02-21T07:43:38.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa86442d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce9c76b0 con 0x557bce91de50 2024-02-21T07:43:38.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa86442d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bce8f2000 con 0x557bce96e590 2024-02-21T07:43:38.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa86442d740 10 client.0 _ll_register_callbacks cb 0x7fa8480070e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:38.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa85a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce9337e0 0x557bce9be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa85aa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa85a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce9337e0 0x557bce9be9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58774/0 (socket says 172.21.15.69:58774) 2024-02-21T07:43:38.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa85a000640 1 -- 172.21.15.69:0/3376986283 learned_addr learned my addr 172.21.15.69:0/3376986283 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.734+0000 7fa85b400640 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce96e590 0x557bce9c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.735+0000 7fa85aa00640 1 -- 172.21.15.69:0/3376986283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce96e590 msgr2=0x557bce9c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.735+0000 7fa85aa00640 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce96e590 0x557bce9c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.735+0000 7fa85aa00640 1 -- 172.21.15.69:0/3376986283 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce9337e0 msgr2=0x557bce9be9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.735+0000 7fa85aa00640 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce9337e0 0x557bce9be9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.735+0000 7fa85aa00640 1 -- 172.21.15.69:0/3376986283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c004260 con 0x557bce91de50 2024-02-21T07:43:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.735+0000 7fa85a000640 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce9337e0 0x557bce9be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.735+0000 7fa85aa00640 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f1780 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000c00 tx=0x7fa848009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93615cf4ecb8a08a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.735+0000 7fa83be00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:38.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.736+0000 7fa83be00640 1 -- 172.21.15.69:0/3376986283 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c006040 con 0x557bce91de50 2024-02-21T07:43:38.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.736+0000 7fa86442d740 1 -- 172.21.15.69:0/3376986283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa848004e40 con 0x557bce91de50 2024-02-21T07:43:38.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.736+0000 7fa83be00640 1 -- 172.21.15.69:0/3376986283 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa84c0061a0 con 0x557bce91de50 2024-02-21T07:43:38.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.736+0000 7fa83be00640 1 -- 172.21.15.69:0/3376986283 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa84c006360 con 0x557bce91de50 2024-02-21T07:43:38.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.736+0000 7fa86442d740 10 client.5365 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:38.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.736+0000 7fa86442d740 1 -- 172.21.15.69:0/3376986283 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x557bce81f650 con 0x557bce91de50 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.737+0000 7fa83be00640 1 -- 172.21.15.69:0/3376986283 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa848004e40 con 0x557bce91de50 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.737+0000 7fa83be00640 1 -- 172.21.15.69:0/3376986283 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa84c018070 con 0x557bce91de50 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.737+0000 7fa86442d740 10 client.5365 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.737+0000 7fa86442d740 10 client.5365 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.g 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.737+0000 7fa86442d740 20 client.5365 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.737+0000 7fa86442d740 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x557bce91da50 0x557bce9d5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.737+0000 7fa86442d740 4 client.5365 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.737+0000 7fa86442d740 1 -- 172.21.15.69:0/3376986283 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557bce5ea890 con 0x557bce91da50 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.738+0000 7fa85a000640 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x557bce91da50 0x557bce9d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.738+0000 7fa85a000640 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x557bce91da50 0x557bce9d5d60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b719107ac0b7287 server_cookie=f0d4b356f5452551 in_seq=0 out_seq=0 2024-02-21T07:43:38.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.738+0000 7fa83be00640 10 client.5365 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:43:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa83be00640 1 -- 172.21.15.69:0/3376986283 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557bce5ea890 con 0x557bce91da50 2024-02-21T07:43:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa83be00640 10 client.5365 handle_command_reply: tid=0 2024-02-21T07:43:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 client.5365 shutdown 2024-02-21T07:43:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 -- 172.21.15.69:0/3376986283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 msgr2=0x557bce8f1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f1780 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa84c000c00 tx=0x7fa848009040 comp rx=0 tx=0).stop 2024-02-21T07:43:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 -- 172.21.15.69:0/3376986283 shutdown_connections 2024-02-21T07:43:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x557bce91da50 0x557bce9d5d60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x557bce96e590 0x557bce9c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557bce9337e0 0x557bce9be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 --2- 172.21.15.69:0/3376986283 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x557bce91de50 0x557bce8f1780 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 -- 172.21.15.69:0/3376986283 >> 172.21.15.69:0/3376986283 conn(0x557bce932ec0 msgr2=0x557bce9c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa83be00640 0 client.5365 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:43:38.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 -- 172.21.15.69:0/3376986283 shutdown_connections 2024-02-21T07:43:38.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.739+0000 7fa86442d740 1 -- 172.21.15.69:0/3376986283 wait complete. 2024-02-21T07:43:38.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.740+0000 7fa86442d740 20 client.5365 trim_cache size 0 max 16384 2024-02-21T07:43:38.747 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:43:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.740+0000 7fa861800640 1 -- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa83c09f130 msgr2=0x7fa83c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.740+0000 7fa861800640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa83c09f130 0x7fa83c0a15f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa85c17b9d0 tx=0x7fa848004bb0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.740+0000 7fa861800640 1 -- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa85c21b850 msgr2=0x7fa85c16d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.740+0000 7fa861800640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa85c21b850 0x7fa85c16d000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa854033000 tx=0x7fa854004a40 comp rx=0 tx=0).stop 2024-02-21T07:43:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.741+0000 7fa861800640 1 -- 172.21.15.69:0/2349598243 shutdown_connections 2024-02-21T07:43:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.741+0000 7fa861800640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa83c09f130 0x7fa83c0a15f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.741+0000 7fa861800640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa85c21b850 0x7fa85c16d000 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.741+0000 7fa861800640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa85c183ea0 0x7fa85c21b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.741+0000 7fa861800640 1 --2- 172.21.15.69:0/2349598243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa85c0eed50 0x7fa85c21a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.741+0000 7fa861800640 1 -- 172.21.15.69:0/2349598243 >> 172.21.15.69:0/2349598243 conn(0x7fa85c0ce3d0 msgr2=0x7fa85c0ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.741+0000 7fa861800640 1 -- 172.21.15.69:0/2349598243 shutdown_connections 2024-02-21T07:43:38.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.741+0000 7fa861800640 1 -- 172.21.15.69:0/2349598243 wait complete. 2024-02-21T07:43:38.769 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:43:38.769 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:43:38.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.937+0000 7fc8dd000640 1 Processor -- start 2024-02-21T07:43:38.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.937+0000 7fc8dd000640 1 -- start start 2024-02-21T07:43:38.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.938+0000 7fc8dd000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8d817f2a0 0x7fc8d80fe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.938+0000 7fc8dd000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc8d80fe6a0 0x7fc8d818ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.938+0000 7fc8dd000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d818a800 con 0x7fc8d818b1d0 2024-02-21T07:43:38.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.938+0000 7fc8dd000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d80ff160 con 0x7fc8d80fe6a0 2024-02-21T07:43:38.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.938+0000 7fc8dd000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d80fde70 con 0x7fc8d817f2a0 2024-02-21T07:43:38.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.939+0000 7fc8d7400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8d817f2a0 0x7fc8d80fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.939+0000 7fc8d7400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc8d817f2a0 0x7fc8d80fe160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:48992/0 (socket says 172.21.15.69:48992) 2024-02-21T07:43:38.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.939+0000 7fc8d7400640 1 -- 172.21.15.69:0/1532406675 learned_addr learned my addr 172.21.15.69:0/1532406675 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.939+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/1532406675 >> v2:172.21.15.69:3300/0 conn(0x7fc8d80fe6a0 0x7fc8d818ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.939+0000 7fc8d7400640 1 -- 172.21.15.69:0/1532406675 >> v2:172.21.15.69:3300/0 conn(0x7fc8d80fe6a0 msgr2=0x7fc8d818ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.939+0000 7fc8d7400640 1 --2- 172.21.15.69:0/1532406675 >> v2:172.21.15.69:3300/0 conn(0x7fc8d80fe6a0 0x7fc8d818ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.939+0000 7fc8d7400640 1 -- 172.21.15.69:0/1532406675 >> v1:172.21.15.69:6789/0 conn(0x7fc8d818b1d0 legacy=0x7fc8d80ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.939+0000 7fc8d7400640 1 -- 172.21.15.69:0/1532406675 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8189f10 con 0x7fc8d817f2a0 2024-02-21T07:43:38.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.941+0000 7fc8d7400640 1 --2- 172.21.15.69:0/1532406675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8d817f2a0 0x7fc8d80fe160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80fe130 tx=0x7fc8c802b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c1c28b0c8f7171f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.941+0000 7fc8d6000640 1 -- 172.21.15.69:0/1532406675 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8030870 con 0x7fc8d817f2a0 2024-02-21T07:43:38.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.942+0000 7fc8d6000640 1 -- 172.21.15.69:0/1532406675 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c80309d0 con 0x7fc8d817f2a0 2024-02-21T07:43:38.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.942+0000 7fc8d6000640 1 -- 172.21.15.69:0/1532406675 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8030d60 con 0x7fc8d817f2a0 2024-02-21T07:43:38.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.942+0000 7fc8dd000640 1 -- 172.21.15.69:0/1532406675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8d817f2a0 msgr2=0x7fc8d80fe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.942+0000 7fc8dd000640 1 --2- 172.21.15.69:0/1532406675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8d817f2a0 0x7fc8d80fe160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80fe130 tx=0x7fc8c802b9b0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.942+0000 7fc8dd000640 1 -- 172.21.15.69:0/1532406675 shutdown_connections 2024-02-21T07:43:38.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.942+0000 7fc8dd000640 1 --2- 172.21.15.69:0/1532406675 >> v2:172.21.15.69:3300/0 conn(0x7fc8d80fe6a0 0x7fc8d818ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.942+0000 7fc8dd000640 1 --2- 172.21.15.69:0/1532406675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8d817f2a0 0x7fc8d80fe160 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.942+0000 7fc8dd000640 1 -- 172.21.15.69:0/1532406675 >> 172.21.15.69:0/1532406675 conn(0x7fc8d80d2b00 msgr2=0x7fc8d80d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.943+0000 7fc8dd000640 1 -- 172.21.15.69:0/1532406675 shutdown_connections 2024-02-21T07:43:38.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.943+0000 7fc8dd000640 1 -- 172.21.15.69:0/1532406675 wait complete. 2024-02-21T07:43:38.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.944+0000 7fc8dd000640 1 Processor -- start 2024-02-21T07:43:38.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.945+0000 7fc8dd000640 1 -- start start 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8dd000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8d80fe6a0 0x7fc8d821f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8dd000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8d817f2a0 0x7fc8d816d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8dd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d818b1d0 0x7fc8d816f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8dd000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d816f340 con 0x7fc8d818b1d0 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8dd000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d817ea50 con 0x7fc8d817f2a0 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8dd000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d821faf0 con 0x7fc8d80fe6a0 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8d7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d818b1d0 0x7fc8d816f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8d7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8d80fe6a0 0x7fc8d821f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8d7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d818b1d0 0x7fc8d816f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48360/0 (socket says 172.21.15.69:48360) 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8d7e00640 1 -- 172.21.15.69:0/1758187940 learned_addr learned my addr 172.21.15.69:0/1758187940 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.946+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8d817f2a0 0x7fc8d816d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.947+0000 7fc8d7e00640 1 -- 172.21.15.69:0/1758187940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8d80fe6a0 msgr2=0x7fc8d821f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.947+0000 7fc8d7e00640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8d80fe6a0 0x7fc8d821f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.947+0000 7fc8d7e00640 1 -- 172.21.15.69:0/1758187940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8d817f2a0 msgr2=0x7fc8d816d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.947+0000 7fc8d7e00640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8d817f2a0 0x7fc8d816d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.947+0000 7fc8d7e00640 1 -- 172.21.15.69:0/1758187940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80094d0 con 0x7fc8d818b1d0 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.947+0000 7fc8d7400640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8d80fe6a0 0x7fc8d821f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.947+0000 7fc8d7e00640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d818b1d0 0x7fc8d816f760 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000c800 tx=0x7fc8d000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.947+0000 7fc8cf400640 1 -- 172.21.15.69:0/1758187940 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0003b70 con 0x7fc8d818b1d0 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.947+0000 7fc8cf400640 1 -- 172.21.15.69:0/1758187940 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0003cf0 con 0x7fc8d818b1d0 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.947+0000 7fc8cf400640 1 -- 172.21.15.69:0/1758187940 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d000aa90 con 0x7fc8d818b1d0 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.948+0000 7fc8dd000640 1 -- 172.21.15.69:0/1758187940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d816e9e0 con 0x7fc8d818b1d0 2024-02-21T07:43:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.948+0000 7fc8dd000640 1 -- 172.21.15.69:0/1758187940 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d816ec80 con 0x7fc8d818b1d0 2024-02-21T07:43:38.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.953+0000 7fc8cf400640 1 -- 172.21.15.69:0/1758187940 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc8d000abf0 con 0x7fc8d818b1d0 2024-02-21T07:43:38.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.953+0000 7fc8e13cb740 1 Processor -- start 2024-02-21T07:43:38.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.954+0000 7fc8e13cb740 1 -- start start 2024-02-21T07:43:38.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb124070 0x55f4bb124450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb15f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 0x55f4bb1604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bb057210 con 0x55f4bb124990 2024-02-21T07:43:38.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bb054740 con 0x55f4bb15f740 2024-02-21T07:43:38.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bb04ff20 con 0x55f4bb124070 2024-02-21T07:43:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb124070 0x55f4bb124450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb124070 0x55f4bb124450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49004/0 (socket says 172.21.15.69:49004) 2024-02-21T07:43:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8d6a00640 1 -- 172.21.15.69:0/3982021313 learned_addr learned my addr 172.21.15.69:0/3982021313 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8d7400640 1 --2- 172.21.15.69:0/3982021313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/3982021313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 0x55f4bb1604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.955+0000 7fc8cf400640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc8b809f160 0x7fc8b80a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8cf400640 1 -- 172.21.15.69:0/1758187940 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc8d00c9980 con 0x7fc8d818b1d0 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8d7400640 1 -- 172.21.15.69:0/3982021313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb124070 msgr2=0x55f4bb124450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8d7400640 1 --2- 172.21.15.69:0/3982021313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb124070 0x55f4bb124450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8d7400640 1 -- 172.21.15.69:0/3982021313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 msgr2=0x55f4bb1604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8d7400640 1 --2- 172.21.15.69:0/3982021313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 0x55f4bb1604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8d7400640 1 -- 172.21.15.69:0/3982021313 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4bb011df0 con 0x55f4bb124990 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8d7e00640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc8b809f160 0x7fc8b80a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8d7400640 1 --2- 172.21.15.69:0/3982021313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb15f200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80fdfb0 tx=0x7fc8c8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513b3dc14bbb385b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8c3e00640 1 -- 172.21.15.69:0/3982021313 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8039650 con 0x55f4bb124990 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8c3e00640 1 -- 172.21.15.69:0/3982021313 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c80397b0 con 0x55f4bb124990 2024-02-21T07:43:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.956+0000 7fc8c3e00640 1 -- 172.21.15.69:0/3982021313 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8039b20 con 0x55f4bb124990 2024-02-21T07:43:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.957+0000 7fc8e13cb740 1 -- 172.21.15.69:0/3982021313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 msgr2=0x55f4bb15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.957+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/3982021313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb15f200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80fdfb0 tx=0x7fc8c8030000 comp rx=0 tx=0).stop 2024-02-21T07:43:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.957+0000 7fc8e13cb740 1 -- 172.21.15.69:0/3982021313 shutdown_connections 2024-02-21T07:43:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.957+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/3982021313 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 0x55f4bb1604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.957+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/3982021313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb15f200 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.957+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/3982021313 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb124070 0x55f4bb124450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.957+0000 7fc8e13cb740 1 -- 172.21.15.69:0/3982021313 >> 172.21.15.69:0/3982021313 conn(0x55f4bb0e6640 msgr2=0x55f4bb0e76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.958+0000 7fc8d7e00640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc8b809f160 0x7fc8b80a1620 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0018040 tx=0x7fc8d000cf10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.958+0000 7fc8e13cb740 1 -- 172.21.15.69:0/3982021313 shutdown_connections 2024-02-21T07:43:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.958+0000 7fc8e13cb740 1 -- 172.21.15.69:0/3982021313 wait complete. 2024-02-21T07:43:38.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.959+0000 7fc8e13cb740 1 -- start start 2024-02-21T07:43:38.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.959+0000 7fc8e13cb740 1 Processor -- start 2024-02-21T07:43:38.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb11a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 0x55f4bb14d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb128840 0x55f4bb16ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4baff5150 con 0x55f4bb124990 2024-02-21T07:43:38.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4baff4df0 con 0x55f4bb15f740 2024-02-21T07:43:38.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4badbe1c0 con 0x55f4bb128840 2024-02-21T07:43:38.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8e13cb740 10 client.0 _ll_register_callbacks cb 0x55f4bb0442b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:38.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb11a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb11a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48392/0 (socket says 172.21.15.69:48392) 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8d6a00640 1 -- 172.21.15.69:0/1997242015 learned_addr learned my addr 172.21.15.69:0/1997242015 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.961+0000 7fc8d7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 0x55f4bb14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.962+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb128840 0x55f4bb16ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.962+0000 7fc8d7400640 1 -- 172.21.15.69:0/1997242015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb128840 msgr2=0x55f4bb16ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.962+0000 7fc8d7400640 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb128840 0x55f4bb16ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.962+0000 7fc8d7400640 1 -- 172.21.15.69:0/1997242015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 msgr2=0x55f4bb11a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.962+0000 7fc8d7400640 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb11a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.962+0000 7fc8d7400640 1 -- 172.21.15.69:0/1997242015 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d8189f10 con 0x55f4bb15f740 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.962+0000 7fc8d7400640 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 0x55f4bb14d230 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc8c802bef0 tx=0x7fc8c8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3f0add2ac88c2c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.962+0000 7fc8c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.963+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1997242015 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8039b20 con 0x55f4bb15f740 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.963+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1997242015 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4bad4f7e0 con 0x55f4bb15f740 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.963+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1997242015 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc8c803e040 con 0x55f4bb15f740 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.963+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1997242015 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8c8004500 con 0x55f4bb15f740 2024-02-21T07:43:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.963+0000 7fc8e13cb740 10 client.5374 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:38.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.963+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1997242015 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55f4bb04e5a0 con 0x55f4bb15f740 2024-02-21T07:43:38.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.963+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1997242015 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c805a020 con 0x55f4bb15f740 2024-02-21T07:43:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.964+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1997242015 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc8c8039c80 con 0x55f4bb15f740 2024-02-21T07:43:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.964+0000 7fc8e13cb740 10 client.5374 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.964+0000 7fc8e13cb740 10 client.5374 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:43:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.964+0000 7fc8e13cb740 20 client.5374 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.964+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f4bb128c20 0x55f4bb11d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.964+0000 7fc8e13cb740 4 client.5374 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.964+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1997242015 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4bad8c720 con 0x55f4bb128c20 2024-02-21T07:43:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.965+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f4bb128c20 0x55f4bb11d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.965+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f4bb128c20 0x55f4bb11d4c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=22d96ccb5585fab9 server_cookie=22f409d27b923580 in_seq=0 out_seq=0 2024-02-21T07:43:38.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.965+0000 7fc8c0c00640 10 client.5374 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:43:38.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.966+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1997242015 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f4bad8c720 con 0x55f4bb128c20 2024-02-21T07:43:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.966+0000 7fc8c0c00640 10 client.5374 handle_command_reply: tid=0 2024-02-21T07:43:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.966+0000 7fc8e13cb740 1 client.5374 shutdown 2024-02-21T07:43:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1997242015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 msgr2=0x55f4bb14d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 0x55f4bb14d230 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc8c802bef0 tx=0x7fc8c8004730 comp rx=0 tx=0).stop 2024-02-21T07:43:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1997242015 shutdown_connections 2024-02-21T07:43:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f4bb128c20 0x55f4bb11d4c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb128840 0x55f4bb16ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb15f740 0x55f4bb14d230 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8c0c00640 0 client.5374 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:43:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1997242015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb11a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1997242015 >> 172.21.15.69:0/1997242015 conn(0x55f4bb124070 msgr2=0x55f4bb0e80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1997242015 shutdown_connections 2024-02-21T07:43:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.967+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1997242015 wait complete. 2024-02-21T07:43:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.968+0000 7fc8e13cb740 20 client.5374 trim_cache size 0 max 16384 2024-02-21T07:43:38.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.982+0000 7fc8e13cb740 1 Processor -- start 2024-02-21T07:43:38.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.983+0000 7fc8e13cb740 1 -- start start 2024-02-21T07:43:38.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.984+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb124990 0x55f4bb124450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.984+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb128840 0x55f4bb178200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.984+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb15f740 0x55f4bb16b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.984+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bb146de0 con 0x55f4bb128840 2024-02-21T07:43:38.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.984+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bb15fb20 con 0x55f4bb124990 2024-02-21T07:43:38.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.984+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bb0f39b0 con 0x55f4bb15f740 2024-02-21T07:43:38.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.984+0000 7fc8d7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb128840 0x55f4bb178200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.984+0000 7fc8d7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb128840 0x55f4bb178200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48398/0 (socket says 172.21.15.69:48398) 2024-02-21T07:43:38.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.984+0000 7fc8d7400640 1 -- 172.21.15.69:0/2101777516 learned_addr learned my addr 172.21.15.69:0/2101777516 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/2101777516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb124990 0x55f4bb124450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8d7400640 1 -- 172.21.15.69:0/2101777516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb15f740 msgr2=0x55f4bb16b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8d7400640 1 --2- 172.21.15.69:0/2101777516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb15f740 0x55f4bb16b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8d7400640 1 -- 172.21.15.69:0/2101777516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb124990 msgr2=0x55f4bb124450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8d7400640 1 --2- 172.21.15.69:0/2101777516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb124990 0x55f4bb124450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8d7400640 1 -- 172.21.15.69:0/2101777516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4bafeaab0 con 0x55f4bb128840 2024-02-21T07:43:38.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/2101777516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb124990 0x55f4bb124450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:43:38.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8d7400640 1 --2- 172.21.15.69:0/2101777516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb128840 0x55f4bb178200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc8c802bfc0 tx=0x7fc8c804a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1708b76f9e636e02 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8c3400640 1 -- 172.21.15.69:0/2101777516 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8030870 con 0x55f4bb128840 2024-02-21T07:43:38.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8c3400640 1 -- 172.21.15.69:0/2101777516 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c805a040 con 0x55f4bb128840 2024-02-21T07:43:38.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.985+0000 7fc8c3400640 1 -- 172.21.15.69:0/2101777516 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8039b60 con 0x55f4bb128840 2024-02-21T07:43:38.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.986+0000 7fc8e13cb740 1 -- 172.21.15.69:0/2101777516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb128840 msgr2=0x55f4bb178200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:38.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.986+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/2101777516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb128840 0x55f4bb178200 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc8c802bfc0 tx=0x7fc8c804a000 comp rx=0 tx=0).stop 2024-02-21T07:43:38.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.986+0000 7fc8e13cb740 1 -- 172.21.15.69:0/2101777516 shutdown_connections 2024-02-21T07:43:38.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.986+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/2101777516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb15f740 0x55f4bb16b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.986+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/2101777516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb128840 0x55f4bb178200 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.986+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/2101777516 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb124990 0x55f4bb124450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.986+0000 7fc8e13cb740 1 -- 172.21.15.69:0/2101777516 >> 172.21.15.69:0/2101777516 conn(0x55f4bb124070 msgr2=0x55f4bb1207b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:38.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.986+0000 7fc8e13cb740 1 -- 172.21.15.69:0/2101777516 shutdown_connections 2024-02-21T07:43:38.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.986+0000 7fc8e13cb740 1 -- 172.21.15.69:0/2101777516 wait complete. 2024-02-21T07:43:38.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.987+0000 7fc8e13cb740 1 -- start start 2024-02-21T07:43:38.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.987+0000 7fc8e13cb740 1 Processor -- start 2024-02-21T07:43:38.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.988+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb1ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb128840 0x55f4bb16b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8e13cb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb15f740 0x55f4bb1c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bb1ceb70 con 0x55f4bb124990 2024-02-21T07:43:38.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bb1cf260 con 0x55f4bb128840 2024-02-21T07:43:38.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8e13cb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4bb16bd50 con 0x55f4bb15f740 2024-02-21T07:43:38.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8e13cb740 10 client.0 _ll_register_callbacks cb 0x7fc8c4007bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:38.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb1ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb128840 0x55f4bb16b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb1ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48414/0 (socket says 172.21.15.69:48414) 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d6a00640 1 -- 172.21.15.69:0/1820632479 learned_addr learned my addr 172.21.15.69:0/1820632479 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb15f740 0x55f4bb1c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d7400640 1 -- 172.21.15.69:0/1820632479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb15f740 msgr2=0x55f4bb1c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d7400640 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb15f740 0x55f4bb1c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d7400640 1 -- 172.21.15.69:0/1820632479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 msgr2=0x55f4bb1ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d7400640 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb1ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d7400640 1 -- 172.21.15.69:0/1820632479 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4bb04e5a0 con 0x55f4bb128840 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.989+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb1ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.990+0000 7fc8d7400640 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb128840 0x55f4bb16b810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8057000 tx=0x7fc8c803b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cafd364840150b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:38.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.990+0000 7fc8c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:38.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.990+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1820632479 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c804d670 con 0x55f4bb128840 2024-02-21T07:43:38.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.990+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1820632479 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc8c803e070 con 0x55f4bb128840 2024-02-21T07:43:38.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.990+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1820632479 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8c80397b0 con 0x55f4bb128840 2024-02-21T07:43:38.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1820632479 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8c804d7d0 con 0x55f4bb128840 2024-02-21T07:43:38.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8e13cb740 10 client.5377 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:38.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1820632479 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55f4bb010650 con 0x55f4bb128840 2024-02-21T07:43:38.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1820632479 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c80397b0 con 0x55f4bb128840 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1820632479 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc8c8066030 con 0x55f4bb128840 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8e13cb740 10 client.5377 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8e13cb740 10 client.5377 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8e13cb740 20 client.5377 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f4bb15f310 0x55f4bb15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8e13cb740 4 client.5377 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.991+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1820632479 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f4baddb890 con 0x55f4bb15f310 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.992+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f4bb15f310 0x55f4bb15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.992+0000 7fc8d6a00640 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f4bb15f310 0x55f4bb15c6a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eab18f2f339c3375 server_cookie=88101dbb13e1a02a in_seq=0 out_seq=0 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.992+0000 7fc8c0c00640 10 client.5377 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.992+0000 7fc8c0c00640 1 -- 172.21.15.69:0/1820632479 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f4baddb890 con 0x55f4bb15f310 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.992+0000 7fc8c0c00640 10 client.5377 handle_command_reply: tid=0 2024-02-21T07:43:38.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.992+0000 7fc8e13cb740 1 client.5377 shutdown 2024-02-21T07:43:39.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1820632479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb128840 msgr2=0x55f4bb16b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb128840 0x55f4bb16b810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8057000 tx=0x7fc8c803b040 comp rx=0 tx=0).stop 2024-02-21T07:43:39.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1820632479 shutdown_connections 2024-02-21T07:43:39.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f4bb15f310 0x55f4bb15c6a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f4bb15f740 0x55f4bb1c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f4bb128840 0x55f4bb16b810 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 1 --2- 172.21.15.69:0/1820632479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f4bb124990 0x55f4bb1ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1820632479 >> 172.21.15.69:0/1820632479 conn(0x55f4bb124070 msgr2=0x55f4bb151320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:39.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8c0c00640 0 client.5377 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:43:39.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1820632479 shutdown_connections 2024-02-21T07:43:39.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 1 -- 172.21.15.69:0/1820632479 wait complete. 2024-02-21T07:43:39.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.993+0000 7fc8e13cb740 20 client.5377 trim_cache size 0 max 16384 2024-02-21T07:43:39.001 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:43:39.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 -- 172.21.15.69:0/1758187940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc8b809f160 msgr2=0x7fc8b80a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc8b809f160 0x7fc8b80a1620 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0018040 tx=0x7fc8d000cf10 comp rx=0 tx=0).stop 2024-02-21T07:43:39.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 -- 172.21.15.69:0/1758187940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d818b1d0 msgr2=0x7fc8d816f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d818b1d0 0x7fc8d816f760 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000c800 tx=0x7fc8d000ccc0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 -- 172.21.15.69:0/1758187940 shutdown_connections 2024-02-21T07:43:39.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc8b809f160 0x7fc8b80a1620 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8d818b1d0 0x7fc8d816f760 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc8d817f2a0 0x7fc8d816d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 --2- 172.21.15.69:0/1758187940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc8d80fe6a0 0x7fc8d821f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 -- 172.21.15.69:0/1758187940 >> 172.21.15.69:0/1758187940 conn(0x7fc8d80d2b00 msgr2=0x7fc8d80d2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:39.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 -- 172.21.15.69:0/1758187940 shutdown_connections 2024-02-21T07:43:39.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:38.994+0000 7fc8dd000640 1 -- 172.21.15.69:0/1758187940 wait complete. 2024-02-21T07:43:39.016 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:43:39.016 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:43:39.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.183+0000 7f92e3600640 1 Processor -- start 2024-02-21T07:43:39.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.183+0000 7f92e3600640 1 -- start start 2024-02-21T07:43:39.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.185+0000 7f92e3600640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f92dc183ea0 0x7f92dc1846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.185+0000 7f92e3600640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92dc1850b0 con 0x7f92dc0eed50 2024-02-21T07:43:39.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.185+0000 7f92e3600640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92dc185390 con 0x7f92dc184c20 2024-02-21T07:43:39.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.185+0000 7f92e3600640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92dc186010 con 0x7f92dc183ea0 2024-02-21T07:43:39.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.185+0000 7f92e0c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f92dc183ea0 0x7f92dc1846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.185+0000 7f92e1600640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f92dc0eed50 0x7f92dc186bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40538/0 (socket says 172.21.15.69:40538) 2024-02-21T07:43:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.185+0000 7f92e1600640 1 -- 172.21.15.69:0/2741674926 learned_addr learned my addr 172.21.15.69:0/2741674926 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.185+0000 7f92dbe00640 1 --1- 172.21.15.69:0/2741674926 >> v1:172.21.15.184:6789/0 conn(0x7f92dc184c20 0x7f92dc0ee640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:36432/0 (socket says 172.21.15.69:36432) 2024-02-21T07:43:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.186+0000 7f92e0c00640 1 -- 172.21.15.69:0/2741674926 >> v1:172.21.15.184:6789/0 conn(0x7f92dc184c20 legacy=0x7f92dc0ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.186+0000 7f92e0c00640 1 -- 172.21.15.69:0/2741674926 >> v1:172.21.15.69:6789/0 conn(0x7f92dc0eed50 legacy=0x7f92dc186bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.186+0000 7f92e0c00640 1 -- 172.21.15.69:0/2741674926 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc185670 con 0x7f92dc183ea0 2024-02-21T07:43:39.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.188+0000 7f92e0c00640 1 --2- 172.21.15.69:0/2741674926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc183ea0 0x7f92dc1846e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f92d00097a0 tx=0x7f92d002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81b0b39a68fe0916 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:39.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.188+0000 7f92db400640 1 -- 172.21.15.69:0/2741674926 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0031640 con 0x7f92dc183ea0 2024-02-21T07:43:39.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.188+0000 7f92db400640 1 -- 172.21.15.69:0/2741674926 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d00317a0 con 0x7f92dc183ea0 2024-02-21T07:43:39.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.188+0000 7f92db400640 1 -- 172.21.15.69:0/2741674926 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0031b70 con 0x7f92dc183ea0 2024-02-21T07:43:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.189+0000 7f92e3600640 1 -- 172.21.15.69:0/2741674926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc183ea0 msgr2=0x7f92dc1846e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.189+0000 7f92e3600640 1 --2- 172.21.15.69:0/2741674926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc183ea0 0x7f92dc1846e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f92d00097a0 tx=0x7f92d002b8f0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.189+0000 7f92e3600640 1 -- 172.21.15.69:0/2741674926 shutdown_connections 2024-02-21T07:43:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.189+0000 7f92e3600640 1 --2- 172.21.15.69:0/2741674926 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc183ea0 0x7f92dc1846e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.189+0000 7f92e3600640 1 -- 172.21.15.69:0/2741674926 >> 172.21.15.69:0/2741674926 conn(0x7f92dc0ce3d0 msgr2=0x7f92dc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.189+0000 7f92e3600640 1 -- 172.21.15.69:0/2741674926 shutdown_connections 2024-02-21T07:43:39.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.189+0000 7f92e3600640 1 -- 172.21.15.69:0/2741674926 wait complete. 2024-02-21T07:43:39.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.191+0000 7f92e3600640 1 Processor -- start 2024-02-21T07:43:39.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.191+0000 7f92e3600640 1 -- start start 2024-02-21T07:43:39.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.192+0000 7f92e3600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0eed50 0x7f92dc21f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.192+0000 7f92e3600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92dc183ea0 0x7f92dc170c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.192+0000 7f92e3600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc2203d0 0x7f92dc220860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.192+0000 7f92e3600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc189860 con 0x7f92dc2203d0 2024-02-21T07:43:39.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.192+0000 7f92e3600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc188fc0 con 0x7f92dc183ea0 2024-02-21T07:43:39.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.192+0000 7f92e3600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc1892a0 con 0x7f92dc0eed50 2024-02-21T07:43:39.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.193+0000 7f92e1600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc2203d0 0x7f92dc220860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.193+0000 7f92e0c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0eed50 0x7f92dc21f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.193+0000 7f92e1600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc2203d0 0x7f92dc220860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48422/0 (socket says 172.21.15.69:48422) 2024-02-21T07:43:39.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.193+0000 7f92e1600640 1 -- 172.21.15.69:0/2653858944 learned_addr learned my addr 172.21.15.69:0/2653858944 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:39.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.193+0000 7f92dbe00640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92dc183ea0 0x7f92dc170c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.193+0000 7f92e1600640 1 -- 172.21.15.69:0/2653858944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0eed50 msgr2=0x7f92dc21f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.193+0000 7f92e1600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0eed50 0x7f92dc21f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.193+0000 7f92e1600640 1 -- 172.21.15.69:0/2653858944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92dc183ea0 msgr2=0x7f92dc170c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.193+0000 7f92e1600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92dc183ea0 0x7f92dc170c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.193+0000 7f92e1600640 1 -- 172.21.15.69:0/2653858944 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0009400 con 0x7f92dc2203d0 2024-02-21T07:43:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.194+0000 7f92e1600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc2203d0 0x7f92dc220860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f92d400ca80 tx=0x7f92d400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.194+0000 7f92d8c00640 1 -- 172.21.15.69:0/2653858944 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d400ac30 con 0x7f92dc2203d0 2024-02-21T07:43:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.194+0000 7f92d8c00640 1 -- 172.21.15.69:0/2653858944 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d400ad90 con 0x7f92dc2203d0 2024-02-21T07:43:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.194+0000 7f92d8c00640 1 -- 172.21.15.69:0/2653858944 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d400ac30 con 0x7f92dc2203d0 2024-02-21T07:43:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.194+0000 7f92e3600640 1 -- 172.21.15.69:0/2653858944 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc1865b0 con 0x7f92dc2203d0 2024-02-21T07:43:39.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.195+0000 7f92e3600640 1 -- 172.21.15.69:0/2653858944 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc21fbd0 con 0x7f92dc2203d0 2024-02-21T07:43:39.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.200+0000 7f92d8c00640 1 -- 172.21.15.69:0/2653858944 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f92d4007070 con 0x7f92dc2203d0 2024-02-21T07:43:39.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.200+0000 7f92e63a6740 1 Processor -- start 2024-02-21T07:43:39.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.200+0000 7f92e63a6740 1 -- start start 2024-02-21T07:43:39.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.201+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb72496ec0 0x55bb724972a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.201+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 0x55bb724d2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.201+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724d2590 0x55bb724d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.201+0000 7f92e63a6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb723ca210 con 0x55bb72496ec0 2024-02-21T07:43:39.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.201+0000 7f92e63a6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb723c7740 con 0x55bb724977e0 2024-02-21T07:43:39.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.201+0000 7f92e63a6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb723c2f20 con 0x55bb724d2590 2024-02-21T07:43:39.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92dbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb72496ec0 0x55bb724972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92dbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb72496ec0 0x55bb724972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48428/0 (socket says 172.21.15.69:48428) 2024-02-21T07:43:39.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92dbe00640 1 -- 172.21.15.69:0/3392532482 learned_addr learned my addr 172.21.15.69:0/3392532482 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:39.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92e0c00640 1 --2- 172.21.15.69:0/3392532482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 0x55bb724d2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92d8c00640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f92bc09f190 0x7f92bc0a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3392532482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724d2590 0x55bb724d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92dbe00640 1 -- 172.21.15.69:0/3392532482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724d2590 msgr2=0x55bb724d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3392532482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724d2590 0x55bb724d3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92dbe00640 1 -- 172.21.15.69:0/3392532482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 msgr2=0x55bb724d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3392532482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 0x55bb724d2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92dbe00640 1 -- 172.21.15.69:0/3392532482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb72384df0 con 0x55bb72496ec0 2024-02-21T07:43:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.202+0000 7f92d8c00640 1 -- 172.21.15.69:0/2653858944 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f92d40c9610 con 0x7f92dc2203d0 2024-02-21T07:43:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.203+0000 7f92e1600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f92bc09f190 0x7f92bc0a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.203+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3392532482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb72496ec0 0x55bb724972a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f92c8004b60 tx=0x7f92c8012cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511abac19f4c5a39 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.203+0000 7f92cd200640 1 -- 172.21.15.69:0/3392532482 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8017050 con 0x55bb72496ec0 2024-02-21T07:43:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.203+0000 7f92cd200640 1 -- 172.21.15.69:0/3392532482 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8018040 con 0x55bb72496ec0 2024-02-21T07:43:39.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.203+0000 7f92cd200640 1 -- 172.21.15.69:0/3392532482 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8004e70 con 0x55bb72496ec0 2024-02-21T07:43:39.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.204+0000 7f92e63a6740 1 -- 172.21.15.69:0/3392532482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb72496ec0 msgr2=0x55bb724972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.204+0000 7f92e63a6740 1 --2- 172.21.15.69:0/3392532482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb72496ec0 0x55bb724972a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f92c8004b60 tx=0x7f92c8012cf0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.204+0000 7f92e63a6740 1 -- 172.21.15.69:0/3392532482 shutdown_connections 2024-02-21T07:43:39.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.204+0000 7f92e63a6740 1 --2- 172.21.15.69:0/3392532482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724d2590 0x55bb724d3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.204+0000 7f92e63a6740 1 --2- 172.21.15.69:0/3392532482 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 0x55bb724d2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.204+0000 7f92e63a6740 1 --2- 172.21.15.69:0/3392532482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb72496ec0 0x55bb724972a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.205+0000 7f92e63a6740 1 -- 172.21.15.69:0/3392532482 >> 172.21.15.69:0/3392532482 conn(0x55bb72459490 msgr2=0x55bb7245a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:39.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.205+0000 7f92e1600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f92bc09f190 0x7f92bc0a1650 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f92d400a730 tx=0x7f92d40012d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:39.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.205+0000 7f92e63a6740 1 -- 172.21.15.69:0/3392532482 shutdown_connections 2024-02-21T07:43:39.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.205+0000 7f92e63a6740 1 -- 172.21.15.69:0/3392532482 wait complete. 2024-02-21T07:43:39.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.206+0000 7f92e63a6740 1 -- start start 2024-02-21T07:43:39.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.207+0000 7f92e63a6740 1 Processor -- start 2024-02-21T07:43:39.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 0x55bb7248c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 0x55bb72490080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 0x55bb7248a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92e63a6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb72368150 con 0x55bb724d2590 2024-02-21T07:43:39.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92e63a6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb72367df0 con 0x55bb724977e0 2024-02-21T07:43:39.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92e63a6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb721311c0 con 0x55bb7248b890 2024-02-21T07:43:39.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92e63a6740 10 client.0 _ll_register_callbacks cb 0x55bb723b72b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:39.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92dbe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 0x55bb7248a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92dbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 0x55bb7248c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92dbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 0x55bb7248c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38482/0 (socket says 172.21.15.69:38482) 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.209+0000 7f92dbe00640 1 -- 172.21.15.69:0/1829462365 learned_addr learned my addr 172.21.15.69:0/1829462365 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92e0c00640 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 0x55bb72490080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92dbe00640 1 -- 172.21.15.69:0/1829462365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 msgr2=0x55bb7248a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92dbe00640 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 0x55bb7248a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92dbe00640 1 -- 172.21.15.69:0/1829462365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 msgr2=0x55bb72490080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92dbe00640 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 0x55bb72490080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92dbe00640 1 -- 172.21.15.69:0/1829462365 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc185390 con 0x55bb724977e0 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92dbe00640 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 0x55bb7248c0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f92c8007fd0 tx=0x7f92c801e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df351d28b36bb7f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92c1600640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92c1600640 1 -- 172.21.15.69:0/1829462365 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8026070 con 0x55bb724977e0 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92c1600640 1 -- 172.21.15.69:0/1829462365 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f92c8012510 con 0x55bb724977e0 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.210+0000 7f92e63a6740 1 -- 172.21.15.69:0/1829462365 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb720c27e0 con 0x55bb724977e0 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92c1600640 1 -- 172.21.15.69:0/1829462365 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92c8017070 con 0x55bb724977e0 2024-02-21T07:43:39.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92e63a6740 10 client.5386 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:39.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92e63a6740 1 -- 172.21.15.69:0/1829462365 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55bb723c15a0 con 0x55bb724977e0 2024-02-21T07:43:39.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92c1600640 1 -- 172.21.15.69:0/1829462365 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb720c27e0 con 0x55bb724977e0 2024-02-21T07:43:39.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92c1600640 1 -- 172.21.15.69:0/1829462365 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f92c801b070 con 0x55bb724977e0 2024-02-21T07:43:39.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92e63a6740 10 client.5386 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:39.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92e63a6740 10 client.5386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:39.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92e63a6740 20 client.5386 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:39.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92e63a6740 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55bb72490760 0x55bb7249b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92e63a6740 4 client.5386 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:39.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.211+0000 7f92e63a6740 1 -- 172.21.15.69:0/1829462365 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb720ff720 con 0x55bb72490760 2024-02-21T07:43:39.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.212+0000 7f92e0c00640 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55bb72490760 0x55bb7249b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.212+0000 7f92e0c00640 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55bb72490760 0x55bb7249b850 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7170b43f7707ac6 server_cookie=2908439916fb829d in_seq=0 out_seq=0 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.213+0000 7f92c1600640 10 client.5386 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.213+0000 7f92c1600640 1 -- 172.21.15.69:0/1829462365 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bb720ff720 con 0x55bb72490760 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.213+0000 7f92c1600640 10 client.5386 handle_command_reply: tid=0 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.214+0000 7f92e63a6740 1 client.5386 shutdown 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.214+0000 7f92e63a6740 1 -- 172.21.15.69:0/1829462365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 msgr2=0x55bb7248c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.214+0000 7f92e63a6740 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 0x55bb7248c0a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f92c8007fd0 tx=0x7f92c801e000 comp rx=0 tx=0).stop 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.215+0000 7f92e63a6740 1 -- 172.21.15.69:0/1829462365 shutdown_connections 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.215+0000 7f92e63a6740 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55bb72490760 0x55bb7249b850 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.215+0000 7f92e63a6740 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 0x55bb7248a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.215+0000 7f92e63a6740 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 0x55bb72490080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.215+0000 7f92e63a6740 1 --2- 172.21.15.69:0/1829462365 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724977e0 0x55bb7248c0a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.215+0000 7f92c1600640 0 client.5386 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:39.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.215+0000 7f92e63a6740 1 -- 172.21.15.69:0/1829462365 >> 172.21.15.69:0/1829462365 conn(0x55bb72496ec0 msgr2=0x55bb724c01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:39.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.215+0000 7f92e63a6740 1 -- 172.21.15.69:0/1829462365 shutdown_connections 2024-02-21T07:43:39.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.215+0000 7f92e63a6740 1 -- 172.21.15.69:0/1829462365 wait complete. 2024-02-21T07:43:39.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.215+0000 7f92e63a6740 20 client.5386 trim_cache size 0 max 16384 2024-02-21T07:43:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.228+0000 7f92e63a6740 1 Processor -- start 2024-02-21T07:43:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.228+0000 7f92e63a6740 1 -- start start 2024-02-21T07:43:39.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.229+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb7248b890 0x55bb72457c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.229+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724977e0 0x55bb724d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.229+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 0x55bb7248ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.229+0000 7f92e63a6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb72490480 con 0x55bb724d2590 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.229+0000 7f92e63a6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb724ebfa0 con 0x55bb7248b890 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.229+0000 7f92e63a6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb72458570 con 0x55bb724977e0 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.229+0000 7f92e0c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724977e0 0x55bb724d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.229+0000 7f92e0c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724977e0 0x55bb724d1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49076/0 (socket says 172.21.15.69:49076) 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.229+0000 7f92e0c00640 1 -- 172.21.15.69:0/415450593 learned_addr learned my addr 172.21.15.69:0/415450593 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.230+0000 7f92dbe00640 1 --2- 172.21.15.69:0/415450593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb7248b890 0x55bb72457c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.230+0000 7f92e0c00640 1 -- 172.21.15.69:0/415450593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb7248b890 msgr2=0x55bb72457c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.230+0000 7f92dbe00640 1 --2- 172.21.15.69:0/415450593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 0x55bb7248ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.230+0000 7f92e0c00640 1 --2- 172.21.15.69:0/415450593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb7248b890 0x55bb72457c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.230+0000 7f92e0c00640 1 -- 172.21.15.69:0/415450593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 msgr2=0x55bb7248ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.230+0000 7f92e0c00640 1 --2- 172.21.15.69:0/415450593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 0x55bb7248ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.230+0000 7f92e0c00640 1 -- 172.21.15.69:0/415450593 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb724d0010 con 0x55bb724977e0 2024-02-21T07:43:39.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.230+0000 7f92dbe00640 1 --2- 172.21.15.69:0/415450593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 0x55bb7248ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:43:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.230+0000 7f92e0c00640 1 --2- 172.21.15.69:0/415450593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724977e0 0x55bb724d1f50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f92d0031770 tx=0x7f92d0030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d86b8a3196d0b54a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.230+0000 7f92c3e00640 1 -- 172.21.15.69:0/415450593 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0040040 con 0x55bb724977e0 2024-02-21T07:43:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.231+0000 7f92c3e00640 1 -- 172.21.15.69:0/415450593 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d0031b90 con 0x55bb724977e0 2024-02-21T07:43:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.231+0000 7f92c3e00640 1 -- 172.21.15.69:0/415450593 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d00490d0 con 0x55bb724977e0 2024-02-21T07:43:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.231+0000 7f92e63a6740 1 -- 172.21.15.69:0/415450593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724977e0 msgr2=0x55bb724d1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.231+0000 7f92e63a6740 1 --2- 172.21.15.69:0/415450593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724977e0 0x55bb724d1f50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f92d0031770 tx=0x7f92d0030000 comp rx=0 tx=0).stop 2024-02-21T07:43:39.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.231+0000 7f92e63a6740 1 -- 172.21.15.69:0/415450593 shutdown_connections 2024-02-21T07:43:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.231+0000 7f92e63a6740 1 --2- 172.21.15.69:0/415450593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724d2590 0x55bb7248ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.231+0000 7f92e63a6740 1 --2- 172.21.15.69:0/415450593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb724977e0 0x55bb724d1f50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.231+0000 7f92e63a6740 1 --2- 172.21.15.69:0/415450593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb7248b890 0x55bb72457c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.231+0000 7f92e63a6740 1 -- 172.21.15.69:0/415450593 >> 172.21.15.69:0/415450593 conn(0x55bb72496ec0 msgr2=0x55bb7245af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.232+0000 7f92e63a6740 1 -- 172.21.15.69:0/415450593 shutdown_connections 2024-02-21T07:43:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.232+0000 7f92e63a6740 1 -- 172.21.15.69:0/415450593 wait complete. 2024-02-21T07:43:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.232+0000 7f92e63a6740 1 -- start start 2024-02-21T07:43:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.233+0000 7f92e63a6740 1 Processor -- start 2024-02-21T07:43:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 0x55bb72457ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724977e0 0x55bb724603b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92e63a6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724d2590 0x55bb7252d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92e63a6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb72458020 con 0x55bb724977e0 2024-02-21T07:43:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92e63a6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb724608f0 con 0x55bb724d2590 2024-02-21T07:43:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92e63a6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb72539870 con 0x55bb7248b890 2024-02-21T07:43:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92e63a6740 10 client.0 _ll_register_callbacks cb 0x7f92c8012ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92e0c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724977e0 0x55bb724603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92dbe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 0x55bb72457ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92dbe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 0x55bb72457ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49092/0 (socket says 172.21.15.69:49092) 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92e0c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724977e0 0x55bb724603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48466/0 (socket says 172.21.15.69:48466) 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92dbe00640 1 -- 172.21.15.69:0/3583445774 learned_addr learned my addr 172.21.15.69:0/3583445774 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.234+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724d2590 0x55bb7252d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92dbe00640 1 -- 172.21.15.69:0/3583445774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724d2590 msgr2=0x55bb7252d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724d2590 0x55bb7252d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92dbe00640 1 -- 172.21.15.69:0/3583445774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724977e0 msgr2=0x55bb724603b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724977e0 0x55bb724603b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92dbe00640 1 -- 172.21.15.69:0/3583445774 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc185670 con 0x55bb7248b890 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 0x55bb72457ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f92c8007fd0 tx=0x7f92c8026000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8543e051416a9ea7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92c1600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92c1600640 1 -- 172.21.15.69:0/3583445774 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c801ee70 con 0x55bb7248b890 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92e63a6740 1 -- 172.21.15.69:0/3583445774 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f92c8018040 con 0x55bb7248b890 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92c1600640 1 -- 172.21.15.69:0/3583445774 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f92c8004c50 con 0x55bb7248b890 2024-02-21T07:43:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92c1600640 1 -- 172.21.15.69:0/3583445774 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92c80108a0 con 0x55bb7248b890 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92e63a6740 10 client.5363 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.235+0000 7f92e63a6740 1 -- 172.21.15.69:0/3583445774 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55bb7235dab0 con 0x55bb7248b890 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.236+0000 7f92c1600640 1 -- 172.21.15.69:0/3583445774 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8018040 con 0x55bb7248b890 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.236+0000 7f92c1600640 1 -- 172.21.15.69:0/3583445774 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f92c801b040 con 0x55bb7248b890 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.236+0000 7f92e63a6740 10 client.5363 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.236+0000 7f92e63a6740 10 client.5363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.236+0000 7f92e63a6740 20 client.5363 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.236+0000 7f92e63a6740 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55bb72495c60 0x55bb72525a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.236+0000 7f92e63a6740 4 client.5363 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.236+0000 7f92e63a6740 1 -- 172.21.15.69:0/3583445774 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bb7214e890 con 0x55bb72495c60 2024-02-21T07:43:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.236+0000 7f92e0c00640 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55bb72495c60 0x55bb72525a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:39.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92c1600640 10 client.5363 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92e0c00640 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55bb72495c60 0x55bb72525a60 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca6080bd61c98f5b server_cookie=c783d970a464c929 in_seq=0 out_seq=0 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92c1600640 1 -- 172.21.15.69:0/3583445774 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bb7214e890 con 0x55bb72495c60 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92c1600640 10 client.5363 handle_command_reply: tid=0 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92e63a6740 1 client.5363 shutdown 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92e63a6740 1 -- 172.21.15.69:0/3583445774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 msgr2=0x55bb72457ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92e63a6740 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 0x55bb72457ae0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f92c8007fd0 tx=0x7f92c8026000 comp rx=0 tx=0).stop 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92e63a6740 1 -- 172.21.15.69:0/3583445774 shutdown_connections 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92e63a6740 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55bb72495c60 0x55bb72525a60 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92e63a6740 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55bb724d2590 0x55bb7252d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.237+0000 7f92e63a6740 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb724977e0 0x55bb724603b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.238+0000 7f92e63a6740 1 --2- 172.21.15.69:0/3583445774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55bb7248b890 0x55bb72457ae0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.238+0000 7f92e63a6740 1 -- 172.21.15.69:0/3583445774 >> 172.21.15.69:0/3583445774 conn(0x55bb72496ec0 msgr2=0x55bb724d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.238+0000 7f92c1600640 0 client.5363 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:39.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.238+0000 7f92e63a6740 1 -- 172.21.15.69:0/3583445774 shutdown_connections 2024-02-21T07:43:39.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.238+0000 7f92e63a6740 1 -- 172.21.15.69:0/3583445774 wait complete. 2024-02-21T07:43:39.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.238+0000 7f92e63a6740 20 client.5363 trim_cache size 0 max 16384 2024-02-21T07:43:39.247 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 -- 172.21.15.69:0/2653858944 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f92bc09f190 msgr2=0x7f92bc0a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f92bc09f190 0x7f92bc0a1650 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f92d400a730 tx=0x7f92d40012d0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 -- 172.21.15.69:0/2653858944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc2203d0 msgr2=0x7f92dc220860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc2203d0 0x7f92dc220860 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f92d400ca80 tx=0x7f92d400cf40 comp rx=0 tx=0).stop 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 -- 172.21.15.69:0/2653858944 shutdown_connections 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f92bc09f190 0x7f92bc0a1650 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc2203d0 0x7f92dc220860 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f92dc183ea0 0x7f92dc170c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 --2- 172.21.15.69:0/2653858944 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f92dc0eed50 0x7f92dc21f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 -- 172.21.15.69:0/2653858944 >> 172.21.15.69:0/2653858944 conn(0x7f92dc0ce3d0 msgr2=0x7f92dc0d24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 -- 172.21.15.69:0/2653858944 shutdown_connections 2024-02-21T07:43:39.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:39.239+0000 7f92e3600640 1 -- 172.21.15.69:0/2653858944 wait complete. 2024-02-21T07:43:40.262 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:43:40.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:43:40.262 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:43:40.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.444+0000 7f450aa00640 1 Processor -- start 2024-02-21T07:43:40.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.444+0000 7f450aa00640 1 -- start start 2024-02-21T07:43:40.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.445+0000 7f450aa00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4504182790 0x7f45040d1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.445+0000 7f450aa00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f45040d22b0 0x7f45040fd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.445+0000 7f450aa00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45040d09f0 con 0x7f45040fd9c0 2024-02-21T07:43:40.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.445+0000 7f450aa00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45040d4540 con 0x7f4504182790 2024-02-21T07:43:40.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.445+0000 7f450aa00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45040d0cd0 con 0x7f45040d22b0 2024-02-21T07:43:40.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.446+0000 7f4509600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4504182790 0x7f45040d1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.446+0000 7f4508c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f45040d22b0 0x7f45040fd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.446+0000 7f4509600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4504182790 0x7f45040d1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48468/0 (socket says 172.21.15.69:48468) 2024-02-21T07:43:40.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.446+0000 7f4509600640 1 -- 172.21.15.69:0/847493261 learned_addr learned my addr 172.21.15.69:0/847493261 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.446+0000 7f4509600640 1 -- 172.21.15.69:0/847493261 >> v2:172.21.15.184:3300/0 conn(0x7f45040d22b0 msgr2=0x7f45040fd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.446+0000 7f4509600640 1 --2- 172.21.15.69:0/847493261 >> v2:172.21.15.184:3300/0 conn(0x7f45040d22b0 0x7f45040fd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.446+0000 7f4509600640 1 -- 172.21.15.69:0/847493261 >> v1:172.21.15.174:6789/0 conn(0x7f45040fd9c0 legacy=0x7f450418be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.446+0000 7f4509600640 1 -- 172.21.15.69:0/847493261 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45040d0fb0 con 0x7f4504182790 2024-02-21T07:43:40.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.448+0000 7f4509600640 1 --2- 172.21.15.69:0/847493261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4504182790 0x7f45040d1d70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f45040fcd50 tx=0x7f44f802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713ad8c0d7ef272e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.449+0000 7f4503e00640 1 -- 172.21.15.69:0/847493261 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8030860 con 0x7f4504182790 2024-02-21T07:43:40.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.449+0000 7f4503e00640 1 -- 172.21.15.69:0/847493261 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f80309c0 con 0x7f4504182790 2024-02-21T07:43:40.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.449+0000 7f4503e00640 1 -- 172.21.15.69:0/847493261 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8030d50 con 0x7f4504182790 2024-02-21T07:43:40.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.449+0000 7f450aa00640 1 -- 172.21.15.69:0/847493261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4504182790 msgr2=0x7f45040d1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.449+0000 7f450aa00640 1 --2- 172.21.15.69:0/847493261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4504182790 0x7f45040d1d70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f45040fcd50 tx=0x7f44f802b9a0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.450+0000 7f450aa00640 1 -- 172.21.15.69:0/847493261 shutdown_connections 2024-02-21T07:43:40.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.450+0000 7f450aa00640 1 --2- 172.21.15.69:0/847493261 >> v2:172.21.15.184:3300/0 conn(0x7f45040d22b0 0x7f45040fd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.450+0000 7f450aa00640 1 --2- 172.21.15.69:0/847493261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4504182790 0x7f45040d1d70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.450+0000 7f450aa00640 1 -- 172.21.15.69:0/847493261 >> 172.21.15.69:0/847493261 conn(0x7f45040668e0 msgr2=0x7f4504066cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.450+0000 7f450aa00640 1 -- 172.21.15.69:0/847493261 shutdown_connections 2024-02-21T07:43:40.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.450+0000 7f450aa00640 1 -- 172.21.15.69:0/847493261 wait complete. 2024-02-21T07:43:40.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.453+0000 7f450aa00640 1 Processor -- start 2024-02-21T07:43:40.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.453+0000 7f450aa00640 1 -- start start 2024-02-21T07:43:40.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.455+0000 7f450aa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45040d22b0 0x7f4504212b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.455+0000 7f450aa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45040fd9c0 0x7f45041776e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.455+0000 7f450aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4504182790 0x7f4504220a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.455+0000 7f450aa00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4504214830 con 0x7f4504182790 2024-02-21T07:43:40.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.455+0000 7f450aa00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4504220600 con 0x7f45040fd9c0 2024-02-21T07:43:40.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.455+0000 7f450aa00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4504213460 con 0x7f45040d22b0 2024-02-21T07:43:40.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.455+0000 7f4508c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45040fd9c0 0x7f45041776e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f4508c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45040fd9c0 0x7f45041776e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38514/0 (socket says 172.21.15.69:38514) 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f4508c00640 1 -- 172.21.15.69:0/2056322717 learned_addr learned my addr 172.21.15.69:0/2056322717 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f4509600640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45040d22b0 0x7f4504212b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f4508c00640 1 -- 172.21.15.69:0/2056322717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45040d22b0 msgr2=0x7f4504212b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f4508c00640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45040d22b0 0x7f4504212b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f4508c00640 1 -- 172.21.15.69:0/2056322717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4504182790 msgr2=0x7f4504220a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f450a000640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4504182790 0x7f4504220a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f4508c00640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4504182790 0x7f4504220a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f4508c00640 1 -- 172.21.15.69:0/2056322717 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80094d0 con 0x7f45040fd9c0 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f4509600640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45040d22b0 0x7f4504212b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f450a000640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4504182790 0x7f4504220a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.456+0000 7f4508c00640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45040fd9c0 0x7f45041776e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f44f000e8a0 tx=0x7f44f000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.457+0000 7f4501600640 1 -- 172.21.15.69:0/2056322717 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f0009510 con 0x7f45040fd9c0 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.457+0000 7f4501600640 1 -- 172.21.15.69:0/2056322717 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f000c940 con 0x7f45040fd9c0 2024-02-21T07:43:40.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.457+0000 7f4501600640 1 -- 172.21.15.69:0/2056322717 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f000ccf0 con 0x7f45040fd9c0 2024-02-21T07:43:40.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.457+0000 7f450aa00640 1 -- 172.21.15.69:0/2056322717 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4504213740 con 0x7f45040fd9c0 2024-02-21T07:43:40.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.457+0000 7f450aa00640 1 -- 172.21.15.69:0/2056322717 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450421fcd0 con 0x7f45040fd9c0 2024-02-21T07:43:40.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.461+0000 7f450ebf3740 1 Processor -- start 2024-02-21T07:43:40.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.461+0000 7f450ebf3740 1 -- start start 2024-02-21T07:43:40.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.462+0000 7f4501600640 1 -- 172.21.15.69:0/2056322717 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f44f0013470 con 0x7f45040fd9c0 2024-02-21T07:43:40.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a38c030 0x56320a38c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a3b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f450ebf3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a307300 con 0x56320a38c030 2024-02-21T07:43:40.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f450ebf3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a2b9e50 con 0x56320a392a50 2024-02-21T07:43:40.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f450ebf3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a2b7380 con 0x56320a3925d0 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f4509600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a3b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f4509600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a3b8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49112/0 (socket says 172.21.15.69:49112) 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f4509600640 1 -- 172.21.15.69:0/568915799 learned_addr learned my addr 172.21.15.69:0/568915799 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f4508c00640 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.463+0000 7f450a000640 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a38c030 0x56320a38c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.464+0000 7f4501600640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f44e409f160 0x7f44e40a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.464+0000 7f450a000640 1 -- 172.21.15.69:0/568915799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 msgr2=0x56320a3b8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.464+0000 7f450a000640 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a3b8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.464+0000 7f450a000640 1 -- 172.21.15.69:0/568915799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 msgr2=0x56320a3b9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.464+0000 7f450a000640 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.464+0000 7f450a000640 1 -- 172.21.15.69:0/568915799 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56320a27bc80 con 0x56320a38c030 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.464+0000 7f4501600640 1 -- 172.21.15.69:0/2056322717 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f44f00c9e40 con 0x7f45040fd9c0 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.464+0000 7f4509600640 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a3b8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:40.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.464+0000 7f4508c00640 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:40.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.464+0000 7f450a000640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f44e409f160 0x7f44e40a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.465+0000 7f450a000640 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a38c030 0x56320a38c410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f44fc001bb0 tx=0x7f44fc002070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8028fb7804b3b7b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.465+0000 7f44f5c00640 1 -- 172.21.15.69:0/568915799 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc00b070 con 0x56320a38c030 2024-02-21T07:43:40.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.465+0000 7f44f5c00640 1 -- 172.21.15.69:0/568915799 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc0136c0 con 0x56320a38c030 2024-02-21T07:43:40.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.465+0000 7f44f5c00640 1 -- 172.21.15.69:0/568915799 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc013ab0 con 0x56320a38c030 2024-02-21T07:43:40.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.466+0000 7f450ebf3740 1 -- 172.21.15.69:0/568915799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a38c030 msgr2=0x56320a38c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.466+0000 7f450ebf3740 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a38c030 0x56320a38c410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f44fc001bb0 tx=0x7f44fc002070 comp rx=0 tx=0).stop 2024-02-21T07:43:40.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.466+0000 7f450a000640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f44e409f160 0x7f44e40a1620 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f44fc01c000 tx=0x7f44fc01d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.466+0000 7f450ebf3740 1 -- 172.21.15.69:0/568915799 shutdown_connections 2024-02-21T07:43:40.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.466+0000 7f450ebf3740 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.466+0000 7f450ebf3740 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a3b8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.466+0000 7f450ebf3740 1 --2- 172.21.15.69:0/568915799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a38c030 0x56320a38c410 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.466+0000 7f450ebf3740 1 -- 172.21.15.69:0/568915799 >> 172.21.15.69:0/568915799 conn(0x56320a349960 msgr2=0x56320a34a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.466+0000 7f450ebf3740 1 -- 172.21.15.69:0/568915799 shutdown_connections 2024-02-21T07:43:40.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.466+0000 7f450ebf3740 1 -- 172.21.15.69:0/568915799 wait complete. 2024-02-21T07:43:40.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.467+0000 7f450ebf3740 1 -- start start 2024-02-21T07:43:40.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.467+0000 7f450ebf3740 1 Processor -- start 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.468+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a3bdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.468+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a392a50 0x56320a3bbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.468+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 0x56320a3b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.468+0000 7f450ebf3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a2b2b60 con 0x56320a392a50 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.468+0000 7f450ebf3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a257fd0 con 0x56320a382d50 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.468+0000 7f450ebf3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a257c70 con 0x56320a3925d0 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.468+0000 7f450ebf3740 10 client.0 _ll_register_callbacks cb 0x563209fc3c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.469+0000 7f450a000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 0x56320a3b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.469+0000 7f450a000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 0x56320a3b9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38530/0 (socket says 172.21.15.69:38530) 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.469+0000 7f450a000640 1 -- 172.21.15.69:0/1824576072 learned_addr learned my addr 172.21.15.69:0/1824576072 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.469+0000 7f4509600640 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a3bdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.469+0000 7f4508c00640 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a392a50 0x56320a3bbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.469+0000 7f4508c00640 1 -- 172.21.15.69:0/1824576072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 msgr2=0x56320a3bdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.469+0000 7f4508c00640 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a3bdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.469+0000 7f4508c00640 1 -- 172.21.15.69:0/1824576072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 msgr2=0x56320a3b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.469+0000 7f4508c00640 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 0x56320a3b9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.469+0000 7f4508c00640 1 -- 172.21.15.69:0/1824576072 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45040d09f0 con 0x56320a392a50 2024-02-21T07:43:40.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.470+0000 7f4508c00640 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a392a50 0x56320a3bbfd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f44f00c7770 tx=0x7f44f00c7bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4d99ab0413aa5c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.470+0000 7f44ea000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:40.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.470+0000 7f44ea000640 1 -- 172.21.15.69:0/1824576072 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00b6040 con 0x56320a392a50 2024-02-21T07:43:40.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.470+0000 7f44ea000640 1 -- 172.21.15.69:0/1824576072 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f44f0097fd0 con 0x56320a392a50 2024-02-21T07:43:40.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.470+0000 7f450ebf3740 1 -- 172.21.15.69:0/1824576072 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563209fb2860 con 0x56320a392a50 2024-02-21T07:43:40.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.470+0000 7f44ea000640 1 -- 172.21.15.69:0/1824576072 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44f0095a10 con 0x56320a392a50 2024-02-21T07:43:40.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.470+0000 7f450ebf3740 10 client.5223 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:40.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.470+0000 7f450ebf3740 1 -- 172.21.15.69:0/1824576072 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x56320a2b11e0 con 0x56320a392a50 2024-02-21T07:43:40.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.471+0000 7f44ea000640 1 -- 172.21.15.69:0/1824576072 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563209fb2860 con 0x56320a392a50 2024-02-21T07:43:40.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.471+0000 7f44ea000640 1 -- 172.21.15.69:0/1824576072 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f44f0011070 con 0x56320a392a50 2024-02-21T07:43:40.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.471+0000 7f450ebf3740 10 client.5223 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:40.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.471+0000 7f450ebf3740 10 client.5223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:40.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.471+0000 7f450ebf3740 20 client.5223 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:40.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.471+0000 7f450ebf3740 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x56320a3ba740 0x56320a3deb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.471+0000 7f450ebf3740 4 client.5223 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:40.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.471+0000 7f450ebf3740 1 -- 172.21.15.69:0/1824576072 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56320a003410 con 0x56320a3ba740 2024-02-21T07:43:40.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.472+0000 7f4509600640 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x56320a3ba740 0x56320a3deb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.473+0000 7f44ea000640 10 client.5223 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:40.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.473+0000 7f4509600640 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x56320a3ba740 0x56320a3deb30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a35e4c237a3ae187 server_cookie=ce9df5988e596c02 in_seq=0 out_seq=0 2024-02-21T07:43:40.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.474+0000 7f44ea000640 1 -- 172.21.15.69:0/1824576072 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56320a003410 con 0x56320a3ba740 2024-02-21T07:43:40.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.474+0000 7f44ea000640 10 client.5223 handle_command_reply: tid=0 2024-02-21T07:43:40.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.474+0000 7f450ebf3740 1 client.5223 shutdown 2024-02-21T07:43:40.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f450ebf3740 1 -- 172.21.15.69:0/1824576072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a392a50 msgr2=0x56320a3bbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f450ebf3740 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a392a50 0x56320a3bbfd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f44f00c7770 tx=0x7f44f00c7bd0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f450ebf3740 1 -- 172.21.15.69:0/1824576072 shutdown_connections 2024-02-21T07:43:40.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f450ebf3740 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x56320a3ba740 0x56320a3deb30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f450ebf3740 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 0x56320a3b9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f450ebf3740 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a392a50 0x56320a3bbfd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f44ea000640 0 client.5223 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:40.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f450ebf3740 1 --2- 172.21.15.69:0/1824576072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a3bdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f450ebf3740 1 -- 172.21.15.69:0/1824576072 >> 172.21.15.69:0/1824576072 conn(0x56320a38c030 msgr2=0x56320a3c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f450ebf3740 1 -- 172.21.15.69:0/1824576072 shutdown_connections 2024-02-21T07:43:40.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.475+0000 7f450ebf3740 1 -- 172.21.15.69:0/1824576072 wait complete. 2024-02-21T07:43:40.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.476+0000 7f450ebf3740 20 client.5223 trim_cache size 0 max 16384 2024-02-21T07:43:40.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.492+0000 7f450ebf3740 1 Processor -- start 2024-02-21T07:43:40.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.492+0000 7f450ebf3740 1 -- start start 2024-02-21T07:43:40.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.493+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a382d50 0x56320a3d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.493+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a4226c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.493+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.493+0000 7f450ebf3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563209ffb0c0 con 0x56320a382d50 2024-02-21T07:43:40.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.493+0000 7f450ebf3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a391e10 con 0x56320a392a50 2024-02-21T07:43:40.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.493+0000 7f450ebf3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a41a680 con 0x56320a3925d0 2024-02-21T07:43:40.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.493+0000 7f450a000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.493+0000 7f450a000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38538/0 (socket says 172.21.15.69:38538) 2024-02-21T07:43:40.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.493+0000 7f450a000640 1 -- 172.21.15.69:0/2429198580 learned_addr learned my addr 172.21.15.69:0/2429198580 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.493+0000 7f4508c00640 1 --2- 172.21.15.69:0/2429198580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a4226c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.494+0000 7f450a000640 1 -- 172.21.15.69:0/2429198580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 msgr2=0x56320a4226c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.494+0000 7f450a000640 1 --2- 172.21.15.69:0/2429198580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a4226c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.494+0000 7f450a000640 1 -- 172.21.15.69:0/2429198580 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a382d50 msgr2=0x56320a3d3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.494+0000 7f450a000640 1 --2- 172.21.15.69:0/2429198580 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a382d50 0x56320a3d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.494+0000 7f450a000640 1 -- 172.21.15.69:0/2429198580 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56320a24da90 con 0x56320a392a50 2024-02-21T07:43:40.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.494+0000 7f450a000640 1 --2- 172.21.15.69:0/2429198580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b8e70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0017f0 tx=0x7f44fc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b2227e3b2a48b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.494+0000 7f44f5200640 1 -- 172.21.15.69:0/2429198580 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc00b050 con 0x56320a392a50 2024-02-21T07:43:40.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.494+0000 7f44f5200640 1 -- 172.21.15.69:0/2429198580 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc013440 con 0x56320a392a50 2024-02-21T07:43:40.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.494+0000 7f44f5200640 1 -- 172.21.15.69:0/2429198580 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc00dea0 con 0x56320a392a50 2024-02-21T07:43:40.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.495+0000 7f450ebf3740 1 -- 172.21.15.69:0/2429198580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 msgr2=0x56320a3b8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.495+0000 7f450ebf3740 1 --2- 172.21.15.69:0/2429198580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b8e70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f44fc0017f0 tx=0x7f44fc014000 comp rx=0 tx=0).stop 2024-02-21T07:43:40.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.495+0000 7f450ebf3740 1 -- 172.21.15.69:0/2429198580 shutdown_connections 2024-02-21T07:43:40.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.495+0000 7f450ebf3740 1 --2- 172.21.15.69:0/2429198580 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a392a50 0x56320a3b8e70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.495+0000 7f450ebf3740 1 --2- 172.21.15.69:0/2429198580 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a3925d0 0x56320a4226c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.495+0000 7f450ebf3740 1 --2- 172.21.15.69:0/2429198580 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a382d50 0x56320a3d3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.495+0000 7f450ebf3740 1 -- 172.21.15.69:0/2429198580 >> 172.21.15.69:0/2429198580 conn(0x56320a38c030 msgr2=0x56320a351e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.495+0000 7f450ebf3740 1 -- 172.21.15.69:0/2429198580 shutdown_connections 2024-02-21T07:43:40.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.495+0000 7f450ebf3740 1 -- 172.21.15.69:0/2429198580 wait complete. 2024-02-21T07:43:40.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.496+0000 7f450ebf3740 1 -- start start 2024-02-21T07:43:40.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.496+0000 7f450ebf3740 1 Processor -- start 2024-02-21T07:43:40.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.497+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 0x56320a4309f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.497+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a3925d0 0x56320a421c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.497+0000 7f450ebf3740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a392a50 0x56320a4334a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.497+0000 7f450ebf3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a4339e0 con 0x56320a3925d0 2024-02-21T07:43:40.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.497+0000 7f450ebf3740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a3e2d30 con 0x56320a382d50 2024-02-21T07:43:40.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.497+0000 7f450ebf3740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320a37fe40 con 0x56320a392a50 2024-02-21T07:43:40.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.497+0000 7f450ebf3740 10 client.0 _ll_register_callbacks cb 0x7f44fc001500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:40.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.498+0000 7f450a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a392a50 0x56320a4334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.498+0000 7f450a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a392a50 0x56320a4334a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49134/0 (socket says 172.21.15.69:49134) 2024-02-21T07:43:40.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.498+0000 7f450a000640 1 -- 172.21.15.69:0/3113424451 learned_addr learned my addr 172.21.15.69:0/3113424451 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.498+0000 7f4508c00640 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a3925d0 0x56320a421c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.498+0000 7f450a000640 1 -- 172.21.15.69:0/3113424451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 msgr2=0x56320a4309f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.498+0000 7f4509600640 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 0x56320a4309f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.499+0000 7f450a000640 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 0x56320a4309f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.499+0000 7f450a000640 1 -- 172.21.15.69:0/3113424451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a3925d0 msgr2=0x56320a421c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.499+0000 7f450a000640 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a3925d0 0x56320a421c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.499+0000 7f450a000640 1 -- 172.21.15.69:0/3113424451 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56320a27bc80 con 0x56320a392a50 2024-02-21T07:43:40.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.499+0000 7f4508c00640 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a3925d0 0x56320a421c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:40.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.499+0000 7f450a000640 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a392a50 0x56320a4334a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00d520 tx=0x7f44fc000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9927337dd4b0c510 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.499+0000 7f44ea000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:43:40.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.499+0000 7f44ea000640 1 -- 172.21.15.69:0/3113424451 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44fc006d50 con 0x56320a392a50 2024-02-21T07:43:40.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.499+0000 7f450ebf3740 1 -- 172.21.15.69:0/3113424451 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44fc0136c0 con 0x56320a392a50 2024-02-21T07:43:40.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.499+0000 7f44ea000640 1 -- 172.21.15.69:0/3113424451 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f44fc01e820 con 0x56320a392a50 2024-02-21T07:43:40.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f44ea000640 1 -- 172.21.15.69:0/3113424451 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44fc00b020 con 0x56320a392a50 2024-02-21T07:43:40.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f450ebf3740 10 client.5381 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:40.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f450ebf3740 1 -- 172.21.15.69:0/3113424451 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x56320a2736a0 con 0x56320a392a50 2024-02-21T07:43:40.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f44ea000640 1 -- 172.21.15.69:0/3113424451 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44fc0136c0 con 0x56320a392a50 2024-02-21T07:43:40.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f44ea000640 1 -- 172.21.15.69:0/3113424451 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f44fc039070 con 0x56320a392a50 2024-02-21T07:43:40.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f450ebf3740 10 client.5381 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:40.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f450ebf3740 10 client.5381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:40.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f450ebf3740 20 client.5381 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:40.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f450ebf3740 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x56320a3be140 0x56320a3b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f450ebf3740 4 client.5381 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:43:40.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.500+0000 7f450ebf3740 1 -- 172.21.15.69:0/3113424451 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x563209fef7b0 con 0x56320a3be140 2024-02-21T07:43:40.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.501+0000 7f4509600640 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x56320a3be140 0x56320a3b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.502+0000 7f4509600640 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x56320a3be140 0x56320a3b80d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91c6be01d6b053a7 server_cookie=44a0798df4981a0a in_seq=0 out_seq=0 2024-02-21T07:43:40.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.502+0000 7f44ea000640 10 client.5381 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:40.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.503+0000 7f44ea000640 1 -- 172.21.15.69:0/3113424451 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563209fef7b0 con 0x56320a3be140 2024-02-21T07:43:40.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.503+0000 7f44ea000640 10 client.5381 handle_command_reply: tid=0 2024-02-21T07:43:40.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.503+0000 7f450ebf3740 1 client.5381 shutdown 2024-02-21T07:43:40.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.503+0000 7f450ebf3740 1 -- 172.21.15.69:0/3113424451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a392a50 msgr2=0x56320a4334a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.503+0000 7f450ebf3740 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a392a50 0x56320a4334a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f44fc00d520 tx=0x7f44fc000f40 comp rx=0 tx=0).stop 2024-02-21T07:43:40.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.504+0000 7f450ebf3740 1 -- 172.21.15.69:0/3113424451 shutdown_connections 2024-02-21T07:43:40.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.504+0000 7f450ebf3740 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x56320a3be140 0x56320a3b80d0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.504+0000 7f450ebf3740 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56320a392a50 0x56320a4334a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.504+0000 7f450ebf3740 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56320a3925d0 0x56320a421c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.504+0000 7f450ebf3740 1 --2- 172.21.15.69:0/3113424451 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56320a382d50 0x56320a4309f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.504+0000 7f450ebf3740 1 -- 172.21.15.69:0/3113424451 >> 172.21.15.69:0/3113424451 conn(0x56320a38c030 msgr2=0x56320a385d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.504+0000 7f44ea000640 0 client.5381 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:40.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.506+0000 7f450ebf3740 1 -- 172.21.15.69:0/3113424451 shutdown_connections 2024-02-21T07:43:40.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.506+0000 7f450ebf3740 1 -- 172.21.15.69:0/3113424451 wait complete. 2024-02-21T07:43:40.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.506+0000 7f450ebf3740 20 client.5381 trim_cache size 0 max 16384 2024-02-21T07:43:40.512 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:43:40.512 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-02-21T07:43:40.512 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "490a94b5-9690-4fb6-a39e-13f2ba333e3d", 2024-02-21T07:43:40.512 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-02-21T07:43:40.512 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:43:40.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.507+0000 7f450aa00640 1 -- 172.21.15.69:0/2056322717 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f44e409f160 msgr2=0x7f44e40a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.507+0000 7f450aa00640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f44e409f160 0x7f44e40a1620 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f44fc01c000 tx=0x7f44fc01d000 comp rx=0 tx=0).stop 2024-02-21T07:43:40.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.507+0000 7f450aa00640 1 -- 172.21.15.69:0/2056322717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45040fd9c0 msgr2=0x7f45041776e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.507+0000 7f450aa00640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45040fd9c0 0x7f45041776e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f44f000e8a0 tx=0x7f44f000eca0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.507+0000 7f450aa00640 1 -- 172.21.15.69:0/2056322717 shutdown_connections 2024-02-21T07:43:40.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.507+0000 7f450aa00640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f44e409f160 0x7f44e40a1620 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.507+0000 7f450aa00640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4504182790 0x7f4504220a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.507+0000 7f450aa00640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f45040fd9c0 0x7f45041776e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.507+0000 7f450aa00640 1 --2- 172.21.15.69:0/2056322717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f45040d22b0 0x7f4504212b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.507+0000 7f450aa00640 1 -- 172.21.15.69:0/2056322717 >> 172.21.15.69:0/2056322717 conn(0x7f45040668e0 msgr2=0x7f4504188c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.508+0000 7f450aa00640 1 -- 172.21.15.69:0/2056322717 shutdown_connections 2024-02-21T07:43:40.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.508+0000 7f450aa00640 1 -- 172.21.15.69:0/2056322717 wait complete. 2024-02-21T07:43:40.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:43:40.530 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:43:40.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.693+0000 7f668fe00640 1 Processor -- start 2024-02-21T07:43:40.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.693+0000 7f668fe00640 1 -- start start 2024-02-21T07:43:40.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.695+0000 7f668fe00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669018a800 con 0x7f66900fe870 2024-02-21T07:43:40.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.695+0000 7f668fe00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66900fde70 con 0x7f669018b3a0 2024-02-21T07:43:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.695+0000 7f668fe00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6690189f10 con 0x7f669017f2a0 2024-02-21T07:43:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.695+0000 7f668e000640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f66900fe870 0x7f669018ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40554/0 (socket says 172.21.15.69:40554) 2024-02-21T07:43:40.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.695+0000 7f668e000640 1 -- 172.21.15.69:0/1679615689 learned_addr learned my addr 172.21.15.69:0/1679615689 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:40.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.695+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831442429 0 0) 0x7f669018a800 con 0x7f66900fe870 2024-02-21T07:43:40.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6674003520 con 0x7f66900fe870 2024-02-21T07:43:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115415298 0 0) 0x7f6690189f10 con 0x7f669017f2a0 2024-02-21T07:43:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f669018a800 con 0x7f669017f2a0 2024-02-21T07:43:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516807949 0 0) 0x7f66900fde70 con 0x7f669018b3a0 2024-02-21T07:43:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6690189f10 con 0x7f669018b3a0 2024-02-21T07:43:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2231964383 0 0) 0x7f6674003520 con 0x7f66900fe870 2024-02-21T07:43:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 >> v1:172.21.15.184:6789/0 conn(0x7f669017f2a0 legacy=0x7f66900fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 >> v1:172.21.15.174:6789/0 conn(0x7f669018b3a0 legacy=0x7f66900ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900fee80 con 0x7f66900fe870 2024-02-21T07:43:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f667c0015a0 con 0x7f66900fe870 2024-02-21T07:43:40.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 >> v1:172.21.15.69:6789/0 conn(0x7f66900fe870 legacy=0x7f669018ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6674004da0 0x7f6674005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f6674003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6674004280 0x7f667400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6680001210 con 0x7f6674004da0 2024-02-21T07:43:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667400c220 con 0x7f6674004280 2024-02-21T07:43:40.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667400c3e0 con 0x7f66740037b0 2024-02-21T07:43:40.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668e000640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f6674003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.696+0000 7f668f400640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6674004280 0x7f667400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.697+0000 7f668ea00640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6674004da0 0x7f6674005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.697+0000 7f668e000640 1 -- 172.21.15.69:0/1679615689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6674004280 msgr2=0x7f667400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.697+0000 7f668e000640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6674004280 0x7f667400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.697+0000 7f668e000640 1 -- 172.21.15.69:0/1679615689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6674004da0 msgr2=0x7f6674005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.697+0000 7f668e000640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6674004da0 0x7f6674005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.697+0000 7f668e000640 1 -- 172.21.15.69:0/1679615689 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674003520 con 0x7f66740037b0 2024-02-21T07:43:40.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.697+0000 7f668f400640 1 -- 172.21.15.69:0/1679615689 reap_dead start 2024-02-21T07:43:40.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.699+0000 7f668e000640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f6674003c30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f667c007fa0 tx=0x7f66740057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0251b20e79f8301 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.699+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c005ad0 con 0x7f66740037b0 2024-02-21T07:43:40.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.699+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c005c50 con 0x7f66740037b0 2024-02-21T07:43:40.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.699+0000 7f668d600640 1 -- 172.21.15.69:0/1679615689 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c007070 con 0x7f66740037b0 2024-02-21T07:43:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.700+0000 7f668fe00640 1 -- 172.21.15.69:0/1679615689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 msgr2=0x7f6674003c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.700+0000 7f668fe00640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f6674003c30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f667c007fa0 tx=0x7f66740057f0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.700+0000 7f668fe00640 1 -- 172.21.15.69:0/1679615689 shutdown_connections 2024-02-21T07:43:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.700+0000 7f668fe00640 1 --2- 172.21.15.69:0/1679615689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f6674003c30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.700+0000 7f668fe00640 1 -- 172.21.15.69:0/1679615689 >> 172.21.15.69:0/1679615689 conn(0x7f66900d2b00 msgr2=0x7f66900d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.700+0000 7f668fe00640 1 -- 172.21.15.69:0/1679615689 shutdown_connections 2024-02-21T07:43:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.700+0000 7f668fe00640 1 -- 172.21.15.69:0/1679615689 wait complete. 2024-02-21T07:43:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.702+0000 7f668fe00640 1 Processor -- start 2024-02-21T07:43:40.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.702+0000 7f668fe00640 1 -- start start 2024-02-21T07:43:40.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.704+0000 7f668fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f66900d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.704+0000 7f668fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690167b70 0x7f669021fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.704+0000 7f668fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66902201a0 0x7f6690221d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.704+0000 7f668fe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66900d2260 con 0x7f6690167b70 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.704+0000 7f668fe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6690220620 con 0x7f66902201a0 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.704+0000 7f668fe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6690167fd0 con 0x7f66740037b0 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f66900d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f66900d08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49156/0 (socket says 172.21.15.69:49156) 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668ea00640 1 -- 172.21.15.69:0/3172118345 learned_addr learned my addr 172.21.15.69:0/3172118345 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668e000640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690167b70 0x7f669021fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668f400640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66902201a0 0x7f6690221d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668ea00640 1 -- 172.21.15.69:0/3172118345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66902201a0 msgr2=0x7f6690221d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668ea00640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66902201a0 0x7f6690221d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668ea00640 1 -- 172.21.15.69:0/3172118345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690167b70 msgr2=0x7f669021fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668ea00640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690167b70 0x7f669021fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668ea00640 1 -- 172.21.15.69:0/3172118345 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900d1370 con 0x7f66740037b0 2024-02-21T07:43:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.705+0000 7f668ea00640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f66900d08d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f668000e5a0 tx=0x7f668000e9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.706+0000 7f6686a00640 1 -- 172.21.15.69:0/3172118345 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800052e0 con 0x7f66740037b0 2024-02-21T07:43:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.706+0000 7f6686a00640 1 -- 172.21.15.69:0/3172118345 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6680005440 con 0x7f66740037b0 2024-02-21T07:43:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.706+0000 7f6686a00640 1 -- 172.21.15.69:0/3172118345 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66800037f0 con 0x7f66740037b0 2024-02-21T07:43:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.706+0000 7f668fe00640 1 -- 172.21.15.69:0/3172118345 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66900d1650 con 0x7f66740037b0 2024-02-21T07:43:40.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.706+0000 7f668fe00640 1 -- 172.21.15.69:0/3172118345 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66900d1c10 con 0x7f66740037b0 2024-02-21T07:43:40.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.710+0000 7f66987b7740 1 Processor -- start 2024-02-21T07:43:40.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.710+0000 7f66987b7740 1 -- start start 2024-02-21T07:43:40.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.710+0000 7f6686a00640 1 -- 172.21.15.69:0/3172118345 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f6680003950 con 0x7f66740037b0 2024-02-21T07:43:40.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.711+0000 7f66987b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a470c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.711+0000 7f66987b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a471150 0x560d4a43b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.711+0000 7f66987b7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43bab0 0x560d4a3fe0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.711+0000 7f66987b7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a372150 con 0x560d4a43bab0 2024-02-21T07:43:40.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.711+0000 7f66987b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a36f680 con 0x560d4a471150 2024-02-21T07:43:40.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.711+0000 7f66987b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a36ae60 con 0x560d4a43b190 2024-02-21T07:43:40.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.712+0000 7f668e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43bab0 0x560d4a3fe0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.712+0000 7f668ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a471150 0x560d4a43b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.712+0000 7f668f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a470c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.712+0000 7f668ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a471150 0x560d4a43b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38578/0 (socket says 172.21.15.69:38578) 2024-02-21T07:43:40.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.712+0000 7f668ea00640 1 -- 172.21.15.69:0/3146086949 learned_addr learned my addr 172.21.15.69:0/3146086949 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.712+0000 7f668f400640 1 -- 172.21.15.69:0/3146086949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a471150 msgr2=0x560d4a43b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.713+0000 7f668f400640 1 --2- 172.21.15.69:0/3146086949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a471150 0x560d4a43b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.713+0000 7f6686a00640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f667009f230 0x7f66700a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.713+0000 7f668f400640 1 -- 172.21.15.69:0/3146086949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43bab0 msgr2=0x560d4a3fe0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.713+0000 7f668f400640 1 --2- 172.21.15.69:0/3146086949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43bab0 0x560d4a3fe0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.713+0000 7f668f400640 1 -- 172.21.15.69:0/3146086949 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d4a324060 con 0x560d4a43b190 2024-02-21T07:43:40.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.713+0000 7f6686a00640 1 -- 172.21.15.69:0/3172118345 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f66800c9af0 con 0x7f66740037b0 2024-02-21T07:43:40.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.713+0000 7f668f400640 1 --2- 172.21.15.69:0/3146086949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a470c10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f669018b780 tx=0x7f66880017c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1595cf7de73f76 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.713+0000 7f668f400640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f667009f230 0x7f66700a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.713+0000 7f668e000640 1 --2- 172.21.15.69:0/3146086949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43bab0 0x560d4a3fe0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.713+0000 7f668ea00640 1 --2- 172.21.15.69:0/3146086949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a471150 0x560d4a43b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.714+0000 7f667b400640 1 -- 172.21.15.69:0/3146086949 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668801c030 con 0x560d4a43b190 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.714+0000 7f667b400640 1 -- 172.21.15.69:0/3146086949 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6688003970 con 0x560d4a43b190 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.714+0000 7f667b400640 1 -- 172.21.15.69:0/3146086949 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688003de0 con 0x560d4a43b190 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.715+0000 7f66987b7740 1 -- 172.21.15.69:0/3146086949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 msgr2=0x560d4a470c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.715+0000 7f66987b7740 1 --2- 172.21.15.69:0/3146086949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a470c10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f669018b780 tx=0x7f66880017c0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.715+0000 7f66987b7740 1 -- 172.21.15.69:0/3146086949 shutdown_connections 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.715+0000 7f66987b7740 1 --2- 172.21.15.69:0/3146086949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43bab0 0x560d4a3fe0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.715+0000 7f66987b7740 1 --2- 172.21.15.69:0/3146086949 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a471150 0x560d4a43b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.715+0000 7f66987b7740 1 --2- 172.21.15.69:0/3146086949 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a470c10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.715+0000 7f66987b7740 1 -- 172.21.15.69:0/3146086949 >> 172.21.15.69:0/3146086949 conn(0x560d4a3ca5a0 msgr2=0x560d4a402080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.715+0000 7f66987b7740 1 -- 172.21.15.69:0/3146086949 shutdown_connections 2024-02-21T07:43:40.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.715+0000 7f66987b7740 1 -- 172.21.15.69:0/3146086949 wait complete. 2024-02-21T07:43:40.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.715+0000 7f668f400640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f667009f230 0x7f66700a16f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f668801c000 tx=0x7f6688004000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.716+0000 7f66987b7740 1 -- start start 2024-02-21T07:43:40.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.716+0000 7f66987b7740 1 Processor -- start 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.717+0000 7f66987b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a432a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.717+0000 7f66987b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a485f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.717+0000 7f66987b7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a3fec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.717+0000 7f66987b7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a30fec0 con 0x560d4a471150 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.717+0000 7f66987b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a30fb60 con 0x560d4a43bab0 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.717+0000 7f66987b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a0d91c0 con 0x560d4a43b190 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.717+0000 7f66987b7740 10 client.0 _ll_register_callbacks cb 0x560d4a323960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a432a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a485f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a3fec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a485f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38594/0 (socket says 172.21.15.69:38594) 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668e000640 1 -- 172.21.15.69:0/1472036059 learned_addr learned my addr 172.21.15.69:0/1472036059 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668e000640 1 -- 172.21.15.69:0/1472036059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 msgr2=0x560d4a432a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668e000640 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a432a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668e000640 1 -- 172.21.15.69:0/1472036059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 msgr2=0x560d4a3fec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668e000640 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a3fec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668e000640 1 -- 172.21.15.69:0/1472036059 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6690189f10 con 0x560d4a43bab0 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.718+0000 7f668f400640 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a3fec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.719+0000 7f668e000640 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a485f80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f667c007fa0 tx=0x7f667c0018b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a35fb6ef3453a18 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.719+0000 7f666fe00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.719+0000 7f666fe00640 1 -- 172.21.15.69:0/1472036059 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c004bf0 con 0x560d4a43bab0 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.719+0000 7f66987b7740 1 -- 172.21.15.69:0/1472036059 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d4a06a7e0 con 0x560d4a43bab0 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.719+0000 7f666fe00640 1 -- 172.21.15.69:0/1472036059 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f667c03c030 con 0x560d4a43bab0 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.719+0000 7f666fe00640 1 -- 172.21.15.69:0/1472036059 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f667c004d50 con 0x560d4a43bab0 2024-02-21T07:43:40.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.719+0000 7f66987b7740 10 client.5419 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:40.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.719+0000 7f66987b7740 1 -- 172.21.15.69:0/1472036059 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x560d4a3694e0 con 0x560d4a43bab0 2024-02-21T07:43:40.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.720+0000 7f666fe00640 1 -- 172.21.15.69:0/1472036059 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c04e020 con 0x560d4a43bab0 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.720+0000 7f666fe00640 1 -- 172.21.15.69:0/1472036059 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f667c007070 con 0x560d4a43bab0 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.720+0000 7f66987b7740 10 client.5419 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.720+0000 7f66987b7740 10 client.5419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.720+0000 7f66987b7740 20 client.5419 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.720+0000 7f66987b7740 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x560d4a4312b0 0x560d4a3ff610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.720+0000 7f66987b7740 4 client.5419 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.720+0000 7f66987b7740 1 -- 172.21.15.69:0/1472036059 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d4a0a7720 con 0x560d4a4312b0 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.720+0000 7f668ea00640 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x560d4a4312b0 0x560d4a3ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.721+0000 7f668ea00640 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x560d4a4312b0 0x560d4a3ff610 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52dc22749944eec4 server_cookie=977ea05196a672ff in_seq=0 out_seq=0 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.721+0000 7f666fe00640 10 client.5419 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.721+0000 7f666fe00640 1 -- 172.21.15.69:0/1472036059 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560d4a0a7720 con 0x560d4a4312b0 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.721+0000 7f666fe00640 10 client.5419 handle_command_reply: tid=0 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.721+0000 7f66987b7740 1 client.5419 shutdown 2024-02-21T07:43:40.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.722+0000 7f66987b7740 1 -- 172.21.15.69:0/1472036059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 msgr2=0x560d4a485f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.722+0000 7f66987b7740 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a485f80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f667c007fa0 tx=0x7f667c0018b0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.722+0000 7f66987b7740 1 -- 172.21.15.69:0/1472036059 shutdown_connections 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.722+0000 7f66987b7740 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x560d4a4312b0 0x560d4a3ff610 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.722+0000 7f66987b7740 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a3fec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.722+0000 7f66987b7740 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a485f80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.722+0000 7f66987b7740 1 --2- 172.21.15.69:0/1472036059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a432a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.722+0000 7f66987b7740 1 -- 172.21.15.69:0/1472036059 >> 172.21.15.69:0/1472036059 conn(0x560d4a3ca5a0 msgr2=0x560d4a472b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.722+0000 7f666fe00640 0 client.5419 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.723+0000 7f66987b7740 1 -- 172.21.15.69:0/1472036059 shutdown_connections 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.723+0000 7f66987b7740 1 -- 172.21.15.69:0/1472036059 wait complete. 2024-02-21T07:43:40.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.723+0000 7f66987b7740 20 client.5419 trim_cache size 0 max 16384 2024-02-21T07:43:40.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.739+0000 7f66987b7740 1 Processor -- start 2024-02-21T07:43:40.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.739+0000 7f66987b7740 1 -- start start 2024-02-21T07:43:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f66987b7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43b190 0x560d4a441ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f66987b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a432ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f66987b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a471150 0x560d4a4d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f66987b7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a486b40 con 0x560d4a43b190 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f66987b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a431aa0 con 0x560d4a43bab0 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f66987b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a4862d0 con 0x560d4a471150 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f668ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43b190 0x560d4a441ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f668e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a432ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f668f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a471150 0x560d4a4d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f668ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43b190 0x560d4a441ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48566/0 (socket says 172.21.15.69:48566) 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f668e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a432ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38606/0 (socket says 172.21.15.69:38606) 2024-02-21T07:43:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.741+0000 7f668ea00640 1 -- 172.21.15.69:0/1810230021 learned_addr learned my addr 172.21.15.69:0/1810230021 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.742+0000 7f668f400640 1 -- 172.21.15.69:0/1810230021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 msgr2=0x560d4a432ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.742+0000 7f668f400640 1 --2- 172.21.15.69:0/1810230021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a432ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.742+0000 7f668f400640 1 -- 172.21.15.69:0/1810230021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43b190 msgr2=0x560d4a441ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.742+0000 7f668f400640 1 --2- 172.21.15.69:0/1810230021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43b190 0x560d4a441ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.742+0000 7f668f400640 1 -- 172.21.15.69:0/1810230021 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d4a305950 con 0x560d4a471150 2024-02-21T07:43:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.742+0000 7f668ea00640 1 --2- 172.21.15.69:0/1810230021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43b190 0x560d4a441ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.742+0000 7f668f400640 1 --2- 172.21.15.69:0/1810230021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a471150 0x560d4a4d1080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6688018000 tx=0x7f668800f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=603d719dc2e81afd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.743+0000 7f667aa00640 1 -- 172.21.15.69:0/1810230021 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688034070 con 0x560d4a471150 2024-02-21T07:43:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.743+0000 7f667aa00640 1 -- 172.21.15.69:0/1810230021 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6688012a10 con 0x560d4a471150 2024-02-21T07:43:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.743+0000 7f667aa00640 1 -- 172.21.15.69:0/1810230021 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688003ce0 con 0x560d4a471150 2024-02-21T07:43:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.743+0000 7f66987b7740 1 -- 172.21.15.69:0/1810230021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a471150 msgr2=0x560d4a4d1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.743+0000 7f66987b7740 1 --2- 172.21.15.69:0/1810230021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a471150 0x560d4a4d1080 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6688018000 tx=0x7f668800f000 comp rx=0 tx=0).stop 2024-02-21T07:43:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.744+0000 7f66987b7740 1 -- 172.21.15.69:0/1810230021 shutdown_connections 2024-02-21T07:43:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.744+0000 7f66987b7740 1 --2- 172.21.15.69:0/1810230021 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a471150 0x560d4a4d1080 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.744+0000 7f66987b7740 1 --2- 172.21.15.69:0/1810230021 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a432ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.744+0000 7f66987b7740 1 --2- 172.21.15.69:0/1810230021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a43b190 0x560d4a441ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.744+0000 7f66987b7740 1 -- 172.21.15.69:0/1810230021 >> 172.21.15.69:0/1810230021 conn(0x560d4a3ca5a0 msgr2=0x560d4a4452f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.744+0000 7f66987b7740 1 -- 172.21.15.69:0/1810230021 shutdown_connections 2024-02-21T07:43:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.744+0000 7f66987b7740 1 -- 172.21.15.69:0/1810230021 wait complete. 2024-02-21T07:43:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.745+0000 7f66987b7740 1 -- start start 2024-02-21T07:43:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.745+0000 7f66987b7740 1 Processor -- start 2024-02-21T07:43:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.747+0000 7f66987b7740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a4caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.747+0000 7f66987b7740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a493720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.747+0000 7f66987b7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a443170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.747+0000 7f66987b7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a3f9420 con 0x560d4a471150 2024-02-21T07:43:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.747+0000 7f66987b7740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a4cff70 con 0x560d4a43bab0 2024-02-21T07:43:40.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.747+0000 7f66987b7740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4a4436b0 con 0x560d4a43b190 2024-02-21T07:43:40.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.747+0000 7f66987b7740 10 client.0 _ll_register_callbacks cb 0x7f66740036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:40.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a443170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a4caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a443170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48576/0 (socket says 172.21.15.69:48576) 2024-02-21T07:43:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668f400640 1 -- 172.21.15.69:0/1618378298 learned_addr learned my addr 172.21.15.69:0/1618378298 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a4caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49198/0 (socket says 172.21.15.69:49198) 2024-02-21T07:43:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668e000640 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a493720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668f400640 1 -- 172.21.15.69:0/1618378298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 msgr2=0x560d4a4caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668f400640 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a4caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668f400640 1 -- 172.21.15.69:0/1618378298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 msgr2=0x560d4a493720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668f400640 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a493720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668f400640 1 -- 172.21.15.69:0/1618378298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6680022070 con 0x560d4a471150 2024-02-21T07:43:40.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.748+0000 7f668ea00640 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a4caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:40.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.749+0000 7f668f400640 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a443170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f669018ceb0 tx=0x7f66880016a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ada87fab710ad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.749+0000 7f666fe00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:40.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.749+0000 7f666fe00640 1 -- 172.21.15.69:0/1618378298 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668803d070 con 0x560d4a471150 2024-02-21T07:43:40.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.749+0000 7f666fe00640 1 -- 172.21.15.69:0/1618378298 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6688029040 con 0x560d4a471150 2024-02-21T07:43:40.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.749+0000 7f66987b7740 1 -- 172.21.15.69:0/1618378298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6688003970 con 0x560d4a471150 2024-02-21T07:43:40.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.750+0000 7f666fe00640 1 -- 172.21.15.69:0/1618378298 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6688034050 con 0x560d4a471150 2024-02-21T07:43:40.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.750+0000 7f66987b7740 10 client.5244 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:40.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.750+0000 7f66987b7740 1 -- 172.21.15.69:0/1618378298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x560d4a324060 con 0x560d4a471150 2024-02-21T07:43:40.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.750+0000 7f666fe00640 1 -- 172.21.15.69:0/1618378298 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6688003970 con 0x560d4a471150 2024-02-21T07:43:40.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.751+0000 7f666fe00640 1 -- 172.21.15.69:0/1618378298 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6688040030 con 0x560d4a471150 2024-02-21T07:43:40.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.751+0000 7f66987b7740 10 client.5244 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:40.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.751+0000 7f66987b7740 10 client.5244 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:40.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.751+0000 7f66987b7740 20 client.5244 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:40.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.751+0000 7f66987b7740 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x560d4a486440 0x560d4a3fe080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.751+0000 7f66987b7740 4 client.5244 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:43:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.751+0000 7f66987b7740 1 -- 172.21.15.69:0/1618378298 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560d4a0f6890 con 0x560d4a486440 2024-02-21T07:43:40.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.751+0000 7f668ea00640 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x560d4a486440 0x560d4a3fe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.752+0000 7f668ea00640 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x560d4a486440 0x560d4a3fe080 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57b59a2a4863b05a server_cookie=c7e54afb9da9bcbb in_seq=0 out_seq=0 2024-02-21T07:43:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.752+0000 7f666fe00640 10 client.5244 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.752+0000 7f666fe00640 1 -- 172.21.15.69:0/1618378298 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560d4a0f6890 con 0x560d4a486440 2024-02-21T07:43:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.752+0000 7f666fe00640 10 client.5244 handle_command_reply: tid=0 2024-02-21T07:43:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.752+0000 7f66987b7740 1 client.5244 shutdown 2024-02-21T07:43:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.752+0000 7f66987b7740 1 -- 172.21.15.69:0/1618378298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 msgr2=0x560d4a443170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.752+0000 7f66987b7740 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a443170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f669018ceb0 tx=0x7f66880016a0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.753+0000 7f66987b7740 1 -- 172.21.15.69:0/1618378298 shutdown_connections 2024-02-21T07:43:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.753+0000 7f66987b7740 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x560d4a486440 0x560d4a3fe080 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.753+0000 7f66987b7740 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d4a471150 0x560d4a443170 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.753+0000 7f66987b7740 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560d4a43bab0 0x560d4a493720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.753+0000 7f66987b7740 1 --2- 172.21.15.69:0/1618378298 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560d4a43b190 0x560d4a4caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.753+0000 7f666fe00640 0 client.5244 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:40.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.753+0000 7f66987b7740 1 -- 172.21.15.69:0/1618378298 >> 172.21.15.69:0/1618378298 conn(0x560d4a3ca5a0 msgr2=0x560d4a402040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.753+0000 7f66987b7740 1 -- 172.21.15.69:0/1618378298 shutdown_connections 2024-02-21T07:43:40.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.753+0000 7f66987b7740 1 -- 172.21.15.69:0/1618378298 wait complete. 2024-02-21T07:43:40.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.753+0000 7f66987b7740 20 client.5244 trim_cache size 0 max 16384 2024-02-21T07:43:40.760 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:43:40.760 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-02-21T07:43:40.761 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-02-21T07:43:40.761 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:43:40.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 -- 172.21.15.69:0/3172118345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f667009f230 msgr2=0x7f66700a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f667009f230 0x7f66700a16f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f668801c000 tx=0x7f6688004000 comp rx=0 tx=0).stop 2024-02-21T07:43:40.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 -- 172.21.15.69:0/3172118345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 msgr2=0x7f66900d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f66900d08d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f668000e5a0 tx=0x7f668000e9a0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 -- 172.21.15.69:0/3172118345 shutdown_connections 2024-02-21T07:43:40.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f667009f230 0x7f66700a16f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66902201a0 0x7f6690221d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6690167b70 0x7f669021fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 --2- 172.21.15.69:0/3172118345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66740037b0 0x7f66900d08d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 -- 172.21.15.69:0/3172118345 >> 172.21.15.69:0/3172118345 conn(0x7f66900d2b00 msgr2=0x7f66900fb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 -- 172.21.15.69:0/3172118345 shutdown_connections 2024-02-21T07:43:40.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.754+0000 7f668fe00640 1 -- 172.21.15.69:0/3172118345 wait complete. 2024-02-21T07:43:40.780 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:43:40.781 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:43:40.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.948+0000 7f0663200640 1 Processor -- start 2024-02-21T07:43:40.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.948+0000 7f0663200640 1 -- start start 2024-02-21T07:43:40.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.950+0000 7f0663200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f065c15dad0 0x7f065c0fd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.950+0000 7f0663200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f065c160c10 0x7f065c161020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.950+0000 7f0663200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c1897f0 con 0x7f065c189d50 2024-02-21T07:43:40.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.950+0000 7f0663200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c0fdc80 con 0x7f065c15dad0 2024-02-21T07:43:40.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.950+0000 7f0663200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c0fc3c0 con 0x7f065c160c10 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.950+0000 7f0661e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f065c15dad0 0x7f065c0fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.950+0000 7f0662800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f065c160c10 0x7f065c161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.950+0000 7f0661e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f065c15dad0 0x7f065c0fd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38616/0 (socket says 172.21.15.69:38616) 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.950+0000 7f0661e00640 1 -- 172.21.15.69:0/241747973 learned_addr learned my addr 172.21.15.69:0/241747973 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.950+0000 7f0661400640 1 --1- 172.21.15.69:0/241747973 >> v1:172.21.15.184:6789/0 conn(0x7f065c189d50 0x7f065c160500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:36448/0 (socket says 172.21.15.69:36448) 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.951+0000 7f0660a00640 1 -- 172.21.15.69:0/241747973 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754520274 0 0) 0x7f065c1897f0 con 0x7f065c189d50 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.951+0000 7f0661e00640 1 -- 172.21.15.69:0/241747973 >> v2:172.21.15.184:3300/0 conn(0x7f065c160c10 msgr2=0x7f065c161020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.951+0000 7f0661e00640 1 --2- 172.21.15.69:0/241747973 >> v2:172.21.15.184:3300/0 conn(0x7f065c160c10 0x7f065c161020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.951+0000 7f0661e00640 1 -- 172.21.15.69:0/241747973 >> v1:172.21.15.184:6789/0 conn(0x7f065c189d50 legacy=0x7f065c160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.951+0000 7f0661e00640 1 -- 172.21.15.69:0/241747973 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c0fc6a0 con 0x7f065c15dad0 2024-02-21T07:43:40.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.951+0000 7f0662800640 1 --2- 172.21.15.69:0/241747973 >> v2:172.21.15.184:3300/0 conn(0x7f065c160c10 0x7f065c161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:40.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.952+0000 7f0661e00640 1 --2- 172.21.15.69:0/241747973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c15dad0 0x7f065c0fd740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f065c0fad90 tx=0x7f065002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f523839208c1c17 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.953+0000 7f0660a00640 1 -- 172.21.15.69:0/241747973 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650030860 con 0x7f065c15dad0 2024-02-21T07:43:40.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.953+0000 7f0660a00640 1 -- 172.21.15.69:0/241747973 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06500309c0 con 0x7f065c15dad0 2024-02-21T07:43:40.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.953+0000 7f0660a00640 1 -- 172.21.15.69:0/241747973 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650030d50 con 0x7f065c15dad0 2024-02-21T07:43:40.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.953+0000 7f0663200640 1 -- 172.21.15.69:0/241747973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c15dad0 msgr2=0x7f065c0fd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.953+0000 7f0663200640 1 --2- 172.21.15.69:0/241747973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c15dad0 0x7f065c0fd740 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f065c0fad90 tx=0x7f065002b9a0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.953+0000 7f0663200640 1 -- 172.21.15.69:0/241747973 shutdown_connections 2024-02-21T07:43:40.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.953+0000 7f0663200640 1 --2- 172.21.15.69:0/241747973 >> v2:172.21.15.184:3300/0 conn(0x7f065c160c10 0x7f065c161020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.953+0000 7f0663200640 1 --2- 172.21.15.69:0/241747973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c15dad0 0x7f065c0fd740 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.953+0000 7f0663200640 1 -- 172.21.15.69:0/241747973 >> 172.21.15.69:0/241747973 conn(0x7f065c0d2c90 msgr2=0x7f065c0d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:40.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.954+0000 7f0663200640 1 -- 172.21.15.69:0/241747973 shutdown_connections 2024-02-21T07:43:40.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.954+0000 7f0663200640 1 -- 172.21.15.69:0/241747973 wait complete. 2024-02-21T07:43:40.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.955+0000 7f0663200640 1 Processor -- start 2024-02-21T07:43:40.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.956+0000 7f0663200640 1 -- start start 2024-02-21T07:43:40.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0663200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c15dad0 0x7f065c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0663200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c160c10 0x7f065c21f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0663200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c189d50 0x7f065c21c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0663200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c152080 con 0x7f065c189d50 2024-02-21T07:43:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0663200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c2203a0 con 0x7f065c160c10 2024-02-21T07:43:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0663200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c220680 con 0x7f065c15dad0 2024-02-21T07:43:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0661e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c15dad0 0x7f065c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0662800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c189d50 0x7f065c21c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0661e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c15dad0 0x7f065c151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49206/0 (socket says 172.21.15.69:49206) 2024-02-21T07:43:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0661e00640 1 -- 172.21.15.69:0/3258700247 learned_addr learned my addr 172.21.15.69:0/3258700247 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.957+0000 7f0661400640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c160c10 0x7f065c21f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0661e00640 1 -- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c160c10 msgr2=0x7f065c21f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0661e00640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c160c10 0x7f065c21f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0661e00640 1 -- 172.21.15.69:0/3258700247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c189d50 msgr2=0x7f065c21c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0661e00640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c189d50 0x7f065c21c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0661e00640 1 -- 172.21.15.69:0/3258700247 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0658009a70 con 0x7f065c15dad0 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0662800640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c189d50 0x7f065c21c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0661400640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c160c10 0x7f065c21f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0661e00640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c15dad0 0x7f065c151b40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f065002b9e0 tx=0x7f0650004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0656000640 1 -- 172.21.15.69:0/3258700247 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650039a90 con 0x7f065c15dad0 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0656000640 1 -- 172.21.15.69:0/3258700247 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650039c30 con 0x7f065c15dad0 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0656000640 1 -- 172.21.15.69:0/3258700247 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650043410 con 0x7f065c15dad0 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0663200640 1 -- 172.21.15.69:0/3258700247 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06500094d0 con 0x7f065c15dad0 2024-02-21T07:43:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.958+0000 7f0663200640 1 -- 172.21.15.69:0/3258700247 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c220c40 con 0x7f065c15dad0 2024-02-21T07:43:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.960+0000 7f0663200640 1 -- 172.21.15.69:0/3258700247 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c06cba0 con 0x7f065c15dad0 2024-02-21T07:43:40.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.962+0000 7f0656000640 1 -- 172.21.15.69:0/3258700247 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f0650043570 con 0x7f065c15dad0 2024-02-21T07:43:40.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.963+0000 7f0656000640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f064009f130 0x7f06400a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:40.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.963+0000 7f0656000640 1 -- 172.21.15.69:0/3258700247 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f06500ebf50 con 0x7f065c15dad0 2024-02-21T07:43:40.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.963+0000 7f0661400640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f064009f130 0x7f06400a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:40.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.964+0000 7f0661400640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f064009f130 0x7f06400a15f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f065c0facb0 tx=0x7f064c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:40.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:40.967+0000 7f0656000640 1 -- 172.21.15.69:0/3258700247 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f065007d8c0 con 0x7f065c15dad0 2024-02-21T07:43:41.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.393+0000 7f0663200640 1 -- 172.21.15.69:0/3258700247 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f065c069c10 con 0x7f065c15dad0 2024-02-21T07:43:41.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.394+0000 7f0656000640 1 -- 172.21.15.69:0/3258700247 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+11372 (secure 0 0 0) 0x7f0650048070 con 0x7f065c15dad0 2024-02-21T07:43:41.400 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:43:41.400 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:56.243830+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:43:41.401 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 19 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 -- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f064009f130 msgr2=0x7f06400a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f064009f130 0x7f06400a15f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f065c0facb0 tx=0x7f064c009040 comp rx=0 tx=0).stop 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 -- 172.21.15.69:0/3258700247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c15dad0 msgr2=0x7f065c151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c15dad0 0x7f065c151b40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f065002b9e0 tx=0x7f0650004730 comp rx=0 tx=0).stop 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 -- 172.21.15.69:0/3258700247 shutdown_connections 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f064009f130 0x7f06400a15f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f065c189d50 0x7f065c21c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f065c160c10 0x7f065c21f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 --2- 172.21.15.69:0/3258700247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f065c15dad0 0x7f065c151b40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 -- 172.21.15.69:0/3258700247 >> 172.21.15.69:0/3258700247 conn(0x7f065c0d2c90 msgr2=0x7f065c068a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 -- 172.21.15.69:0/3258700247 shutdown_connections 2024-02-21T07:43:41.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.397+0000 7f0663200640 1 -- 172.21.15.69:0/3258700247 wait complete. 2024-02-21T07:43:41.420 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:43:41.420 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-02-21T07:43:41.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.609+0000 7fd48a000640 1 Processor -- start 2024-02-21T07:43:41.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.610+0000 7fd48a000640 1 -- start start 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.611+0000 7fd48a000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd484188fd0 0x7fd48406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.611+0000 7fd48a000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48406b4e0 con 0x7fd48415d830 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.611+0000 7fd48a000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd484189710 con 0x7fd48415dc10 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.611+0000 7fd48a000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48418cec0 con 0x7fd484188fd0 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.612+0000 7fd483e00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd48415dc10 0x7fd4841888c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:36460/0 (socket says 172.21.15.69:36460) 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.612+0000 7fd483e00640 1 -- 172.21.15.69:0/3893019524 learned_addr learned my addr 172.21.15.69:0/3893019524 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.612+0000 7fd489600640 1 --2- 172.21.15.69:0/3893019524 >> v2:172.21.15.174:3300/0 conn(0x7fd484188fd0 0x7fd48406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.612+0000 7fd483400640 1 -- 172.21.15.69:0/3893019524 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531259259 0 0) 0x7fd484189710 con 0x7fd48415dc10 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.612+0000 7fd483400640 1 -- 172.21.15.69:0/3893019524 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd46c003520 con 0x7fd48415dc10 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.612+0000 7fd489600640 1 -- 172.21.15.69:0/3893019524 >> v1:172.21.15.184:6789/0 conn(0x7fd48415dc10 legacy=0x7fd4841888c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.612+0000 7fd489600640 1 -- 172.21.15.69:0/3893019524 >> v1:172.21.15.69:6789/0 conn(0x7fd48415d830 legacy=0x7fd4840f93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.612+0000 7fd489600640 1 -- 172.21.15.69:0/3893019524 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48406b730 con 0x7fd484188fd0 2024-02-21T07:43:41.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.614+0000 7fd489600640 1 --2- 172.21.15.69:0/3893019524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd484188fd0 0x7fd48406c4f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009d90 tx=0x7fd47c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=624e9fada6719dbc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.614+0000 7fd483400640 1 -- 172.21.15.69:0/3893019524 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c02cbd0 con 0x7fd484188fd0 2024-02-21T07:43:41.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.614+0000 7fd483400640 1 -- 172.21.15.69:0/3893019524 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c02cd30 con 0x7fd484188fd0 2024-02-21T07:43:41.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.614+0000 7fd483400640 1 -- 172.21.15.69:0/3893019524 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c02cea0 con 0x7fd484188fd0 2024-02-21T07:43:41.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.615+0000 7fd48a000640 1 -- 172.21.15.69:0/3893019524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd484188fd0 msgr2=0x7fd48406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.615+0000 7fd48a000640 1 --2- 172.21.15.69:0/3893019524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd484188fd0 0x7fd48406c4f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009d90 tx=0x7fd47c02be20 comp rx=0 tx=0).stop 2024-02-21T07:43:41.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.615+0000 7fd48a000640 1 -- 172.21.15.69:0/3893019524 shutdown_connections 2024-02-21T07:43:41.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.615+0000 7fd48a000640 1 --2- 172.21.15.69:0/3893019524 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd484188fd0 0x7fd48406c4f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.615+0000 7fd48a000640 1 -- 172.21.15.69:0/3893019524 >> 172.21.15.69:0/3893019524 conn(0x7fd4840d63e0 msgr2=0x7fd4840d67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.615+0000 7fd48a000640 1 -- 172.21.15.69:0/3893019524 shutdown_connections 2024-02-21T07:43:41.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.616+0000 7fd48a000640 1 -- 172.21.15.69:0/3893019524 wait complete. 2024-02-21T07:43:41.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.619+0000 7fd48a000640 1 Processor -- start 2024-02-21T07:43:41.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.619+0000 7fd48a000640 1 -- start start 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd48a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd48415d830 0x7fd48421e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd48a000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd48415dc10 0x7fd4841537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd48a000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd484188fd0 0x7fd48415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd48a000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840fc2d0 con 0x7fd48415d830 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd48a000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48421f490 con 0x7fd48415dc10 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd48a000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840fbf30 con 0x7fd484188fd0 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd488c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd48415d830 0x7fd48421e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd488c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd48415d830 0x7fd48421e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48592/0 (socket says 172.21.15.69:48592) 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd488c00640 1 -- 172.21.15.69:0/1452366872 learned_addr learned my addr 172.21.15.69:0/1452366872 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd489600640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd484188fd0 0x7fd48415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.621+0000 7fd483e00640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd48415dc10 0x7fd4841537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd489600640 1 -- 172.21.15.69:0/1452366872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd48415dc10 msgr2=0x7fd4841537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd489600640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd48415dc10 0x7fd4841537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd489600640 1 -- 172.21.15.69:0/1452366872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd48415d830 msgr2=0x7fd48421e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd489600640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd48415d830 0x7fd48421e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd489600640 1 -- 172.21.15.69:0/1452366872 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c009a70 con 0x7fd484188fd0 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd488c00640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd48415d830 0x7fd48421e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd489600640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd484188fd0 0x7fd48415b050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd47c033000 tx=0x7fd47c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd480c00640 1 -- 172.21.15.69:0/1452366872 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c02cea0 con 0x7fd484188fd0 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd480c00640 1 -- 172.21.15.69:0/1452366872 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c003b90 con 0x7fd484188fd0 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd48a000640 1 -- 172.21.15.69:0/1452366872 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd484153cf0 con 0x7fd484188fd0 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.622+0000 7fd480c00640 1 -- 172.21.15.69:0/1452366872 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c009450 con 0x7fd484188fd0 2024-02-21T07:43:41.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.623+0000 7fd48a000640 1 -- 172.21.15.69:0/1452366872 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48421eed0 con 0x7fd484188fd0 2024-02-21T07:43:41.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.627+0000 7fd480c00640 1 -- 172.21.15.69:0/1452366872 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fd47c004030 con 0x7fd484188fd0 2024-02-21T07:43:41.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.628+0000 7fd48e3dc740 1 Processor -- start 2024-02-21T07:43:41.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.628+0000 7fd48e3dc740 1 -- start start 2024-02-21T07:43:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5070 0x55702a9e5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702a9e5990 0x55702aa20200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20740 0x55702aa214d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702a918210 con 0x55702a9e5070 2024-02-21T07:43:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702a915740 con 0x55702aa20740 2024-02-21T07:43:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702a910f20 con 0x55702a9e5990 2024-02-21T07:43:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd483e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5070 0x55702a9e5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd483e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5070 0x55702a9e5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48604/0 (socket says 172.21.15.69:48604) 2024-02-21T07:43:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd483e00640 1 -- 172.21.15.69:0/2700273642 learned_addr learned my addr 172.21.15.69:0/2700273642 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd480c00640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd46409f130 0x7fd4640a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd483e00640 1 --2- 172.21.15.69:0/2700273642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20740 0x55702aa214d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd488c00640 1 --2- 172.21.15.69:0/2700273642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702a9e5990 0x55702aa20200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.629+0000 7fd480c00640 1 -- 172.21.15.69:0/1452366872 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd47c0ec3f0 con 0x7fd484188fd0 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.630+0000 7fd483e00640 1 -- 172.21.15.69:0/2700273642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702a9e5990 msgr2=0x55702aa20200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.630+0000 7fd483e00640 1 --2- 172.21.15.69:0/2700273642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702a9e5990 0x55702aa20200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.630+0000 7fd483e00640 1 -- 172.21.15.69:0/2700273642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20740 msgr2=0x55702aa214d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.630+0000 7fd483e00640 1 --2- 172.21.15.69:0/2700273642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20740 0x55702aa214d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.630+0000 7fd483e00640 1 -- 172.21.15.69:0/2700273642 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55702a8d2df0 con 0x55702a9e5070 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.630+0000 7fd489600640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd46409f130 0x7fd4640a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.630+0000 7fd483e00640 1 --2- 172.21.15.69:0/2700273642 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5070 0x55702a9e5450 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd484163f30 tx=0x7fd470006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bab73b77bc71a0c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.630+0000 7fd475200640 1 -- 172.21.15.69:0/2700273642 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470007730 con 0x55702a9e5070 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.631+0000 7fd475200640 1 -- 172.21.15.69:0/2700273642 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4700193f0 con 0x55702a9e5070 2024-02-21T07:43:41.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.631+0000 7fd475200640 1 -- 172.21.15.69:0/2700273642 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470019760 con 0x55702a9e5070 2024-02-21T07:43:41.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.631+0000 7fd48e3dc740 1 -- 172.21.15.69:0/2700273642 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5070 msgr2=0x55702a9e5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.631+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/2700273642 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5070 0x55702a9e5450 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd484163f30 tx=0x7fd470006940 comp rx=0 tx=0).stop 2024-02-21T07:43:41.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.631+0000 7fd489600640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd46409f130 0x7fd4640a15f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0b9ea0 tx=0x7fd47c0c0040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.632+0000 7fd48e3dc740 1 -- 172.21.15.69:0/2700273642 shutdown_connections 2024-02-21T07:43:41.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.632+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/2700273642 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20740 0x55702aa214d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.632+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/2700273642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702a9e5990 0x55702aa20200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.632+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/2700273642 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5070 0x55702a9e5450 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.632+0000 7fd48e3dc740 1 -- 172.21.15.69:0/2700273642 >> 172.21.15.69:0/2700273642 conn(0x55702a9a7640 msgr2=0x55702a9a86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.632+0000 7fd48e3dc740 1 -- 172.21.15.69:0/2700273642 shutdown_connections 2024-02-21T07:43:41.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.632+0000 7fd48e3dc740 1 -- 172.21.15.69:0/2700273642 wait complete. 2024-02-21T07:43:41.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.633+0000 7fd48e3dc740 1 -- start start 2024-02-21T07:43:41.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.634+0000 7fd48e3dc740 1 Processor -- start 2024-02-21T07:43:41.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702a9e5990 0x55702aa2a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702aa20740 0x55702aa2c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa2ac60 0x55702aa0e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702a8b6150 con 0x55702aa20740 2024-02-21T07:43:41.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702a8b5df0 con 0x55702aa2ac60 2024-02-21T07:43:41.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702a67f1c0 con 0x55702a9e5990 2024-02-21T07:43:41.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd48e3dc740 10 client.0 _ll_register_callbacks cb 0x55702a9052b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:41.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd488c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702aa20740 0x55702aa2c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd483e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa2ac60 0x55702aa0e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd483e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa2ac60 0x55702aa0e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38662/0 (socket says 172.21.15.69:38662) 2024-02-21T07:43:41.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd483e00640 1 -- 172.21.15.69:0/3228436901 learned_addr learned my addr 172.21.15.69:0/3228436901 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:41.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.636+0000 7fd483e00640 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702a9e5990 0x55702aa2a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.637+0000 7fd483e00640 1 -- 172.21.15.69:0/3228436901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702a9e5990 msgr2=0x55702aa2a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.637+0000 7fd483e00640 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702a9e5990 0x55702aa2a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.637+0000 7fd483e00640 1 -- 172.21.15.69:0/3228436901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702aa20740 msgr2=0x55702aa2c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.637+0000 7fd483e00640 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702aa20740 0x55702aa2c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.637+0000 7fd483e00640 1 -- 172.21.15.69:0/3228436901 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c003520 con 0x55702aa2ac60 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.637+0000 7fd483e00640 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa2ac60 0x55702aa0e190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd47000f000 tx=0x7fd470013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93c8380b2c90374f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.637+0000 7fd469600640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.638+0000 7fd469600640 1 -- 172.21.15.69:0/3228436901 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700199a0 con 0x55702aa2ac60 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.638+0000 7fd48e3dc740 1 -- 172.21.15.69:0/3228436901 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55702a6107e0 con 0x55702aa2ac60 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.638+0000 7fd469600640 1 -- 172.21.15.69:0/3228436901 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd470019b00 con 0x55702aa2ac60 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.638+0000 7fd469600640 1 -- 172.21.15.69:0/3228436901 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd470019cc0 con 0x55702aa2ac60 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.638+0000 7fd48e3dc740 10 client.5440 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:41.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.638+0000 7fd48e3dc740 1 -- 172.21.15.69:0/3228436901 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55702a90f5a0 con 0x55702aa2ac60 2024-02-21T07:43:41.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.638+0000 7fd469600640 1 -- 172.21.15.69:0/3228436901 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd470035020 con 0x55702aa2ac60 2024-02-21T07:43:41.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.639+0000 7fd469600640 1 -- 172.21.15.69:0/3228436901 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd470030070 con 0x55702aa2ac60 2024-02-21T07:43:41.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.639+0000 7fd48e3dc740 10 client.5440 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:41.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.639+0000 7fd48e3dc740 10 client.5440 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.b 2024-02-21T07:43:41.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.639+0000 7fd48e3dc740 20 client.5440 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:41.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.639+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55702a9e2bd0 0x55702a9a4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.639+0000 7fd48e3dc740 4 client.5440 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:41.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.639+0000 7fd48e3dc740 1 -- 172.21.15.69:0/3228436901 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55702a64d720 con 0x55702a9e2bd0 2024-02-21T07:43:41.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.639+0000 7fd488c00640 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55702a9e2bd0 0x55702a9a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.640+0000 7fd488c00640 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55702a9e2bd0 0x55702a9a4240 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=59365e3c1bf19519 server_cookie=2e965afd6806b8dd in_seq=0 out_seq=0 2024-02-21T07:43:41.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.640+0000 7fd469600640 10 client.5440 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:43:41.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.641+0000 7fd469600640 1 -- 172.21.15.69:0/3228436901 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55702a64d720 con 0x55702a9e2bd0 2024-02-21T07:43:41.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.641+0000 7fd469600640 10 client.5440 handle_command_reply: tid=0 2024-02-21T07:43:41.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.641+0000 7fd48e3dc740 1 client.5440 shutdown 2024-02-21T07:43:41.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.641+0000 7fd48e3dc740 1 -- 172.21.15.69:0/3228436901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa2ac60 msgr2=0x55702aa0e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.641+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa2ac60 0x55702aa0e190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd47000f000 tx=0x7fd470013000 comp rx=0 tx=0).stop 2024-02-21T07:43:41.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.642+0000 7fd48e3dc740 1 -- 172.21.15.69:0/3228436901 shutdown_connections 2024-02-21T07:43:41.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.642+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55702a9e2bd0 0x55702a9a4240 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.642+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa2ac60 0x55702aa0e190 secure :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd47000f000 tx=0x7fd470013000 comp rx=0 tx=0).stop 2024-02-21T07:43:41.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.642+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702aa20740 0x55702aa2c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.642+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/3228436901 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702a9e5990 0x55702aa2a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.642+0000 7fd469600640 0 client.5440 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:43:41.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.642+0000 7fd48e3dc740 1 -- 172.21.15.69:0/3228436901 >> 172.21.15.69:0/3228436901 conn(0x55702a9e5070 msgr2=0x55702a9e1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.642+0000 7fd48e3dc740 1 -- 172.21.15.69:0/3228436901 shutdown_connections 2024-02-21T07:43:41.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.642+0000 7fd48e3dc740 1 -- 172.21.15.69:0/3228436901 wait complete. 2024-02-21T07:43:41.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.643+0000 7fd48e3dc740 20 client.5440 trim_cache size 0 max 16384 2024-02-21T07:43:41.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.667+0000 7fd48e3dc740 1 Processor -- start 2024-02-21T07:43:41.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.668+0000 7fd48e3dc740 1 -- start start 2024-02-21T07:43:41.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.669+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702aa20d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.669+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20740 0x55702aa2c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.669+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702aa20320 0x55702aa7e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.669+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702aa1eee0 con 0x55702a9e5990 2024-02-21T07:43:41.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.669+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702a9a6aa0 con 0x55702aa20740 2024-02-21T07:43:41.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.669+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702aa1cc30 con 0x55702aa20320 2024-02-21T07:43:41.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.670+0000 7fd483e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702aa20d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.670+0000 7fd483e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702aa20d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48632/0 (socket says 172.21.15.69:48632) 2024-02-21T07:43:41.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.670+0000 7fd483e00640 1 -- 172.21.15.69:0/403651935 learned_addr learned my addr 172.21.15.69:0/403651935 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:41.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.670+0000 7fd488c00640 1 --2- 172.21.15.69:0/403651935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20740 0x55702aa2c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.670+0000 7fd483e00640 1 --2- 172.21.15.69:0/403651935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702aa20320 0x55702aa7e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.670+0000 7fd483e00640 1 -- 172.21.15.69:0/403651935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702aa20320 msgr2=0x55702aa7e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.670+0000 7fd483e00640 1 --2- 172.21.15.69:0/403651935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702aa20320 0x55702aa7e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.670+0000 7fd483e00640 1 -- 172.21.15.69:0/403651935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20740 msgr2=0x55702aa2c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.670+0000 7fd483e00640 1 --2- 172.21.15.69:0/403651935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20740 0x55702aa2c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.670+0000 7fd483e00640 1 -- 172.21.15.69:0/403651935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55702aa1d900 con 0x55702a9e5990 2024-02-21T07:43:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.671+0000 7fd483e00640 1 --2- 172.21.15.69:0/403651935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702aa20d60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd470001a90 tx=0x7fd47002a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adada8e811bdef4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.671+0000 7fd46be00640 1 -- 172.21.15.69:0/403651935 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4700199a0 con 0x55702a9e5990 2024-02-21T07:43:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.671+0000 7fd46be00640 1 -- 172.21.15.69:0/403651935 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd470035040 con 0x55702a9e5990 2024-02-21T07:43:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.671+0000 7fd46be00640 1 -- 172.21.15.69:0/403651935 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470019d00 con 0x55702a9e5990 2024-02-21T07:43:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.672+0000 7fd48e3dc740 1 -- 172.21.15.69:0/403651935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 msgr2=0x55702aa20d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.672+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/403651935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702aa20d60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd470001a90 tx=0x7fd47002a070 comp rx=0 tx=0).stop 2024-02-21T07:43:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.672+0000 7fd48e3dc740 1 -- 172.21.15.69:0/403651935 shutdown_connections 2024-02-21T07:43:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.672+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/403651935 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702aa20320 0x55702aa7e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.672+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/403651935 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20740 0x55702aa2c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.672+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/403651935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702aa20d60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.672+0000 7fd48e3dc740 1 -- 172.21.15.69:0/403651935 >> 172.21.15.69:0/403651935 conn(0x55702a9e5070 msgr2=0x55702a9a90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.672+0000 7fd48e3dc740 1 -- 172.21.15.69:0/403651935 shutdown_connections 2024-02-21T07:43:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.672+0000 7fd48e3dc740 1 -- 172.21.15.69:0/403651935 wait complete. 2024-02-21T07:43:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.673+0000 7fd48e3dc740 1 -- start start 2024-02-21T07:43:41.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.674+0000 7fd48e3dc740 1 Processor -- start 2024-02-21T07:43:41.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702a9a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20320 0x55702aa1eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd48e3dc740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702aa20740 0x55702aa15640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702aa88610 con 0x55702a9e5990 2024-02-21T07:43:41.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702aa16050 con 0x55702aa20320 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd48e3dc740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55702aa88470 con 0x55702aa20740 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd48e3dc740 10 client.0 _ll_register_callbacks cb 0x7fd470006cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd483e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702a9a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd483e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702a9a67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48648/0 (socket says 172.21.15.69:48648) 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd483e00640 1 -- 172.21.15.69:0/1909355559 learned_addr learned my addr 172.21.15.69:0/1909355559 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd488c00640 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20320 0x55702aa1eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd483e00640 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702aa20740 0x55702aa15640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd483e00640 1 -- 172.21.15.69:0/1909355559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702aa20740 msgr2=0x55702aa15640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd483e00640 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702aa20740 0x55702aa15640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd483e00640 1 -- 172.21.15.69:0/1909355559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20320 msgr2=0x55702aa1eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd483e00640 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20320 0x55702aa1eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.676+0000 7fd483e00640 1 -- 172.21.15.69:0/1909355559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55702a90f5a0 con 0x55702a9e5990 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.677+0000 7fd483e00640 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702a9a67c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd470001d70 tx=0x7fd470000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef66af4fbf68232e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.677+0000 7fd469600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.677+0000 7fd469600640 1 -- 172.21.15.69:0/1909355559 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470019ba0 con 0x55702a9e5990 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.677+0000 7fd469600640 1 -- 172.21.15.69:0/1909355559 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd470036080 con 0x55702a9e5990 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.677+0000 7fd48e3dc740 1 -- 172.21.15.69:0/1909355559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd4700193f0 con 0x55702a9e5990 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.677+0000 7fd469600640 1 -- 172.21.15.69:0/1909355559 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd470019d00 con 0x55702a9e5990 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.677+0000 7fd48e3dc740 10 client.5265 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.677+0000 7fd48e3dc740 1 -- 172.21.15.69:0/1909355559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55702a8abab0 con 0x55702a9e5990 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.678+0000 7fd469600640 1 -- 172.21.15.69:0/1909355559 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47004e020 con 0x55702a9e5990 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.678+0000 7fd469600640 1 -- 172.21.15.69:0/1909355559 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd470030040 con 0x55702a9e5990 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.678+0000 7fd48e3dc740 10 client.5265 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.678+0000 7fd48e3dc740 10 client.5265 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.b 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.678+0000 7fd48e3dc740 20 client.5265 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.678+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55702aa129d0 0x55702a99f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.678+0000 7fd48e3dc740 4 client.5265 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:43:41.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.678+0000 7fd48e3dc740 1 -- 172.21.15.69:0/1909355559 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55702a69c890 con 0x55702aa129d0 2024-02-21T07:43:41.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.678+0000 7fd488c00640 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55702aa129d0 0x55702a99f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.679+0000 7fd469600640 10 client.5265 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:43:41.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.679+0000 7fd488c00640 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55702aa129d0 0x55702a99f550 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f252a0db54369ca6 server_cookie=e1b73dd1839dccb9 in_seq=0 out_seq=0 2024-02-21T07:43:41.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.679+0000 7fd469600640 1 -- 172.21.15.69:0/1909355559 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55702a69c890 con 0x55702aa129d0 2024-02-21T07:43:41.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.679+0000 7fd469600640 10 client.5265 handle_command_reply: tid=0 2024-02-21T07:43:41.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.679+0000 7fd48e3dc740 1 client.5265 shutdown 2024-02-21T07:43:41.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 1 -- 172.21.15.69:0/1909355559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 msgr2=0x55702a9a67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702a9a67c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd470001d70 tx=0x7fd470000ed0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 1 -- 172.21.15.69:0/1909355559 shutdown_connections 2024-02-21T07:43:41.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x55702aa129d0 0x55702a99f550 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55702aa20740 0x55702aa15640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55702aa20320 0x55702aa1eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 1 --2- 172.21.15.69:0/1909355559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55702a9e5990 0x55702a9a67c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 1 -- 172.21.15.69:0/1909355559 >> 172.21.15.69:0/1909355559 conn(0x55702a9e5070 msgr2=0x55702aa1c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd469600640 0 client.5265 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:43:41.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 1 -- 172.21.15.69:0/1909355559 shutdown_connections 2024-02-21T07:43:41.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 1 -- 172.21.15.69:0/1909355559 wait complete. 2024-02-21T07:43:41.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.680+0000 7fd48e3dc740 20 client.5265 trim_cache size 0 max 16384 2024-02-21T07:43:41.688 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:43:41.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.681+0000 7fd48a000640 1 -- 172.21.15.69:0/1452366872 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd46409f130 msgr2=0x7fd4640a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.681+0000 7fd48a000640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd46409f130 0x7fd4640a15f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0b9ea0 tx=0x7fd47c0c0040 comp rx=0 tx=0).stop 2024-02-21T07:43:41.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.681+0000 7fd48a000640 1 -- 172.21.15.69:0/1452366872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd484188fd0 msgr2=0x7fd48415b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.681+0000 7fd48a000640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd484188fd0 0x7fd48415b050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd47c033000 tx=0x7fd47c004a40 comp rx=0 tx=0).stop 2024-02-21T07:43:41.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.681+0000 7fd48a000640 1 -- 172.21.15.69:0/1452366872 shutdown_connections 2024-02-21T07:43:41.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.681+0000 7fd48a000640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd46409f130 0x7fd4640a15f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.681+0000 7fd48a000640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd484188fd0 0x7fd48415b050 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.681+0000 7fd48a000640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd48415dc10 0x7fd4841537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.681+0000 7fd48a000640 1 --2- 172.21.15.69:0/1452366872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd48415d830 0x7fd48421e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.681+0000 7fd48a000640 1 -- 172.21.15.69:0/1452366872 >> 172.21.15.69:0/1452366872 conn(0x7fd4840d63e0 msgr2=0x7fd4840fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.682+0000 7fd48a000640 1 -- 172.21.15.69:0/1452366872 shutdown_connections 2024-02-21T07:43:41.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.682+0000 7fd48a000640 1 -- 172.21.15.69:0/1452366872 wait complete. 2024-02-21T07:43:41.710 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:43:41.710 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-02-21T07:43:41.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.880+0000 7f9de7e00640 1 Processor -- start 2024-02-21T07:43:41.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.880+0000 7f9de7e00640 1 -- start start 2024-02-21T07:43:41.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.882+0000 7f9de7e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9de817f2a0 0x7f9de80fe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.882+0000 7f9de7e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9de80fe6a0 0x7f9de818ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.882+0000 7f9de7e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de818a800 con 0x7f9de818b1d0 2024-02-21T07:43:41.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.882+0000 7f9de7e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de80ff160 con 0x7f9de80fe6a0 2024-02-21T07:43:41.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.882+0000 7f9de7e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de80fde70 con 0x7f9de817f2a0 2024-02-21T07:43:41.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.882+0000 7f9de6000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9de80fe6a0 0x7f9de818ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.882+0000 7f9de6a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9de817f2a0 0x7f9de80fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.882+0000 7f9de7400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f9de818b1d0 0x7f9de80ce9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:45630/0 (socket says 172.21.15.69:45630) 2024-02-21T07:43:41.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.882+0000 7f9de7400640 1 -- 172.21.15.69:0/2106762057 learned_addr learned my addr 172.21.15.69:0/2106762057 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:41.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.883+0000 7f9de6a00640 1 -- 172.21.15.69:0/2106762057 >> v2:172.21.15.69:3300/0 conn(0x7f9de80fe6a0 msgr2=0x7f9de818ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.883+0000 7f9de6a00640 1 --2- 172.21.15.69:0/2106762057 >> v2:172.21.15.69:3300/0 conn(0x7f9de80fe6a0 0x7f9de818ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.883+0000 7f9de6a00640 1 -- 172.21.15.69:0/2106762057 >> v1:172.21.15.174:6789/0 conn(0x7f9de818b1d0 legacy=0x7f9de80ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.883+0000 7f9de6a00640 1 -- 172.21.15.69:0/2106762057 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de8189f10 con 0x7f9de817f2a0 2024-02-21T07:43:41.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.883+0000 7f9de5600640 1 -- 172.21.15.69:0/2106762057 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280096314 0 0) 0x7f9de818a800 con 0x7f9de818b1d0 2024-02-21T07:43:41.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.884+0000 7f9de6a00640 1 --2- 172.21.15.69:0/2106762057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9de817f2a0 0x7f9de80fe160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9de80fe130 tx=0x7f9dd802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb8c9ec72be8c9bd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.884+0000 7f9de5600640 1 -- 172.21.15.69:0/2106762057 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8031830 con 0x7f9de817f2a0 2024-02-21T07:43:41.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.884+0000 7f9de5600640 1 -- 172.21.15.69:0/2106762057 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd8031990 con 0x7f9de817f2a0 2024-02-21T07:43:41.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.884+0000 7f9de5600640 1 -- 172.21.15.69:0/2106762057 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8031d20 con 0x7f9de817f2a0 2024-02-21T07:43:41.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.885+0000 7f9de7e00640 1 -- 172.21.15.69:0/2106762057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9de817f2a0 msgr2=0x7f9de80fe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.885+0000 7f9de7e00640 1 --2- 172.21.15.69:0/2106762057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9de817f2a0 0x7f9de80fe160 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9de80fe130 tx=0x7f9dd802b8d0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.885+0000 7f9de7e00640 1 -- 172.21.15.69:0/2106762057 shutdown_connections 2024-02-21T07:43:41.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.885+0000 7f9de7e00640 1 --2- 172.21.15.69:0/2106762057 >> v2:172.21.15.69:3300/0 conn(0x7f9de80fe6a0 0x7f9de818ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.885+0000 7f9de7e00640 1 --2- 172.21.15.69:0/2106762057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9de817f2a0 0x7f9de80fe160 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.885+0000 7f9de7e00640 1 -- 172.21.15.69:0/2106762057 >> 172.21.15.69:0/2106762057 conn(0x7f9de80d2b00 msgr2=0x7f9de80d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.886+0000 7f9de7e00640 1 -- 172.21.15.69:0/2106762057 shutdown_connections 2024-02-21T07:43:41.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.886+0000 7f9de7e00640 1 -- 172.21.15.69:0/2106762057 wait complete. 2024-02-21T07:43:41.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.889+0000 7f9de7e00640 1 Processor -- start 2024-02-21T07:43:41.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.889+0000 7f9de7e00640 1 -- start start 2024-02-21T07:43:41.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9de80fe6a0 0x7f9de8153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9de817f2a0 0x7f9de821f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9de818b1d0 0x7f9de80d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de7e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de8220f60 con 0x7f9de80fe6a0 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de7e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de8153fe0 con 0x7f9de818b1d0 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de7e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de8220070 con 0x7f9de817f2a0 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9de80fe6a0 0x7f9de8153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9de80fe6a0 0x7f9de8153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48664/0 (socket says 172.21.15.69:48664) 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de6a00640 1 -- 172.21.15.69:0/1194210113 learned_addr learned my addr 172.21.15.69:0/1194210113 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de6000640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9de817f2a0 0x7f9de821f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.891+0000 7f9de7400640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9de818b1d0 0x7f9de80d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9de6a00640 1 -- 172.21.15.69:0/1194210113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9de817f2a0 msgr2=0x7f9de821f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9de6a00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9de817f2a0 0x7f9de821f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9de6a00640 1 -- 172.21.15.69:0/1194210113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9de818b1d0 msgr2=0x7f9de80d1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9de6a00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9de818b1d0 0x7f9de80d1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9de6a00640 1 -- 172.21.15.69:0/1194210113 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd8009400 con 0x7f9de80fe6a0 2024-02-21T07:43:41.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9de6000640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9de817f2a0 0x7f9de821f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:41.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9de6a00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9de80fe6a0 0x7f9de8153aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009890 tx=0x7f9dd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9ddf400640 1 -- 172.21.15.69:0/1194210113 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd80317d0 con 0x7f9de80fe6a0 2024-02-21T07:43:41.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9ddf400640 1 -- 172.21.15.69:0/1194210113 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd803ba70 con 0x7f9de80fe6a0 2024-02-21T07:43:41.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9ddf400640 1 -- 172.21.15.69:0/1194210113 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd803be20 con 0x7f9de80fe6a0 2024-02-21T07:43:41.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.892+0000 7f9de7e00640 1 -- 172.21.15.69:0/1194210113 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de8220350 con 0x7f9de80fe6a0 2024-02-21T07:43:41.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.893+0000 7f9de7e00640 1 -- 172.21.15.69:0/1194210113 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de8220910 con 0x7f9de80fe6a0 2024-02-21T07:43:41.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.897+0000 7f9df09f1740 1 Processor -- start 2024-02-21T07:43:41.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.897+0000 7f9df09f1740 1 -- start start 2024-02-21T07:43:41.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.897+0000 7f9ddf400640 1 -- 172.21.15.69:0/1194210113 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f9dd80453f0 con 0x7f9de80fe6a0 2024-02-21T07:43:41.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.898+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266c880 0x55d40266cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.898+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40266d1a0 0x55d4026a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.898+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d4026a7f50 0x55d4026a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.898+0000 7f9df09f1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d402597210 con 0x55d40266d1a0 2024-02-21T07:43:41.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.898+0000 7f9df09f1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d402594740 con 0x55d40266c880 2024-02-21T07:43:41.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.898+0000 7f9df09f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40258ff20 con 0x55d4026a7f50 2024-02-21T07:43:41.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40266d1a0 0x55d4026a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40266d1a0 0x55d4026a7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48676/0 (socket says 172.21.15.69:48676) 2024-02-21T07:43:41.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de6a00640 1 -- 172.21.15.69:0/804113192 learned_addr learned my addr 172.21.15.69:0/804113192 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:41.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de7400640 1 --2- 172.21.15.69:0/804113192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266c880 0x55d40266cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de6000640 1 --2- 172.21.15.69:0/804113192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d4026a7f50 0x55d4026a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de7400640 1 -- 172.21.15.69:0/804113192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d4026a7f50 msgr2=0x55d4026a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de7400640 1 --2- 172.21.15.69:0/804113192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d4026a7f50 0x55d4026a8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de7400640 1 -- 172.21.15.69:0/804113192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40266d1a0 msgr2=0x55d4026a7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de7400640 1 --2- 172.21.15.69:0/804113192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40266d1a0 0x55d4026a7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de7400640 1 -- 172.21.15.69:0/804113192 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d402551df0 con 0x55d40266c880 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9de6a00640 1 --2- 172.21.15.69:0/804113192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40266d1a0 0x55d4026a7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.899+0000 7f9ddf400640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9dc809f130 0x7f9dc80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.900+0000 7f9de7400640 1 --2- 172.21.15.69:0/804113192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266c880 0x55d40266cc60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9de0001a50 tx=0x7f9de0001f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b58a24842ac6d59 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.900+0000 7f9ddf400640 1 -- 172.21.15.69:0/1194210113 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9dd80ebeb0 con 0x7f9de80fe6a0 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.900+0000 7f9de6a00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9dc809f130 0x7f9dc80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.900+0000 7f9dd3400640 1 -- 172.21.15.69:0/804113192 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0004cc0 con 0x55d40266c880 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.900+0000 7f9dd3400640 1 -- 172.21.15.69:0/804113192 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de0007850 con 0x55d40266c880 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.900+0000 7f9dd3400640 1 -- 172.21.15.69:0/804113192 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0013630 con 0x55d40266c880 2024-02-21T07:43:41.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.901+0000 7f9df09f1740 1 -- 172.21.15.69:0/804113192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266c880 msgr2=0x55d40266cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.901+0000 7f9df09f1740 1 --2- 172.21.15.69:0/804113192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266c880 0x55d40266cc60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9de0001a50 tx=0x7f9de0001f10 comp rx=0 tx=0).stop 2024-02-21T07:43:41.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.901+0000 7f9de6a00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9dc809f130 0x7f9dc80a15f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9dd802b910 tx=0x7f9dd80ef920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.901+0000 7f9df09f1740 1 -- 172.21.15.69:0/804113192 shutdown_connections 2024-02-21T07:43:41.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.901+0000 7f9df09f1740 1 --2- 172.21.15.69:0/804113192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d4026a7f50 0x55d4026a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.901+0000 7f9df09f1740 1 --2- 172.21.15.69:0/804113192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40266d1a0 0x55d4026a7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.901+0000 7f9df09f1740 1 --2- 172.21.15.69:0/804113192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266c880 0x55d40266cc60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.901+0000 7f9df09f1740 1 -- 172.21.15.69:0/804113192 >> 172.21.15.69:0/804113192 conn(0x55d40262ee50 msgr2=0x55d40262fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.901+0000 7f9df09f1740 1 -- 172.21.15.69:0/804113192 shutdown_connections 2024-02-21T07:43:41.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.901+0000 7f9df09f1740 1 -- 172.21.15.69:0/804113192 wait complete. 2024-02-21T07:43:41.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.902+0000 7f9df09f1740 1 -- start start 2024-02-21T07:43:41.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.902+0000 7f9df09f1740 1 Processor -- start 2024-02-21T07:43:41.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.903+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 0x55d4026606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.903+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 0x55d402657350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.903+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 0x55d40265e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.903+0000 7f9df09f1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d402535150 con 0x55d4026a7f50 2024-02-21T07:43:41.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.903+0000 7f9df09f1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d402534df0 con 0x55d40265dc90 2024-02-21T07:43:41.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.903+0000 7f9df09f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4022fe1c0 con 0x55d40266d1a0 2024-02-21T07:43:41.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.903+0000 7f9df09f1740 10 client.0 _ll_register_callbacks cb 0x55d4025842b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.904+0000 7f9de7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 0x55d4026606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.904+0000 7f9de6000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 0x55d402657350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.904+0000 7f9de7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 0x55d4026606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49290/0 (socket says 172.21.15.69:49290) 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.904+0000 7f9de7400640 1 -- 172.21.15.69:0/2123441890 learned_addr learned my addr 172.21.15.69:0/2123441890 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.904+0000 7f9de7400640 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 0x55d40265e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.904+0000 7f9de7400640 1 -- 172.21.15.69:0/2123441890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 msgr2=0x55d40265e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.904+0000 7f9de7400640 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 0x55d40265e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.904+0000 7f9de7400640 1 -- 172.21.15.69:0/2123441890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 msgr2=0x55d402657350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.904+0000 7f9de7400640 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 0x55d402657350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.904+0000 7f9de7400640 1 -- 172.21.15.69:0/2123441890 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de0004e20 con 0x55d40266d1a0 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.905+0000 7f9de7400640 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 0x55d4026606d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9de0000f80 tx=0x7f9de000c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada91e8abd8672db server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.905+0000 7f9dc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.905+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2123441890 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de0001770 con 0x55d40266d1a0 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.905+0000 7f9df09f1740 1 -- 172.21.15.69:0/2123441890 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d40228f7e0 con 0x55d40266d1a0 2024-02-21T07:43:41.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.905+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2123441890 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9de001d430 con 0x55d40266d1a0 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.905+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2123441890 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9de00013e0 con 0x55d40266d1a0 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.905+0000 7f9df09f1740 10 client.5432 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.905+0000 7f9df09f1740 1 -- 172.21.15.69:0/2123441890 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55d40258e5a0 con 0x55d40266d1a0 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.905+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2123441890 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d40228f7e0 con 0x55d40266d1a0 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.906+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2123441890 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9de0012070 con 0x55d40266d1a0 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.906+0000 7f9df09f1740 10 client.5432 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.906+0000 7f9df09f1740 10 client.5432 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.d 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.906+0000 7f9df09f1740 20 client.5432 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.906+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d4026b15e0 0x55d4026b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.906+0000 7f9df09f1740 4 client.5432 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.906+0000 7f9df09f1740 1 -- 172.21.15.69:0/2123441890 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4022cc720 con 0x55d4026b15e0 2024-02-21T07:43:41.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.906+0000 7f9de6000640 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d4026b15e0 0x55d4026b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.907+0000 7f9de6000640 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d4026b15e0 0x55d4026b4260 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ac111ad17dadb2bf server_cookie=1749ec978f7043d5 in_seq=0 out_seq=0 2024-02-21T07:43:41.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.907+0000 7f9dc7e00640 10 client.5432 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:43:41.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.907+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2123441890 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d4022cc720 con 0x55d4026b15e0 2024-02-21T07:43:41.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.907+0000 7f9dc7e00640 10 client.5432 handle_command_reply: tid=0 2024-02-21T07:43:41.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 client.5432 shutdown 2024-02-21T07:43:41.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 -- 172.21.15.69:0/2123441890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 msgr2=0x55d4026606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 0x55d4026606d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9de0000f80 tx=0x7f9de000c000 comp rx=0 tx=0).stop 2024-02-21T07:43:41.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 -- 172.21.15.69:0/2123441890 shutdown_connections 2024-02-21T07:43:41.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d4026b15e0 0x55d4026b4260 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 0x55d40265e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 0x55d402657350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2123441890 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 0x55d4026606d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 -- 172.21.15.69:0/2123441890 >> 172.21.15.69:0/2123441890 conn(0x55d40266c880 msgr2=0x55d4026308c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9dc7e00640 0 client.5432 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:43:41.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 -- 172.21.15.69:0/2123441890 shutdown_connections 2024-02-21T07:43:41.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 1 -- 172.21.15.69:0/2123441890 wait complete. 2024-02-21T07:43:41.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.908+0000 7f9df09f1740 20 client.5432 trim_cache size 0 max 16384 2024-02-21T07:43:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.933+0000 7f9df09f1740 1 Processor -- start 2024-02-21T07:43:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.933+0000 7f9df09f1740 1 -- start start 2024-02-21T07:43:41.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.934+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40265dc90 0x55d402621e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.934+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266d1a0 0x55d4026613b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d4026a7f50 0x55d4026618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9df09f1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d402622370 con 0x55d40265dc90 2024-02-21T07:43:41.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9df09f1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d402657160 con 0x55d40266d1a0 2024-02-21T07:43:41.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9df09f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40262e060 con 0x55d4026a7f50 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9de7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40265dc90 0x55d402621e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9de7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40265dc90 0x55d402621e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48706/0 (socket says 172.21.15.69:48706) 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9de7400640 1 -- 172.21.15.69:0/1980513310 learned_addr learned my addr 172.21.15.69:0/1980513310 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9de6000640 1 --2- 172.21.15.69:0/1980513310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266d1a0 0x55d4026613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9de7400640 1 --2- 172.21.15.69:0/1980513310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d4026a7f50 0x55d4026618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9de6000640 1 -- 172.21.15.69:0/1980513310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d4026a7f50 msgr2=0x55d4026618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9de6000640 1 --2- 172.21.15.69:0/1980513310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d4026a7f50 0x55d4026618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9de6000640 1 -- 172.21.15.69:0/1980513310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40265dc90 msgr2=0x55d402621e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9de6000640 1 --2- 172.21.15.69:0/1980513310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40265dc90 0x55d402621e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.935+0000 7f9de6000640 1 -- 172.21.15.69:0/1980513310 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d40252aab0 con 0x55d40266d1a0 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.936+0000 7f9de6000640 1 --2- 172.21.15.69:0/1980513310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266d1a0 0x55d4026613b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55d402660e60 tx=0x7f9dd4008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55aacadb292e12c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.936+0000 7f9dd2a00640 1 -- 172.21.15.69:0/1980513310 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4016430 con 0x55d40266d1a0 2024-02-21T07:43:41.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.936+0000 7f9dd2a00640 1 -- 172.21.15.69:0/1980513310 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd4021070 con 0x55d40266d1a0 2024-02-21T07:43:41.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.936+0000 7f9dd2a00640 1 -- 172.21.15.69:0/1980513310 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4016790 con 0x55d40266d1a0 2024-02-21T07:43:41.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.937+0000 7f9df09f1740 1 -- 172.21.15.69:0/1980513310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266d1a0 msgr2=0x55d4026613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.937+0000 7f9df09f1740 1 --2- 172.21.15.69:0/1980513310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266d1a0 0x55d4026613b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55d402660e60 tx=0x7f9dd4008040 comp rx=0 tx=0).stop 2024-02-21T07:43:41.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.937+0000 7f9df09f1740 1 -- 172.21.15.69:0/1980513310 shutdown_connections 2024-02-21T07:43:41.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.937+0000 7f9df09f1740 1 --2- 172.21.15.69:0/1980513310 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d4026a7f50 0x55d4026618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.937+0000 7f9df09f1740 1 --2- 172.21.15.69:0/1980513310 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40266d1a0 0x55d4026613b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.937+0000 7f9df09f1740 1 --2- 172.21.15.69:0/1980513310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d40265dc90 0x55d402621e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.937+0000 7f9df09f1740 1 -- 172.21.15.69:0/1980513310 >> 172.21.15.69:0/1980513310 conn(0x55d40266c880 msgr2=0x55d4026663d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.937+0000 7f9df09f1740 1 -- 172.21.15.69:0/1980513310 shutdown_connections 2024-02-21T07:43:41.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.937+0000 7f9df09f1740 1 -- 172.21.15.69:0/1980513310 wait complete. 2024-02-21T07:43:41.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.938+0000 7f9df09f1740 1 -- start start 2024-02-21T07:43:41.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.939+0000 7f9df09f1740 1 Processor -- start 2024-02-21T07:43:41.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 0x55d4026355e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 0x55d40262d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9df09f1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 0x55d402670070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9df09f1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40270fc30 con 0x55d4026a7f50 2024-02-21T07:43:41.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9df09f1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d402635b20 con 0x55d40265dc90 2024-02-21T07:43:41.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9df09f1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d40261e6a0 con 0x55d40266d1a0 2024-02-21T07:43:41.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9df09f1740 10 client.0 _ll_register_callbacks cb 0x7f9de0004ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:41.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9de7400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 0x55d4026355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9de7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 0x55d402670070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9de7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 0x55d402670070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48720/0 (socket says 172.21.15.69:48720) 2024-02-21T07:43:41.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9de7400640 1 -- 172.21.15.69:0/2937735683 learned_addr learned my addr 172.21.15.69:0/2937735683 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:41.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.941+0000 7f9de6000640 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 0x55d40262d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.942+0000 7f9de7400640 1 -- 172.21.15.69:0/2937735683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 msgr2=0x55d40262d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.942+0000 7f9de7400640 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 0x55d40262d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.942+0000 7f9de7400640 1 -- 172.21.15.69:0/2937735683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 msgr2=0x55d402670070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:41.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.942+0000 7f9de7400640 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 0x55d402670070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.942+0000 7f9de7400640 1 -- 172.21.15.69:0/2937735683 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd400e360 con 0x55d40265dc90 2024-02-21T07:43:41.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.942+0000 7f9de7400640 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 0x55d4026355e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9de0020640 tx=0x7f9de0006000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f08a4cbb4d41e992 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:41.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.943+0000 7f9dc7e00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:41.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.943+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2937735683 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de001d8c0 con 0x55d40265dc90 2024-02-21T07:43:41.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.943+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2937735683 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9de001da20 con 0x55d40265dc90 2024-02-21T07:43:41.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.943+0000 7f9df09f1740 1 -- 172.21.15.69:0/2937735683 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9de0007850 con 0x55d40265dc90 2024-02-21T07:43:41.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.943+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2937735683 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9de001dbe0 con 0x55d40265dc90 2024-02-21T07:43:41.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.943+0000 7f9df09f1740 10 client.5467 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:41.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.943+0000 7f9df09f1740 1 -- 172.21.15.69:0/2937735683 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55d402550650 con 0x55d40265dc90 2024-02-21T07:43:41.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.943+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2937735683 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de0041080 con 0x55d40265dc90 2024-02-21T07:43:41.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.944+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2937735683 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9de0035020 con 0x55d40265dc90 2024-02-21T07:43:41.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.944+0000 7f9df09f1740 10 client.5467 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:41.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.944+0000 7f9df09f1740 10 client.5467 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.d 2024-02-21T07:43:41.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.944+0000 7f9df09f1740 20 client.5467 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:41.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.944+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d40262d600 0x55d4026ff5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:41.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.944+0000 7f9df09f1740 4 client.5467 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:43:41.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.944+0000 7f9df09f1740 1 -- 172.21.15.69:0/2937735683 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d40231b890 con 0x55d40262d600 2024-02-21T07:43:41.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.944+0000 7f9de6000640 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d40262d600 0x55d4026ff5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:41.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9de6000640 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d40262d600 0x55d4026ff5c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2c87757e3048a4c server_cookie=212b1e8fa71ae94d in_seq=0 out_seq=0 2024-02-21T07:43:41.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9dc7e00640 10 client.5467 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:43:41.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9dc7e00640 1 -- 172.21.15.69:0/2937735683 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d40231b890 con 0x55d40262d600 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9dc7e00640 10 client.5467 handle_command_reply: tid=0 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9df09f1740 1 client.5467 shutdown 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9df09f1740 1 -- 172.21.15.69:0/2937735683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 msgr2=0x55d4026355e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 0x55d4026355e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9de0020640 tx=0x7f9de0006000 comp rx=0 tx=0).stop 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9df09f1740 1 -- 172.21.15.69:0/2937735683 shutdown_connections 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d40262d600 0x55d4026ff5c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d4026a7f50 0x55d402670070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d40266d1a0 0x55d40262d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9dc7e00640 0 client.5467 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9df09f1740 1 --2- 172.21.15.69:0/2937735683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d40265dc90 0x55d4026355e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.945+0000 7f9df09f1740 1 -- 172.21.15.69:0/2937735683 >> 172.21.15.69:0/2937735683 conn(0x55d40266c880 msgr2=0x55d4026572d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.946+0000 7f9df09f1740 1 -- 172.21.15.69:0/2937735683 shutdown_connections 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.946+0000 7f9df09f1740 1 -- 172.21.15.69:0/2937735683 wait complete. 2024-02-21T07:43:41.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.946+0000 7f9df09f1740 20 client.5467 trim_cache size 0 max 16384 2024-02-21T07:43:41.954 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 -- 172.21.15.69:0/1194210113 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9dc809f130 msgr2=0x7f9dc80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9dc809f130 0x7f9dc80a15f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9dd802b910 tx=0x7f9dd80ef920 comp rx=0 tx=0).stop 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 -- 172.21.15.69:0/1194210113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9de80fe6a0 msgr2=0x7f9de8153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9de80fe6a0 0x7f9de8153aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009890 tx=0x7f9dd80046c0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 -- 172.21.15.69:0/1194210113 shutdown_connections 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f9dc809f130 0x7f9dc80a15f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f9de818b1d0 0x7f9de80d1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9de817f2a0 0x7f9de821f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 --2- 172.21.15.69:0/1194210113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9de80fe6a0 0x7f9de8153aa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 -- 172.21.15.69:0/1194210113 >> 172.21.15.69:0/1194210113 conn(0x7f9de80d2b00 msgr2=0x7f9de817aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:41.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 -- 172.21.15.69:0/1194210113 shutdown_connections 2024-02-21T07:43:41.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:41.947+0000 7f9de7e00640 1 -- 172.21.15.69:0/1194210113 wait complete. 2024-02-21T07:43:41.970 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:43:41.971 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:43:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.136+0000 7f95dbe00640 1 Processor -- start 2024-02-21T07:43:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.136+0000 7f95dbe00640 1 -- start start 2024-02-21T07:43:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.137+0000 7f95dbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f95dc17f2a0 0x7f95dc0fe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.137+0000 7f95dbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f95dc18b3a0 0x7f95dc0ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.137+0000 7f95dbe00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95dc18a800 con 0x7f95dc0fe6a0 2024-02-21T07:43:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.137+0000 7f95dbe00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95dc0ff160 con 0x7f95dc17f2a0 2024-02-21T07:43:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.137+0000 7f95dbe00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95dc0fde70 con 0x7f95dc18b3a0 2024-02-21T07:43:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.138+0000 7f95da000640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f95dc0fe6a0 0x7f95dc18ac90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40566/0 (socket says 172.21.15.69:40566) 2024-02-21T07:43:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.138+0000 7f95db400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f95dc18b3a0 0x7f95dc0ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.138+0000 7f95da000640 1 -- 172.21.15.69:0/3605817364 learned_addr learned my addr 172.21.15.69:0/3605817364 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.138+0000 7f95daa00640 1 --2- 172.21.15.69:0/3605817364 >> v2:172.21.15.69:3300/0 conn(0x7f95dc17f2a0 0x7f95dc0fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.138+0000 7f95db400640 1 -- 172.21.15.69:0/3605817364 >> v2:172.21.15.69:3300/0 conn(0x7f95dc17f2a0 msgr2=0x7f95dc0fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.138+0000 7f95db400640 1 --2- 172.21.15.69:0/3605817364 >> v2:172.21.15.69:3300/0 conn(0x7f95dc17f2a0 0x7f95dc0fe160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.138+0000 7f95db400640 1 -- 172.21.15.69:0/3605817364 >> v1:172.21.15.69:6789/0 conn(0x7f95dc0fe6a0 legacy=0x7f95dc18ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.138+0000 7f95db400640 1 -- 172.21.15.69:0/3605817364 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95dc189f10 con 0x7f95dc18b3a0 2024-02-21T07:43:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.140+0000 7f95db400640 1 --2- 172.21.15.69:0/3605817364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95dc18b3a0 0x7f95dc0ce9c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0d06a0 tx=0x7f95d402bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed6fb2b8cac21a2a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.140+0000 7f95d9600640 1 -- 172.21.15.69:0/3605817364 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d402cc70 con 0x7f95dc18b3a0 2024-02-21T07:43:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.140+0000 7f95d9600640 1 -- 172.21.15.69:0/3605817364 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d402cdd0 con 0x7f95dc18b3a0 2024-02-21T07:43:42.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.140+0000 7f95d9600640 1 -- 172.21.15.69:0/3605817364 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4034660 con 0x7f95dc18b3a0 2024-02-21T07:43:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.140+0000 7f95dbe00640 1 -- 172.21.15.69:0/3605817364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95dc18b3a0 msgr2=0x7f95dc0ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.140+0000 7f95dbe00640 1 --2- 172.21.15.69:0/3605817364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95dc18b3a0 0x7f95dc0ce9c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f95dc0d06a0 tx=0x7f95d402bec0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.141+0000 7f95dbe00640 1 -- 172.21.15.69:0/3605817364 shutdown_connections 2024-02-21T07:43:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.141+0000 7f95dbe00640 1 --2- 172.21.15.69:0/3605817364 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95dc18b3a0 0x7f95dc0ce9c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.141+0000 7f95dbe00640 1 --2- 172.21.15.69:0/3605817364 >> v2:172.21.15.69:3300/0 conn(0x7f95dc17f2a0 0x7f95dc0fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.141+0000 7f95dbe00640 1 -- 172.21.15.69:0/3605817364 >> 172.21.15.69:0/3605817364 conn(0x7f95dc0d2b00 msgr2=0x7f95dc0d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.141+0000 7f95dbe00640 1 -- 172.21.15.69:0/3605817364 shutdown_connections 2024-02-21T07:43:42.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.141+0000 7f95dbe00640 1 -- 172.21.15.69:0/3605817364 wait complete. 2024-02-21T07:43:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.143+0000 7f95dbe00640 1 Processor -- start 2024-02-21T07:43:42.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.143+0000 7f95dbe00640 1 -- start start 2024-02-21T07:43:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95dbe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc0fe6a0 0x7f95dc179d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95dbe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95dc17f2a0 0x7f95dc21fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95dbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95dc18b3a0 0x7f95dc0d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95dbe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc220230 con 0x7f95dc18b3a0 2024-02-21T07:43:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95dbe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0d2710 con 0x7f95dc17f2a0 2024-02-21T07:43:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95dbe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95dc0d1b90 con 0x7f95dc0fe6a0 2024-02-21T07:43:42.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95db400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95dc18b3a0 0x7f95dc0d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95db400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95dc18b3a0 0x7f95dc0d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48738/0 (socket says 172.21.15.69:48738) 2024-02-21T07:43:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95db400640 1 -- 172.21.15.69:0/1696526817 learned_addr learned my addr 172.21.15.69:0/1696526817 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95daa00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc0fe6a0 0x7f95dc179d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.144+0000 7f95da000640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95dc17f2a0 0x7f95dc21fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.145+0000 7f95daa00640 1 -- 172.21.15.69:0/1696526817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95dc17f2a0 msgr2=0x7f95dc21fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.145+0000 7f95daa00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95dc17f2a0 0x7f95dc21fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.145+0000 7f95daa00640 1 -- 172.21.15.69:0/1696526817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95dc18b3a0 msgr2=0x7f95dc0d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.145+0000 7f95daa00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95dc18b3a0 0x7f95dc0d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.145+0000 7f95daa00640 1 -- 172.21.15.69:0/1696526817 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d4009a70 con 0x7f95dc0fe6a0 2024-02-21T07:43:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.145+0000 7f95daa00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc0fe6a0 0x7f95dc179d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00d5f0 tx=0x7f95cc00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.145+0000 7f95d2a00640 1 -- 172.21.15.69:0/1696526817 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0125f0 con 0x7f95dc0fe6a0 2024-02-21T07:43:42.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.146+0000 7f95d2a00640 1 -- 172.21.15.69:0/1696526817 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc012750 con 0x7f95dc0fe6a0 2024-02-21T07:43:42.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.146+0000 7f95d2a00640 1 -- 172.21.15.69:0/1696526817 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc012b00 con 0x7f95dc0fe6a0 2024-02-21T07:43:42.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.146+0000 7f95dbe00640 1 -- 172.21.15.69:0/1696526817 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95dc0d1e70 con 0x7f95dc0fe6a0 2024-02-21T07:43:42.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.146+0000 7f95dbe00640 1 -- 172.21.15.69:0/1696526817 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95dc0d2430 con 0x7f95dc0fe6a0 2024-02-21T07:43:42.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.149+0000 7f95d2a00640 1 -- 172.21.15.69:0/1696526817 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f95cc012c60 con 0x7f95dc0fe6a0 2024-02-21T07:43:42.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.150+0000 7f95e436b740 1 Processor -- start 2024-02-21T07:43:42.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.151+0000 7f95e436b740 1 -- start start 2024-02-21T07:43:42.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.151+0000 7f95d2a00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f95bc09f130 0x7f95bc0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.151+0000 7f95d2a00640 1 -- 172.21.15.69:0/1696526817 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f95cc0ca130 con 0x7f95dc0fe6a0 2024-02-21T07:43:42.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.152+0000 7f95db400640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f95bc09f130 0x7f95bc0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95db400640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f95bc09f130 0x7f95bc0a15f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f95dc17eba0 tx=0x7f95d4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95e436b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413afc070 0x565413afc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95e436b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413b37200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95e436b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b384d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95e436b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x565413a2f210 con 0x565413afc990 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95e436b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x565413a2c740 con 0x565413b37740 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95e436b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x565413a27f20 con 0x565413afc070 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95da000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413b37200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95da000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413b37200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48752/0 (socket says 172.21.15.69:48752) 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95da000640 1 -- 172.21.15.69:0/3719819799 learned_addr learned my addr 172.21.15.69:0/3719819799 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95db400640 1 --2- 172.21.15.69:0/3719819799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b384d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95daa00640 1 --2- 172.21.15.69:0/3719819799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413afc070 0x565413afc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95da000640 1 -- 172.21.15.69:0/3719819799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413afc070 msgr2=0x565413afc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.153+0000 7f95da000640 1 --2- 172.21.15.69:0/3719819799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413afc070 0x565413afc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.154+0000 7f95da000640 1 -- 172.21.15.69:0/3719819799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 msgr2=0x565413b384d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.154+0000 7f95da000640 1 --2- 172.21.15.69:0/3719819799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b384d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.154+0000 7f95da000640 1 -- 172.21.15.69:0/3719819799 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654139e9df0 con 0x565413afc990 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.154+0000 7f95da000640 1 --2- 172.21.15.69:0/3719819799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413b37200 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95c8004d10 tx=0x7f95c8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397247fd15e0045b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.154+0000 7f95c7000640 1 -- 172.21.15.69:0/3719819799 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8004990 con 0x565413afc990 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.154+0000 7f95c7000640 1 -- 172.21.15.69:0/3719819799 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c8007770 con 0x565413afc990 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.154+0000 7f95c7000640 1 -- 172.21.15.69:0/3719819799 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c80019e0 con 0x565413afc990 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.155+0000 7f95e436b740 1 -- 172.21.15.69:0/3719819799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 msgr2=0x565413b37200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.155+0000 7f95e436b740 1 --2- 172.21.15.69:0/3719819799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413b37200 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95c8004d10 tx=0x7f95c8007430 comp rx=0 tx=0).stop 2024-02-21T07:43:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.155+0000 7f95e436b740 1 -- 172.21.15.69:0/3719819799 shutdown_connections 2024-02-21T07:43:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.155+0000 7f95e436b740 1 --2- 172.21.15.69:0/3719819799 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b384d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.155+0000 7f95e436b740 1 --2- 172.21.15.69:0/3719819799 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413b37200 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.155+0000 7f95e436b740 1 --2- 172.21.15.69:0/3719819799 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413afc070 0x565413afc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.155+0000 7f95e436b740 1 -- 172.21.15.69:0/3719819799 >> 172.21.15.69:0/3719819799 conn(0x565413abe640 msgr2=0x565413abf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.155+0000 7f95e436b740 1 -- 172.21.15.69:0/3719819799 shutdown_connections 2024-02-21T07:43:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.155+0000 7f95e436b740 1 -- 172.21.15.69:0/3719819799 wait complete. 2024-02-21T07:43:42.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.156+0000 7f95e436b740 1 -- start start 2024-02-21T07:43:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.156+0000 7f95e436b740 1 Processor -- start 2024-02-21T07:43:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.157+0000 7f95e436b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413af2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95e436b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95e436b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413abd260 0x565413af3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95e436b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654139cd150 con 0x565413afc990 2024-02-21T07:43:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95e436b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654139ccdf0 con 0x565413b37740 2024-02-21T07:43:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95e436b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654137961c0 con 0x565413abd260 2024-02-21T07:43:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95e436b740 10 client.0 _ll_register_callbacks cb 0x565413a1c2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95daa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413af2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95daa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413af2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48754/0 (socket says 172.21.15.69:48754) 2024-02-21T07:43:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95daa00640 1 -- 172.21.15.69:0/3144007925 learned_addr learned my addr 172.21.15.69:0/3144007925 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95db400640 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413abd260 0x565413af3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95da000640 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95daa00640 1 -- 172.21.15.69:0/3144007925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413abd260 msgr2=0x565413af3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95daa00640 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413abd260 0x565413af3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95daa00640 1 -- 172.21.15.69:0/3144007925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 msgr2=0x565413b408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95daa00640 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.158+0000 7f95daa00640 1 -- 172.21.15.69:0/3144007925 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95dc18a800 con 0x565413afc990 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.159+0000 7f95daa00640 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413af2110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00dfb0 tx=0x7f95cc0c7e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f5c0a704a1ddb9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.159+0000 7f95bb400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.159+0000 7f95bb400640 1 -- 172.21.15.69:0/3144007925 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc097210 con 0x565413afc990 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.159+0000 7f95bb400640 1 -- 172.21.15.69:0/3144007925 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f95cc09bd10 con 0x565413afc990 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.159+0000 7f95e436b740 1 -- 172.21.15.69:0/3144007925 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565413764720 con 0x565413afc990 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.159+0000 7f95bb400640 1 -- 172.21.15.69:0/3144007925 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95cc097370 con 0x565413afc990 2024-02-21T07:43:42.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.159+0000 7f95e436b740 10 client.5298 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.159+0000 7f95e436b740 1 -- 172.21.15.69:0/3144007925 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x565413a265a0 con 0x565413afc990 2024-02-21T07:43:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.159+0000 7f95bb400640 1 -- 172.21.15.69:0/3144007925 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565413764720 con 0x565413afc990 2024-02-21T07:43:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.160+0000 7f95bb400640 1 -- 172.21.15.69:0/3144007925 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f95cc093880 con 0x565413afc990 2024-02-21T07:43:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.160+0000 7f95e436b740 10 client.5298 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.160+0000 7f95e436b740 10 client.5298 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.g 2024-02-21T07:43:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.160+0000 7f95e436b740 20 client.5298 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.160+0000 7f95e436b740 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x565413b415e0 0x565413ae6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.160+0000 7f95e436b740 4 client.5298 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:42.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.160+0000 7f95e436b740 1 -- 172.21.15.69:0/3144007925 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654137b3890 con 0x565413b415e0 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.160+0000 7f95da000640 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x565413b415e0 0x565413ae6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.161+0000 7f95da000640 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x565413b415e0 0x565413ae6510 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=76e97aab5944fa4b server_cookie=ff3d3e6c9ea9aa75 in_seq=0 out_seq=0 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.161+0000 7f95bb400640 10 client.5298 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.162+0000 7f95bb400640 1 -- 172.21.15.69:0/3144007925 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5654137b3890 con 0x565413b415e0 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.162+0000 7f95bb400640 10 client.5298 handle_command_reply: tid=0 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.162+0000 7f95e436b740 1 client.5298 shutdown 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 1 -- 172.21.15.69:0/3144007925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 msgr2=0x565413af2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413af2110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00dfb0 tx=0x7f95cc0c7e00 comp rx=0 tx=0).stop 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 1 -- 172.21.15.69:0/3144007925 shutdown_connections 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x565413b415e0 0x565413ae6510 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413abd260 0x565413af3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95bb400640 0 client.5298 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:43:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 1 --2- 172.21.15.69:0/3144007925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413afc990 0x565413af2110 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 1 -- 172.21.15.69:0/3144007925 >> 172.21.15.69:0/3144007925 conn(0x565413afc070 msgr2=0x565413ac00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 1 -- 172.21.15.69:0/3144007925 shutdown_connections 2024-02-21T07:43:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 1 -- 172.21.15.69:0/3144007925 wait complete. 2024-02-21T07:43:42.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.163+0000 7f95e436b740 20 client.5298 trim_cache size 0 max 16384 2024-02-21T07:43:42.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.176+0000 7f95e436b740 1 Processor -- start 2024-02-21T07:43:42.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.176+0000 7f95e436b740 1 -- start start 2024-02-21T07:43:42.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95e436b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413abc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95e436b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413afc990 0x565413b8f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95e436b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b8fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95e436b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x565413abd100 con 0x565413abd260 2024-02-21T07:43:42.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95e436b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x565413af1600 con 0x565413b37740 2024-02-21T07:43:42.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95e436b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x565413afbaf0 con 0x565413afc990 2024-02-21T07:43:42.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95daa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413abc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95daa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413abc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48756/0 (socket says 172.21.15.69:48756) 2024-02-21T07:43:42.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95daa00640 1 -- 172.21.15.69:0/1759396909 learned_addr learned my addr 172.21.15.69:0/1759396909 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95db400640 1 --2- 172.21.15.69:0/1759396909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b8fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.177+0000 7f95da000640 1 --2- 172.21.15.69:0/1759396909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413afc990 0x565413b8f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.178+0000 7f95daa00640 1 -- 172.21.15.69:0/1759396909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413afc990 msgr2=0x565413b8f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.178+0000 7f95daa00640 1 --2- 172.21.15.69:0/1759396909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413afc990 0x565413b8f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.178+0000 7f95daa00640 1 -- 172.21.15.69:0/1759396909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 msgr2=0x565413b8fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.178+0000 7f95daa00640 1 --2- 172.21.15.69:0/1759396909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b8fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.178+0000 7f95daa00640 1 -- 172.21.15.69:0/1759396909 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654139c2ab0 con 0x565413abd260 2024-02-21T07:43:42.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.178+0000 7f95daa00640 1 --2- 172.21.15.69:0/1759396909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413abc5d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc099000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a0d69db05303f9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.178+0000 7f95c6600640 1 -- 172.21.15.69:0/1759396909 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc012f10 con 0x565413abd260 2024-02-21T07:43:42.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.178+0000 7f95c6600640 1 -- 172.21.15.69:0/1759396909 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95cc0c5030 con 0x565413abd260 2024-02-21T07:43:42.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.178+0000 7f95c6600640 1 -- 172.21.15.69:0/1759396909 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc097230 con 0x565413abd260 2024-02-21T07:43:42.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.179+0000 7f95e436b740 1 -- 172.21.15.69:0/1759396909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 msgr2=0x565413abc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.179+0000 7f95e436b740 1 --2- 172.21.15.69:0/1759396909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413abc5d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc099000 comp rx=0 tx=0).stop 2024-02-21T07:43:42.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.179+0000 7f95e436b740 1 -- 172.21.15.69:0/1759396909 shutdown_connections 2024-02-21T07:43:42.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.179+0000 7f95e436b740 1 --2- 172.21.15.69:0/1759396909 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413b37740 0x565413b8fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.179+0000 7f95e436b740 1 --2- 172.21.15.69:0/1759396909 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413afc990 0x565413b8f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.179+0000 7f95e436b740 1 --2- 172.21.15.69:0/1759396909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413abc5d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.179+0000 7f95e436b740 1 -- 172.21.15.69:0/1759396909 >> 172.21.15.69:0/1759396909 conn(0x565413afc070 msgr2=0x565413ac00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.179+0000 7f95e436b740 1 -- 172.21.15.69:0/1759396909 shutdown_connections 2024-02-21T07:43:42.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.179+0000 7f95e436b740 1 -- 172.21.15.69:0/1759396909 wait complete. 2024-02-21T07:43:42.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.180+0000 7f95e436b740 1 -- start start 2024-02-21T07:43:42.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.180+0000 7f95e436b740 1 Processor -- start 2024-02-21T07:43:42.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.181+0000 7f95e436b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413b2f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.181+0000 7f95e436b740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413afc990 0x565413b33de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.181+0000 7f95e436b740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413b37740 0x565413b8bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.181+0000 7f95e436b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x565413b34320 con 0x565413abd260 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.181+0000 7f95e436b740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x565413abff00 con 0x565413afc990 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.181+0000 7f95e436b740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x565413b30000 con 0x565413b37740 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.181+0000 7f95e436b740 10 client.0 _ll_register_callbacks cb 0x7f95c80048e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.182+0000 7f95daa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413b2f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.182+0000 7f95daa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413b2f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48758/0 (socket says 172.21.15.69:48758) 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.182+0000 7f95daa00640 1 -- 172.21.15.69:0/3828275960 learned_addr learned my addr 172.21.15.69:0/3828275960 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.182+0000 7f95da000640 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413afc990 0x565413b33de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.182+0000 7f95db400640 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413b37740 0x565413b8bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.182+0000 7f95daa00640 1 -- 172.21.15.69:0/3828275960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413b37740 msgr2=0x565413b8bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.182+0000 7f95daa00640 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413b37740 0x565413b8bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.182+0000 7f95daa00640 1 -- 172.21.15.69:0/3828275960 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413afc990 msgr2=0x565413b33de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.182+0000 7f95daa00640 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413afc990 0x565413b33de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.182+0000 7f95daa00640 1 -- 172.21.15.69:0/3828275960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565413a265a0 con 0x565413abd260 2024-02-21T07:43:42.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.184+0000 7f95daa00640 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413b2f700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00d5c0 tx=0x7f95cc0c7f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484dd0e238635817 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.184+0000 7f95bb400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:42.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.184+0000 7f95bb400640 1 -- 172.21.15.69:0/3828275960 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95cc012f10 con 0x565413abd260 2024-02-21T07:43:42.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.184+0000 7f95bb400640 1 -- 172.21.15.69:0/3828275960 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f95cc09bd10 con 0x565413abd260 2024-02-21T07:43:42.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.184+0000 7f95e436b740 1 -- 172.21.15.69:0/3828275960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654137277e0 con 0x565413abd260 2024-02-21T07:43:42.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.184+0000 7f95bb400640 1 -- 172.21.15.69:0/3828275960 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95cc0a0360 con 0x565413abd260 2024-02-21T07:43:42.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.185+0000 7f95e436b740 10 client.5304 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:42.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.185+0000 7f95e436b740 1 -- 172.21.15.69:0/3828275960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5654139e8650 con 0x565413abd260 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.185+0000 7f95bb400640 1 -- 172.21.15.69:0/3828275960 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5654137277e0 con 0x565413abd260 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.185+0000 7f95bb400640 1 -- 172.21.15.69:0/3828275960 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f95cc097010 con 0x565413abd260 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.185+0000 7f95e436b740 10 client.5304 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.185+0000 7f95e436b740 10 client.5304 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.g 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.185+0000 7f95e436b740 20 client.5304 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.185+0000 7f95e436b740 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x565413aba8b0 0x565413b8c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.185+0000 7f95e436b740 4 client.5304 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.185+0000 7f95e436b740 1 -- 172.21.15.69:0/3828275960 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5654137164e0 con 0x565413aba8b0 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.186+0000 7f95da000640 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x565413aba8b0 0x565413b8c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.186+0000 7f95bb400640 10 client.5304 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:43:42.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.186+0000 7f95da000640 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x565413aba8b0 0x565413b8c0c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=420686286c8a89e2 server_cookie=95948e1b41ab8b6d in_seq=0 out_seq=0 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95bb400640 1 -- 172.21.15.69:0/3828275960 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5654137164e0 con 0x565413aba8b0 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95bb400640 10 client.5304 handle_command_reply: tid=0 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95e436b740 1 client.5304 shutdown 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95e436b740 1 -- 172.21.15.69:0/3828275960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 msgr2=0x565413b2f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95e436b740 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413b2f700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00d5c0 tx=0x7f95cc0c7f90 comp rx=0 tx=0).stop 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95e436b740 1 -- 172.21.15.69:0/3828275960 shutdown_connections 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95e436b740 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x565413aba8b0 0x565413b8c0c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95e436b740 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565413b37740 0x565413b8bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95e436b740 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565413afc990 0x565413b33de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95e436b740 1 --2- 172.21.15.69:0/3828275960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565413abd260 0x565413b2f700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95e436b740 1 -- 172.21.15.69:0/3828275960 >> 172.21.15.69:0/3828275960 conn(0x565413afc070 msgr2=0x565413abace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95bb400640 0 client.5304 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:43:42.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.187+0000 7f95e436b740 1 -- 172.21.15.69:0/3828275960 shutdown_connections 2024-02-21T07:43:42.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.188+0000 7f95e436b740 1 -- 172.21.15.69:0/3828275960 wait complete. 2024-02-21T07:43:42.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.188+0000 7f95e436b740 20 client.5304 trim_cache size 0 max 16384 2024-02-21T07:43:42.196 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:43:42.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.188+0000 7f95dbe00640 1 -- 172.21.15.69:0/1696526817 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f95bc09f130 msgr2=0x7f95bc0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.188+0000 7f95dbe00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f95bc09f130 0x7f95bc0a15f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f95dc17eba0 tx=0x7f95d4030000 comp rx=0 tx=0).stop 2024-02-21T07:43:42.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.188+0000 7f95dbe00640 1 -- 172.21.15.69:0/1696526817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc0fe6a0 msgr2=0x7f95dc179d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.188+0000 7f95dbe00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc0fe6a0 0x7f95dc179d10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00d5f0 tx=0x7f95cc00dab0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.189+0000 7f95dbe00640 1 -- 172.21.15.69:0/1696526817 shutdown_connections 2024-02-21T07:43:42.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.189+0000 7f95dbe00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f95bc09f130 0x7f95bc0a15f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.189+0000 7f95dbe00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95dc18b3a0 0x7f95dc0d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.189+0000 7f95dbe00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f95dc17f2a0 0x7f95dc21fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.189+0000 7f95dbe00640 1 --2- 172.21.15.69:0/1696526817 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f95dc0fe6a0 0x7f95dc179d10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.189+0000 7f95dbe00640 1 -- 172.21.15.69:0/1696526817 >> 172.21.15.69:0/1696526817 conn(0x7f95dc0d2b00 msgr2=0x7f95dc1778b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.189+0000 7f95dbe00640 1 -- 172.21.15.69:0/1696526817 shutdown_connections 2024-02-21T07:43:42.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.189+0000 7f95dbe00640 1 -- 172.21.15.69:0/1696526817 wait complete. 2024-02-21T07:43:42.210 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:43:42.210 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:43:42.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.374+0000 7f6f99c00640 1 Processor -- start 2024-02-21T07:43:42.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.374+0000 7f6f99c00640 1 -- start start 2024-02-21T07:43:42.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.375+0000 7f6f99c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6f94187c60 0x7f6f94188090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.376+0000 7f6f99c00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f941885d0 con 0x7f6f94186160 2024-02-21T07:43:42.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.376+0000 7f6f99c00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f940f7c40 con 0x7f6f9408dd90 2024-02-21T07:43:42.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.376+0000 7f6f99c00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f940f87c0 con 0x7f6f94187c60 2024-02-21T07:43:42.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.376+0000 7f6f93400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f6f9408dd90 0x7f6f940f6850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:45644/0 (socket says 172.21.15.69:45644) 2024-02-21T07:43:42.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.376+0000 7f6f93400640 1 -- 172.21.15.69:0/3030392327 learned_addr learned my addr 172.21.15.69:0/3030392327 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:42.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.376+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468148618 0 0) 0x7f6f940f7c40 con 0x7f6f9408dd90 2024-02-21T07:43:42.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.376+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f78003520 con 0x7f6f9408dd90 2024-02-21T07:43:42.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.376+0000 7f6f99200640 1 --2- 172.21.15.69:0/3030392327 >> v2:172.21.15.69:3300/0 conn(0x7f6f94187c60 0x7f6f94188090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3704678426 0 0) 0x7f6f78003520 con 0x7f6f9408dd90 2024-02-21T07:43:42.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 >> v2:172.21.15.69:3300/0 conn(0x7f6f94187c60 msgr2=0x7f6f94188090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 --2- 172.21.15.69:0/3030392327 >> v2:172.21.15.69:3300/0 conn(0x7f6f94187c60 0x7f6f94188090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 >> v1:172.21.15.69:6789/0 conn(0x7f6f94186160 legacy=0x7f6f9408d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940f7f20 con 0x7f6f9408dd90 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f6f80001670 con 0x7f6f9408dd90 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 >> v1:172.21.15.174:6789/0 conn(0x7f6f9408dd90 legacy=0x7f6f940f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78003a10 0x7f6f78003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f780047c0 0x7f6f78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f78005380 0x7f6f7800b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940f87c0 con 0x7f6f780047c0 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7800c280 con 0x7f6f78003a10 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7800c440 con 0x7f6f78005380 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f93400640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f780047c0 0x7f6f78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.377+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78003a10 0x7f6f78003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.378+0000 7f6f99200640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f78005380 0x7f6f7800b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.378+0000 7f6f93e00640 1 -- 172.21.15.69:0/3030392327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f78005380 msgr2=0x7f6f7800b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.378+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f78005380 0x7f6f7800b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.378+0000 7f6f93e00640 1 -- 172.21.15.69:0/3030392327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f780047c0 msgr2=0x7f6f78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.378+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f780047c0 0x7f6f78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.378+0000 7f6f93e00640 1 -- 172.21.15.69:0/3030392327 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78003520 con 0x7f6f78003a10 2024-02-21T07:43:42.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.378+0000 7f6f99200640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f78005380 0x7f6f7800b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:42.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.378+0000 7f6f99200640 1 -- 172.21.15.69:0/3030392327 reap_dead start 2024-02-21T07:43:42.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.380+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78003a10 0x7f6f78003e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6f84003db0 tx=0x7f6f780057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68028fb9604b2b0e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.380+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84032600 con 0x7f6f78003a10 2024-02-21T07:43:42.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.380+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8402e050 con 0x7f6f78003a10 2024-02-21T07:43:42.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.380+0000 7f6f92a00640 1 -- 172.21.15.69:0/3030392327 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f840329e0 con 0x7f6f78003a10 2024-02-21T07:43:42.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.380+0000 7f6f99c00640 1 -- 172.21.15.69:0/3030392327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78003a10 msgr2=0x7f6f78003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.380+0000 7f6f99c00640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78003a10 0x7f6f78003e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6f84003db0 tx=0x7f6f780057f0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.381+0000 7f6f99c00640 1 -- 172.21.15.69:0/3030392327 shutdown_connections 2024-02-21T07:43:42.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.381+0000 7f6f99c00640 1 --2- 172.21.15.69:0/3030392327 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f78003a10 0x7f6f78003e10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.381+0000 7f6f99c00640 1 -- 172.21.15.69:0/3030392327 >> 172.21.15.69:0/3030392327 conn(0x7f6f940d03a0 msgr2=0x7f6f940d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.381+0000 7f6f99c00640 1 -- 172.21.15.69:0/3030392327 shutdown_connections 2024-02-21T07:43:42.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.381+0000 7f6f99c00640 1 -- 172.21.15.69:0/3030392327 wait complete. 2024-02-21T07:43:42.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.383+0000 7f6f99c00640 1 Processor -- start 2024-02-21T07:43:42.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.383+0000 7f6f99c00640 1 -- start start 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.384+0000 7f6f99c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f78003a10 0x7f6f94176340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.384+0000 7f6f99c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f94177fc0 0x7f6f94172130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.384+0000 7f6f99c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f9421fac0 0x7f6f9421ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.384+0000 7f6f99c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94177b30 con 0x7f6f78003a10 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.384+0000 7f6f99c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94176c40 con 0x7f6f94177fc0 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.384+0000 7f6f99c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94176f20 con 0x7f6f9421fac0 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.384+0000 7f6f93400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f94177fc0 0x7f6f94172130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.384+0000 7f6f93400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f94177fc0 0x7f6f94172130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38828/0 (socket says 172.21.15.69:38828) 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.385+0000 7f6f93400640 1 -- 172.21.15.69:0/3334886691 learned_addr learned my addr 172.21.15.69:0/3334886691 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.385+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f78003a10 0x7f6f94176340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.385+0000 7f6f99200640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f9421fac0 0x7f6f9421ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.385+0000 7f6f93400640 1 -- 172.21.15.69:0/3334886691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f9421fac0 msgr2=0x7f6f9421ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.385+0000 7f6f93400640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f9421fac0 0x7f6f9421ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.385+0000 7f6f93400640 1 -- 172.21.15.69:0/3334886691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f78003a10 msgr2=0x7f6f94176340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.385+0000 7f6f93400640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f78003a10 0x7f6f94176340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.385+0000 7f6f93400640 1 -- 172.21.15.69:0/3334886691 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94177200 con 0x7f6f94177fc0 2024-02-21T07:43:42.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.385+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f78003a10 0x7f6f94176340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:42.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.385+0000 7f6f93400640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f94177fc0 0x7f6f94172130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6f800017a0 tx=0x7f6f80007430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.386+0000 7f6f8be00640 1 -- 172.21.15.69:0/3334886691 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000f730 con 0x7f6f94177fc0 2024-02-21T07:43:42.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.386+0000 7f6f8be00640 1 -- 172.21.15.69:0/3334886691 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8000f8b0 con 0x7f6f94177fc0 2024-02-21T07:43:42.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.386+0000 7f6f8be00640 1 -- 172.21.15.69:0/3334886691 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8000fc60 con 0x7f6f94177fc0 2024-02-21T07:43:42.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.386+0000 7f6f99c00640 1 -- 172.21.15.69:0/3334886691 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f941774e0 con 0x7f6f94177fc0 2024-02-21T07:43:42.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.386+0000 7f6f99c00640 1 -- 172.21.15.69:0/3334886691 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f94176880 con 0x7f6f94177fc0 2024-02-21T07:43:42.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.390+0000 7f6f9de20740 1 Processor -- start 2024-02-21T07:43:42.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.390+0000 7f6f9de20740 1 -- start start 2024-02-21T07:43:42.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.391+0000 7f6f8be00640 1 -- 172.21.15.69:0/3334886691 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f6f8001d460 con 0x7f6f94177fc0 2024-02-21T07:43:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.391+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909070 0x55af4d909450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.391+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d909990 0x55af4d944200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.391+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d944740 0x55af4d9454d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.391+0000 7f6f9de20740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d83c210 con 0x55af4d944740 2024-02-21T07:43:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.391+0000 7f6f9de20740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d839740 con 0x55af4d909070 2024-02-21T07:43:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.391+0000 7f6f9de20740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d834f20 con 0x55af4d909990 2024-02-21T07:43:42.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.392+0000 7f6f99200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909070 0x55af4d909450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.392+0000 7f6f99200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909070 0x55af4d909450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38842/0 (socket says 172.21.15.69:38842) 2024-02-21T07:43:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.392+0000 7f6f99200640 1 -- 172.21.15.69:0/4231212192 learned_addr learned my addr 172.21.15.69:0/4231212192 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.392+0000 7f6f93e00640 1 --2- 172.21.15.69:0/4231212192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d909990 0x55af4d944200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.392+0000 7f6f99200640 1 -- 172.21.15.69:0/4231212192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d909990 msgr2=0x55af4d944200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.392+0000 7f6f99200640 1 --2- 172.21.15.69:0/4231212192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d909990 0x55af4d944200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.392+0000 7f6f99200640 1 -- 172.21.15.69:0/4231212192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d944740 msgr2=0x55af4d9454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.392+0000 7f6f99200640 1 --2- 172.21.15.69:0/4231212192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d944740 0x55af4d9454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.392+0000 7f6f99200640 1 -- 172.21.15.69:0/4231212192 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af4d7f6df0 con 0x55af4d909070 2024-02-21T07:43:42.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.392+0000 7f6f99200640 1 --2- 172.21.15.69:0/4231212192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909070 0x55af4d909450 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6f94090620 tx=0x7f6f8c009d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce3eb37cb3fbfb88 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.393+0000 7f6f8be00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f7409f130 0x7f6f740a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.393+0000 7f6f88c00640 1 -- 172.21.15.69:0/4231212192 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c016660 con 0x55af4d909070 2024-02-21T07:43:42.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.393+0000 7f6f88c00640 1 -- 172.21.15.69:0/4231212192 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c00f040 con 0x55af4d909070 2024-02-21T07:43:42.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.393+0000 7f6f88c00640 1 -- 172.21.15.69:0/4231212192 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0169c0 con 0x55af4d909070 2024-02-21T07:43:42.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.393+0000 7f6f8be00640 1 -- 172.21.15.69:0/3334886691 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6f800c9d10 con 0x7f6f94177fc0 2024-02-21T07:43:42.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.393+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f7409f130 0x7f6f740a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.394+0000 7f6f9de20740 1 -- 172.21.15.69:0/4231212192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909070 msgr2=0x55af4d909450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.394+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4231212192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909070 0x55af4d909450 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6f94090620 tx=0x7f6f8c009d80 comp rx=0 tx=0).stop 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.394+0000 7f6f9de20740 1 -- 172.21.15.69:0/4231212192 shutdown_connections 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.394+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4231212192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d944740 0x55af4d9454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.394+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4231212192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d909990 0x55af4d944200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.394+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4231212192 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909070 0x55af4d909450 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.394+0000 7f6f9de20740 1 -- 172.21.15.69:0/4231212192 >> 172.21.15.69:0/4231212192 conn(0x55af4d8cb640 msgr2=0x55af4d8cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.394+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f7409f130 0x7f6f740a15f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f84034000 tx=0x7f6f84009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.394+0000 7f6f9de20740 1 -- 172.21.15.69:0/4231212192 shutdown_connections 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.394+0000 7f6f9de20740 1 -- 172.21.15.69:0/4231212192 wait complete. 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.395+0000 7f6f9de20740 1 -- start start 2024-02-21T07:43:42.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.395+0000 7f6f9de20740 1 Processor -- start 2024-02-21T07:43:42.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.397+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909990 0x55af4d94f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.397+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d944740 0x55af4d8fb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.397+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d9053b0 0x55af4d8c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.397+0000 7f6f9de20740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d7da150 con 0x55af4d9053b0 2024-02-21T07:43:42.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.397+0000 7f6f9de20740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d7d9df0 con 0x55af4d909990 2024-02-21T07:43:42.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.397+0000 7f6f9de20740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d5a31c0 con 0x55af4d944740 2024-02-21T07:43:42.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.397+0000 7f6f9de20740 10 client.0 _ll_register_callbacks cb 0x55af4d8292b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:42.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f99200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d9053b0 0x55af4d8c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f93e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909990 0x55af4d94f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f99200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d9053b0 0x55af4d8c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48786/0 (socket says 172.21.15.69:48786) 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f99200640 1 -- 172.21.15.69:0/3364828166 learned_addr learned my addr 172.21.15.69:0/3364828166 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f99200640 1 -- 172.21.15.69:0/3364828166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d944740 msgr2=0x55af4d8fb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f93400640 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d944740 0x55af4d8fb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f99200640 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d944740 0x55af4d8fb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f99200640 1 -- 172.21.15.69:0/3364828166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909990 msgr2=0x55af4d94f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f99200640 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909990 0x55af4d94f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f99200640 1 -- 172.21.15.69:0/3364828166 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c0096b0 con 0x55af4d9053b0 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909990 0x55af4d94f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.398+0000 7f6f93400640 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d944740 0x55af4d8fb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.399+0000 7f6f99200640 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d9053b0 0x55af4d8c7f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00b000 tx=0x7f6f8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66054da83471eec server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.399+0000 7f6f7d600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.399+0000 7f6f7d600640 1 -- 172.21.15.69:0/3364828166 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c029440 con 0x55af4d9053b0 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.399+0000 7f6f9de20740 1 -- 172.21.15.69:0/3364828166 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af4d5347e0 con 0x55af4d9053b0 2024-02-21T07:43:42.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.399+0000 7f6f7d600640 1 -- 172.21.15.69:0/3364828166 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6f8c01f420 con 0x55af4d9053b0 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.399+0000 7f6f7d600640 1 -- 172.21.15.69:0/3364828166 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f8c01f5e0 con 0x55af4d9053b0 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.399+0000 7f6f9de20740 10 client.5313 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.399+0000 7f6f9de20740 1 -- 172.21.15.69:0/3364828166 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55af4d8335a0 con 0x55af4d9053b0 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.399+0000 7f6f7d600640 1 -- 172.21.15.69:0/3364828166 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55af4d5347e0 con 0x55af4d9053b0 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.400+0000 7f6f7d600640 1 -- 172.21.15.69:0/3364828166 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6f8c014040 con 0x55af4d9053b0 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.400+0000 7f6f9de20740 10 client.5313 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.400+0000 7f6f9de20740 10 client.5313 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.400+0000 7f6f9de20740 20 client.5313 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.400+0000 7f6f9de20740 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55af4d8ff4d0 0x55af4d8ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.400+0000 7f6f9de20740 4 client.5313 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.400+0000 7f6f9de20740 1 -- 172.21.15.69:0/3364828166 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af4d571720 con 0x55af4d8ff4d0 2024-02-21T07:43:42.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.400+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55af4d8ff4d0 0x55af4d8ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.402+0000 7f6f93e00640 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55af4d8ff4d0 0x55af4d8ff8e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cb600dc7f0d4b4ea server_cookie=43a2098e77bbfaaa in_seq=0 out_seq=0 2024-02-21T07:43:42.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.402+0000 7f6f7d600640 10 client.5313 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:43:42.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f7d600640 1 -- 172.21.15.69:0/3364828166 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55af4d571720 con 0x55af4d8ff4d0 2024-02-21T07:43:42.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f7d600640 10 client.5313 handle_command_reply: tid=0 2024-02-21T07:43:42.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f9de20740 1 client.5313 shutdown 2024-02-21T07:43:42.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f9de20740 1 -- 172.21.15.69:0/3364828166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d9053b0 msgr2=0x55af4d8c7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f9de20740 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d9053b0 0x55af4d8c7f20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00b000 tx=0x7f6f8c004a40 comp rx=0 tx=0).stop 2024-02-21T07:43:42.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f9de20740 1 -- 172.21.15.69:0/3364828166 shutdown_connections 2024-02-21T07:43:42.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f9de20740 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d9053b0 0x55af4d8c7f20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f9de20740 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55af4d8ff4d0 0x55af4d8ff8e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f9de20740 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d944740 0x55af4d8fb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f7d600640 0 client.5313 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:43:42.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f9de20740 1 --2- 172.21.15.69:0/3364828166 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d909990 0x55af4d94f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.403+0000 7f6f9de20740 1 -- 172.21.15.69:0/3364828166 >> 172.21.15.69:0/3364828166 conn(0x55af4d909070 msgr2=0x55af4d8cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.404+0000 7f6f9de20740 1 -- 172.21.15.69:0/3364828166 shutdown_connections 2024-02-21T07:43:42.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.404+0000 7f6f9de20740 1 -- 172.21.15.69:0/3364828166 wait complete. 2024-02-21T07:43:42.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.404+0000 7f6f9de20740 20 client.5313 trim_cache size 0 max 16384 2024-02-21T07:43:42.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.429+0000 7f6f9de20740 1 Processor -- start 2024-02-21T07:43:42.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.429+0000 7f6f9de20740 1 -- start start 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d944c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d9119f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 0x55af4d8f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f9de20740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d908ef0 con 0x55af4d909990 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f9de20740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d941d00 con 0x55af4d944740 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f9de20740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d8c36f0 con 0x55af4d9053b0 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f93400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d9119f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f93e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d944c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f93400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d9119f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48798/0 (socket says 172.21.15.69:48798) 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f93400640 1 -- 172.21.15.69:0/4273797631 learned_addr learned my addr 172.21.15.69:0/4273797631 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f99200640 1 --2- 172.21.15.69:0/4273797631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 0x55af4d8f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.431+0000 7f6f93e00640 1 -- 172.21.15.69:0/4273797631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 msgr2=0x55af4d8f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.432+0000 7f6f93e00640 1 --2- 172.21.15.69:0/4273797631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 0x55af4d8f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.432+0000 7f6f93e00640 1 -- 172.21.15.69:0/4273797631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 msgr2=0x55af4d9119f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.432+0000 7f6f93e00640 1 --2- 172.21.15.69:0/4273797631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d9119f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.432+0000 7f6f93e00640 1 -- 172.21.15.69:0/4273797631 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af4d7cfab0 con 0x55af4d9053b0 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.432+0000 7f6f93400640 1 --2- 172.21.15.69:0/4273797631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d9119f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.432+0000 7f6f93e00640 1 --2- 172.21.15.69:0/4273797631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d944c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800c410 tx=0x7f6f84007cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c87416155902660 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.432+0000 7f6f7fe00640 1 -- 172.21.15.69:0/4273797631 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84051b70 con 0x55af4d9053b0 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.432+0000 7f6f7fe00640 1 -- 172.21.15.69:0/4273797631 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84041070 con 0x55af4d9053b0 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.432+0000 7f6f7fe00640 1 -- 172.21.15.69:0/4273797631 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84051330 con 0x55af4d9053b0 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.433+0000 7f6f9de20740 1 -- 172.21.15.69:0/4273797631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 msgr2=0x55af4d944c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.433+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4273797631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d944c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6f7800c410 tx=0x7f6f84007cc0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.433+0000 7f6f9de20740 1 -- 172.21.15.69:0/4273797631 shutdown_connections 2024-02-21T07:43:42.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.433+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4273797631 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 0x55af4d8f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.433+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4273797631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d9119f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.433+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4273797631 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d944c20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.433+0000 7f6f9de20740 1 -- 172.21.15.69:0/4273797631 >> 172.21.15.69:0/4273797631 conn(0x55af4d909070 msgr2=0x55af4d94b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.433+0000 7f6f9de20740 1 -- 172.21.15.69:0/4273797631 shutdown_connections 2024-02-21T07:43:42.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.434+0000 7f6f9de20740 1 -- 172.21.15.69:0/4273797631 wait complete. 2024-02-21T07:43:42.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.434+0000 7f6f9de20740 1 -- start start 2024-02-21T07:43:42.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.435+0000 7f6f9de20740 1 Processor -- start 2024-02-21T07:43:42.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d8d4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d911950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f9de20740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 0x55af4d941eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f9de20740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d915540 con 0x55af4d909990 2024-02-21T07:43:42.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f9de20740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d9423f0 con 0x55af4d944740 2024-02-21T07:43:42.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f9de20740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af4d934b70 con 0x55af4d9053b0 2024-02-21T07:43:42.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f9de20740 10 client.0 _ll_register_callbacks cb 0x7f6f8c003de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:42.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f93e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d8d4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f93400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d911950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f93e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d8d4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49408/0 (socket says 172.21.15.69:49408) 2024-02-21T07:43:42.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f93e00640 1 -- 172.21.15.69:0/4130216966 learned_addr learned my addr 172.21.15.69:0/4130216966 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.436+0000 7f6f99200640 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 0x55af4d941eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.437+0000 7f6f93e00640 1 -- 172.21.15.69:0/4130216966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 msgr2=0x55af4d941eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.437+0000 7f6f93e00640 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 0x55af4d941eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.437+0000 7f6f93e00640 1 -- 172.21.15.69:0/4130216966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 msgr2=0x55af4d911950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.437+0000 7f6f93e00640 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d911950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.437+0000 7f6f93e00640 1 -- 172.21.15.69:0/4130216966 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f94176880 con 0x55af4d9053b0 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.437+0000 7f6f99200640 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 0x55af4d941eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.437+0000 7f6f93400640 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d911950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.437+0000 7f6f93e00640 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d8d4060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6f84007370 tx=0x7f6f84003760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c3ec418887df9ad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.437+0000 7f6f7d600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.438+0000 7f6f7d600640 1 -- 172.21.15.69:0/4130216966 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8403d650 con 0x55af4d9053b0 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.438+0000 7f6f9de20740 1 -- 172.21.15.69:0/4130216966 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6f8c00f040 con 0x55af4d9053b0 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.438+0000 7f6f7d600640 1 -- 172.21.15.69:0/4130216966 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6f8404f070 con 0x55af4d9053b0 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.438+0000 7f6f7d600640 1 -- 172.21.15.69:0/4130216966 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f8403d7b0 con 0x55af4d9053b0 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.438+0000 7f6f9de20740 10 client.5465 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.438+0000 7f6f9de20740 1 -- 172.21.15.69:0/4130216966 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x7f6f78003520 con 0x55af4d9053b0 2024-02-21T07:43:42.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.438+0000 7f6f7d600640 1 -- 172.21.15.69:0/4130216966 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c00f040 con 0x55af4d9053b0 2024-02-21T07:43:42.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.439+0000 7f6f7d600640 1 -- 172.21.15.69:0/4130216966 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6f84045040 con 0x55af4d9053b0 2024-02-21T07:43:42.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.439+0000 7f6f9de20740 10 client.5465 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:42.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.439+0000 7f6f9de20740 10 client.5465 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:43:42.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.439+0000 7f6f9de20740 20 client.5465 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:42.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.439+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55af4d8ee040 0x55af4d914df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.439+0000 7f6f9de20740 4 client.5465 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:43:42.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.439+0000 7f6f9de20740 1 -- 172.21.15.69:0/4130216966 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55af4d5c0890 con 0x55af4d8ee040 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.440+0000 7f6f93400640 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55af4d8ee040 0x55af4d914df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.440+0000 7f6f93400640 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55af4d8ee040 0x55af4d914df0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7be2a90bcc07c8ca server_cookie=ec2d459fefbac4a5 in_seq=0 out_seq=0 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.440+0000 7f6f7d600640 10 client.5465 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f7d600640 1 -- 172.21.15.69:0/4130216966 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55af4d5c0890 con 0x55af4d8ee040 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f7d600640 10 client.5465 handle_command_reply: tid=0 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 client.5465 shutdown 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 -- 172.21.15.69:0/4130216966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 msgr2=0x55af4d8d4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d8d4060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6f84007370 tx=0x7f6f84003760 comp rx=0 tx=0).stop 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 -- 172.21.15.69:0/4130216966 shutdown_connections 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55af4d944740 0x55af4d941eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af4d909990 0x55af4d911950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55af4d8ee040 0x55af4d914df0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 --2- 172.21.15.69:0/4130216966 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55af4d9053b0 0x55af4d8d4060 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 -- 172.21.15.69:0/4130216966 >> 172.21.15.69:0/4130216966 conn(0x55af4d909070 msgr2=0x55af4d8f4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f7d600640 0 client.5465 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:43:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 -- 172.21.15.69:0/4130216966 shutdown_connections 2024-02-21T07:43:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 1 -- 172.21.15.69:0/4130216966 wait complete. 2024-02-21T07:43:42.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.441+0000 7f6f9de20740 20 client.5465 trim_cache size 0 max 16384 2024-02-21T07:43:42.449 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:43:42.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 -- 172.21.15.69:0/3334886691 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f7409f130 msgr2=0x7f6f740a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f7409f130 0x7f6f740a15f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f84034000 tx=0x7f6f84009030 comp rx=0 tx=0).stop 2024-02-21T07:43:42.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 -- 172.21.15.69:0/3334886691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f94177fc0 msgr2=0x7f6f94172130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f94177fc0 0x7f6f94172130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6f800017a0 tx=0x7f6f80007430 comp rx=0 tx=0).stop 2024-02-21T07:43:42.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 -- 172.21.15.69:0/3334886691 shutdown_connections 2024-02-21T07:43:42.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f6f7409f130 0x7f6f740a15f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f9421fac0 0x7f6f9421ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f6f94177fc0 0x7f6f94172130 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 --2- 172.21.15.69:0/3334886691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f78003a10 0x7f6f94176340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 -- 172.21.15.69:0/3334886691 >> 172.21.15.69:0/3334886691 conn(0x7f6f940d03a0 msgr2=0x7f6f9408d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.442+0000 7f6f99c00640 1 -- 172.21.15.69:0/3334886691 shutdown_connections 2024-02-21T07:43:42.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.443+0000 7f6f99c00640 1 -- 172.21.15.69:0/3334886691 wait complete. 2024-02-21T07:43:42.464 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:43:42.465 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:43:42.539 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:43:42.544 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:43:42.585 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:43:42.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.702+0000 7f5016200640 1 Processor -- start 2024-02-21T07:43:42.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.702+0000 7f5016200640 1 -- start start 2024-02-21T07:43:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.704+0000 7f5016200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f501017f2a0 0x7f50100fe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.704+0000 7f5016200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f50100fe6a0 0x7f501018ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.704+0000 7f5016200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501018a800 con 0x7f501018b1d0 2024-02-21T07:43:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.704+0000 7f5016200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50100ff160 con 0x7f501017f2a0 2024-02-21T07:43:42.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.704+0000 7f5016200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50100fde70 con 0x7f50100fe6a0 2024-02-21T07:43:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.704+0000 7f5014e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f501017f2a0 0x7f50100fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.704+0000 7f5014e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f501017f2a0 0x7f50100fe160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48828/0 (socket says 172.21.15.69:48828) 2024-02-21T07:43:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.704+0000 7f5014e00640 1 -- 172.21.15.69:0/785064841 learned_addr learned my addr 172.21.15.69:0/785064841 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.705+0000 7f500fe00640 1 --2- 172.21.15.69:0/785064841 >> v2:172.21.15.184:3300/0 conn(0x7f50100fe6a0 0x7f501018ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.705+0000 7f500fe00640 1 -- 172.21.15.69:0/785064841 >> v2:172.21.15.69:3300/0 conn(0x7f501017f2a0 msgr2=0x7f50100fe160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.705+0000 7f500f400640 1 -- 172.21.15.69:0/785064841 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731127993 0 0) 0x7f501018a800 con 0x7f501018b1d0 2024-02-21T07:43:42.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.705+0000 7f500fe00640 1 --2- 172.21.15.69:0/785064841 >> v2:172.21.15.69:3300/0 conn(0x7f501017f2a0 0x7f50100fe160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.705+0000 7f500fe00640 1 -- 172.21.15.69:0/785064841 >> v1:172.21.15.174:6789/0 conn(0x7f501018b1d0 legacy=0x7f50100ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.705+0000 7f500fe00640 1 -- 172.21.15.69:0/785064841 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010189f10 con 0x7f50100fe6a0 2024-02-21T07:43:42.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.705+0000 7f5014e00640 1 --2- 172.21.15.69:0/785064841 >> v2:172.21.15.69:3300/0 conn(0x7f501017f2a0 0x7f50100fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:42.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.707+0000 7f500fe00640 1 --2- 172.21.15.69:0/785064841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50100fe6a0 0x7f501018ac90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f501006cbe0 tx=0x7f4ffc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=926784a54acf6a0f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.707+0000 7f500f400640 1 -- 172.21.15.69:0/785064841 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc031830 con 0x7f50100fe6a0 2024-02-21T07:43:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.707+0000 7f500f400640 1 -- 172.21.15.69:0/785064841 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc031990 con 0x7f50100fe6a0 2024-02-21T07:43:42.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.707+0000 7f500f400640 1 -- 172.21.15.69:0/785064841 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc031d20 con 0x7f50100fe6a0 2024-02-21T07:43:42.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.708+0000 7f5016200640 1 -- 172.21.15.69:0/785064841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50100fe6a0 msgr2=0x7f501018ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.708+0000 7f5016200640 1 --2- 172.21.15.69:0/785064841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50100fe6a0 0x7f501018ac90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f501006cbe0 tx=0x7f4ffc02b8d0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.708+0000 7f5016200640 1 -- 172.21.15.69:0/785064841 shutdown_connections 2024-02-21T07:43:42.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.708+0000 7f5016200640 1 --2- 172.21.15.69:0/785064841 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50100fe6a0 0x7f501018ac90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.708+0000 7f5016200640 1 --2- 172.21.15.69:0/785064841 >> v2:172.21.15.69:3300/0 conn(0x7f501017f2a0 0x7f50100fe160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.708+0000 7f5016200640 1 -- 172.21.15.69:0/785064841 >> 172.21.15.69:0/785064841 conn(0x7f50100d2b00 msgr2=0x7f50100d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.708+0000 7f5016200640 1 -- 172.21.15.69:0/785064841 shutdown_connections 2024-02-21T07:43:42.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.708+0000 7f5016200640 1 -- 172.21.15.69:0/785064841 wait complete. 2024-02-21T07:43:42.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.710+0000 7f5016200640 1 Processor -- start 2024-02-21T07:43:42.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.710+0000 7f5016200640 1 -- start start 2024-02-21T07:43:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.711+0000 7f5016200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50100fe6a0 0x7f501016b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.711+0000 7f5016200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501017f2a0 0x7f501021dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.711+0000 7f5016200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f501018b1d0 0x7f501021e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.711+0000 7f5016200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501021ca20 con 0x7f50100fe6a0 2024-02-21T07:43:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.711+0000 7f5016200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501021d880 con 0x7f501017f2a0 2024-02-21T07:43:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.711+0000 7f5016200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501021cc70 con 0x7f501018b1d0 2024-02-21T07:43:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.711+0000 7f5014e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50100fe6a0 0x7f501016b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.711+0000 7f5014e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50100fe6a0 0x7f501016b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48836/0 (socket says 172.21.15.69:48836) 2024-02-21T07:43:42.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.712+0000 7f5014e00640 1 -- 172.21.15.69:0/1152665207 learned_addr learned my addr 172.21.15.69:0/1152665207 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.712+0000 7f5015800640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f501018b1d0 0x7f501021e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.712+0000 7f500fe00640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501017f2a0 0x7f501021dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.712+0000 7f5015800640 1 -- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501017f2a0 msgr2=0x7f501021dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.712+0000 7f5015800640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501017f2a0 0x7f501021dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.712+0000 7f5015800640 1 -- 172.21.15.69:0/1152665207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50100fe6a0 msgr2=0x7f501016b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.712+0000 7f5015800640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50100fe6a0 0x7f501016b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.712+0000 7f5015800640 1 -- 172.21.15.69:0/1152665207 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040094d0 con 0x7f501018b1d0 2024-02-21T07:43:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.712+0000 7f500fe00640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501017f2a0 0x7f501021dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:42.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.712+0000 7f5015800640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f501018b1d0 0x7f501021e250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f500800c6a0 tx=0x7f500800cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.713+0000 7f500cc00640 1 -- 172.21.15.69:0/1152665207 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5008003b70 con 0x7f501018b1d0 2024-02-21T07:43:42.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.713+0000 7f500cc00640 1 -- 172.21.15.69:0/1152665207 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5008003cf0 con 0x7f501018b1d0 2024-02-21T07:43:42.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.713+0000 7f500cc00640 1 -- 172.21.15.69:0/1152665207 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50080052b0 con 0x7f501018b1d0 2024-02-21T07:43:42.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.713+0000 7f5016200640 1 -- 172.21.15.69:0/1152665207 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ffc009400 con 0x7f501018b1d0 2024-02-21T07:43:42.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.713+0000 7f5016200640 1 -- 172.21.15.69:0/1152665207 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501021d230 con 0x7f501018b1d0 2024-02-21T07:43:42.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.717+0000 7f501a5a1740 1 Processor -- start 2024-02-21T07:43:42.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.717+0000 7f500cc00640 1 -- 172.21.15.69:0/1152665207 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f5008005410 con 0x7f501018b1d0 2024-02-21T07:43:42.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.718+0000 7f501a5a1740 1 -- start start 2024-02-21T07:43:42.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.719+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a607070 0x564f1a607450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.719+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 0x564f1a642200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.719+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a642740 0x564f1a6434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.719+0000 7f501a5a1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a53a210 con 0x564f1a642740 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.719+0000 7f501a5a1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a537740 con 0x564f1a607070 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.719+0000 7f501a5a1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a532f20 con 0x564f1a607990 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.720+0000 7f500cc00640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ff009f130 0x7f4ff00a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.720+0000 7f500cc00640 1 -- 172.21.15.69:0/1152665207 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f50080c9950 con 0x7f501018b1d0 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.720+0000 7f500fe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a607070 0x564f1a607450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.720+0000 7f500fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a642740 0x564f1a6434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.720+0000 7f5014e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 0x564f1a642200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.720+0000 7f5014e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 0x564f1a642200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49440/0 (socket says 172.21.15.69:49440) 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.720+0000 7f5014e00640 1 -- 172.21.15.69:0/3107127447 learned_addr learned my addr 172.21.15.69:0/3107127447 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.720+0000 7f500fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a642740 0x564f1a6434d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48848/0 (socket says 172.21.15.69:48848) 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.720+0000 7f5015800640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ff009f130 0x7f4ff00a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.721+0000 7f500fe00640 1 -- 172.21.15.69:0/3107127447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 msgr2=0x564f1a642200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.721+0000 7f500fe00640 1 --2- 172.21.15.69:0/3107127447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 0x564f1a642200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.721+0000 7f500fe00640 1 -- 172.21.15.69:0/3107127447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a607070 msgr2=0x564f1a607450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.721+0000 7f500fe00640 1 --2- 172.21.15.69:0/3107127447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a607070 0x564f1a607450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.721+0000 7f500fe00640 1 -- 172.21.15.69:0/3107127447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f1a4f4df0 con 0x564f1a642740 2024-02-21T07:43:42.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.721+0000 7f500fe00640 1 --2- 172.21.15.69:0/3107127447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a642740 0x564f1a6434d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc033000 tx=0x7f4ffc008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0006d85b82e4e86 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.721+0000 7f5001600640 1 -- 172.21.15.69:0/3107127447 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc004030 con 0x564f1a642740 2024-02-21T07:43:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.721+0000 7f5001600640 1 -- 172.21.15.69:0/3107127447 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc040070 con 0x564f1a642740 2024-02-21T07:43:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.721+0000 7f5001600640 1 -- 172.21.15.69:0/3107127447 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc004390 con 0x564f1a642740 2024-02-21T07:43:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.722+0000 7f501a5a1740 1 -- 172.21.15.69:0/3107127447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a642740 msgr2=0x564f1a6434d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.722+0000 7f501a5a1740 1 --2- 172.21.15.69:0/3107127447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a642740 0x564f1a6434d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc033000 tx=0x7f4ffc008030 comp rx=0 tx=0).stop 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.722+0000 7f5015800640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ff009f130 0x7f4ff00a15f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50080012e0 tx=0x7f50080b6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.722+0000 7f501a5a1740 1 -- 172.21.15.69:0/3107127447 shutdown_connections 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.722+0000 7f501a5a1740 1 --2- 172.21.15.69:0/3107127447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a642740 0x564f1a6434d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.722+0000 7f501a5a1740 1 --2- 172.21.15.69:0/3107127447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 0x564f1a642200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.722+0000 7f501a5a1740 1 --2- 172.21.15.69:0/3107127447 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a607070 0x564f1a607450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.722+0000 7f501a5a1740 1 -- 172.21.15.69:0/3107127447 >> 172.21.15.69:0/3107127447 conn(0x564f1a5c9640 msgr2=0x564f1a5ca6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.722+0000 7f501a5a1740 1 -- 172.21.15.69:0/3107127447 shutdown_connections 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.722+0000 7f501a5a1740 1 -- 172.21.15.69:0/3107127447 wait complete. 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.723+0000 7f501a5a1740 1 -- start start 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.723+0000 7f501a5a1740 1 Processor -- start 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.724+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a607990 0x564f1a5fe430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.724+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 0x564f1a6061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.724+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a5f1b20 0x564f1a64e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.724+0000 7f501a5a1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a4d8150 con 0x564f1a607990 2024-02-21T07:43:42.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.724+0000 7f501a5a1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a4d7df0 con 0x564f1a5f1b20 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.724+0000 7f501a5a1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a2a11c0 con 0x564f1a642740 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f501a5a1740 10 client.0 _ll_register_callbacks cb 0x564f1a5272b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f500fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a607990 0x564f1a5fe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f5014e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 0x564f1a6061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f500fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a607990 0x564f1a5fe430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48852/0 (socket says 172.21.15.69:48852) 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f5014e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 0x564f1a6061a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49444/0 (socket says 172.21.15.69:49444) 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f500fe00640 1 -- 172.21.15.69:0/2128893720 learned_addr learned my addr 172.21.15.69:0/2128893720 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f500fe00640 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a5f1b20 0x564f1a64e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f500fe00640 1 -- 172.21.15.69:0/2128893720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 msgr2=0x564f1a6061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f500fe00640 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 0x564f1a6061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f500fe00640 1 -- 172.21.15.69:0/2128893720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a5f1b20 msgr2=0x564f1a64e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f500fe00640 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a5f1b20 0x564f1a64e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.725+0000 7f500fe00640 1 -- 172.21.15.69:0/2128893720 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ffc042040 con 0x564f1a607990 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.726+0000 7f500fe00640 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a607990 0x564f1a5fe430 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc02b910 tx=0x7f4ffc009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca82e73f862fb712 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.726+0000 7f4ff6000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.726+0000 7f4ff6000640 1 -- 172.21.15.69:0/2128893720 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0040b0 con 0x564f1a607990 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.726+0000 7f4ff6000640 1 -- 172.21.15.69:0/2128893720 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4ffc000e40 con 0x564f1a607990 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.726+0000 7f501a5a1740 1 -- 172.21.15.69:0/2128893720 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f1a2327e0 con 0x564f1a607990 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.726+0000 7f4ff6000640 1 -- 172.21.15.69:0/2128893720 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ffc004210 con 0x564f1a607990 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.726+0000 7f501a5a1740 10 client.5331 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.726+0000 7f501a5a1740 1 -- 172.21.15.69:0/2128893720 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x564f1a5315a0 con 0x564f1a607990 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.726+0000 7f4ff6000640 1 -- 172.21.15.69:0/2128893720 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564f1a2327e0 con 0x564f1a607990 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.727+0000 7f4ff6000640 1 -- 172.21.15.69:0/2128893720 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4ffc004370 con 0x564f1a607990 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.727+0000 7f501a5a1740 10 client.5331 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.727+0000 7f501a5a1740 10 client.5331 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.727+0000 7f501a5a1740 20 client.5331 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.727+0000 7f501a5a1740 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564f1a64f380 0x564f1a655ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.727+0000 7f501a5a1740 4 client.5331 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:42.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.727+0000 7f501a5a1740 1 -- 172.21.15.69:0/2128893720 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f1a26f720 con 0x564f1a64f380 2024-02-21T07:43:42.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.727+0000 7f5014e00640 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564f1a64f380 0x564f1a655ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.728+0000 7f5014e00640 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564f1a64f380 0x564f1a655ca0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=268c4b596f1d3f36 server_cookie=12a565f506fc2c99 in_seq=0 out_seq=0 2024-02-21T07:43:42.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.728+0000 7f4ff6000640 10 client.5331 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:42.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.728+0000 7f4ff6000640 1 -- 172.21.15.69:0/2128893720 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564f1a26f720 con 0x564f1a64f380 2024-02-21T07:43:42.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.728+0000 7f4ff6000640 10 client.5331 handle_command_reply: tid=0 2024-02-21T07:43:42.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 client.5331 shutdown 2024-02-21T07:43:42.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 -- 172.21.15.69:0/2128893720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a607990 msgr2=0x564f1a5fe430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a607990 0x564f1a5fe430 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc02b910 tx=0x7f4ffc009190 comp rx=0 tx=0).stop 2024-02-21T07:43:42.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 -- 172.21.15.69:0/2128893720 shutdown_connections 2024-02-21T07:43:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564f1a64f380 0x564f1a655ca0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a5f1b20 0x564f1a64e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 0x564f1a6061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 --2- 172.21.15.69:0/2128893720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a607990 0x564f1a5fe430 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 -- 172.21.15.69:0/2128893720 >> 172.21.15.69:0/2128893720 conn(0x564f1a607070 msgr2=0x564f1a5cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f4ff6000640 0 client.5331 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 -- 172.21.15.69:0/2128893720 shutdown_connections 2024-02-21T07:43:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 1 -- 172.21.15.69:0/2128893720 wait complete. 2024-02-21T07:43:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.729+0000 7f501a5a1740 20 client.5331 trim_cache size 0 max 16384 2024-02-21T07:43:42.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.753+0000 7f501a5a1740 1 Processor -- start 2024-02-21T07:43:42.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.753+0000 7f501a5a1740 1 -- start start 2024-02-21T07:43:42.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.754+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a5c9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.754+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 0x564f1a63e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.754+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a642740 0x564f1a5f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.754+0000 7f501a5a1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a606570 con 0x564f1a5f1b20 2024-02-21T07:43:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.754+0000 7f501a5a1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a5d18b0 con 0x564f1a642740 2024-02-21T07:43:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.754+0000 7f501a5a1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a5fe430 con 0x564f1a607990 2024-02-21T07:43:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.755+0000 7f500fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a5c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.755+0000 7f500fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a5c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48860/0 (socket says 172.21.15.69:48860) 2024-02-21T07:43:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.755+0000 7f500fe00640 1 -- 172.21.15.69:0/4049086916 learned_addr learned my addr 172.21.15.69:0/4049086916 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.755+0000 7f5014e00640 1 --2- 172.21.15.69:0/4049086916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 0x564f1a63e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.755+0000 7f500fe00640 1 -- 172.21.15.69:0/4049086916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 msgr2=0x564f1a63e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.755+0000 7f500fe00640 1 --2- 172.21.15.69:0/4049086916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 0x564f1a63e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.755+0000 7f500fe00640 1 -- 172.21.15.69:0/4049086916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a642740 msgr2=0x564f1a5f8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.755+0000 7f500fe00640 1 --2- 172.21.15.69:0/4049086916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a642740 0x564f1a5f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.755+0000 7f500fe00640 1 -- 172.21.15.69:0/4049086916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f1a4cdab0 con 0x564f1a5f1b20 2024-02-21T07:43:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.756+0000 7f500fe00640 1 --2- 172.21.15.69:0/4049086916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a5c9000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc02bfd0 tx=0x7f4ffc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5277d61329327fa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.756+0000 7f5000c00640 1 -- 172.21.15.69:0/4049086916 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc031ea0 con 0x564f1a5f1b20 2024-02-21T07:43:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.756+0000 7f5000c00640 1 -- 172.21.15.69:0/4049086916 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc004040 con 0x564f1a5f1b20 2024-02-21T07:43:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.757+0000 7f5000c00640 1 -- 172.21.15.69:0/4049086916 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0043b0 con 0x564f1a5f1b20 2024-02-21T07:43:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.757+0000 7f501a5a1740 1 -- 172.21.15.69:0/4049086916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 msgr2=0x564f1a5c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.757+0000 7f501a5a1740 1 --2- 172.21.15.69:0/4049086916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a5c9000 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc02bfd0 tx=0x7f4ffc030000 comp rx=0 tx=0).stop 2024-02-21T07:43:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.757+0000 7f501a5a1740 1 -- 172.21.15.69:0/4049086916 shutdown_connections 2024-02-21T07:43:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.757+0000 7f501a5a1740 1 --2- 172.21.15.69:0/4049086916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a642740 0x564f1a5f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.757+0000 7f501a5a1740 1 --2- 172.21.15.69:0/4049086916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a607990 0x564f1a63e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.757+0000 7f501a5a1740 1 --2- 172.21.15.69:0/4049086916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a5c9000 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.757+0000 7f501a5a1740 1 -- 172.21.15.69:0/4049086916 >> 172.21.15.69:0/4049086916 conn(0x564f1a607070 msgr2=0x564f1a5c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.757+0000 7f501a5a1740 1 -- 172.21.15.69:0/4049086916 shutdown_connections 2024-02-21T07:43:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.758+0000 7f501a5a1740 1 -- 172.21.15.69:0/4049086916 wait complete. 2024-02-21T07:43:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.759+0000 7f501a5a1740 1 -- start start 2024-02-21T07:43:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.759+0000 7f501a5a1740 1 Processor -- start 2024-02-21T07:43:42.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a609fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a607990 0x564f1a6abf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f501a5a1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 0x564f1a6ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f501a5a1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a5c6940 con 0x564f1a5f1b20 2024-02-21T07:43:42.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f501a5a1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a5eab80 con 0x564f1a607990 2024-02-21T07:43:42.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f501a5a1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f1a6ac990 con 0x564f1a642740 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f501a5a1740 10 client.0 _ll_register_callbacks cb 0x7f50040090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f500fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a609fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f500fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a609fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48866/0 (socket says 172.21.15.69:48866) 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f500fe00640 1 -- 172.21.15.69:0/3061868468 learned_addr learned my addr 172.21.15.69:0/3061868468 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.761+0000 7f500fe00640 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 0x564f1a6ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.762+0000 7f5014e00640 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a607990 0x564f1a6abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.762+0000 7f500fe00640 1 -- 172.21.15.69:0/3061868468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 msgr2=0x564f1a6ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.762+0000 7f500fe00640 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 0x564f1a6ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.762+0000 7f500fe00640 1 -- 172.21.15.69:0/3061868468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a607990 msgr2=0x564f1a6abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.762+0000 7f500fe00640 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a607990 0x564f1a6abf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.762+0000 7f500fe00640 1 -- 172.21.15.69:0/3061868468 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f1a5315a0 con 0x564f1a5f1b20 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.762+0000 7f500fe00640 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a609fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0059b0 tx=0x7f4ffc04f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481d5f946067eeff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.762+0000 7f4ff6000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.762+0000 7f4ff6000640 1 -- 172.21.15.69:0/3061868468 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0036d0 con 0x564f1a5f1b20 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.762+0000 7f4ff6000640 1 -- 172.21.15.69:0/3061868468 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4ffc000e40 con 0x564f1a5f1b20 2024-02-21T07:43:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.763+0000 7f501a5a1740 1 -- 172.21.15.69:0/3061868468 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ffc040070 con 0x564f1a5f1b20 2024-02-21T07:43:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.763+0000 7f4ff6000640 1 -- 172.21.15.69:0/3061868468 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ffc003830 con 0x564f1a5f1b20 2024-02-21T07:43:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.763+0000 7f501a5a1740 10 client.5337 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.763+0000 7f501a5a1740 1 -- 172.21.15.69:0/3061868468 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x564f1a4f3650 con 0x564f1a5f1b20 2024-02-21T07:43:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.763+0000 7f4ff6000640 1 -- 172.21.15.69:0/3061868468 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc040070 con 0x564f1a5f1b20 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.764+0000 7f4ff6000640 1 -- 172.21.15.69:0/3061868468 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4ffc003990 con 0x564f1a5f1b20 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.764+0000 7f501a5a1740 10 client.5337 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.764+0000 7f501a5a1740 10 client.5337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.764+0000 7f501a5a1740 20 client.5337 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.764+0000 7f501a5a1740 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564f1a642b20 0x564f1a64b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.764+0000 7f501a5a1740 4 client.5337 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.764+0000 7f501a5a1740 1 -- 172.21.15.69:0/3061868468 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564f1a2be890 con 0x564f1a642b20 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.764+0000 7f5014e00640 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564f1a642b20 0x564f1a64b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f5014e00640 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564f1a642b20 0x564f1a64b4a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f8aee66565ef20 server_cookie=af49ad31deef6772 in_seq=0 out_seq=0 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f4ff6000640 10 client.5337 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f4ff6000640 1 -- 172.21.15.69:0/3061868468 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564f1a2be890 con 0x564f1a642b20 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f4ff6000640 10 client.5337 handle_command_reply: tid=0 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f501a5a1740 1 client.5337 shutdown 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f501a5a1740 1 -- 172.21.15.69:0/3061868468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 msgr2=0x564f1a609fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f501a5a1740 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a609fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc0059b0 tx=0x7f4ffc04f000 comp rx=0 tx=0).stop 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f501a5a1740 1 -- 172.21.15.69:0/3061868468 shutdown_connections 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f501a5a1740 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564f1a642b20 0x564f1a64b4a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f501a5a1740 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564f1a642740 0x564f1a6ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f4ff6000640 0 client.5337 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f501a5a1740 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564f1a607990 0x564f1a6abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f501a5a1740 1 --2- 172.21.15.69:0/3061868468 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564f1a5f1b20 0x564f1a609fc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.765+0000 7f501a5a1740 1 -- 172.21.15.69:0/3061868468 >> 172.21.15.69:0/3061868468 conn(0x564f1a607070 msgr2=0x564f1a5f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.766+0000 7f501a5a1740 1 -- 172.21.15.69:0/3061868468 shutdown_connections 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.766+0000 7f501a5a1740 1 -- 172.21.15.69:0/3061868468 wait complete. 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.766+0000 7f501a5a1740 20 client.5337 trim_cache size 0 max 16384 2024-02-21T07:43:42.773 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:43:42.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 -- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ff009f130 msgr2=0x7f4ff00a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ff009f130 0x7f4ff00a15f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f50080012e0 tx=0x7f50080b6040 comp rx=0 tx=0).stop 2024-02-21T07:43:42.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 -- 172.21.15.69:0/1152665207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f501018b1d0 msgr2=0x7f501021e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:42.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f501018b1d0 0x7f501021e250 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f500800c6a0 tx=0x7f500800cb60 comp rx=0 tx=0).stop 2024-02-21T07:43:42.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 -- 172.21.15.69:0/1152665207 shutdown_connections 2024-02-21T07:43:42.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f4ff009f130 0x7f4ff00a15f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f501018b1d0 0x7f501021e250 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f501017f2a0 0x7f501021dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 --2- 172.21.15.69:0/1152665207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50100fe6a0 0x7f501016b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:42.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 -- 172.21.15.69:0/1152665207 >> 172.21.15.69:0/1152665207 conn(0x7f50100d2b00 msgr2=0x7f501017b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:42.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 -- 172.21.15.69:0/1152665207 shutdown_connections 2024-02-21T07:43:42.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:42.767+0000 7f5016200640 1 -- 172.21.15.69:0/1152665207 wait complete. 2024-02-21T07:43:43.796 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:43:43.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:43:43.797 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:43:43.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.983+0000 7f01ea800640 1 Processor -- start 2024-02-21T07:43:43.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.983+0000 7f01ea800640 1 -- start start 2024-02-21T07:43:43.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.986+0000 7f01ea800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f01e406eaa0 0x7f01e418a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:43.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.986+0000 7f01ea800640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e41875b0 con 0x7f01e4183e60 2024-02-21T07:43:43.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.986+0000 7f01ea800640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e4184240 con 0x7f01e418a620 2024-02-21T07:43:43.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.986+0000 7f01ea800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e40f76e0 con 0x7f01e406eaa0 2024-02-21T07:43:43.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.986+0000 7f01e9400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f01e4183e60 0x7f01e4071140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40582/0 (socket says 172.21.15.69:40582) 2024-02-21T07:43:43.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.986+0000 7f01e9400640 1 -- 172.21.15.69:0/1227577080 learned_addr learned my addr 172.21.15.69:0/1227577080 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:43.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.986+0000 7f01e8a00640 1 --2- 172.21.15.69:0/1227577080 >> v2:172.21.15.174:3300/0 conn(0x7f01e406eaa0 0x7f01e418a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:43.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.987+0000 7f01e3e00640 1 -- 172.21.15.69:0/1227577080 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157432688 0 0) 0x7f01e4184240 con 0x7f01e418a620 2024-02-21T07:43:43.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.987+0000 7f01e8a00640 1 -- 172.21.15.69:0/1227577080 >> v1:172.21.15.174:6789/0 conn(0x7f01e418a620 legacy=0x7f01e40f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:43.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.987+0000 7f01e8a00640 1 -- 172.21.15.69:0/1227577080 >> v1:172.21.15.69:6789/0 conn(0x7f01e4183e60 legacy=0x7f01e4071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:43.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.987+0000 7f01e8a00640 1 -- 172.21.15.69:0/1227577080 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e418aab0 con 0x7f01e406eaa0 2024-02-21T07:43:43.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.988+0000 7f01e8a00640 1 --2- 172.21.15.69:0/1227577080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01e406eaa0 0x7f01e418a0e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f01d00097a0 tx=0x7f01d002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c39e80ea27cc5ac9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:43.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.988+0000 7f01e3e00640 1 -- 172.21.15.69:0/1227577080 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d002e070 con 0x7f01e406eaa0 2024-02-21T07:43:43.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.988+0000 7f01e3e00640 1 -- 172.21.15.69:0/1227577080 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d00315a0 con 0x7f01e406eaa0 2024-02-21T07:43:43.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.988+0000 7f01e3e00640 1 -- 172.21.15.69:0/1227577080 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d0031930 con 0x7f01e406eaa0 2024-02-21T07:43:43.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.989+0000 7f01ea800640 1 -- 172.21.15.69:0/1227577080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01e406eaa0 msgr2=0x7f01e418a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:43.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.989+0000 7f01ea800640 1 --2- 172.21.15.69:0/1227577080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01e406eaa0 0x7f01e418a0e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f01d00097a0 tx=0x7f01d002b840 comp rx=0 tx=0).stop 2024-02-21T07:43:43.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.989+0000 7f01ea800640 1 -- 172.21.15.69:0/1227577080 shutdown_connections 2024-02-21T07:43:43.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.989+0000 7f01ea800640 1 --2- 172.21.15.69:0/1227577080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01e406eaa0 0x7f01e418a0e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:43.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.989+0000 7f01ea800640 1 -- 172.21.15.69:0/1227577080 >> 172.21.15.69:0/1227577080 conn(0x7f01e40cf360 msgr2=0x7f01e40cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:43.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.989+0000 7f01ea800640 1 -- 172.21.15.69:0/1227577080 shutdown_connections 2024-02-21T07:43:43.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.989+0000 7f01ea800640 1 -- 172.21.15.69:0/1227577080 wait complete. 2024-02-21T07:43:43.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.992+0000 7f01ea800640 1 Processor -- start 2024-02-21T07:43:43.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.993+0000 7f01ea800640 1 -- start start 2024-02-21T07:43:44.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.994+0000 7f01ea800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01e406eaa0 0x7f01e4176520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.994+0000 7f01ea800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01e4183e60 0x7f01e4176a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.994+0000 7f01ea800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01e418a620 0x7f01e421c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.994+0000 7f01ea800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e406e680 con 0x7f01e4183e60 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.994+0000 7f01ea800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e421d2a0 con 0x7f01e418a620 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.995+0000 7f01ea800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e421d580 con 0x7f01e406eaa0 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.995+0000 7f01e8a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01e4183e60 0x7f01e4176a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.995+0000 7f01e9400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01e406eaa0 0x7f01e4176520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.995+0000 7f01e9400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01e406eaa0 0x7f01e4176520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49468/0 (socket says 172.21.15.69:49468) 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.995+0000 7f01e9400640 1 -- 172.21.15.69:0/3835023795 learned_addr learned my addr 172.21.15.69:0/3835023795 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.995+0000 7f01e8a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01e4183e60 0x7f01e4176a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48872/0 (socket says 172.21.15.69:48872) 2024-02-21T07:43:44.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.995+0000 7f01e9e00640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01e418a620 0x7f01e421c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.995+0000 7f01e9400640 1 -- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01e418a620 msgr2=0x7f01e421c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.995+0000 7f01e9400640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01e418a620 0x7f01e421c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.996+0000 7f01e9400640 1 -- 172.21.15.69:0/3835023795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01e4183e60 msgr2=0x7f01e4176a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.996+0000 7f01e9400640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01e4183e60 0x7f01e4176a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.996+0000 7f01e9400640 1 -- 172.21.15.69:0/3835023795 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d0009400 con 0x7f01e406eaa0 2024-02-21T07:43:44.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.996+0000 7f01e9e00640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01e418a620 0x7f01e421c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:44.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.996+0000 7f01e9400640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01e406eaa0 0x7f01e4176520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c400 tx=0x7f01d800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.996+0000 7f01e1600640 1 -- 172.21.15.69:0/3835023795 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8005ce0 con 0x7f01e406eaa0 2024-02-21T07:43:44.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.996+0000 7f01e1600640 1 -- 172.21.15.69:0/3835023795 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d8005e40 con 0x7f01e406eaa0 2024-02-21T07:43:44.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.996+0000 7f01e1600640 1 -- 172.21.15.69:0/3835023795 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d80072d0 con 0x7f01e406eaa0 2024-02-21T07:43:44.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.996+0000 7f01ea800640 1 -- 172.21.15.69:0/3835023795 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e421d860 con 0x7f01e406eaa0 2024-02-21T07:43:44.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:43.996+0000 7f01ea800640 1 -- 172.21.15.69:0/3835023795 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e421de20 con 0x7f01e406eaa0 2024-02-21T07:43:44.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.001+0000 7f01eec24740 1 Processor -- start 2024-02-21T07:43:44.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.001+0000 7f01eec24740 1 -- start start 2024-02-21T07:43:44.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.001+0000 7f01e1600640 1 -- 172.21.15.69:0/3835023795 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f01d80074f0 con 0x7f01e406eaa0 2024-02-21T07:43:44.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.002+0000 7f01e1600640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f01c409f130 0x7f01c40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.002+0000 7f01e1600640 1 -- 172.21.15.69:0/3835023795 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f01d80c91a0 con 0x7f01e406eaa0 2024-02-21T07:43:44.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01eec24740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10c390 0x55b88d10c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01eec24740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d147520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01eec24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d147a60 0x55b88d1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01eec24740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88d08c300 con 0x55b88d10ccb0 2024-02-21T07:43:44.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01eec24740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88d03ee50 con 0x55b88d10c390 2024-02-21T07:43:44.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01eec24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88d03c380 con 0x55b88d147a60 2024-02-21T07:43:44.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01e9e00640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f01c409f130 0x7f01c40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01e9400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10c390 0x55b88d10c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01e9400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10c390 0x55b88d10c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38950/0 (socket says 172.21.15.69:38950) 2024-02-21T07:43:44.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01e9400640 1 -- 172.21.15.69:0/1673213771 learned_addr learned my addr 172.21.15.69:0/1673213771 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01e8a00640 1 --2- 172.21.15.69:0/1673213771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01e9400640 1 -- 172.21.15.69:0/1673213771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d147a60 msgr2=0x55b88d1487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01e9400640 1 --2- 172.21.15.69:0/1673213771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d147a60 0x55b88d1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01e9400640 1 -- 172.21.15.69:0/1673213771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 msgr2=0x55b88d147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.003+0000 7f01e9400640 1 --2- 172.21.15.69:0/1673213771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.004+0000 7f01e9400640 1 -- 172.21.15.69:0/1673213771 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b88d000c80 con 0x55b88d10c390 2024-02-21T07:43:44.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.004+0000 7f01e8a00640 1 --2- 172.21.15.69:0/1673213771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:44.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.004+0000 7f01e9400640 1 --2- 172.21.15.69:0/1673213771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10c390 0x55b88d10c770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f01d80c6aa0 tx=0x7f01d8096ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84a9bd3ab4e7f608 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.004+0000 7f01d5c00640 1 -- 172.21.15.69:0/1673213771 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d809f3d0 con 0x55b88d10c390 2024-02-21T07:43:44.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.004+0000 7f01d5c00640 1 -- 172.21.15.69:0/1673213771 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80c6c40 con 0x55b88d10c390 2024-02-21T07:43:44.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.004+0000 7f01d5c00640 1 -- 172.21.15.69:0/1673213771 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8096130 con 0x55b88d10c390 2024-02-21T07:43:44.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.005+0000 7f01eec24740 1 -- 172.21.15.69:0/1673213771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10c390 msgr2=0x55b88d10c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.005+0000 7f01eec24740 1 --2- 172.21.15.69:0/1673213771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10c390 0x55b88d10c770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f01d80c6aa0 tx=0x7f01d8096ce0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.005+0000 7f01e9e00640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f01c409f130 0x7f01c40a15f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01e4161890 tx=0x7f01dc0016b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.005+0000 7f01eec24740 1 -- 172.21.15.69:0/1673213771 shutdown_connections 2024-02-21T07:43:44.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.005+0000 7f01eec24740 1 --2- 172.21.15.69:0/1673213771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d147a60 0x55b88d1487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.005+0000 7f01eec24740 1 --2- 172.21.15.69:0/1673213771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.005+0000 7f01eec24740 1 --2- 172.21.15.69:0/1673213771 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10c390 0x55b88d10c770 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.005+0000 7f01eec24740 1 -- 172.21.15.69:0/1673213771 >> 172.21.15.69:0/1673213771 conn(0x55b88d0ce960 msgr2=0x55b88d0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.005+0000 7f01eec24740 1 -- 172.21.15.69:0/1673213771 shutdown_connections 2024-02-21T07:43:44.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.005+0000 7f01eec24740 1 -- 172.21.15.69:0/1673213771 wait complete. 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.006+0000 7f01eec24740 1 -- start start 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.006+0000 7f01eec24740 1 Processor -- start 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.007+0000 7f01eec24740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10ccb0 0x55b88d1522f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.007+0000 7f01eec24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d147a60 0x55b88d101810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.007+0000 7f01eec24740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d1053a0 0x55b88d150200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.007+0000 7f01eec24740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88d037b60 con 0x55b88d1053a0 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.007+0000 7f01eec24740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88cfdcfd0 con 0x55b88d10ccb0 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.007+0000 7f01eec24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88cfdcc70 con 0x55b88d147a60 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01eec24740 10 client.0 _ll_register_callbacks cb 0x55b88cd48c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e9400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10ccb0 0x55b88d1522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d1053a0 0x55b88d150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e9400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10ccb0 0x55b88d1522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38960/0 (socket says 172.21.15.69:38960) 2024-02-21T07:43:44.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e9400640 1 -- 172.21.15.69:0/2107901934 learned_addr learned my addr 172.21.15.69:0/2107901934 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e8a00640 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d147a60 0x55b88d101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e9400640 1 -- 172.21.15.69:0/2107901934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d147a60 msgr2=0x55b88d101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e9400640 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d147a60 0x55b88d101810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e9400640 1 -- 172.21.15.69:0/2107901934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d1053a0 msgr2=0x55b88d150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e9400640 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d1053a0 0x55b88d150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e9400640 1 -- 172.21.15.69:0/2107901934 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e421de20 con 0x55b88d10ccb0 2024-02-21T07:43:44.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.008+0000 7f01e8a00640 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d147a60 0x55b88d101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:44.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.009+0000 7f01e9400640 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10ccb0 0x55b88d1522f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f01d8094f90 tx=0x7f01d8000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e965eb1a9ec846c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.009+0000 7f01ca000640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:43:44.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.009+0000 7f01ca000640 1 -- 172.21.15.69:0/2107901934 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8092a30 con 0x55b88d10ccb0 2024-02-21T07:43:44.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.009+0000 7f01ca000640 1 -- 172.21.15.69:0/2107901934 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f01d8092b90 con 0x55b88d10ccb0 2024-02-21T07:43:44.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.009+0000 7f01eec24740 1 -- 172.21.15.69:0/2107901934 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b88cd37860 con 0x55b88d10ccb0 2024-02-21T07:43:44.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.009+0000 7f01ca000640 1 -- 172.21.15.69:0/2107901934 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01d8092d50 con 0x55b88d10ccb0 2024-02-21T07:43:44.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.009+0000 7f01eec24740 10 client.5533 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:44.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.009+0000 7f01eec24740 1 -- 172.21.15.69:0/2107901934 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55b88d0361e0 con 0x55b88d10ccb0 2024-02-21T07:43:44.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.010+0000 7f01ca000640 1 -- 172.21.15.69:0/2107901934 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80c4020 con 0x55b88d10ccb0 2024-02-21T07:43:44.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.010+0000 7f01ca000640 1 -- 172.21.15.69:0/2107901934 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01d8095ba0 con 0x55b88d10ccb0 2024-02-21T07:43:44.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.010+0000 7f01eec24740 10 client.5533 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:44.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.010+0000 7f01eec24740 10 client.5533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:44.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.010+0000 7f01eec24740 20 client.5533 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:44.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.010+0000 7f01eec24740 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b88d1529e0 0x55b88d150c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.010+0000 7f01eec24740 4 client.5533 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:44.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.010+0000 7f01eec24740 1 -- 172.21.15.69:0/2107901934 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b88cd88410 con 0x55b88d1529e0 2024-02-21T07:43:44.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.010+0000 7f01e8a00640 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b88d1529e0 0x55b88d150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.011+0000 7f01e8a00640 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b88d1529e0 0x55b88d150c10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f1fd0faa723efab server_cookie=328b2a2b52cf2a38 in_seq=0 out_seq=0 2024-02-21T07:43:44.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.011+0000 7f01ca000640 10 client.5533 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:44.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01ca000640 1 -- 172.21.15.69:0/2107901934 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b88cd88410 con 0x55b88d1529e0 2024-02-21T07:43:44.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01ca000640 10 client.5533 handle_command_reply: tid=0 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01eec24740 1 client.5533 shutdown 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01eec24740 1 -- 172.21.15.69:0/2107901934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10ccb0 msgr2=0x55b88d1522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01eec24740 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10ccb0 0x55b88d1522f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f01d8094f90 tx=0x7f01d8000ed0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01eec24740 1 -- 172.21.15.69:0/2107901934 shutdown_connections 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01eec24740 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b88d1529e0 0x55b88d150c10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01eec24740 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d1053a0 0x55b88d150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01eec24740 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d147a60 0x55b88d101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01eec24740 1 --2- 172.21.15.69:0/2107901934 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d10ccb0 0x55b88d1522f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01eec24740 1 -- 172.21.15.69:0/2107901934 >> 172.21.15.69:0/2107901934 conn(0x55b88d10c390 msgr2=0x55b88d146950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.012+0000 7f01ca000640 0 client.5533 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.013+0000 7f01eec24740 1 -- 172.21.15.69:0/2107901934 shutdown_connections 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.013+0000 7f01eec24740 1 -- 172.21.15.69:0/2107901934 wait complete. 2024-02-21T07:43:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.013+0000 7f01eec24740 20 client.5533 trim_cache size 0 max 16384 2024-02-21T07:43:44.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.029+0000 7f01eec24740 1 Processor -- start 2024-02-21T07:43:44.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.029+0000 7f01eec24740 1 -- start start 2024-02-21T07:43:44.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.030+0000 7f01eec24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d1053a0 0x55b88d10c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.030+0000 7f01eec24740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d104af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.030+0000 7f01eec24740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d147a60 0x55b88d114c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.030+0000 7f01eec24740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88cd800c0 con 0x55b88d10ccb0 2024-02-21T07:43:44.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.030+0000 7f01eec24740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88d143ec0 con 0x55b88d147a60 2024-02-21T07:43:44.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.030+0000 7f01eec24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88d0cdb40 con 0x55b88d1053a0 2024-02-21T07:43:44.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.030+0000 7f01e8a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.030+0000 7f01e9400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d1053a0 0x55b88d10c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.030+0000 7f01e8a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d104af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48900/0 (socket says 172.21.15.69:48900) 2024-02-21T07:43:44.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.030+0000 7f01e8a00640 1 -- 172.21.15.69:0/3568095268 learned_addr learned my addr 172.21.15.69:0/3568095268 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.031+0000 7f01e9e00640 1 --2- 172.21.15.69:0/3568095268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d147a60 0x55b88d114c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.031+0000 7f01e9400640 1 -- 172.21.15.69:0/3568095268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d147a60 msgr2=0x55b88d114c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.031+0000 7f01e9400640 1 --2- 172.21.15.69:0/3568095268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d147a60 0x55b88d114c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.031+0000 7f01e9400640 1 -- 172.21.15.69:0/3568095268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 msgr2=0x55b88d104af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.031+0000 7f01e9400640 1 --2- 172.21.15.69:0/3568095268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d104af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.031+0000 7f01e9400640 1 -- 172.21.15.69:0/3568095268 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b88cfd2a90 con 0x55b88d1053a0 2024-02-21T07:43:44.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.031+0000 7f01e8a00640 1 --2- 172.21.15.69:0/3568095268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:44.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.031+0000 7f01e9400640 1 --2- 172.21.15.69:0/3568095268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d1053a0 0x55b88d10c770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f01d800cdc0 tx=0x7f01d80ad070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=657b3bbf6533b28c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.032+0000 7f01d5200640 1 -- 172.21.15.69:0/3568095268 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d800e040 con 0x55b88d1053a0 2024-02-21T07:43:44.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.032+0000 7f01d5200640 1 -- 172.21.15.69:0/3568095268 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80c4040 con 0x55b88d1053a0 2024-02-21T07:43:44.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.032+0000 7f01d5200640 1 -- 172.21.15.69:0/3568095268 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d809f3d0 con 0x55b88d1053a0 2024-02-21T07:43:44.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.032+0000 7f01eec24740 1 -- 172.21.15.69:0/3568095268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d1053a0 msgr2=0x55b88d10c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.032+0000 7f01eec24740 1 --2- 172.21.15.69:0/3568095268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d1053a0 0x55b88d10c770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f01d800cdc0 tx=0x7f01d80ad070 comp rx=0 tx=0).stop 2024-02-21T07:43:44.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.032+0000 7f01eec24740 1 -- 172.21.15.69:0/3568095268 shutdown_connections 2024-02-21T07:43:44.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.032+0000 7f01eec24740 1 --2- 172.21.15.69:0/3568095268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d147a60 0x55b88d114c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.032+0000 7f01eec24740 1 --2- 172.21.15.69:0/3568095268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d10ccb0 0x55b88d104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.032+0000 7f01eec24740 1 --2- 172.21.15.69:0/3568095268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d1053a0 0x55b88d10c770 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.032+0000 7f01eec24740 1 -- 172.21.15.69:0/3568095268 >> 172.21.15.69:0/3568095268 conn(0x55b88d10c390 msgr2=0x55b88d101620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.033+0000 7f01eec24740 1 -- 172.21.15.69:0/3568095268 shutdown_connections 2024-02-21T07:43:44.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.033+0000 7f01eec24740 1 -- 172.21.15.69:0/3568095268 wait complete. 2024-02-21T07:43:44.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.033+0000 7f01eec24740 1 -- start start 2024-02-21T07:43:44.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.034+0000 7f01eec24740 1 Processor -- start 2024-02-21T07:43:44.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01eec24740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d1053a0 0x55b88d10bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01eec24740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d10ccb0 0x55b88d1457e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01eec24740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d147a60 0x55b88d19e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01eec24740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88d0fa420 con 0x55b88d147a60 2024-02-21T07:43:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01eec24740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88d19ed40 con 0x55b88d1053a0 2024-02-21T07:43:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01eec24740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b88d0cc2e0 con 0x55b88d10ccb0 2024-02-21T07:43:44.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01eec24740 10 client.0 _ll_register_callbacks cb 0x7f01d8007820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01e8a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d10ccb0 0x55b88d1457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01e8a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d10ccb0 0x55b88d1457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49508/0 (socket says 172.21.15.69:49508) 2024-02-21T07:43:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01e8a00640 1 -- 172.21.15.69:0/919383260 learned_addr learned my addr 172.21.15.69:0/919383260 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01e9400640 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d1053a0 0x55b88d10bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.035+0000 7f01e9e00640 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d147a60 0x55b88d19e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.036+0000 7f01e9e00640 1 -- 172.21.15.69:0/919383260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d10ccb0 msgr2=0x55b88d1457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.036+0000 7f01e9e00640 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d10ccb0 0x55b88d1457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.036+0000 7f01e9e00640 1 -- 172.21.15.69:0/919383260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d1053a0 msgr2=0x55b88d10bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.036+0000 7f01e9e00640 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d1053a0 0x55b88d10bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.036+0000 7f01e9e00640 1 -- 172.21.15.69:0/919383260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e418aab0 con 0x55b88d147a60 2024-02-21T07:43:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.036+0000 7f01e9400640 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d1053a0 0x55b88d10bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.036+0000 7f01e9e00640 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d147a60 0x55b88d19e800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f01dc007fd0 tx=0x7f01dc001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be454df6771528e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.036+0000 7f01ca000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.037+0000 7f01ca000640 1 -- 172.21.15.69:0/919383260 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc024480 con 0x55b88d147a60 2024-02-21T07:43:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.037+0000 7f01ca000640 1 -- 172.21.15.69:0/919383260 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f01dc01d040 con 0x55b88d147a60 2024-02-21T07:43:44.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.037+0000 7f01eec24740 1 -- 172.21.15.69:0/919383260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01d80c6c40 con 0x55b88d147a60 2024-02-21T07:43:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.037+0000 7f01ca000640 1 -- 172.21.15.69:0/919383260 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01dc0245e0 con 0x55b88d147a60 2024-02-21T07:43:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.037+0000 7f01eec24740 10 client.5355 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.037+0000 7f01eec24740 1 -- 172.21.15.69:0/919383260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55b88d0361e0 con 0x55b88d147a60 2024-02-21T07:43:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.037+0000 7f01ca000640 1 -- 172.21.15.69:0/919383260 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d80c6c40 con 0x55b88d147a60 2024-02-21T07:43:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.038+0000 7f01ca000640 1 -- 172.21.15.69:0/919383260 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f01dc02b060 con 0x55b88d147a60 2024-02-21T07:43:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.038+0000 7f01eec24740 10 client.5355 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.038+0000 7f01eec24740 10 client.5355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.038+0000 7f01eec24740 20 client.5355 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.038+0000 7f01eec24740 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b88d151e40 0x55b88d0fa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.038+0000 7f01eec24740 4 client.5355 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:43:44.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.038+0000 7f01eec24740 1 -- 172.21.15.69:0/919383260 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b88cd747b0 con 0x55b88d151e40 2024-02-21T07:43:44.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.038+0000 7f01e9400640 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b88d151e40 0x55b88d0fa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.039+0000 7f01ca000640 10 client.5355 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:44.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.039+0000 7f01e9400640 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b88d151e40 0x55b88d0fa840 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfeada72e7af746a server_cookie=d44d0c8a4bb3e9cb in_seq=0 out_seq=0 2024-02-21T07:43:44.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.040+0000 7f01ca000640 1 -- 172.21.15.69:0/919383260 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b88cd747b0 con 0x55b88d151e40 2024-02-21T07:43:44.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.040+0000 7f01ca000640 10 client.5355 handle_command_reply: tid=0 2024-02-21T07:43:44.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.040+0000 7f01eec24740 1 client.5355 shutdown 2024-02-21T07:43:44.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01eec24740 1 -- 172.21.15.69:0/919383260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d147a60 msgr2=0x55b88d19e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01eec24740 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d147a60 0x55b88d19e800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f01dc007fd0 tx=0x7f01dc001400 comp rx=0 tx=0).stop 2024-02-21T07:43:44.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01eec24740 1 -- 172.21.15.69:0/919383260 shutdown_connections 2024-02-21T07:43:44.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01eec24740 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b88d151e40 0x55b88d0fa840 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01eec24740 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b88d147a60 0x55b88d19e800 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01eec24740 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b88d10ccb0 0x55b88d1457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01eec24740 1 --2- 172.21.15.69:0/919383260 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b88d1053a0 0x55b88d10bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01eec24740 1 -- 172.21.15.69:0/919383260 >> 172.21.15.69:0/919383260 conn(0x55b88d10c390 msgr2=0x55b88d160fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01ca000640 0 client.5355 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:44.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01eec24740 1 -- 172.21.15.69:0/919383260 shutdown_connections 2024-02-21T07:43:44.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.041+0000 7f01eec24740 1 -- 172.21.15.69:0/919383260 wait complete. 2024-02-21T07:43:44.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.042+0000 7f01eec24740 20 client.5355 trim_cache size 0 max 16384 2024-02-21T07:43:44.048 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:43:44.048 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-02-21T07:43:44.048 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "caac8896-a3d3-461a-8763-f4b52ef7f7d4", 2024-02-21T07:43:44.048 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-02-21T07:43:44.049 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:43:44.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.042+0000 7f01ea800640 1 -- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f01c409f130 msgr2=0x7f01c40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.042+0000 7f01ea800640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f01c409f130 0x7f01c40a15f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f01e4161890 tx=0x7f01dc0016b0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.042+0000 7f01ea800640 1 -- 172.21.15.69:0/3835023795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01e406eaa0 msgr2=0x7f01e4176520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.042+0000 7f01ea800640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01e406eaa0 0x7f01e4176520 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f01d800c400 tx=0x7f01d800c8c0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.043+0000 7f01ea800640 1 -- 172.21.15.69:0/3835023795 shutdown_connections 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.043+0000 7f01ea800640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f01c409f130 0x7f01c40a15f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.043+0000 7f01ea800640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f01e418a620 0x7f01e421c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.043+0000 7f01ea800640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01e4183e60 0x7f01e4176a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.043+0000 7f01ea800640 1 --2- 172.21.15.69:0/3835023795 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01e406eaa0 0x7f01e4176520 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.043+0000 7f01ea800640 1 -- 172.21.15.69:0/3835023795 >> 172.21.15.69:0/3835023795 conn(0x7f01e40cf360 msgr2=0x7f01e40c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.043+0000 7f01ea800640 1 -- 172.21.15.69:0/3835023795 shutdown_connections 2024-02-21T07:43:44.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.043+0000 7f01ea800640 1 -- 172.21.15.69:0/3835023795 wait complete. 2024-02-21T07:43:44.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:43:44.074 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:43:44.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.240+0000 7f6734c00640 1 Processor -- start 2024-02-21T07:43:44.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.240+0000 7f6734c00640 1 -- start start 2024-02-21T07:43:44.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.241+0000 7f6734c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6730183e30 0x7f6730184530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.241+0000 7f6734c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f67300f2020 0x7f67301868f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.241+0000 7f6734c00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6730184210 con 0x7f67301861f0 2024-02-21T07:43:44.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.241+0000 7f6734c00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6730184e70 con 0x7f6730183e30 2024-02-21T07:43:44.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.241+0000 7f6734c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6730185150 con 0x7f67300f2020 2024-02-21T07:43:44.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.242+0000 7f672f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6730183e30 0x7f6730184530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.242+0000 7f672f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6730183e30 0x7f6730184530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48930/0 (socket says 172.21.15.69:48930) 2024-02-21T07:43:44.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.242+0000 7f672f400640 1 -- 172.21.15.69:0/55919072 learned_addr learned my addr 172.21.15.69:0/55919072 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.242+0000 7f672fe00640 1 --2- 172.21.15.69:0/55919072 >> v2:172.21.15.174:3300/0 conn(0x7f67300f2020 0x7f67301868f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.242+0000 7f672f400640 1 -- 172.21.15.69:0/55919072 >> v2:172.21.15.174:3300/0 conn(0x7f67300f2020 msgr2=0x7f67301868f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.242+0000 7f672f400640 1 --2- 172.21.15.69:0/55919072 >> v2:172.21.15.174:3300/0 conn(0x7f67300f2020 0x7f67301868f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.242+0000 7f672f400640 1 -- 172.21.15.69:0/55919072 >> v1:172.21.15.174:6789/0 conn(0x7f67301861f0 legacy=0x7f67300f1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.242+0000 7f672f400640 1 -- 172.21.15.69:0/55919072 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6730185430 con 0x7f6730183e30 2024-02-21T07:43:44.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.242+0000 7f672fe00640 1 --2- 172.21.15.69:0/55919072 >> v2:172.21.15.174:3300/0 conn(0x7f67300f2020 0x7f67301868f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:44.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.244+0000 7f672f400640 1 --2- 172.21.15.69:0/55919072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6730183e30 0x7f6730184530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f67300f0d20 tx=0x7f672002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c17b40ac01f6e3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.244+0000 7f672e000640 1 -- 172.21.15.69:0/55919072 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720031870 con 0x7f6730183e30 2024-02-21T07:43:44.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.244+0000 7f672e000640 1 -- 172.21.15.69:0/55919072 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67200319d0 con 0x7f6730183e30 2024-02-21T07:43:44.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.244+0000 7f672e000640 1 -- 172.21.15.69:0/55919072 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720031d60 con 0x7f6730183e30 2024-02-21T07:43:44.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.245+0000 7f6734c00640 1 -- 172.21.15.69:0/55919072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6730183e30 msgr2=0x7f6730184530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.245+0000 7f6734c00640 1 --2- 172.21.15.69:0/55919072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6730183e30 0x7f6730184530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f67300f0d20 tx=0x7f672002b910 comp rx=0 tx=0).stop 2024-02-21T07:43:44.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.245+0000 7f6734c00640 1 -- 172.21.15.69:0/55919072 shutdown_connections 2024-02-21T07:43:44.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.245+0000 7f6734c00640 1 --2- 172.21.15.69:0/55919072 >> v2:172.21.15.174:3300/0 conn(0x7f67300f2020 0x7f67301868f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.245+0000 7f6734c00640 1 --2- 172.21.15.69:0/55919072 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6730183e30 0x7f6730184530 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.245+0000 7f6734c00640 1 -- 172.21.15.69:0/55919072 >> 172.21.15.69:0/55919072 conn(0x7f67300ce190 msgr2=0x7f67300ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.245+0000 7f6734c00640 1 -- 172.21.15.69:0/55919072 shutdown_connections 2024-02-21T07:43:44.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.245+0000 7f6734c00640 1 -- 172.21.15.69:0/55919072 wait complete. 2024-02-21T07:43:44.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.247+0000 7f6734c00640 1 Processor -- start 2024-02-21T07:43:44.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.247+0000 7f6734c00640 1 -- start start 2024-02-21T07:43:44.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f6734c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67300f2020 0x7f67300cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f6734c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6730183e30 0x7f673016af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f6734c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67301861f0 0x7f6730221bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f6734c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6730216ee0 con 0x7f67301861f0 2024-02-21T07:43:44.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f6734c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6730220840 con 0x7f67300f2020 2024-02-21T07:43:44.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f6734c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6730220b20 con 0x7f6730183e30 2024-02-21T07:43:44.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f672fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67301861f0 0x7f6730221bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f672ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6730183e30 0x7f673016af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f672f400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67300f2020 0x7f67300cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f672ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6730183e30 0x7f673016af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49514/0 (socket says 172.21.15.69:49514) 2024-02-21T07:43:44.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.249+0000 7f672ea00640 1 -- 172.21.15.69:0/1320615183 learned_addr learned my addr 172.21.15.69:0/1320615183 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.250+0000 7f672fe00640 1 -- 172.21.15.69:0/1320615183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6730183e30 msgr2=0x7f673016af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.250+0000 7f672fe00640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6730183e30 0x7f673016af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.250+0000 7f672fe00640 1 -- 172.21.15.69:0/1320615183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67300f2020 msgr2=0x7f67300cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.250+0000 7f672fe00640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67300f2020 0x7f67300cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.250+0000 7f672fe00640 1 -- 172.21.15.69:0/1320615183 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200094d0 con 0x7f67301861f0 2024-02-21T07:43:44.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.250+0000 7f672fe00640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67301861f0 0x7f6730221bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6728007d10 tx=0x7f672800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.250+0000 7f6727400640 1 -- 172.21.15.69:0/1320615183 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728003990 con 0x7f67301861f0 2024-02-21T07:43:44.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.250+0000 7f6727400640 1 -- 172.21.15.69:0/1320615183 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672800f040 con 0x7f67301861f0 2024-02-21T07:43:44.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.250+0000 7f6727400640 1 -- 172.21.15.69:0/1320615183 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728003d10 con 0x7f67301861f0 2024-02-21T07:43:44.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.250+0000 7f6734c00640 1 -- 172.21.15.69:0/1320615183 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6730220e00 con 0x7f67301861f0 2024-02-21T07:43:44.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.251+0000 7f6734c00640 1 -- 172.21.15.69:0/1320615183 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67302213c0 con 0x7f67301861f0 2024-02-21T07:43:44.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.255+0000 7f6738f9f740 1 Processor -- start 2024-02-21T07:43:44.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.256+0000 7f6727400640 1 -- 172.21.15.69:0/1320615183 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f6728004030 con 0x7f67301861f0 2024-02-21T07:43:44.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.256+0000 7f6738f9f740 1 -- start start 2024-02-21T07:43:44.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff375c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f6727400640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f671009f130 0x7f67100a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff340570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff340ab0 0x561bff3030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f6738f9f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff277150 con 0x561bff376150 2024-02-21T07:43:44.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f6738f9f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff274680 con 0x561bff340ab0 2024-02-21T07:43:44.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f6738f9f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff26fe60 con 0x561bff340190 2024-02-21T07:43:44.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f6727400640 1 -- 172.21.15.69:0/1320615183 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f67280c9e90 con 0x7f67301861f0 2024-02-21T07:43:44.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f672ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff340570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f672f400640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f671009f130 0x7f67100a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f672ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff340570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48962/0 (socket says 172.21.15.69:48962) 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f672ea00640 1 -- 172.21.15.69:0/1425276456 learned_addr learned my addr 172.21.15.69:0/1425276456 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f672fe00640 1 --2- 172.21.15.69:0/1425276456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff340ab0 0x561bff3030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.258+0000 7f672ea00640 1 --2- 172.21.15.69:0/1425276456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff375c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.259+0000 7f672ea00640 1 -- 172.21.15.69:0/1425276456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 msgr2=0x561bff375c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.259+0000 7f672ea00640 1 --2- 172.21.15.69:0/1425276456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff375c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.259+0000 7f672ea00640 1 -- 172.21.15.69:0/1425276456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff340ab0 msgr2=0x561bff3030c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.259+0000 7f672ea00640 1 --2- 172.21.15.69:0/1425276456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff340ab0 0x561bff3030c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.259+0000 7f672ea00640 1 -- 172.21.15.69:0/1425276456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bff229060 con 0x561bff376150 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.259+0000 7f672ea00640 1 --2- 172.21.15.69:0/1425276456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff340570 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f671c001bf0 tx=0x7f671c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910f4a22c15db775 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.259+0000 7f672f400640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f671009f130 0x7f67100a15f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6720036000 tx=0x7f672003c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.259+0000 7f671b400640 1 -- 172.21.15.69:0/1425276456 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c005310 con 0x561bff376150 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.259+0000 7f671b400640 1 -- 172.21.15.69:0/1425276456 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c005470 con 0x561bff376150 2024-02-21T07:43:44.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.260+0000 7f671b400640 1 -- 172.21.15.69:0/1425276456 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c007230 con 0x561bff376150 2024-02-21T07:43:44.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.260+0000 7f6738f9f740 1 -- 172.21.15.69:0/1425276456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 msgr2=0x561bff340570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.260+0000 7f6738f9f740 1 --2- 172.21.15.69:0/1425276456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff340570 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f671c001bf0 tx=0x7f671c007ec0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.260+0000 7f6738f9f740 1 -- 172.21.15.69:0/1425276456 shutdown_connections 2024-02-21T07:43:44.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.260+0000 7f6738f9f740 1 --2- 172.21.15.69:0/1425276456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff340ab0 0x561bff3030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.260+0000 7f6738f9f740 1 --2- 172.21.15.69:0/1425276456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff340570 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.260+0000 7f6738f9f740 1 --2- 172.21.15.69:0/1425276456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff375c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.260+0000 7f6738f9f740 1 -- 172.21.15.69:0/1425276456 >> 172.21.15.69:0/1425276456 conn(0x561bff2cf5a0 msgr2=0x561bff307080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.261+0000 7f6738f9f740 1 -- 172.21.15.69:0/1425276456 shutdown_connections 2024-02-21T07:43:44.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.261+0000 7f6738f9f740 1 -- 172.21.15.69:0/1425276456 wait complete. 2024-02-21T07:43:44.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.261+0000 7f6738f9f740 1 -- start start 2024-02-21T07:43:44.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.262+0000 7f6738f9f740 1 Processor -- start 2024-02-21T07:43:44.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340190 0x561bff3736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340ab0 0x561bff33e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 0x561bff301b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f6738f9f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff214ec0 con 0x561bff340190 2024-02-21T07:43:44.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f6738f9f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff214b60 con 0x561bff376150 2024-02-21T07:43:44.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f6738f9f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bfefde1c0 con 0x561bff340ab0 2024-02-21T07:43:44.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f6738f9f740 10 client.0 _ll_register_callbacks cb 0x561bff228960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:44.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f672f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340190 0x561bff3736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f672f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340190 0x561bff3736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48970/0 (socket says 172.21.15.69:48970) 2024-02-21T07:43:44.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f672f400640 1 -- 172.21.15.69:0/3094988985 learned_addr learned my addr 172.21.15.69:0/3094988985 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f672fe00640 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 0x561bff301b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.263+0000 7f672ea00640 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340ab0 0x561bff33e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.264+0000 7f672f400640 1 -- 172.21.15.69:0/3094988985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340ab0 msgr2=0x561bff33e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.264+0000 7f672f400640 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340ab0 0x561bff33e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.264+0000 7f672f400640 1 -- 172.21.15.69:0/3094988985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 msgr2=0x561bff301b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.264+0000 7f672f400640 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 0x561bff301b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.264+0000 7f672f400640 1 -- 172.21.15.69:0/3094988985 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6730184210 con 0x561bff340190 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.264+0000 7f672fe00640 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 0x561bff301b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.264+0000 7f672f400640 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340190 0x561bff3736e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6720009930 tx=0x7f6720004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f301b1c01c766ce6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.264+0000 7f670fe00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.264+0000 7f670fe00640 1 -- 172.21.15.69:0/3094988985 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720030850 con 0x561bff340190 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.264+0000 7f670fe00640 1 -- 172.21.15.69:0/3094988985 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f672004b070 con 0x561bff340190 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.265+0000 7f6738f9f740 1 -- 172.21.15.69:0/3094988985 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bfef6f7e0 con 0x561bff340190 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.265+0000 7f670fe00640 1 -- 172.21.15.69:0/3094988985 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67200309b0 con 0x561bff340190 2024-02-21T07:43:44.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.265+0000 7f6738f9f740 10 client.5367 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:44.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.265+0000 7f6738f9f740 1 -- 172.21.15.69:0/3094988985 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x561bff26e4e0 con 0x561bff340190 2024-02-21T07:43:44.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.265+0000 7f670fe00640 1 -- 172.21.15.69:0/3094988985 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561bfef6f7e0 con 0x561bff340190 2024-02-21T07:43:44.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.265+0000 7f670fe00640 1 -- 172.21.15.69:0/3094988985 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6720030b10 con 0x561bff340190 2024-02-21T07:43:44.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.266+0000 7f6738f9f740 10 client.5367 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:44.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.266+0000 7f6738f9f740 10 client.5367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:44.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.266+0000 7f6738f9f740 20 client.5367 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:44.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.266+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561bff336100 0x561bff33ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.266+0000 7f6738f9f740 4 client.5367 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:44.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.266+0000 7f6738f9f740 1 -- 172.21.15.69:0/3094988985 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561bfefac720 con 0x561bff336100 2024-02-21T07:43:44.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.266+0000 7f672ea00640 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561bff336100 0x561bff33ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.267+0000 7f672ea00640 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561bff336100 0x561bff33ea90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cb1433280a0a32e server_cookie=a4befde2db230126 in_seq=0 out_seq=0 2024-02-21T07:43:44.274 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.267+0000 7f670fe00640 10 client.5367 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:44.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f670fe00640 1 -- 172.21.15.69:0/3094988985 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561bfefac720 con 0x561bff336100 2024-02-21T07:43:44.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f670fe00640 10 client.5367 handle_command_reply: tid=0 2024-02-21T07:43:44.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f6738f9f740 1 client.5367 shutdown 2024-02-21T07:43:44.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f6738f9f740 1 -- 172.21.15.69:0/3094988985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340190 msgr2=0x561bff3736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340190 0x561bff3736e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6720009930 tx=0x7f6720004730 comp rx=0 tx=0).stop 2024-02-21T07:43:44.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f6738f9f740 1 -- 172.21.15.69:0/3094988985 shutdown_connections 2024-02-21T07:43:44.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561bff336100 0x561bff33ea90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 0x561bff301b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340ab0 0x561bff33e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3094988985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340190 0x561bff3736e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f6738f9f740 1 -- 172.21.15.69:0/3094988985 >> 172.21.15.69:0/3094988985 conn(0x561bff2cf5a0 msgr2=0x561bff375a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f670fe00640 0 client.5367 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:44.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.270+0000 7f6738f9f740 1 -- 172.21.15.69:0/3094988985 shutdown_connections 2024-02-21T07:43:44.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.271+0000 7f6738f9f740 1 -- 172.21.15.69:0/3094988985 wait complete. 2024-02-21T07:43:44.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.271+0000 7f6738f9f740 20 client.5367 trim_cache size 0 max 16384 2024-02-21T07:43:44.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.287+0000 7f6738f9f740 1 Processor -- start 2024-02-21T07:43:44.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.287+0000 7f6738f9f740 1 -- start start 2024-02-21T07:43:44.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff371cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff340ab0 0x561bff3396f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff376530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f6738f9f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff305c10 con 0x561bff376150 2024-02-21T07:43:44.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f6738f9f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff373e40 con 0x561bff340ab0 2024-02-21T07:43:44.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f6738f9f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff306000 con 0x561bff340190 2024-02-21T07:43:44.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f672fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff376530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f672fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff376530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48984/0 (socket says 172.21.15.69:48984) 2024-02-21T07:43:44.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f672fe00640 1 -- 172.21.15.69:0/1481319652 learned_addr learned my addr 172.21.15.69:0/1481319652 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f672f400640 1 --2- 172.21.15.69:0/1481319652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff371cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.288+0000 7f672ea00640 1 --2- 172.21.15.69:0/1481319652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff340ab0 0x561bff3396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.289+0000 7f672fe00640 1 -- 172.21.15.69:0/1481319652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 msgr2=0x561bff371cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.289+0000 7f672fe00640 1 --2- 172.21.15.69:0/1481319652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff371cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.289+0000 7f672fe00640 1 -- 172.21.15.69:0/1481319652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff340ab0 msgr2=0x561bff3396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.289+0000 7f672fe00640 1 --2- 172.21.15.69:0/1481319652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff340ab0 0x561bff3396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.289+0000 7f672fe00640 1 -- 172.21.15.69:0/1481319652 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bff20a950 con 0x561bff376150 2024-02-21T07:43:44.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.289+0000 7f672f400640 1 --2- 172.21.15.69:0/1481319652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff371cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:44.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.289+0000 7f672fe00640 1 --2- 172.21.15.69:0/1481319652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff376530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f67280c7c80 tx=0x7f6728097f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518068584484cd48 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.289+0000 7f671aa00640 1 -- 172.21.15.69:0/1481319652 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280a0010 con 0x561bff376150 2024-02-21T07:43:44.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.289+0000 7f671aa00640 1 -- 172.21.15.69:0/1481319652 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280c7990 con 0x561bff376150 2024-02-21T07:43:44.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.289+0000 7f671aa00640 1 -- 172.21.15.69:0/1481319652 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728097ad0 con 0x561bff376150 2024-02-21T07:43:44.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.290+0000 7f6738f9f740 1 -- 172.21.15.69:0/1481319652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 msgr2=0x561bff376530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.290+0000 7f6738f9f740 1 --2- 172.21.15.69:0/1481319652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff376530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f67280c7c80 tx=0x7f6728097f70 comp rx=0 tx=0).stop 2024-02-21T07:43:44.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.290+0000 7f6738f9f740 1 -- 172.21.15.69:0/1481319652 shutdown_connections 2024-02-21T07:43:44.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.290+0000 7f6738f9f740 1 --2- 172.21.15.69:0/1481319652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff376150 0x561bff376530 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.290+0000 7f6738f9f740 1 --2- 172.21.15.69:0/1481319652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff340ab0 0x561bff3396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.290+0000 7f6738f9f740 1 --2- 172.21.15.69:0/1481319652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff371cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.290+0000 7f6738f9f740 1 -- 172.21.15.69:0/1481319652 >> 172.21.15.69:0/1481319652 conn(0x561bff2cf5a0 msgr2=0x561bff3728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.290+0000 7f6738f9f740 1 -- 172.21.15.69:0/1481319652 shutdown_connections 2024-02-21T07:43:44.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.290+0000 7f6738f9f740 1 -- 172.21.15.69:0/1481319652 wait complete. 2024-02-21T07:43:44.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.291+0000 7f6738f9f740 1 -- start start 2024-02-21T07:43:44.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.292+0000 7f6738f9f740 1 Processor -- start 2024-02-21T07:43:44.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff304270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340ab0 0x561bff370390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f6738f9f740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 0x561bff3708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f6738f9f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff303e50 con 0x561bff340ab0 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f6738f9f740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff388590 con 0x561bff376150 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f6738f9f740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bff388cb0 con 0x561bff340190 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f6738f9f740 10 client.0 _ll_register_callbacks cb 0x7f67200096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f672f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff304270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f672f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff304270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49548/0 (socket says 172.21.15.69:49548) 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f672f400640 1 -- 172.21.15.69:0/3032426988 learned_addr learned my addr 172.21.15.69:0/3032426988 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.294+0000 7f672fe00640 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 0x561bff3708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.295+0000 7f672ea00640 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340ab0 0x561bff370390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.295+0000 7f672f400640 1 -- 172.21.15.69:0/3032426988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 msgr2=0x561bff3708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.295+0000 7f672f400640 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 0x561bff3708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.295+0000 7f672f400640 1 -- 172.21.15.69:0/3032426988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340ab0 msgr2=0x561bff370390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:44.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.295+0000 7f672f400640 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340ab0 0x561bff370390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.295+0000 7f672f400640 1 -- 172.21.15.69:0/3032426988 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561bff26e4e0 con 0x561bff340190 2024-02-21T07:43:44.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.295+0000 7f672f400640 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff304270 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f67200047b0 tx=0x7f6720009240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc395d47c354a3ab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:44.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.295+0000 7f670fe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:43:44.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.295+0000 7f670fe00640 1 -- 172.21.15.69:0/3032426988 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720004220 con 0x561bff340190 2024-02-21T07:43:44.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.295+0000 7f670fe00640 1 -- 172.21.15.69:0/3032426988 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f672004b030 con 0x561bff340190 2024-02-21T07:43:44.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.296+0000 7f6738f9f740 1 -- 172.21.15.69:0/3032426988 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f671c005470 con 0x561bff340190 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.296+0000 7f670fe00640 1 -- 172.21.15.69:0/3032426988 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6720004380 con 0x561bff340190 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.296+0000 7f6738f9f740 10 client.5510 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.296+0000 7f6738f9f740 1 -- 172.21.15.69:0/3032426988 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x7f67302213c0 con 0x561bff340190 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.296+0000 7f670fe00640 1 -- 172.21.15.69:0/3032426988 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720068020 con 0x561bff340190 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.296+0000 7f670fe00640 1 -- 172.21.15.69:0/3032426988 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6720050760 con 0x561bff340190 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.296+0000 7f6738f9f740 10 client.5510 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.296+0000 7f6738f9f740 10 client.5510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.297+0000 7f6738f9f740 20 client.5510 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.297+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561bff390820 0x561bff370e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.297+0000 7f6738f9f740 4 client.5510 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.297+0000 7f6738f9f740 1 -- 172.21.15.69:0/3032426988 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f671c005470 con 0x561bff390820 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.297+0000 7f672ea00640 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561bff390820 0x561bff370e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.297+0000 7f672ea00640 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561bff390820 0x561bff370e10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b303de46b9e1eae server_cookie=a4bd3c51f4941be0 in_seq=0 out_seq=0 2024-02-21T07:43:44.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.297+0000 7f670fe00640 10 client.5510 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f670fe00640 1 -- 172.21.15.69:0/3032426988 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7f671c005470 con 0x561bff390820 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f670fe00640 10 client.5510 handle_command_reply: tid=0 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 client.5510 shutdown 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 -- 172.21.15.69:0/3032426988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 msgr2=0x561bff304270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff304270 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f67200047b0 tx=0x7f6720009240 comp rx=0 tx=0).stop 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 -- 172.21.15.69:0/3032426988 shutdown_connections 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561bff390820 0x561bff370e10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561bff376150 0x561bff3708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bff340ab0 0x561bff370390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f670fe00640 0 client.5510 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 --2- 172.21.15.69:0/3032426988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561bff340190 0x561bff304270 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 -- 172.21.15.69:0/3032426988 >> 172.21.15.69:0/3032426988 conn(0x561bff2cf5a0 msgr2=0x561bff3396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 -- 172.21.15.69:0/3032426988 shutdown_connections 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.298+0000 7f6738f9f740 1 -- 172.21.15.69:0/3032426988 wait complete. 2024-02-21T07:43:44.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.299+0000 7f6738f9f740 20 client.5510 trim_cache size 0 max 16384 2024-02-21T07:43:44.307 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:43:44.307 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T07:43:44.307 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2024-02-21T07:43:44.307 INFO:teuthology.orchestra.run.smithi069.stdout: "caac8896-a3d3-461a-8763-f4b52ef7f7d4": { 2024-02-21T07:43:44.307 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2024-02-21T07:43:44.307 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "caac8896-a3d3-461a-8763-f4b52ef7f7d4", 2024-02-21T07:43:44.307 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2024-02-21T07:43:44.307 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:43:44.307 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:43:44.308 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:43:44.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.299+0000 7f6734c00640 1 -- 172.21.15.69:0/1320615183 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f671009f130 msgr2=0x7f67100a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.299+0000 7f6734c00640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f671009f130 0x7f67100a15f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6720036000 tx=0x7f672003c040 comp rx=0 tx=0).stop 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.300+0000 7f6734c00640 1 -- 172.21.15.69:0/1320615183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67301861f0 msgr2=0x7f6730221bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.300+0000 7f6734c00640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67301861f0 0x7f6730221bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6728007d10 tx=0x7f672800d4a0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.300+0000 7f6734c00640 1 -- 172.21.15.69:0/1320615183 shutdown_connections 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.300+0000 7f6734c00640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f671009f130 0x7f67100a15f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.300+0000 7f6734c00640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67301861f0 0x7f6730221bc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.300+0000 7f6734c00640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6730183e30 0x7f673016af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.300+0000 7f6734c00640 1 --2- 172.21.15.69:0/1320615183 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f67300f2020 0x7f67300cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.300+0000 7f6734c00640 1 -- 172.21.15.69:0/1320615183 >> 172.21.15.69:0/1320615183 conn(0x7f67300ce190 msgr2=0x7f6730181da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.300+0000 7f6734c00640 1 -- 172.21.15.69:0/1320615183 shutdown_connections 2024-02-21T07:43:44.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:43:44.300+0000 7f6734c00640 1 -- 172.21.15.69:0/1320615183 wait complete. 2024-02-21T07:43:44.329 INFO:tasks.cephfs.filesystem:scrub status for tag:caac8896-a3d3-461a-8763-f4b52ef7f7d4 - {'path': '/', 'tag': 'caac8896-a3d3-461a-8763-f4b52ef7f7d4', 'options': 'recursive,force'} 2024-02-21T07:43:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.402+0000 7fe9f8e00640 1 Processor -- start 2024-02-21T07:43:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.402+0000 7fe9f8e00640 1 -- start start 2024-02-21T07:43:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.405+0000 7fe9f8e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe9f40fb210 0x7fe9f40cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.405+0000 7fe9f8e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe9f40cfc90 0x7fe9f41604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.405+0000 7fe9f8e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f40fb670 con 0x7fe9f415a540 2024-02-21T07:43:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.405+0000 7fe9f8e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f40fb900 con 0x7fe9f40cfc90 2024-02-21T07:43:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.405+0000 7fe9f8e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f40ce990 con 0x7fe9f40fb210 2024-02-21T07:43:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.405+0000 7fe9f3400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe9f415a540 0x7fe9f40fab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40594/0 (socket says 172.21.15.69:40594) 2024-02-21T07:43:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.405+0000 7fe9f3400640 1 -- 172.21.15.69:0/3256089345 learned_addr learned my addr 172.21.15.69:0/3256089345 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:43:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.405+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3256089345 >> v2:172.21.15.184:3300/0 conn(0x7fe9f40fb210 0x7fe9f40cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.406+0000 7fe9f3e00640 1 --2- 172.21.15.69:0/3256089345 >> v2:172.21.15.69:3300/0 conn(0x7fe9f40cfc90 0x7fe9f41604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.406+0000 7fe9f2a00640 1 -- 172.21.15.69:0/3256089345 >> v2:172.21.15.69:3300/0 conn(0x7fe9f40cfc90 msgr2=0x7fe9f41604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.406+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3256089345 >> v2:172.21.15.69:3300/0 conn(0x7fe9f40cfc90 0x7fe9f41604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.406+0000 7fe9f2a00640 1 -- 172.21.15.69:0/3256089345 >> v1:172.21.15.69:6789/0 conn(0x7fe9f415a540 legacy=0x7fe9f40fab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.406+0000 7fe9f2a00640 1 -- 172.21.15.69:0/3256089345 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f40cec70 con 0x7fe9f40fb210 2024-02-21T07:43:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.407+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3256089345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 0x7fe9f40cf750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe9f417f820 tx=0x7fe9e002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=749e96cb5d037931 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.407+0000 7fe9f2000640 1 -- 172.21.15.69:0/3256089345 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0031830 con 0x7fe9f40fb210 2024-02-21T07:43:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.408+0000 7fe9f2000640 1 -- 172.21.15.69:0/3256089345 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e0031990 con 0x7fe9f40fb210 2024-02-21T07:43:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.408+0000 7fe9f2000640 1 -- 172.21.15.69:0/3256089345 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0031d20 con 0x7fe9f40fb210 2024-02-21T07:43:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.408+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3256089345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 msgr2=0x7fe9f40cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.408+0000 7fe9f8e00640 1 --2- 172.21.15.69:0/3256089345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 0x7fe9f40cf750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe9f417f820 tx=0x7fe9e002b8d0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.408+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3256089345 shutdown_connections 2024-02-21T07:43:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.408+0000 7fe9f8e00640 1 --2- 172.21.15.69:0/3256089345 >> v2:172.21.15.69:3300/0 conn(0x7fe9f40cfc90 0x7fe9f41604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.408+0000 7fe9f8e00640 1 --2- 172.21.15.69:0/3256089345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 0x7fe9f40cf750 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.408+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3256089345 >> 172.21.15.69:0/3256089345 conn(0x7fe9f40619b0 msgr2=0x7fe9f4061dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.409+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3256089345 shutdown_connections 2024-02-21T07:43:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.409+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3256089345 wait complete. 2024-02-21T07:43:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.411+0000 7fe9f8e00640 1 Processor -- start 2024-02-21T07:43:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.411+0000 7fe9f8e00640 1 -- start start 2024-02-21T07:43:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9f40cfc90 0x7fe9f4149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 0x7fe9f4158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f8e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9f415a540 0x7fe9f4158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f8e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f4220bc0 con 0x7fe9f415a540 2024-02-21T07:43:46.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f8e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f41598c0 con 0x7fe9f40cfc90 2024-02-21T07:43:46.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f8e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f4159ba0 con 0x7fe9f40fb210 2024-02-21T07:43:46.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9f415a540 0x7fe9f4158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f2a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 0x7fe9f4158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f2a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 0x7fe9f4158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49556/0 (socket says 172.21.15.69:49556) 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f2a00640 1 -- 172.21.15.69:0/3392373752 learned_addr learned my addr 172.21.15.69:0/3392373752 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.412+0000 7fe9f3400640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9f40cfc90 0x7fe9f4149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.413+0000 7fe9f2a00640 1 -- 172.21.15.69:0/3392373752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9f40cfc90 msgr2=0x7fe9f4149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.413+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9f40cfc90 0x7fe9f4149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.413+0000 7fe9f2a00640 1 -- 172.21.15.69:0/3392373752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9f415a540 msgr2=0x7fe9f4158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.413+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9f415a540 0x7fe9f4158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.413+0000 7fe9f2a00640 1 -- 172.21.15.69:0/3392373752 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e0009400 con 0x7fe9f40fb210 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.413+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 0x7fe9f4158a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009890 tx=0x7fe9e00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.413+0000 7fe9eb400640 1 -- 172.21.15.69:0/3392373752 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e003ba70 con 0x7fe9f40fb210 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.414+0000 7fe9eb400640 1 -- 172.21.15.69:0/3392373752 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e003bbf0 con 0x7fe9f40fb210 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.414+0000 7fe9eb400640 1 -- 172.21.15.69:0/3392373752 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00453f0 con 0x7fe9f40fb210 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.414+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3392373752 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f4220290 con 0x7fe9f40fb210 2024-02-21T07:43:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.414+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3392373752 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f4220850 con 0x7fe9f40fb210 2024-02-21T07:43:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.417+0000 7fe9eb400640 1 -- 172.21.15.69:0/3392373752 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fe9e0045550 con 0x7fe9f40fb210 2024-02-21T07:43:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.419+0000 7fe9eb400640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe9d409f130 0x7fe9d40a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.419+0000 7fe9fd183740 1 Processor -- start 2024-02-21T07:43:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.419+0000 7fe9eb400640 1 -- 172.21.15.69:0/3392373752 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe9e00ebef0 con 0x7fe9f40fb210 2024-02-21T07:43:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.420+0000 7fe9fd183740 1 -- start start 2024-02-21T07:43:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.420+0000 7fe9f3400640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe9d409f130 0x7fe9d40a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.420+0000 7fe9f3400640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe9d409f130 0x7fe9d40a15f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40cef20 tx=0x7fe9e4007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.421+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 0x559ed123f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.421+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 0x559ed1244c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.421+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 0x559ed1280660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.421+0000 7fe9fd183740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed1200620 con 0x559ed12b46e0 2024-02-21T07:43:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.421+0000 7fe9fd183740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed11b28c0 con 0x559ed1280280 2024-02-21T07:43:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.421+0000 7fe9fd183740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed11afdf0 con 0x559ed12451a0 2024-02-21T07:43:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.422+0000 7fe9f3400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 0x559ed123f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.422+0000 7fe9f3400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 0x559ed123f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:39046/0 (socket says 172.21.15.69:39046) 2024-02-21T07:43:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.422+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3640512892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 0x559ed1244c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.422+0000 7fe9f3400640 1 -- 172.21.15.69:0/3640512892 learned_addr learned my addr 172.21.15.69:0/3640512892 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.422+0000 7fe9f3e00640 1 --2- 172.21.15.69:0/3640512892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 0x559ed1280660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.422+0000 7fe9f2a00640 1 -- 172.21.15.69:0/3640512892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 msgr2=0x559ed1280660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.422+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3640512892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 0x559ed1280660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.422+0000 7fe9f2a00640 1 -- 172.21.15.69:0/3640512892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 msgr2=0x559ed123f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.422+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3640512892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 0x559ed123f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.422+0000 7fe9f2a00640 1 -- 172.21.15.69:0/3640512892 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ed112cb00 con 0x559ed12b46e0 2024-02-21T07:43:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.423+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3640512892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 0x559ed1244c60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00e9710 tx=0x7fe9e00b9340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782126503032083d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.423+0000 7fe9dfe00640 1 -- 172.21.15.69:0/3640512892 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00b7c20 con 0x559ed12b46e0 2024-02-21T07:43:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.423+0000 7fe9dfe00640 1 -- 172.21.15.69:0/3640512892 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e00e9990 con 0x559ed12b46e0 2024-02-21T07:43:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.423+0000 7fe9dfe00640 1 -- 172.21.15.69:0/3640512892 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00c1b80 con 0x559ed12b46e0 2024-02-21T07:43:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.424+0000 7fe9fd183740 1 -- 172.21.15.69:0/3640512892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 msgr2=0x559ed1244c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.424+0000 7fe9fd183740 1 --2- 172.21.15.69:0/3640512892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 0x559ed1244c60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00e9710 tx=0x7fe9e00b9340 comp rx=0 tx=0).stop 2024-02-21T07:43:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.424+0000 7fe9fd183740 1 -- 172.21.15.69:0/3640512892 shutdown_connections 2024-02-21T07:43:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.424+0000 7fe9fd183740 1 --2- 172.21.15.69:0/3640512892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 0x559ed1280660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.424+0000 7fe9fd183740 1 --2- 172.21.15.69:0/3640512892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 0x559ed1244c60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.424+0000 7fe9fd183740 1 --2- 172.21.15.69:0/3640512892 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 0x559ed123f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.424+0000 7fe9fd183740 1 -- 172.21.15.69:0/3640512892 >> 172.21.15.69:0/3640512892 conn(0x559ed120c4b0 msgr2=0x559ed1243eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.424+0000 7fe9fd183740 1 -- 172.21.15.69:0/3640512892 shutdown_connections 2024-02-21T07:43:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.424+0000 7fe9fd183740 1 -- 172.21.15.69:0/3640512892 wait complete. 2024-02-21T07:43:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.426+0000 7fe9fd183740 1 -- start start 2024-02-21T07:43:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.426+0000 7fe9fd183740 1 Processor -- start 2024-02-21T07:43:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.428+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12451a0 0x559ed1280d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.428+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 0x559ed1276690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.428+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12b46e0 0x559ed127b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.428+0000 7fe9fd183740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed11ab5d0 con 0x559ed12451a0 2024-02-21T07:43:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.428+0000 7fe9fd183740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed1150b50 con 0x559ed1280280 2024-02-21T07:43:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.428+0000 7fe9fd183740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed11507f0 con 0x559ed12b46e0 2024-02-21T07:43:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.428+0000 7fe9fd183740 10 client.0 _ll_register_callbacks cb 0x559ed1164550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.428+0000 7fe9f3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12451a0 0x559ed1280d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12451a0 0x559ed1280d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49016/0 (socket says 172.21.15.69:49016) 2024-02-21T07:43:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f2a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 0x559ed1276690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f3400640 1 -- 172.21.15.69:0/340975272 learned_addr learned my addr 172.21.15.69:0/340975272 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f3e00640 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12b46e0 0x559ed127b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f3400640 1 -- 172.21.15.69:0/340975272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12b46e0 msgr2=0x559ed127b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f3400640 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12b46e0 0x559ed127b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f3400640 1 -- 172.21.15.69:0/340975272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 msgr2=0x559ed1276690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f3400640 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 0x559ed1276690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f3400640 1 -- 172.21.15.69:0/340975272 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f4220850 con 0x559ed12451a0 2024-02-21T07:43:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f3e00640 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12b46e0 0x559ed127b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.429+0000 7fe9f3400640 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12451a0 0x559ed1280d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4013700 tx=0x7fe9e4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b626887cdefe332a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.430+0000 7fe9dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.430+0000 7fe9dcc00640 1 -- 172.21.15.69:0/340975272 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4020580 con 0x559ed12451a0 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.430+0000 7fe9fd183740 1 -- 172.21.15.69:0/340975272 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ed117dcd0 con 0x559ed12451a0 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.430+0000 7fe9dcc00640 1 -- 172.21.15.69:0/340975272 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe9e401b070 con 0x559ed12451a0 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.430+0000 7fe9dcc00640 1 -- 172.21.15.69:0/340975272 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9e40206e0 con 0x559ed12451a0 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.430+0000 7fe9fd183740 10 client.5385 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.430+0000 7fe9fd183740 1 -- 172.21.15.69:0/340975272 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x559ed11a9c50 con 0x559ed12451a0 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.431+0000 7fe9dcc00640 1 -- 172.21.15.69:0/340975272 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ed117dcd0 con 0x559ed12451a0 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.431+0000 7fe9dcc00640 1 -- 172.21.15.69:0/340975272 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe9e4012070 con 0x559ed12451a0 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.431+0000 7fe9fd183740 10 client.5385 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.431+0000 7fe9fd183740 10 client.5385 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.431+0000 7fe9fd183740 20 client.5385 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.431+0000 7fe9fd183740 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x559ed12a8b30 0x559ed127a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.431+0000 7fe9fd183740 4 client.5385 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.431+0000 7fe9fd183740 1 -- 172.21.15.69:0/340975272 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ed11a1ce0 con 0x559ed12a8b30 2024-02-21T07:43:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.432+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x559ed12a8b30 0x559ed127a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.432+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x559ed12a8b30 0x559ed127a860 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68c84e1949df11f3 server_cookie=a6e63f2410e064cb in_seq=0 out_seq=0 2024-02-21T07:43:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.432+0000 7fe9dcc00640 10 client.5385 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.433+0000 7fe9dcc00640 1 -- 172.21.15.69:0/340975272 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559ed11a1ce0 con 0x559ed12a8b30 2024-02-21T07:43:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.433+0000 7fe9dcc00640 10 client.5385 handle_command_reply: tid=0 2024-02-21T07:43:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.433+0000 7fe9fd183740 1 client.5385 shutdown 2024-02-21T07:43:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 1 -- 172.21.15.69:0/340975272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12451a0 msgr2=0x559ed1280d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12451a0 0x559ed1280d40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4013700 tx=0x7fe9e4000bc0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 1 -- 172.21.15.69:0/340975272 shutdown_connections 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x559ed12a8b30 0x559ed127a860 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12b46e0 0x559ed127b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed1280280 0x559ed1276690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 1 --2- 172.21.15.69:0/340975272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12451a0 0x559ed1280d40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9dcc00640 0 client.5385 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 1 -- 172.21.15.69:0/340975272 >> 172.21.15.69:0/340975272 conn(0x559ed120c4b0 msgr2=0x559ed124b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 1 -- 172.21.15.69:0/340975272 shutdown_connections 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 1 -- 172.21.15.69:0/340975272 wait complete. 2024-02-21T07:43:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.434+0000 7fe9fd183740 20 client.5385 trim_cache size 0 max 16384 2024-02-21T07:43:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.461+0000 7fe9fd183740 1 Processor -- start 2024-02-21T07:43:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.461+0000 7fe9fd183740 1 -- start start 2024-02-21T07:43:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12451a0 0x559ed1241aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed1280280 0x559ed12d5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 0x559ed126d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9fd183740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed0ef3e60 con 0x559ed12b46e0 2024-02-21T07:43:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9fd183740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed12425e0 con 0x559ed12451a0 2024-02-21T07:43:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9fd183740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed12a26c0 con 0x559ed1280280 2024-02-21T07:43:46.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9f3400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12451a0 0x559ed1241aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9f3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 0x559ed126d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9f3400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12451a0 0x559ed1241aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:39072/0 (socket says 172.21.15.69:39072) 2024-02-21T07:43:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9f3400640 1 -- 172.21.15.69:0/3134577069 learned_addr learned my addr 172.21.15.69:0/3134577069 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.463+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/3134577069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed1280280 0x559ed12d5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.464+0000 7fe9f3e00640 1 -- 172.21.15.69:0/3134577069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed1280280 msgr2=0x559ed12d5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.464+0000 7fe9f3e00640 1 --2- 172.21.15.69:0/3134577069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed1280280 0x559ed12d5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.464+0000 7fe9f3e00640 1 -- 172.21.15.69:0/3134577069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12451a0 msgr2=0x559ed1241aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.464+0000 7fe9f3e00640 1 --2- 172.21.15.69:0/3134577069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12451a0 0x559ed1241aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.464+0000 7fe9f3e00640 1 -- 172.21.15.69:0/3134577069 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ed1146530 con 0x559ed12b46e0 2024-02-21T07:43:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.464+0000 7fe9f3e00640 1 --2- 172.21.15.69:0/3134577069 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 0x559ed126d0b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x559ed12b73f0 tx=0x7fe9ec0149a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fab9ba7587e8bb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:46.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.464+0000 7fe9df400640 1 -- 172.21.15.69:0/3134577069 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec019040 con 0x559ed12b46e0 2024-02-21T07:43:46.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.464+0000 7fe9df400640 1 -- 172.21.15.69:0/3134577069 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec007e10 con 0x559ed12b46e0 2024-02-21T07:43:46.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.464+0000 7fe9df400640 1 -- 172.21.15.69:0/3134577069 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec014310 con 0x559ed12b46e0 2024-02-21T07:43:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.465+0000 7fe9fd183740 1 -- 172.21.15.69:0/3134577069 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 msgr2=0x559ed126d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.465+0000 7fe9fd183740 1 --2- 172.21.15.69:0/3134577069 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 0x559ed126d0b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x559ed12b73f0 tx=0x7fe9ec0149a0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.465+0000 7fe9fd183740 1 -- 172.21.15.69:0/3134577069 shutdown_connections 2024-02-21T07:43:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.465+0000 7fe9fd183740 1 --2- 172.21.15.69:0/3134577069 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed12b46e0 0x559ed126d0b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.466+0000 7fe9fd183740 1 --2- 172.21.15.69:0/3134577069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed1280280 0x559ed12d5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.466+0000 7fe9fd183740 1 --2- 172.21.15.69:0/3134577069 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12451a0 0x559ed1241aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.466+0000 7fe9fd183740 1 -- 172.21.15.69:0/3134577069 >> 172.21.15.69:0/3134577069 conn(0x559ed120c4b0 msgr2=0x559ed1280bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:46.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.466+0000 7fe9fd183740 1 -- 172.21.15.69:0/3134577069 shutdown_connections 2024-02-21T07:43:46.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.466+0000 7fe9fd183740 1 -- 172.21.15.69:0/3134577069 wait complete. 2024-02-21T07:43:46.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.467+0000 7fe9fd183740 1 -- start start 2024-02-21T07:43:46.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.467+0000 7fe9fd183740 1 Processor -- start 2024-02-21T07:43:46.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.469+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 0x559ed12a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.469+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed1280280 0x559ed124a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.469+0000 7fe9fd183740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12b46e0 0x559ed124b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.469+0000 7fe9fd183740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed127cc40 con 0x559ed1280280 2024-02-21T07:43:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.469+0000 7fe9fd183740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed124a540 con 0x559ed12b46e0 2024-02-21T07:43:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.469+0000 7fe9fd183740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed12a9660 con 0x559ed12451a0 2024-02-21T07:43:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.469+0000 7fe9fd183740 10 client.0 _ll_register_callbacks cb 0x7fe9e00b5bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.469+0000 7fe9f2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed1280280 0x559ed124a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.469+0000 7fe9f3400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 0x559ed12a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9f2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed1280280 0x559ed124a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49038/0 (socket says 172.21.15.69:49038) 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9f2a00640 1 -- 172.21.15.69:0/310282635 learned_addr learned my addr 172.21.15.69:0/310282635 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9f3e00640 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12b46e0 0x559ed124b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9f2a00640 1 -- 172.21.15.69:0/310282635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 msgr2=0x559ed12a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 0x559ed12a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9f2a00640 1 -- 172.21.15.69:0/310282635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12b46e0 msgr2=0x559ed124b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12b46e0 0x559ed124b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9f2a00640 1 -- 172.21.15.69:0/310282635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec0097f0 con 0x559ed1280280 2024-02-21T07:43:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9f3400640 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 0x559ed12a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9f2a00640 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed1280280 0x559ed124a000 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009860 tx=0x7fe9e00eb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0ba51d46de3d9c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.470+0000 7fe9dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.471+0000 7fe9dcc00640 1 -- 172.21.15.69:0/310282635 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00e9990 con 0x559ed1280280 2024-02-21T07:43:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.471+0000 7fe9dcc00640 1 -- 172.21.15.69:0/310282635 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe9e00e9af0 con 0x559ed1280280 2024-02-21T07:43:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.471+0000 7fe9fd183740 1 -- 172.21.15.69:0/310282635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ed11d0d30 con 0x559ed1280280 2024-02-21T07:43:46.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.471+0000 7fe9dcc00640 1 -- 172.21.15.69:0/310282635 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9e00c1b80 con 0x559ed1280280 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.471+0000 7fe9fd183740 10 client.5391 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.471+0000 7fe9fd183740 1 -- 172.21.15.69:0/310282635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x559ed116c2c0 con 0x559ed1280280 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.471+0000 7fe9dcc00640 1 -- 172.21.15.69:0/310282635 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ed11d0d30 con 0x559ed1280280 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.472+0000 7fe9dcc00640 1 -- 172.21.15.69:0/310282635 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe9e00baba0 con 0x559ed1280280 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.472+0000 7fe9fd183740 10 client.5391 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.472+0000 7fe9fd183740 10 client.5391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.472+0000 7fe9fd183740 20 client.5391 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.472+0000 7fe9fd183740 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x559ed1249bd0 0x559ed131c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.472+0000 7fe9fd183740 4 client.5391 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.472+0000 7fe9fd183740 1 -- 172.21.15.69:0/310282635 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559ed0eab600 con 0x559ed1249bd0 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.472+0000 7fe9f3400640 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x559ed1249bd0 0x559ed131c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.473+0000 7fe9dcc00640 10 client.5391 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:46.481 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.473+0000 7fe9f3400640 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x559ed1249bd0 0x559ed131c590 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ae513fa9f71a535 server_cookie=cf4e96cf23e6e9f8 in_seq=0 out_seq=0 2024-02-21T07:43:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9dcc00640 1 -- 172.21.15.69:0/310282635 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559ed0eab600 con 0x559ed1249bd0 2024-02-21T07:43:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9dcc00640 10 client.5391 handle_command_reply: tid=0 2024-02-21T07:43:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 client.5391 shutdown 2024-02-21T07:43:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 -- 172.21.15.69:0/310282635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed1280280 msgr2=0x559ed124a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed1280280 0x559ed124a000 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009860 tx=0x7fe9e00eb040 comp rx=0 tx=0).stop 2024-02-21T07:43:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 -- 172.21.15.69:0/310282635 shutdown_connections 2024-02-21T07:43:46.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x559ed1249bd0 0x559ed131c590 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x559ed12b46e0 0x559ed124b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559ed1280280 0x559ed124a000 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 --2- 172.21.15.69:0/310282635 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x559ed12451a0 0x559ed12a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 -- 172.21.15.69:0/310282635 >> 172.21.15.69:0/310282635 conn(0x559ed120c4b0 msgr2=0x559ed123ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9dcc00640 0 client.5391 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 -- 172.21.15.69:0/310282635 shutdown_connections 2024-02-21T07:43:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.482+0000 7fe9fd183740 1 -- 172.21.15.69:0/310282635 wait complete. 2024-02-21T07:43:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.483+0000 7fe9fd183740 20 client.5391 trim_cache size 0 max 16384 2024-02-21T07:43:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-02-21T07:43:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-02-21T07:43:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-02-21T07:43:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-02-21T07:43:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.483+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3392373752 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe9d409f130 msgr2=0x7fe9d40a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.483+0000 7fe9f8e00640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe9d409f130 0x7fe9d40a15f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40cef20 tx=0x7fe9e4007e80 comp rx=0 tx=0).stop 2024-02-21T07:43:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.483+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3392373752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 msgr2=0x7fe9f4158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.483+0000 7fe9f8e00640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 0x7fe9f4158a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009890 tx=0x7fe9e00046c0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.484+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3392373752 shutdown_connections 2024-02-21T07:43:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.484+0000 7fe9f8e00640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe9d409f130 0x7fe9d40a15f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.484+0000 7fe9f8e00640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9f415a540 0x7fe9f4158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.484+0000 7fe9f8e00640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9f40fb210 0x7fe9f4158a20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.484+0000 7fe9f8e00640 1 --2- 172.21.15.69:0/3392373752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe9f40cfc90 0x7fe9f4149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.484+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3392373752 >> 172.21.15.69:0/3392373752 conn(0x7fe9f40619b0 msgr2=0x7fe9f4061d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.484+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3392373752 shutdown_connections 2024-02-21T07:43:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:46.484+0000 7fe9f8e00640 1 -- 172.21.15.69:0/3392373752 wait complete. 2024-02-21T07:43:59.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.624+0000 7f66be200640 1 Processor -- start 2024-02-21T07:43:59.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.624+0000 7f66be200640 1 -- start start 2024-02-21T07:43:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.626+0000 7f66be200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f66b815d590 0x7f66b806b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.626+0000 7f66be200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f66b815d970 0x7f66b80d3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.626+0000 7f66be200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b806bc40 con 0x7f66b80d4200 2024-02-21T07:43:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.626+0000 7f66be200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b806caa0 con 0x7f66b815d590 2024-02-21T07:43:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.626+0000 7f66be200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b8189630 con 0x7f66b815d970 2024-02-21T07:43:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.626+0000 7f66bce00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f66b815d590 0x7f66b806b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.626+0000 7f66bce00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f66b815d590 0x7f66b806b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53028/0 (socket says 172.21.15.69:53028) 2024-02-21T07:43:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.626+0000 7f66bce00640 1 -- 172.21.15.69:0/4275310145 learned_addr learned my addr 172.21.15.69:0/4275310145 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:59.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.626+0000 7f66b7e00640 1 --2- 172.21.15.69:0/4275310145 >> v2:172.21.15.174:3300/0 conn(0x7f66b815d970 0x7f66b80d3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.627+0000 7f66bce00640 1 -- 172.21.15.69:0/4275310145 >> v2:172.21.15.174:3300/0 conn(0x7f66b815d970 msgr2=0x7f66b80d3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:59.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.627+0000 7f66bce00640 1 --2- 172.21.15.69:0/4275310145 >> v2:172.21.15.174:3300/0 conn(0x7f66b815d970 0x7f66b80d3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.627+0000 7f66bce00640 1 -- 172.21.15.69:0/4275310145 >> v1:172.21.15.184:6789/0 conn(0x7f66b80d4200 legacy=0x7f66b806cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:59.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.627+0000 7f66bce00640 1 -- 172.21.15.69:0/4275310145 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b806bf20 con 0x7f66b815d590 2024-02-21T07:43:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.628+0000 7f66bce00640 1 --2- 172.21.15.69:0/4275310145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b815d590 0x7f66b806b300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f66b80d35f0 tx=0x7f66ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef93b4edd64e2d9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.628+0000 7f66b7400640 1 -- 172.21.15.69:0/4275310145 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac031870 con 0x7f66b815d590 2024-02-21T07:43:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.628+0000 7f66b7400640 1 -- 172.21.15.69:0/4275310145 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac0319d0 con 0x7f66b815d590 2024-02-21T07:43:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.628+0000 7f66b7400640 1 -- 172.21.15.69:0/4275310145 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac031d60 con 0x7f66b815d590 2024-02-21T07:43:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.629+0000 7f66be200640 1 -- 172.21.15.69:0/4275310145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b815d590 msgr2=0x7f66b806b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.629+0000 7f66be200640 1 --2- 172.21.15.69:0/4275310145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b815d590 0x7f66b806b300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f66b80d35f0 tx=0x7f66ac02b910 comp rx=0 tx=0).stop 2024-02-21T07:43:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.629+0000 7f66be200640 1 -- 172.21.15.69:0/4275310145 shutdown_connections 2024-02-21T07:43:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.629+0000 7f66be200640 1 --2- 172.21.15.69:0/4275310145 >> v2:172.21.15.174:3300/0 conn(0x7f66b815d970 0x7f66b80d3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.629+0000 7f66be200640 1 --2- 172.21.15.69:0/4275310145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b815d590 0x7f66b806b300 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.629+0000 7f66be200640 1 -- 172.21.15.69:0/4275310145 >> 172.21.15.69:0/4275310145 conn(0x7f66b80615c0 msgr2=0x7f66b80619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.629+0000 7f66be200640 1 -- 172.21.15.69:0/4275310145 shutdown_connections 2024-02-21T07:43:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.629+0000 7f66be200640 1 -- 172.21.15.69:0/4275310145 wait complete. 2024-02-21T07:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.632+0000 7f66be200640 1 Processor -- start 2024-02-21T07:43:59.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.632+0000 7f66be200640 1 -- start start 2024-02-21T07:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66be200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b80d4200 0x7f66b8181130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66be200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b815d590 0x7f66b8181670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66be200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b815d970 0x7f66b8154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66be200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b821ee90 con 0x7f66b815d970 2024-02-21T07:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66be200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b821dfa0 con 0x7f66b815d590 2024-02-21T07:43:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66be200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b821e280 con 0x7f66b80d4200 2024-02-21T07:43:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66bd800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b815d970 0x7f66b8154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66bce00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b80d4200 0x7f66b8181130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66bce00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b80d4200 0x7f66b8181130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:48464/0 (socket says 172.21.15.69:48464) 2024-02-21T07:43:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66bce00640 1 -- 172.21.15.69:0/1184501839 learned_addr learned my addr 172.21.15.69:0/1184501839 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.634+0000 7f66b7e00640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b815d590 0x7f66b8181670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.635+0000 7f66bd800640 1 -- 172.21.15.69:0/1184501839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b80d4200 msgr2=0x7f66b8181130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.635+0000 7f66bd800640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b80d4200 0x7f66b8181130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.635+0000 7f66bd800640 1 -- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b815d590 msgr2=0x7f66b8181670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.635+0000 7f66bd800640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b815d590 0x7f66b8181670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.635+0000 7f66bd800640 1 -- 172.21.15.69:0/1184501839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac0094d0 con 0x7f66b815d970 2024-02-21T07:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.635+0000 7f66b7e00640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b815d590 0x7f66b8181670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.635+0000 7f66bd800640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b815d970 0x7f66b8154110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f66b000c730 tx=0x7f66b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.635+0000 7f66b4c00640 1 -- 172.21.15.69:0/1184501839 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0006d50 con 0x7f66b815d970 2024-02-21T07:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.635+0000 7f66b4c00640 1 -- 172.21.15.69:0/1184501839 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b0003970 con 0x7f66b815d970 2024-02-21T07:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.636+0000 7f66be200640 1 -- 172.21.15.69:0/1184501839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b821e560 con 0x7f66b815d970 2024-02-21T07:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.636+0000 7f66be200640 1 -- 172.21.15.69:0/1184501839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b821eb20 con 0x7f66b815d970 2024-02-21T07:43:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.636+0000 7f66b4c00640 1 -- 172.21.15.69:0/1184501839 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0003d60 con 0x7f66b815d970 2024-02-21T07:43:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.640+0000 7f66b4c00640 1 -- 172.21.15.69:0/1184501839 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f66b00052e0 con 0x7f66b815d970 2024-02-21T07:43:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.641+0000 7f66c2420740 1 Processor -- start 2024-02-21T07:43:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.641+0000 7f66c2420740 1 -- start start 2024-02-21T07:43:59.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66c2420740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55571339c280 0x55571335b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66c2420740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133d06e0 0x555713360c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66c2420740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 0x55571339c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66c2420740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571331c620 con 0x5557133611a0 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66c2420740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557132ce8c0 con 0x55571339c280 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66c2420740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557132cbdf0 con 0x5557133d06e0 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55571339c280 0x55571335b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66b4c00640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f669809f130 0x7f66980a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66bce00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133d06e0 0x555713360c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55571339c280 0x55571335b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:48346/0 (socket says 172.21.15.69:48346) 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66b7e00640 1 -- 172.21.15.69:0/3536672503 learned_addr learned my addr 172.21.15.69:0/3536672503 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66b7e00640 1 --2- 172.21.15.69:0/3536672503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 0x55571339c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.642+0000 7f66bd800640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f669809f130 0x7f66980a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.643+0000 7f66bce00640 1 -- 172.21.15.69:0/3536672503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55571339c280 msgr2=0x55571335b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.643+0000 7f66bce00640 1 --2- 172.21.15.69:0/3536672503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55571339c280 0x55571335b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.643+0000 7f66bce00640 1 -- 172.21.15.69:0/3536672503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 msgr2=0x55571339c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.643+0000 7f66bce00640 1 --2- 172.21.15.69:0/3536672503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 0x55571339c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.643+0000 7f66b4c00640 1 -- 172.21.15.69:0/1184501839 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f66b00c9830 con 0x7f66b815d970 2024-02-21T07:43:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.643+0000 7f66bce00640 1 -- 172.21.15.69:0/3536672503 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555713248b00 con 0x5557133d06e0 2024-02-21T07:43:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.643+0000 7f66bd800640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f669809f130 0x7f66980a15f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f66b009f530 tx=0x7f66b0001250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.643+0000 7f66bce00640 1 --2- 172.21.15.69:0/3536672503 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133d06e0 0x555713360c60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009960 tx=0x7f66ac008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8c084ce6b9fe07c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.644+0000 7f66a9600640 1 -- 172.21.15.69:0/3536672503 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac044620 con 0x5557133d06e0 2024-02-21T07:43:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.644+0000 7f66a9600640 1 -- 172.21.15.69:0/3536672503 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac044780 con 0x5557133d06e0 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.644+0000 7f66a9600640 1 -- 172.21.15.69:0/3536672503 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac044b10 con 0x5557133d06e0 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.644+0000 7f66c2420740 1 -- 172.21.15.69:0/3536672503 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133d06e0 msgr2=0x555713360c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.644+0000 7f66c2420740 1 --2- 172.21.15.69:0/3536672503 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133d06e0 0x555713360c60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009960 tx=0x7f66ac008030 comp rx=0 tx=0).stop 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.644+0000 7f66c2420740 1 -- 172.21.15.69:0/3536672503 shutdown_connections 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.644+0000 7f66c2420740 1 --2- 172.21.15.69:0/3536672503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 0x55571339c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.644+0000 7f66c2420740 1 --2- 172.21.15.69:0/3536672503 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133d06e0 0x555713360c60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.644+0000 7f66c2420740 1 --2- 172.21.15.69:0/3536672503 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55571339c280 0x55571335b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.645+0000 7f66c2420740 1 -- 172.21.15.69:0/3536672503 >> 172.21.15.69:0/3536672503 conn(0x5557133284b0 msgr2=0x55571335feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.645+0000 7f66c2420740 1 -- 172.21.15.69:0/3536672503 shutdown_connections 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.645+0000 7f66c2420740 1 -- 172.21.15.69:0/3536672503 wait complete. 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.645+0000 7f66c2420740 1 -- start start 2024-02-21T07:43:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.646+0000 7f66c2420740 1 Processor -- start 2024-02-21T07:43:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66c2420740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 0x5557133c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66c2420740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x5557133de500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66c2420740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x5557133d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66c2420740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557132c75d0 con 0x55571339c280 2024-02-21T07:43:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66c2420740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571326cb50 con 0x5557133d06e0 2024-02-21T07:43:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66c2420740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571326c7f0 con 0x5557133611a0 2024-02-21T07:43:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66c2420740 10 client.0 _ll_register_callbacks cb 0x555713280550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66bce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x5557133de500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66bce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x5557133de500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53054/0 (socket says 172.21.15.69:53054) 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66bce00640 1 -- 172.21.15.69:0/136114397 learned_addr learned my addr 172.21.15.69:0/136114397 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66b7e00640 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x5557133d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.647+0000 7f66b7e00640 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 0x5557133c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.648+0000 7f66bce00640 1 -- 172.21.15.69:0/136114397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 msgr2=0x5557133c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.648+0000 7f66bce00640 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 0x5557133c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.648+0000 7f66bce00640 1 -- 172.21.15.69:0/136114397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 msgr2=0x5557133d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.648+0000 7f66bce00640 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x5557133d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.648+0000 7f66bce00640 1 -- 172.21.15.69:0/136114397 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b806bf20 con 0x55571339c280 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.648+0000 7f66bce00640 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x5557133de500 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f66ac02bf20 tx=0x7f66ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04cfe41bc60bba5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.648+0000 7f669e000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.648+0000 7f669e000640 1 -- 172.21.15.69:0/136114397 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac003810 con 0x55571339c280 2024-02-21T07:43:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.648+0000 7f669e000640 1 -- 172.21.15.69:0/136114397 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f66ac03f070 con 0x55571339c280 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.648+0000 7f66c2420740 1 -- 172.21.15.69:0/136114397 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555713299cd0 con 0x55571339c280 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f669e000640 1 -- 172.21.15.69:0/136114397 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66ac02c010 con 0x55571339c280 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f66c2420740 10 client.5403 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f66c2420740 1 -- 172.21.15.69:0/136114397 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5557132c5c50 con 0x55571339c280 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f669e000640 1 -- 172.21.15.69:0/136114397 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555713299cd0 con 0x55571339c280 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f669e000640 1 -- 172.21.15.69:0/136114397 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f66ac003970 con 0x55571339c280 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f66c2420740 10 client.5403 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f66c2420740 10 client.5403 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f66c2420740 20 client.5403 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f66c2420740 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5557133962c0 0x5557133e0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f66c2420740 4 client.5403 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f66c2420740 1 -- 172.21.15.69:0/136114397 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557132bdce0 con 0x5557133962c0 2024-02-21T07:43:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.649+0000 7f66b7e00640 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5557133962c0 0x5557133e0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.650+0000 7f669e000640 10 client.5403 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.650+0000 7f66b7e00640 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5557133962c0 0x5557133e0d50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16cfbb7064f71912 server_cookie=f524b519a54c3376 in_seq=0 out_seq=0 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.650+0000 7f669e000640 1 -- 172.21.15.69:0/136114397 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5557132bdce0 con 0x5557133962c0 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.650+0000 7f669e000640 10 client.5403 handle_command_reply: tid=0 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 client.5403 shutdown 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 -- 172.21.15.69:0/136114397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 msgr2=0x5557133de500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x5557133de500 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f66ac02bf20 tx=0x7f66ac004730 comp rx=0 tx=0).stop 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 -- 172.21.15.69:0/136114397 shutdown_connections 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5557133962c0 0x5557133e0d50 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x5557133d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x5557133de500 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f669e000640 0 client.5403 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 --2- 172.21.15.69:0/136114397 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 0x5557133c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 -- 172.21.15.69:0/136114397 >> 172.21.15.69:0/136114397 conn(0x5557133284b0 msgr2=0x5557133d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 -- 172.21.15.69:0/136114397 shutdown_connections 2024-02-21T07:43:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 1 -- 172.21.15.69:0/136114397 wait complete. 2024-02-21T07:43:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.651+0000 7f66c2420740 20 client.5403 trim_cache size 0 max 16384 2024-02-21T07:43:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.665+0000 7f66c2420740 1 Processor -- start 2024-02-21T07:43:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.665+0000 7f66c2420740 1 -- start start 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.666+0000 7f66c2420740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 0x555713394720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.666+0000 7f66c2420740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x55571335d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66c2420740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x55571338c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66c2420740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571300fe60 con 0x55571339c280 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66c2420740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x555713366a20 con 0x5557133d06e0 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66c2420740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555713366e70 con 0x5557133611a0 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66bce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x55571335d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66bce00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x55571335d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53056/0 (socket says 172.21.15.69:53056) 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66bce00640 1 -- 172.21.15.69:0/476941428 learned_addr learned my addr 172.21.15.69:0/476941428 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66b7e00640 1 --2- 172.21.15.69:0/476941428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 0x555713394720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66b7e00640 1 --2- 172.21.15.69:0/476941428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x55571338c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66bce00640 1 -- 172.21.15.69:0/476941428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 msgr2=0x555713394720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66bce00640 1 --2- 172.21.15.69:0/476941428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 0x555713394720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66bce00640 1 -- 172.21.15.69:0/476941428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 msgr2=0x55571338c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66bce00640 1 --2- 172.21.15.69:0/476941428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x55571338c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66bce00640 1 -- 172.21.15.69:0/476941428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555713262530 con 0x55571339c280 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66b7e00640 1 --2- 172.21.15.69:0/476941428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 0x555713394720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.667+0000 7f66bce00640 1 --2- 172.21.15.69:0/476941428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x55571335d160 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f66ac02b950 tx=0x7f66ac04d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91cdf8728bd6cae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.668+0000 7f66a8c00640 1 -- 172.21.15.69:0/476941428 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac003810 con 0x55571339c280 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.668+0000 7f66a8c00640 1 -- 172.21.15.69:0/476941428 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac003970 con 0x55571339c280 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.668+0000 7f66a8c00640 1 -- 172.21.15.69:0/476941428 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac059660 con 0x55571339c280 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.668+0000 7f66c2420740 1 -- 172.21.15.69:0/476941428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 msgr2=0x55571335d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.668+0000 7f66c2420740 1 --2- 172.21.15.69:0/476941428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x55571335d160 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f66ac02b950 tx=0x7f66ac04d000 comp rx=0 tx=0).stop 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.669+0000 7f66c2420740 1 -- 172.21.15.69:0/476941428 shutdown_connections 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.669+0000 7f66c2420740 1 --2- 172.21.15.69:0/476941428 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x55571338c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.669+0000 7f66c2420740 1 --2- 172.21.15.69:0/476941428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55571339c280 0x55571335d160 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.669+0000 7f66c2420740 1 --2- 172.21.15.69:0/476941428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5557133611a0 0x555713394720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.669+0000 7f66c2420740 1 -- 172.21.15.69:0/476941428 >> 172.21.15.69:0/476941428 conn(0x5557133284b0 msgr2=0x5557133c5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.669+0000 7f66c2420740 1 -- 172.21.15.69:0/476941428 shutdown_connections 2024-02-21T07:43:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.669+0000 7f66c2420740 1 -- 172.21.15.69:0/476941428 wait complete. 2024-02-21T07:43:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.670+0000 7f66c2420740 1 -- start start 2024-02-21T07:43:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.670+0000 7f66c2420740 1 Processor -- start 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66c2420740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 0x55571343de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66c2420740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55571339c280 0x555713437990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66c2420740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x5557133bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66c2420740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571343a2c0 con 0x5557133611a0 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66c2420740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571343a460 con 0x5557133d06e0 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66c2420740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55571343e3b0 con 0x55571339c280 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66c2420740 10 client.0 _ll_register_callbacks cb 0x7f66ac0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 0x55571343de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66b7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 0x55571343de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53070/0 (socket says 172.21.15.69:53070) 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66b7e00640 1 -- 172.21.15.69:0/3326946217 learned_addr learned my addr 172.21.15.69:0/3326946217 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66bce00640 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55571339c280 0x555713437990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.671+0000 7f66b7e00640 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x5557133bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f66b7e00640 1 -- 172.21.15.69:0/3326946217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55571339c280 msgr2=0x555713437990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f66b7e00640 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55571339c280 0x555713437990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f66b7e00640 1 -- 172.21.15.69:0/3326946217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 msgr2=0x5557133bec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f66b7e00640 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x5557133bec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f66b7e00640 1 -- 172.21.15.69:0/3326946217 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557132c5c50 con 0x5557133611a0 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f66bce00640 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55571339c280 0x555713437990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f66b7e00640 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 0x55571343de70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f66a4028010 tx=0x7f66a4028040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8d54011cd7cf5f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f669e000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f669e000640 1 -- 172.21.15.69:0/3326946217 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a4003610 con 0x5557133611a0 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f669e000640 1 -- 172.21.15.69:0/3326946217 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f66a4003770 con 0x5557133611a0 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f66c2420740 1 -- 172.21.15.69:0/3326946217 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557132ecd30 con 0x5557133611a0 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f669e000640 1 -- 172.21.15.69:0/3326946217 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66a4003930 con 0x5557133611a0 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f66c2420740 10 client.5409 fetch_fsmap learned FSMap version 19 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.672+0000 7f66c2420740 1 -- 172.21.15.69:0/3326946217 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5557132882c0 con 0x5557133611a0 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.673+0000 7f669e000640 1 -- 172.21.15.69:0/3326946217 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a403f080 con 0x5557133611a0 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.673+0000 7f669e000640 1 -- 172.21.15.69:0/3326946217 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f66a4023030 con 0x5557133611a0 2024-02-21T07:43:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.673+0000 7f66c2420740 10 client.5409 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.673+0000 7f66c2420740 10 client.5409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.673+0000 7f66c2420740 20 client.5409 populate_metadata read hostname 'smithi069' 2024-02-21T07:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.673+0000 7f66c2420740 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55571335d160 0x55571335bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.673+0000 7f66c2420740 4 client.5409 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.673+0000 7f66c2420740 1 -- 172.21.15.69:0/3326946217 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555712fc7600 con 0x55571335d160 2024-02-21T07:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.673+0000 7f66bce00640 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55571335d160 0x55571335bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.674+0000 7f66bce00640 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55571335d160 0x55571335bf00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b3461e40b3d4ba5 server_cookie=4832a8a14af07231 in_seq=0 out_seq=0 2024-02-21T07:43:59.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.674+0000 7f669e000640 10 client.5409 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f669e000640 1 -- 172.21.15.69:0/3326946217 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555712fc7600 con 0x55571335d160 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f669e000640 10 client.5409 handle_command_reply: tid=0 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f66c2420740 1 client.5409 shutdown 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f66c2420740 1 -- 172.21.15.69:0/3326946217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 msgr2=0x55571343de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f66c2420740 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 0x55571343de70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f66a4028010 tx=0x7f66a4028040 comp rx=0 tx=0).stop 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f66c2420740 1 -- 172.21.15.69:0/3326946217 shutdown_connections 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f66c2420740 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55571335d160 0x55571335bf00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f66c2420740 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5557133d06e0 0x5557133bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f66c2420740 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55571339c280 0x555713437990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f66c2420740 1 --2- 172.21.15.69:0/3326946217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5557133611a0 0x55571343de70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.680+0000 7f66c2420740 1 -- 172.21.15.69:0/3326946217 >> 172.21.15.69:0/3326946217 conn(0x5557133284b0 msgr2=0x5557133e0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.681+0000 7f669e000640 0 client.5409 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.681+0000 7f66c2420740 1 -- 172.21.15.69:0/3326946217 shutdown_connections 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.681+0000 7f66c2420740 1 -- 172.21.15.69:0/3326946217 wait complete. 2024-02-21T07:43:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.681+0000 7f66c2420740 20 client.5409 trim_cache size 0 max 16384 2024-02-21T07:43:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-02-21T07:43:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-02-21T07:43:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-02-21T07:43:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 -- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f669809f130 msgr2=0x7f66980a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f669809f130 0x7f66980a15f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f66b009f530 tx=0x7f66b0001250 comp rx=0 tx=0).stop 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 -- 172.21.15.69:0/1184501839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b815d970 msgr2=0x7f66b8154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b815d970 0x7f66b8154110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f66b000c730 tx=0x7f66b000cbf0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 -- 172.21.15.69:0/1184501839 shutdown_connections 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f669809f130 0x7f66980a15f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66b815d970 0x7f66b8154110 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f66b815d590 0x7f66b8181670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 --2- 172.21.15.69:0/1184501839 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66b80d4200 0x7f66b8181130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 -- 172.21.15.69:0/1184501839 >> 172.21.15.69:0/1184501839 conn(0x7f66b80615c0 msgr2=0x7f66b8073e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 -- 172.21.15.69:0/1184501839 shutdown_connections 2024-02-21T07:43:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:43:59.682+0000 7f66be200640 1 -- 172.21.15.69:0/1184501839 wait complete. 2024-02-21T07:44:02.413 INFO:tasks.workunit.client.0.smithi069.stderr:Updating files: 77% (8864/11369) Updating files: 78% (8868/11369) Updating files: 79% (8982/11369) Updating files: 80% (9096/11369) Updating files: 81% (9209/11369) Updating files: 82% (9323/11369) Updating files: 83% (9437/11369) Updating files: 84% (9550/11369) Updating files: 85% (9664/11369) Updating files: 86% (9778/11369) Updating files: 87% (9892/11369) Updating files: 88% (10005/11369) Updating files: 89% (10119/11369) Updating files: 90% (10233/11369) Updating files: 91% (10346/11369) Updating files: 92% (10460/11369) Updating files: 93% (10574/11369) Updating files: 94% (10687/11369) Updating files: 95% (10801/11369) Updating files: 96% (10915/11369) Updating files: 97% (11028/11369) Updating files: 98% (11142/11369) Updating files: 99% (11256/11369) Updating files: 100% (11369/11369) Updating files: 100% (11369/11369), done. 2024-02-21T07:44:03.734 INFO:tasks.workunit.client.0.smithi069.stderr:Note: switching to 'e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb'. 2024-02-21T07:44:03.734 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-02-21T07:44:03.734 INFO:tasks.workunit.client.0.smithi069.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-21T07:44:03.734 INFO:tasks.workunit.client.0.smithi069.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-21T07:44:03.734 INFO:tasks.workunit.client.0.smithi069.stderr:state without impacting any branches by switching back to a branch. 2024-02-21T07:44:03.734 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-02-21T07:44:03.734 INFO:tasks.workunit.client.0.smithi069.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-21T07:44:03.734 INFO:tasks.workunit.client.0.smithi069.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-21T07:44:03.734 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-02-21T07:44:03.734 INFO:tasks.workunit.client.0.smithi069.stderr: git switch -c 2024-02-21T07:44:03.735 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-02-21T07:44:03.735 INFO:tasks.workunit.client.0.smithi069.stderr:Or undo this operation with: 2024-02-21T07:44:03.735 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-02-21T07:44:03.735 INFO:tasks.workunit.client.0.smithi069.stderr: git switch - 2024-02-21T07:44:03.735 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-02-21T07:44:03.735 INFO:tasks.workunit.client.0.smithi069.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-21T07:44:03.735 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-02-21T07:44:03.735 INFO:tasks.workunit.client.0.smithi069.stderr:HEAD is now at e96e3d6862e qa: switch away cephadm from fs:workload 2024-02-21T07:44:03.744 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-21T07:44:03.799 INFO:tasks.workunit.client.0.smithi069.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-21T07:44:03.805 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-21T07:44:03.806 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-21T07:44:04.629 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-21T07:44:04.743 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-21T07:44:04.828 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-21T07:44:04.833 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-21T07:44:04.834 INFO:tasks.workunit.client.0.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-21T07:44:04.917 INFO:tasks.workunit.client.0.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-21T07:44:04.928 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:44:04.929 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-21T07:44:04.976 INFO:tasks.workunit:Running workunits matching kernel_untar_build.sh on client.0... 2024-02-21T07:44:04.978 INFO:tasks.workunit:Running workunit kernel_untar_build.sh... 2024-02-21T07:44:04.978 DEBUG:teuthology.orchestra.run.smithi069:workunit test kernel_untar_build.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh 2024-02-21T07:44:05.091 INFO:tasks.workunit.client.0.smithi069.stderr:+ wget -O linux.tar.xz http://download.ceph.com/qa/linux-6.5.11.tar.xz 2024-02-21T07:44:05.128 INFO:tasks.workunit.client.0.smithi069.stderr:--2024-02-21 07:44:05-- http://download.ceph.com/qa/linux-6.5.11.tar.xz 2024-02-21T07:44:05.138 INFO:tasks.workunit.client.0.smithi069.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-02-21T07:44:05.175 INFO:tasks.workunit.client.0.smithi069.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-02-21T07:44:05.226 INFO:tasks.workunit.client.0.smithi069.stderr:HTTP request sent, awaiting response... 200 OK 2024-02-21T07:44:05.227 INFO:tasks.workunit.client.0.smithi069.stderr:Length: 139010916 (133M) [application/octet-stream] 2024-02-21T07:44:05.227 INFO:tasks.workunit.client.0.smithi069.stderr:Saving to: ‘linux.tar.xz’ 2024-02-21T07:44:05.237 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-02-21T07:44:05.298 INFO:tasks.workunit.client.0.smithi069.stderr: 0K .......... .......... .......... .......... .......... 0% 704K 3m13s 2024-02-21T07:44:05.335 INFO:tasks.workunit.client.0.smithi069.stderr: 50K .......... .......... .......... .......... .......... 0% 1.38M 2m24s 2024-02-21T07:44:05.335 INFO:tasks.workunit.client.0.smithi069.stderr: 100K .......... .......... .......... .......... .......... 0% 43.2M 97s 2024-02-21T07:44:05.335 INFO:tasks.workunit.client.0.smithi069.stderr: 150K .......... .......... .......... .......... .......... 0% 64.4M 73s 2024-02-21T07:44:05.376 INFO:tasks.workunit.client.0.smithi069.stderr: 200K .......... .......... .......... .......... .......... 0% 1.19M 81s 2024-02-21T07:44:05.380 INFO:tasks.workunit.client.0.smithi069.stderr: 250K .......... .......... .......... .......... .......... 0% 21.4M 68s 2024-02-21T07:44:05.380 INFO:tasks.workunit.client.0.smithi069.stderr: 300K .......... .......... .......... .......... .......... 0% 53.9M 59s 2024-02-21T07:44:05.380 INFO:tasks.workunit.client.0.smithi069.stderr: 350K .......... .......... .......... .......... .......... 0% 70.2M 52s 2024-02-21T07:44:05.416 INFO:tasks.workunit.client.0.smithi069.stderr: 400K .......... .......... .......... .......... .......... 0% 1.49M 56s 2024-02-21T07:44:05.417 INFO:tasks.workunit.client.0.smithi069.stderr: 450K .......... .......... .......... .......... .......... 0% 46.3M 51s 2024-02-21T07:44:05.417 INFO:tasks.workunit.client.0.smithi069.stderr: 500K .......... .......... .......... .......... .......... 0% 49.6M 46s 2024-02-21T07:44:05.417 INFO:tasks.workunit.client.0.smithi069.stderr: 550K .......... .......... .......... .......... .......... 0% 72.0M 43s 2024-02-21T07:44:05.417 INFO:tasks.workunit.client.0.smithi069.stderr: 600K .......... .......... .......... .......... .......... 0% 72.2M 39s 2024-02-21T07:44:05.452 INFO:tasks.workunit.client.0.smithi069.stderr: 650K .......... .......... .......... .......... .......... 0% 1.53M 43s 2024-02-21T07:44:05.452 INFO:tasks.workunit.client.0.smithi069.stderr: 700K .......... .......... .......... .......... .......... 0% 52.0M 40s 2024-02-21T07:44:05.452 INFO:tasks.workunit.client.0.smithi069.stderr: 750K .......... .......... .......... .......... .......... 0% 53.0M 38s 2024-02-21T07:44:05.452 INFO:tasks.workunit.client.0.smithi069.stderr: 800K .......... .......... .......... .......... .......... 0% 41.7M 36s 2024-02-21T07:44:05.452 INFO:tasks.workunit.client.0.smithi069.stderr: 850K .......... .......... .......... .......... .......... 0% 79.2M 34s 2024-02-21T07:44:05.484 INFO:tasks.workunit.client.0.smithi069.stderr: 900K .......... .......... .......... .......... .......... 0% 1.54M 36s 2024-02-21T07:44:05.485 INFO:tasks.workunit.client.0.smithi069.stderr: 950K .......... .......... .......... .......... .......... 0% 69.0M 35s 2024-02-21T07:44:05.485 INFO:tasks.workunit.client.0.smithi069.stderr: 1000K .......... .......... .......... .......... .......... 0% 63.1M 33s 2024-02-21T07:44:05.490 INFO:tasks.workunit.client.0.smithi069.stderr: 1050K .......... .......... .......... .......... .......... 0% 14.6M 32s 2024-02-21T07:44:05.490 INFO:tasks.workunit.client.0.smithi069.stderr: 1100K .......... .......... .......... .......... .......... 0% 59.3M 31s 2024-02-21T07:44:05.490 INFO:tasks.workunit.client.0.smithi069.stderr: 1150K .......... .......... .......... .......... .......... 0% 75.2M 29s 2024-02-21T07:44:05.520 INFO:tasks.workunit.client.0.smithi069.stderr: 1200K .......... .......... .......... .......... .......... 0% 1.64M 31s 2024-02-21T07:44:05.521 INFO:tasks.workunit.client.0.smithi069.stderr: 1250K .......... .......... .......... .......... .......... 0% 68.0M 30s 2024-02-21T07:44:05.521 INFO:tasks.workunit.client.0.smithi069.stderr: 1300K .......... .......... .......... .......... .......... 0% 32.7M 29s 2024-02-21T07:44:05.524 INFO:tasks.workunit.client.0.smithi069.stderr: 1350K .......... .......... .......... .......... .......... 1% 20.0M 29s 2024-02-21T07:44:05.525 INFO:tasks.workunit.client.0.smithi069.stderr: 1400K .......... .......... .......... .......... .......... 1% 48.0M 28s 2024-02-21T07:44:05.526 INFO:tasks.workunit.client.0.smithi069.stderr: 1450K .......... .......... .......... .......... .......... 1% 77.6M 27s 2024-02-21T07:44:05.559 INFO:tasks.workunit.client.0.smithi069.stderr: 1500K .......... .......... .......... .......... .......... 1% 1.54M 29s 2024-02-21T07:44:05.559 INFO:tasks.workunit.client.0.smithi069.stderr: 1550K .......... .......... .......... .......... .......... 1% 67.3M 28s 2024-02-21T07:44:05.559 INFO:tasks.workunit.client.0.smithi069.stderr: 1600K .......... .......... .......... .......... .......... 1% 65.6M 27s 2024-02-21T07:44:05.561 INFO:tasks.workunit.client.0.smithi069.stderr: 1650K .......... .......... .......... .......... .......... 1% 54.1M 26s 2024-02-21T07:44:05.561 INFO:tasks.workunit.client.0.smithi069.stderr: 1700K .......... .......... .......... .......... .......... 1% 70.2M 26s 2024-02-21T07:44:05.561 INFO:tasks.workunit.client.0.smithi069.stderr: 1750K .......... .......... .......... .......... .......... 1% 75.6M 25s 2024-02-21T07:44:05.593 INFO:tasks.workunit.client.0.smithi069.stderr: 1800K .......... .......... .......... .......... .......... 1% 1.53M 26s 2024-02-21T07:44:05.595 INFO:tasks.workunit.client.0.smithi069.stderr: 1850K .......... .......... .......... .......... .......... 1% 59.0M 26s 2024-02-21T07:44:05.595 INFO:tasks.workunit.client.0.smithi069.stderr: 1900K .......... .......... .......... .......... .......... 1% 76.5M 25s 2024-02-21T07:44:05.596 INFO:tasks.workunit.client.0.smithi069.stderr: 1950K .......... .......... .......... .......... .......... 1% 32.7M 25s 2024-02-21T07:44:05.597 INFO:tasks.workunit.client.0.smithi069.stderr: 2000K .......... .......... .......... .......... .......... 1% 72.2M 24s 2024-02-21T07:44:05.598 INFO:tasks.workunit.client.0.smithi069.stderr: 2050K .......... .......... .......... .......... .......... 1% 28.4M 24s 2024-02-21T07:44:05.632 INFO:tasks.workunit.client.0.smithi069.stderr: 2100K .......... .......... .......... .......... .......... 1% 1.64M 25s 2024-02-21T07:44:05.633 INFO:tasks.workunit.client.0.smithi069.stderr: 2150K .......... .......... .......... .......... .......... 1% 55.6M 24s 2024-02-21T07:44:05.633 INFO:tasks.workunit.client.0.smithi069.stderr: 2200K .......... .......... .......... .......... .......... 1% 77.2M 24s 2024-02-21T07:44:05.633 INFO:tasks.workunit.client.0.smithi069.stderr: 2250K .......... .......... .......... .......... .......... 1% 78.4M 23s 2024-02-21T07:44:05.633 INFO:tasks.workunit.client.0.smithi069.stderr: 2300K .......... .......... .......... .......... .......... 1% 28.3M 23s 2024-02-21T07:44:05.634 INFO:tasks.workunit.client.0.smithi069.stderr: 2350K .......... .......... .......... .......... .......... 1% 30.3M 23s 2024-02-21T07:44:05.635 INFO:tasks.workunit.client.0.smithi069.stderr: 2400K .......... .......... .......... .......... .......... 1% 55.7M 22s 2024-02-21T07:44:05.664 INFO:tasks.workunit.client.0.smithi069.stderr: 2450K .......... .......... .......... .......... .......... 1% 1.66M 23s 2024-02-21T07:44:05.666 INFO:tasks.workunit.client.0.smithi069.stderr: 2500K .......... .......... .......... .......... .......... 1% 67.9M 23s 2024-02-21T07:44:05.666 INFO:tasks.workunit.client.0.smithi069.stderr: 2550K .......... .......... .......... .......... .......... 1% 61.0M 22s 2024-02-21T07:44:05.667 INFO:tasks.workunit.client.0.smithi069.stderr: 2600K .......... .......... .......... .......... .......... 1% 34.7M 22s 2024-02-21T07:44:05.668 INFO:tasks.workunit.client.0.smithi069.stderr: 2650K .......... .......... .......... .......... .......... 1% 43.4M 22s 2024-02-21T07:44:05.670 INFO:tasks.workunit.client.0.smithi069.stderr: 2700K .......... .......... .......... .......... .......... 2% 37.6M 21s 2024-02-21T07:44:05.670 INFO:tasks.workunit.client.0.smithi069.stderr: 2750K .......... .......... .......... .......... .......... 2% 59.1M 21s 2024-02-21T07:44:05.706 INFO:tasks.workunit.client.0.smithi069.stderr: 2800K .......... .......... .......... .......... .......... 2% 1.67M 22s 2024-02-21T07:44:05.706 INFO:tasks.workunit.client.0.smithi069.stderr: 2850K .......... .......... .......... .......... .......... 2% 46.7M 22s 2024-02-21T07:44:05.706 INFO:tasks.workunit.client.0.smithi069.stderr: 2900K .......... .......... .......... .......... .......... 2% 56.6M 21s 2024-02-21T07:44:05.706 INFO:tasks.workunit.client.0.smithi069.stderr: 2950K .......... .......... .......... .......... .......... 2% 66.8M 21s 2024-02-21T07:44:05.706 INFO:tasks.workunit.client.0.smithi069.stderr: 3000K .......... .......... .......... .......... .......... 2% 38.5M 21s 2024-02-21T07:44:05.706 INFO:tasks.workunit.client.0.smithi069.stderr: 3050K .......... .......... .......... .......... .......... 2% 43.3M 20s 2024-02-21T07:44:05.706 INFO:tasks.workunit.client.0.smithi069.stderr: 3100K .......... .......... .......... .......... .......... 2% 52.9M 20s 2024-02-21T07:44:05.738 INFO:tasks.workunit.client.0.smithi069.stderr: 3150K .......... .......... .......... .......... .......... 2% 1.67M 21s 2024-02-21T07:44:05.738 INFO:tasks.workunit.client.0.smithi069.stderr: 3200K .......... .......... .......... .......... .......... 2% 54.5M 21s 2024-02-21T07:44:05.739 INFO:tasks.workunit.client.0.smithi069.stderr: 3250K .......... .......... .......... .......... .......... 2% 57.7M 20s 2024-02-21T07:44:05.739 INFO:tasks.workunit.client.0.smithi069.stderr: 3300K .......... .......... .......... .......... .......... 2% 64.3M 20s 2024-02-21T07:44:05.739 INFO:tasks.workunit.client.0.smithi069.stderr: 3350K .......... .......... .......... .......... .......... 2% 50.7M 20s 2024-02-21T07:44:05.742 INFO:tasks.workunit.client.0.smithi069.stderr: 3400K .......... .......... .......... .......... .......... 2% 35.3M 20s 2024-02-21T07:44:05.742 INFO:tasks.workunit.client.0.smithi069.stderr: 3450K .......... .......... .......... .......... .......... 2% 57.8M 19s 2024-02-21T07:44:05.742 INFO:tasks.workunit.client.0.smithi069.stderr: 3500K .......... .......... .......... .......... .......... 2% 56.5M 19s 2024-02-21T07:44:05.777 INFO:tasks.workunit.client.0.smithi069.stderr: 3550K .......... .......... .......... .......... .......... 2% 1.67M 20s 2024-02-21T07:44:05.777 INFO:tasks.workunit.client.0.smithi069.stderr: 3600K .......... .......... .......... .......... .......... 2% 55.7M 20s 2024-02-21T07:44:05.777 INFO:tasks.workunit.client.0.smithi069.stderr: 3650K .......... .......... .......... .......... .......... 2% 58.0M 19s 2024-02-21T07:44:05.777 INFO:tasks.workunit.client.0.smithi069.stderr: 3700K .......... .......... .......... .......... .......... 2% 59.3M 19s 2024-02-21T07:44:05.778 INFO:tasks.workunit.client.0.smithi069.stderr: 3750K .......... .......... .......... .......... .......... 2% 64.1M 19s 2024-02-21T07:44:05.778 INFO:tasks.workunit.client.0.smithi069.stderr: 3800K .......... .......... .......... .......... .......... 2% 47.4M 19s 2024-02-21T07:44:05.778 INFO:tasks.workunit.client.0.smithi069.stderr: 3850K .......... .......... .......... .......... .......... 2% 53.0M 19s 2024-02-21T07:44:05.778 INFO:tasks.workunit.client.0.smithi069.stderr: 3900K .......... .......... .......... .......... .......... 2% 55.9M 18s 2024-02-21T07:44:05.819 INFO:tasks.workunit.client.0.smithi069.stderr: 3950K .......... .......... .......... .......... .......... 2% 1.67M 19s 2024-02-21T07:44:05.819 INFO:tasks.workunit.client.0.smithi069.stderr: 4000K .......... .......... .......... .......... .......... 2% 52.2M 19s 2024-02-21T07:44:05.819 INFO:tasks.workunit.client.0.smithi069.stderr: 4050K .......... .......... .......... .......... .......... 3% 51.1M 19s 2024-02-21T07:44:05.820 INFO:tasks.workunit.client.0.smithi069.stderr: 4100K .......... .......... .......... .......... .......... 3% 51.3M 18s 2024-02-21T07:44:05.820 INFO:tasks.workunit.client.0.smithi069.stderr: 4150K .......... .......... .......... .......... .......... 3% 61.5M 18s 2024-02-21T07:44:05.820 INFO:tasks.workunit.client.0.smithi069.stderr: 4200K .......... .......... .......... .......... .......... 3% 52.2M 18s 2024-02-21T07:44:05.820 INFO:tasks.workunit.client.0.smithi069.stderr: 4250K .......... .......... .......... .......... .......... 3% 50.6M 18s 2024-02-21T07:44:05.820 INFO:tasks.workunit.client.0.smithi069.stderr: 4300K .......... .......... .......... .......... .......... 3% 56.4M 18s 2024-02-21T07:44:05.820 INFO:tasks.workunit.client.0.smithi069.stderr: 4350K .......... .......... .......... .......... .......... 3% 69.9M 17s 2024-02-21T07:44:05.849 INFO:tasks.workunit.client.0.smithi069.stderr: 4400K .......... .......... .......... .......... .......... 3% 1.69M 18s 2024-02-21T07:44:05.849 INFO:tasks.workunit.client.0.smithi069.stderr: 4450K .......... .......... .......... .......... .......... 3% 57.2M 18s 2024-02-21T07:44:05.849 INFO:tasks.workunit.client.0.smithi069.stderr: 4500K .......... .......... .......... .......... .......... 3% 49.4M 18s 2024-02-21T07:44:05.849 INFO:tasks.workunit.client.0.smithi069.stderr: 4550K .......... .......... .......... .......... .......... 3% 62.2M 18s 2024-02-21T07:44:05.849 INFO:tasks.workunit.client.0.smithi069.stderr: 4600K .......... .......... .......... .......... .......... 3% 62.1M 17s 2024-02-21T07:44:05.849 INFO:tasks.workunit.client.0.smithi069.stderr: 4650K .......... .......... .......... .......... .......... 3% 60.7M 17s 2024-02-21T07:44:05.849 INFO:tasks.workunit.client.0.smithi069.stderr: 4700K .......... .......... .......... .......... .......... 3% 52.0M 17s 2024-02-21T07:44:05.849 INFO:tasks.workunit.client.0.smithi069.stderr: 4750K .......... .......... .......... .......... .......... 3% 55.2M 17s 2024-02-21T07:44:05.849 INFO:tasks.workunit.client.0.smithi069.stderr: 4800K .......... .......... .......... .......... .......... 3% 72.3M 17s 2024-02-21T07:44:05.881 INFO:tasks.workunit.client.0.smithi069.stderr: 4850K .......... .......... .......... .......... .......... 3% 1.69M 17s 2024-02-21T07:44:05.881 INFO:tasks.workunit.client.0.smithi069.stderr: 4900K .......... .......... .......... .......... .......... 3% 52.7M 17s 2024-02-21T07:44:05.881 INFO:tasks.workunit.client.0.smithi069.stderr: 4950K .......... .......... .......... .......... .......... 3% 59.0M 17s 2024-02-21T07:44:05.881 INFO:tasks.workunit.client.0.smithi069.stderr: 5000K .......... .......... .......... .......... .......... 3% 58.5M 17s 2024-02-21T07:44:05.881 INFO:tasks.workunit.client.0.smithi069.stderr: 5050K .......... .......... .......... .......... .......... 3% 57.4M 17s 2024-02-21T07:44:05.882 INFO:tasks.workunit.client.0.smithi069.stderr: 5100K .......... .......... .......... .......... .......... 3% 38.7M 17s 2024-02-21T07:44:05.885 INFO:tasks.workunit.client.0.smithi069.stderr: 5150K .......... .......... .......... .......... .......... 3% 48.7M 16s 2024-02-21T07:44:05.885 INFO:tasks.workunit.client.0.smithi069.stderr: 5200K .......... .......... .......... .......... .......... 3% 62.6M 16s 2024-02-21T07:44:05.885 INFO:tasks.workunit.client.0.smithi069.stderr: 5250K .......... .......... .......... .......... .......... 3% 82.9M 16s 2024-02-21T07:44:05.885 INFO:tasks.workunit.client.0.smithi069.stderr: 5300K .......... .......... .......... .......... .......... 3% 77.7M 16s 2024-02-21T07:44:05.913 INFO:tasks.workunit.client.0.smithi069.stderr: 5350K .......... .......... .......... .......... .......... 3% 1.73M 17s 2024-02-21T07:44:05.919 INFO:tasks.workunit.client.0.smithi069.stderr: 5400K .......... .......... .......... .......... .......... 4% 66.4M 16s 2024-02-21T07:44:05.919 INFO:tasks.workunit.client.0.smithi069.stderr: 5450K .......... .......... .......... .......... .......... 4% 62.0M 16s 2024-02-21T07:44:05.919 INFO:tasks.workunit.client.0.smithi069.stderr: 5500K .......... .......... .......... .......... .......... 4% 82.1M 16s 2024-02-21T07:44:05.919 INFO:tasks.workunit.client.0.smithi069.stderr: 5550K .......... .......... .......... .......... .......... 4% 72.8M 16s 2024-02-21T07:44:05.919 INFO:tasks.workunit.client.0.smithi069.stderr: 5600K .......... .......... .......... .......... .......... 4% 46.3M 16s 2024-02-21T07:44:05.919 INFO:tasks.workunit.client.0.smithi069.stderr: 5650K .......... .......... .......... .......... .......... 4% 71.3M 16s 2024-02-21T07:44:05.920 INFO:tasks.workunit.client.0.smithi069.stderr: 5700K .......... .......... .......... .......... .......... 4% 69.3M 16s 2024-02-21T07:44:05.920 INFO:tasks.workunit.client.0.smithi069.stderr: 5750K .......... .......... .......... .......... .......... 4% 70.6M 16s 2024-02-21T07:44:05.948 INFO:tasks.workunit.client.0.smithi069.stderr: 5800K .......... .......... .......... .......... .......... 4% 1.69M 16s 2024-02-21T07:44:05.949 INFO:tasks.workunit.client.0.smithi069.stderr: 5850K .......... .......... .......... .......... .......... 4% 60.3M 16s 2024-02-21T07:44:05.958 INFO:tasks.workunit.client.0.smithi069.stderr: 5900K .......... .......... .......... .......... .......... 4% 68.8M 16s 2024-02-21T07:44:05.958 INFO:tasks.workunit.client.0.smithi069.stderr: 5950K .......... .......... .......... .......... .......... 4% 68.7M 16s 2024-02-21T07:44:05.958 INFO:tasks.workunit.client.0.smithi069.stderr: 6000K .......... .......... .......... .......... .......... 4% 66.5M 16s 2024-02-21T07:44:05.959 INFO:tasks.workunit.client.0.smithi069.stderr: 6050K .......... .......... .......... .......... .......... 4% 73.8M 15s 2024-02-21T07:44:05.959 INFO:tasks.workunit.client.0.smithi069.stderr: 6100K .......... .......... .......... .......... .......... 4% 39.6M 15s 2024-02-21T07:44:05.959 INFO:tasks.workunit.client.0.smithi069.stderr: 6150K .......... .......... .......... .......... .......... 4% 75.8M 15s 2024-02-21T07:44:05.959 INFO:tasks.workunit.client.0.smithi069.stderr: 6200K .......... .......... .......... .......... .......... 4% 69.7M 15s 2024-02-21T07:44:05.959 INFO:tasks.workunit.client.0.smithi069.stderr: 6250K .......... .......... .......... .......... .......... 4% 64.5M 15s 2024-02-21T07:44:05.959 INFO:tasks.workunit.client.0.smithi069.stderr: 6300K .......... .......... .......... .......... .......... 4% 79.3M 15s 2024-02-21T07:44:05.984 INFO:tasks.workunit.client.0.smithi069.stderr: 6350K .......... .......... .......... .......... .......... 4% 1.72M 15s 2024-02-21T07:44:05.984 INFO:tasks.workunit.client.0.smithi069.stderr: 6400K .......... .......... .......... .......... .......... 4% 64.7M 15s 2024-02-21T07:44:05.992 INFO:tasks.workunit.client.0.smithi069.stderr: 6450K .......... .......... .......... .......... .......... 4% 58.5M 15s 2024-02-21T07:44:05.992 INFO:tasks.workunit.client.0.smithi069.stderr: 6500K .......... .......... .......... .......... .......... 4% 79.7M 15s 2024-02-21T07:44:05.992 INFO:tasks.workunit.client.0.smithi069.stderr: 6550K .......... .......... .......... .......... .......... 4% 73.7M 15s 2024-02-21T07:44:05.992 INFO:tasks.workunit.client.0.smithi069.stderr: 6600K .......... .......... .......... .......... .......... 4% 81.7M 15s 2024-02-21T07:44:05.992 INFO:tasks.workunit.client.0.smithi069.stderr: 6650K .......... .......... .......... .......... .......... 4% 43.9M 15s 2024-02-21T07:44:05.992 INFO:tasks.workunit.client.0.smithi069.stderr: 6700K .......... .......... .......... .......... .......... 4% 69.2M 15s 2024-02-21T07:44:05.992 INFO:tasks.workunit.client.0.smithi069.stderr: 6750K .......... .......... .......... .......... .......... 5% 70.1M 14s 2024-02-21T07:44:05.992 INFO:tasks.workunit.client.0.smithi069.stderr: 6800K .......... .......... .......... .......... .......... 5% 75.0M 14s 2024-02-21T07:44:05.992 INFO:tasks.workunit.client.0.smithi069.stderr: 6850K .......... .......... .......... .......... .......... 5% 55.8M 14s 2024-02-21T07:44:06.020 INFO:tasks.workunit.client.0.smithi069.stderr: 6900K .......... .......... .......... .......... .......... 5% 1.73M 15s 2024-02-21T07:44:06.024 INFO:tasks.workunit.client.0.smithi069.stderr: 6950K .......... .......... .......... .......... .......... 5% 59.5M 15s 2024-02-21T07:44:06.024 INFO:tasks.workunit.client.0.smithi069.stderr: 7000K .......... .......... .......... .......... .......... 5% 68.2M 15s 2024-02-21T07:44:06.024 INFO:tasks.workunit.client.0.smithi069.stderr: 7050K .......... .......... .......... .......... .......... 5% 75.0M 14s 2024-02-21T07:44:06.024 INFO:tasks.workunit.client.0.smithi069.stderr: 7100K .......... .......... .......... .......... .......... 5% 73.0M 14s 2024-02-21T07:44:06.024 INFO:tasks.workunit.client.0.smithi069.stderr: 7150K .......... .......... .......... .......... .......... 5% 67.9M 14s 2024-02-21T07:44:06.024 INFO:tasks.workunit.client.0.smithi069.stderr: 7200K .......... .......... .......... .......... .......... 5% 70.0M 14s 2024-02-21T07:44:06.027 INFO:tasks.workunit.client.0.smithi069.stderr: 7250K .......... .......... .......... .......... .......... 5% 66.8M 14s 2024-02-21T07:44:06.027 INFO:tasks.workunit.client.0.smithi069.stderr: 7300K .......... .......... .......... .......... .......... 5% 70.3M 14s 2024-02-21T07:44:06.027 INFO:tasks.workunit.client.0.smithi069.stderr: 7350K .......... .......... .......... .......... .......... 5% 66.8M 14s 2024-02-21T07:44:06.028 INFO:tasks.workunit.client.0.smithi069.stderr: 7400K .......... .......... .......... .......... .......... 5% 37.1M 14s 2024-02-21T07:44:06.055 INFO:tasks.workunit.client.0.smithi069.stderr: 7450K .......... .......... .......... .......... .......... 5% 1.79M 14s 2024-02-21T07:44:06.057 INFO:tasks.workunit.client.0.smithi069.stderr: 7500K .......... .......... .......... .......... .......... 5% 63.2M 14s 2024-02-21T07:44:06.057 INFO:tasks.workunit.client.0.smithi069.stderr: 7550K .......... .......... .......... .......... .......... 5% 55.9M 14s 2024-02-21T07:44:06.057 INFO:tasks.workunit.client.0.smithi069.stderr: 7600K .......... .......... .......... .......... .......... 5% 71.0M 14s 2024-02-21T07:44:06.061 INFO:tasks.workunit.client.0.smithi069.stderr: 7650K .......... .......... .......... .......... .......... 5% 68.9M 14s 2024-02-21T07:44:06.061 INFO:tasks.workunit.client.0.smithi069.stderr: 7700K .......... .......... .......... .......... .......... 5% 75.2M 14s 2024-02-21T07:44:06.061 INFO:tasks.workunit.client.0.smithi069.stderr: 7750K .......... .......... .......... .......... .......... 5% 66.6M 14s 2024-02-21T07:44:06.061 INFO:tasks.workunit.client.0.smithi069.stderr: 7800K .......... .......... .......... .......... .......... 5% 69.0M 14s 2024-02-21T07:44:06.061 INFO:tasks.workunit.client.0.smithi069.stderr: 7850K .......... .......... .......... .......... .......... 5% 68.2M 13s 2024-02-21T07:44:06.061 INFO:tasks.workunit.client.0.smithi069.stderr: 7900K .......... .......... .......... .......... .......... 5% 75.4M 13s 2024-02-21T07:44:06.063 INFO:tasks.workunit.client.0.smithi069.stderr: 7950K .......... .......... .......... .......... .......... 5% 70.6M 13s 2024-02-21T07:44:06.063 INFO:tasks.workunit.client.0.smithi069.stderr: 8000K .......... .......... .......... .......... .......... 5% 31.5M 13s 2024-02-21T07:44:06.065 INFO:tasks.workunit.client.0.smithi069.stderr: 8050K .......... .......... .......... .......... .......... 5% 30.9M 13s 2024-02-21T07:44:06.091 INFO:tasks.workunit.client.0.smithi069.stderr: 8100K .......... .......... .......... .......... .......... 6% 1.87M 14s 2024-02-21T07:44:06.092 INFO:tasks.workunit.client.0.smithi069.stderr: 8150K .......... .......... .......... .......... .......... 6% 66.1M 13s 2024-02-21T07:44:06.094 INFO:tasks.workunit.client.0.smithi069.stderr: 8200K .......... .......... .......... .......... .......... 6% 67.4M 13s 2024-02-21T07:44:06.095 INFO:tasks.workunit.client.0.smithi069.stderr: 8250K .......... .......... .......... .......... .......... 6% 79.3M 13s 2024-02-21T07:44:06.095 INFO:tasks.workunit.client.0.smithi069.stderr: 8300K .......... .......... .......... .......... .......... 6% 63.0M 13s 2024-02-21T07:44:06.095 INFO:tasks.workunit.client.0.smithi069.stderr: 8350K .......... .......... .......... .......... .......... 6% 71.5M 13s 2024-02-21T07:44:06.097 INFO:tasks.workunit.client.0.smithi069.stderr: 8400K .......... .......... .......... .......... .......... 6% 70.9M 13s 2024-02-21T07:44:06.097 INFO:tasks.workunit.client.0.smithi069.stderr: 8450K .......... .......... .......... .......... .......... 6% 66.4M 13s 2024-02-21T07:44:06.097 INFO:tasks.workunit.client.0.smithi069.stderr: 8500K .......... .......... .......... .......... .......... 6% 63.4M 13s 2024-02-21T07:44:06.097 INFO:tasks.workunit.client.0.smithi069.stderr: 8550K .......... .......... .......... .......... .......... 6% 76.9M 13s 2024-02-21T07:44:06.098 INFO:tasks.workunit.client.0.smithi069.stderr: 8600K .......... .......... .......... .......... .......... 6% 35.4M 13s 2024-02-21T07:44:06.101 INFO:tasks.workunit.client.0.smithi069.stderr: 8650K .......... .......... .......... .......... .......... 6% 25.0M 13s 2024-02-21T07:44:06.126 INFO:tasks.workunit.client.0.smithi069.stderr: 8700K .......... .......... .......... .......... .......... 6% 1.93M 13s 2024-02-21T07:44:06.127 INFO:tasks.workunit.client.0.smithi069.stderr: 8750K .......... .......... .......... .......... .......... 6% 63.0M 13s 2024-02-21T07:44:06.130 INFO:tasks.workunit.client.0.smithi069.stderr: 8800K .......... .......... .......... .......... .......... 6% 59.0M 13s 2024-02-21T07:44:06.130 INFO:tasks.workunit.client.0.smithi069.stderr: 8850K .......... .......... .......... .......... .......... 6% 73.6M 13s 2024-02-21T07:44:06.130 INFO:tasks.workunit.client.0.smithi069.stderr: 8900K .......... .......... .......... .......... .......... 6% 72.6M 13s 2024-02-21T07:44:06.130 INFO:tasks.workunit.client.0.smithi069.stderr: 8950K .......... .......... .......... .......... .......... 6% 78.3M 13s 2024-02-21T07:44:06.130 INFO:tasks.workunit.client.0.smithi069.stderr: 9000K .......... .......... .......... .......... .......... 6% 68.5M 13s 2024-02-21T07:44:06.133 INFO:tasks.workunit.client.0.smithi069.stderr: 9050K .......... .......... .......... .......... .......... 6% 68.3M 13s 2024-02-21T07:44:06.133 INFO:tasks.workunit.client.0.smithi069.stderr: 9100K .......... .......... .......... .......... .......... 6% 72.2M 13s 2024-02-21T07:44:06.133 INFO:tasks.workunit.client.0.smithi069.stderr: 9150K .......... .......... .......... .......... .......... 6% 74.3M 12s 2024-02-21T07:44:06.133 INFO:tasks.workunit.client.0.smithi069.stderr: 9200K .......... .......... .......... .......... .......... 6% 45.9M 12s 2024-02-21T07:44:06.135 INFO:tasks.workunit.client.0.smithi069.stderr: 9250K .......... .......... .......... .......... .......... 6% 34.3M 12s 2024-02-21T07:44:06.136 INFO:tasks.workunit.client.0.smithi069.stderr: 9300K .......... .......... .......... .......... .......... 6% 25.1M 12s 2024-02-21T07:44:06.138 INFO:tasks.workunit.client.0.smithi069.stderr: 9350K .......... .......... .......... .......... .......... 6% 32.4M 12s 2024-02-21T07:44:06.162 INFO:tasks.workunit.client.0.smithi069.stderr: 9400K .......... .......... .......... .......... .......... 6% 2.05M 13s 2024-02-21T07:44:06.163 INFO:tasks.workunit.client.0.smithi069.stderr: 9450K .......... .......... .......... .......... .......... 6% 65.4M 12s 2024-02-21T07:44:06.163 INFO:tasks.workunit.client.0.smithi069.stderr: 9500K .......... .......... .......... .......... .......... 7% 69.1M 12s 2024-02-21T07:44:06.166 INFO:tasks.workunit.client.0.smithi069.stderr: 9550K .......... .......... .......... .......... .......... 7% 72.2M 12s 2024-02-21T07:44:06.166 INFO:tasks.workunit.client.0.smithi069.stderr: 9600K .......... .......... .......... .......... .......... 7% 62.5M 12s 2024-02-21T07:44:06.166 INFO:tasks.workunit.client.0.smithi069.stderr: 9650K .......... .......... .......... .......... .......... 7% 77.4M 12s 2024-02-21T07:44:06.168 INFO:tasks.workunit.client.0.smithi069.stderr: 9700K .......... .......... .......... .......... .......... 7% 71.1M 12s 2024-02-21T07:44:06.169 INFO:tasks.workunit.client.0.smithi069.stderr: 9750K .......... .......... .......... .......... .......... 7% 69.5M 12s 2024-02-21T07:44:06.169 INFO:tasks.workunit.client.0.smithi069.stderr: 9800K .......... .......... .......... .......... .......... 7% 63.8M 12s 2024-02-21T07:44:06.169 INFO:tasks.workunit.client.0.smithi069.stderr: 9850K .......... .......... .......... .......... .......... 7% 79.0M 12s 2024-02-21T07:44:06.170 INFO:tasks.workunit.client.0.smithi069.stderr: 9900K .......... .......... .......... .......... .......... 7% 22.4M 12s 2024-02-21T07:44:06.172 INFO:tasks.workunit.client.0.smithi069.stderr: 9950K .......... .......... .......... .......... .......... 7% 32.0M 12s 2024-02-21T07:44:06.174 INFO:tasks.workunit.client.0.smithi069.stderr: 10000K .......... .......... .......... .......... .......... 7% 25.5M 12s 2024-02-21T07:44:06.175 INFO:tasks.workunit.client.0.smithi069.stderr: 10050K .......... .......... .......... .......... .......... 7% 42.8M 12s 2024-02-21T07:44:06.197 INFO:tasks.workunit.client.0.smithi069.stderr: 10100K .......... .......... .......... .......... .......... 7% 2.18M 12s 2024-02-21T07:44:06.210 INFO:tasks.workunit.client.0.smithi069.stderr: 10150K .......... .......... .......... .......... .......... 7% 31.5M 12s 2024-02-21T07:44:06.210 INFO:tasks.workunit.client.0.smithi069.stderr: 10200K .......... .......... .......... .......... .......... 7% 58.0M 12s 2024-02-21T07:44:06.210 INFO:tasks.workunit.client.0.smithi069.stderr: 10250K .......... .......... .......... .......... .......... 7% 62.1M 12s 2024-02-21T07:44:06.210 INFO:tasks.workunit.client.0.smithi069.stderr: 10300K .......... .......... .......... .......... .......... 7% 61.7M 12s 2024-02-21T07:44:06.210 INFO:tasks.workunit.client.0.smithi069.stderr: 10350K .......... .......... .......... .......... .......... 7% 49.1M 12s 2024-02-21T07:44:06.210 INFO:tasks.workunit.client.0.smithi069.stderr: 10400K .......... .......... .......... .......... .......... 7% 65.6M 12s 2024-02-21T07:44:06.210 INFO:tasks.workunit.client.0.smithi069.stderr: 10450K .......... .......... .......... .......... .......... 7% 63.5M 12s 2024-02-21T07:44:06.210 INFO:tasks.workunit.client.0.smithi069.stderr: 10500K .......... .......... .......... .......... .......... 7% 39.1M 12s 2024-02-21T07:44:06.210 INFO:tasks.workunit.client.0.smithi069.stderr: 10550K .......... .......... .......... .......... .......... 7% 49.3M 12s 2024-02-21T07:44:06.210 INFO:tasks.workunit.client.0.smithi069.stderr: 10600K .......... .......... .......... .......... .......... 7% 63.3M 12s 2024-02-21T07:44:06.211 INFO:tasks.workunit.client.0.smithi069.stderr: 10650K .......... .......... .......... .......... .......... 7% 66.4M 11s 2024-02-21T07:44:06.211 INFO:tasks.workunit.client.0.smithi069.stderr: 10700K .......... .......... .......... .......... .......... 7% 41.1M 11s 2024-02-21T07:44:06.212 INFO:tasks.workunit.client.0.smithi069.stderr: 10750K .......... .......... .......... .......... .......... 7% 24.8M 11s 2024-02-21T07:44:06.238 INFO:tasks.workunit.client.0.smithi069.stderr: 10800K .......... .......... .......... .......... .......... 7% 2.25M 12s 2024-02-21T07:44:06.238 INFO:tasks.workunit.client.0.smithi069.stderr: 10850K .......... .......... .......... .......... .......... 8% 55.7M 12s 2024-02-21T07:44:06.238 INFO:tasks.workunit.client.0.smithi069.stderr: 10900K .......... .......... .......... .......... .......... 8% 60.1M 11s 2024-02-21T07:44:06.238 INFO:tasks.workunit.client.0.smithi069.stderr: 10950K .......... .......... .......... .......... .......... 8% 49.9M 11s 2024-02-21T07:44:06.238 INFO:tasks.workunit.client.0.smithi069.stderr: 11000K .......... .......... .......... .......... .......... 8% 62.6M 11s 2024-02-21T07:44:06.238 INFO:tasks.workunit.client.0.smithi069.stderr: 11050K .......... .......... .......... .......... .......... 8% 66.9M 11s 2024-02-21T07:44:06.258 INFO:tasks.workunit.client.0.smithi069.stderr: 11100K .......... .......... .......... .......... .......... 8% 3.85M 11s 2024-02-21T07:44:06.258 INFO:tasks.workunit.client.0.smithi069.stderr: 11150K .......... .......... .......... .......... .......... 8% 49.1M 11s 2024-02-21T07:44:06.258 INFO:tasks.workunit.client.0.smithi069.stderr: 11200K .......... .......... .......... .......... .......... 8% 59.8M 11s 2024-02-21T07:44:06.258 INFO:tasks.workunit.client.0.smithi069.stderr: 11250K .......... .......... .......... .......... .......... 8% 54.0M 11s 2024-02-21T07:44:06.258 INFO:tasks.workunit.client.0.smithi069.stderr: 11300K .......... .......... .......... .......... .......... 8% 63.0M 11s 2024-02-21T07:44:06.259 INFO:tasks.workunit.client.0.smithi069.stderr: 11350K .......... .......... .......... .......... .......... 8% 53.5M 11s 2024-02-21T07:44:06.259 INFO:tasks.workunit.client.0.smithi069.stderr: 11400K .......... .......... .......... .......... .......... 8% 65.4M 11s 2024-02-21T07:44:06.259 INFO:tasks.workunit.client.0.smithi069.stderr: 11450K .......... .......... .......... .......... .......... 8% 60.3M 11s 2024-02-21T07:44:06.259 INFO:tasks.workunit.client.0.smithi069.stderr: 11500K .......... .......... .......... .......... .......... 8% 69.7M 11s 2024-02-21T07:44:06.259 INFO:tasks.workunit.client.0.smithi069.stderr: 11550K .......... .......... .......... .......... .......... 8% 58.1M 11s 2024-02-21T07:44:06.272 INFO:tasks.workunit.client.0.smithi069.stderr: 11600K .......... .......... .......... .......... .......... 8% 4.16M 11s 2024-02-21T07:44:06.272 INFO:tasks.workunit.client.0.smithi069.stderr: 11650K .......... .......... .......... .......... .......... 8% 67.5M 11s 2024-02-21T07:44:06.273 INFO:tasks.workunit.client.0.smithi069.stderr: 11700K .......... .......... .......... .......... .......... 8% 70.0M 11s 2024-02-21T07:44:06.273 INFO:tasks.workunit.client.0.smithi069.stderr: 11750K .......... .......... .......... .......... .......... 8% 65.6M 11s 2024-02-21T07:44:06.273 INFO:tasks.workunit.client.0.smithi069.stderr: 11800K .......... .......... .......... .......... .......... 8% 61.5M 11s 2024-02-21T07:44:06.273 INFO:tasks.workunit.client.0.smithi069.stderr: 11850K .......... .......... .......... .......... .......... 8% 81.7M 11s 2024-02-21T07:44:06.285 INFO:tasks.workunit.client.0.smithi069.stderr: 11900K .......... .......... .......... .......... .......... 8% 3.77M 11s 2024-02-21T07:44:06.286 INFO:tasks.workunit.client.0.smithi069.stderr: 11950K .......... .......... .......... .......... .......... 8% 65.8M 11s 2024-02-21T07:44:06.287 INFO:tasks.workunit.client.0.smithi069.stderr: 12000K .......... .......... .......... .......... .......... 8% 67.1M 11s 2024-02-21T07:44:06.292 INFO:tasks.workunit.client.0.smithi069.stderr: 12050K .......... .......... .......... .......... .......... 8% 59.7M 11s 2024-02-21T07:44:06.293 INFO:tasks.workunit.client.0.smithi069.stderr: 12100K .......... .......... .......... .......... .......... 8% 69.8M 11s 2024-02-21T07:44:06.293 INFO:tasks.workunit.client.0.smithi069.stderr: 12150K .......... .......... .......... .......... .......... 8% 74.8M 11s 2024-02-21T07:44:06.293 INFO:tasks.workunit.client.0.smithi069.stderr: 12200K .......... .......... .......... .......... .......... 9% 75.3M 11s 2024-02-21T07:44:06.293 INFO:tasks.workunit.client.0.smithi069.stderr: 12250K .......... .......... .......... .......... .......... 9% 68.5M 11s 2024-02-21T07:44:06.293 INFO:tasks.workunit.client.0.smithi069.stderr: 12300K .......... .......... .......... .......... .......... 9% 73.3M 11s 2024-02-21T07:44:06.293 INFO:tasks.workunit.client.0.smithi069.stderr: 12350K .......... .......... .......... .......... .......... 9% 72.8M 11s 2024-02-21T07:44:06.305 INFO:tasks.workunit.client.0.smithi069.stderr: 12400K .......... .......... .......... .......... .......... 9% 3.88M 11s 2024-02-21T07:44:06.305 INFO:tasks.workunit.client.0.smithi069.stderr: 12450K .......... .......... .......... .......... .......... 9% 67.4M 11s 2024-02-21T07:44:06.306 INFO:tasks.workunit.client.0.smithi069.stderr: 12500K .......... .......... .......... .......... .......... 9% 69.3M 11s 2024-02-21T07:44:06.308 INFO:tasks.workunit.client.0.smithi069.stderr: 12550K .......... .......... .......... .......... .......... 9% 60.1M 11s 2024-02-21T07:44:06.308 INFO:tasks.workunit.client.0.smithi069.stderr: 12600K .......... .......... .......... .......... .......... 9% 71.0M 11s 2024-02-21T07:44:06.308 INFO:tasks.workunit.client.0.smithi069.stderr: 12650K .......... .......... .......... .......... .......... 9% 79.9M 10s 2024-02-21T07:44:06.321 INFO:tasks.workunit.client.0.smithi069.stderr: 12700K .......... .......... .......... .......... .......... 9% 3.78M 11s 2024-02-21T07:44:06.321 INFO:tasks.workunit.client.0.smithi069.stderr: 12750K .......... .......... .......... .......... .......... 9% 62.7M 11s 2024-02-21T07:44:06.322 INFO:tasks.workunit.client.0.smithi069.stderr: 12800K .......... .......... .......... .......... .......... 9% 65.7M 10s 2024-02-21T07:44:06.323 INFO:tasks.workunit.client.0.smithi069.stderr: 12850K .......... .......... .......... .......... .......... 9% 66.9M 10s 2024-02-21T07:44:06.328 INFO:tasks.workunit.client.0.smithi069.stderr: 12900K .......... .......... .......... .......... .......... 9% 59.1M 10s 2024-02-21T07:44:06.328 INFO:tasks.workunit.client.0.smithi069.stderr: 12950K .......... .......... .......... .......... .......... 9% 77.7M 10s 2024-02-21T07:44:06.328 INFO:tasks.workunit.client.0.smithi069.stderr: 13000K .......... .......... .......... .......... .......... 9% 74.6M 10s 2024-02-21T07:44:06.329 INFO:tasks.workunit.client.0.smithi069.stderr: 13050K .......... .......... .......... .......... .......... 9% 74.9M 10s 2024-02-21T07:44:06.329 INFO:tasks.workunit.client.0.smithi069.stderr: 13100K .......... .......... .......... .......... .......... 9% 68.3M 10s 2024-02-21T07:44:06.329 INFO:tasks.workunit.client.0.smithi069.stderr: 13150K .......... .......... .......... .......... .......... 9% 69.5M 10s 2024-02-21T07:44:06.329 INFO:tasks.workunit.client.0.smithi069.stderr: 13200K .......... .......... .......... .......... .......... 9% 67.4M 10s 2024-02-21T07:44:06.344 INFO:tasks.workunit.client.0.smithi069.stderr: 13250K .......... .......... .......... .......... .......... 9% 4.08M 10s 2024-02-21T07:44:06.344 INFO:tasks.workunit.client.0.smithi069.stderr: 13300K .......... .......... .......... .......... .......... 9% 77.7M 10s 2024-02-21T07:44:06.344 INFO:tasks.workunit.client.0.smithi069.stderr: 13350K .......... .......... .......... .......... .......... 9% 59.3M 10s 2024-02-21T07:44:06.345 INFO:tasks.workunit.client.0.smithi069.stderr: 13400K .......... .......... .......... .......... .......... 9% 66.8M 10s 2024-02-21T07:44:06.345 INFO:tasks.workunit.client.0.smithi069.stderr: 13450K .......... .......... .......... .......... .......... 9% 69.0M 10s 2024-02-21T07:44:06.345 INFO:tasks.workunit.client.0.smithi069.stderr: 13500K .......... .......... .......... .......... .......... 9% 71.2M 10s 2024-02-21T07:44:06.346 INFO:tasks.workunit.client.0.smithi069.stderr: 13550K .......... .......... .......... .......... .......... 10% 18.0M 10s 2024-02-21T07:44:06.356 INFO:tasks.workunit.client.0.smithi069.stderr: 13600K .......... .......... .......... .......... .......... 10% 4.57M 10s 2024-02-21T07:44:06.357 INFO:tasks.workunit.client.0.smithi069.stderr: 13650K .......... .......... .......... .......... .......... 10% 68.5M 10s 2024-02-21T07:44:06.358 INFO:tasks.workunit.client.0.smithi069.stderr: 13700K .......... .......... .......... .......... .......... 10% 66.4M 10s 2024-02-21T07:44:06.359 INFO:tasks.workunit.client.0.smithi069.stderr: 13750K .......... .......... .......... .......... .......... 10% 59.3M 10s 2024-02-21T07:44:06.361 INFO:tasks.workunit.client.0.smithi069.stderr: 13800K .......... .......... .......... .......... .......... 10% 69.8M 10s 2024-02-21T07:44:06.363 INFO:tasks.workunit.client.0.smithi069.stderr: 13850K .......... .......... .......... .......... .......... 10% 80.0M 10s 2024-02-21T07:44:06.363 INFO:tasks.workunit.client.0.smithi069.stderr: 13900K .......... .......... .......... .......... .......... 10% 71.3M 10s 2024-02-21T07:44:06.366 INFO:tasks.workunit.client.0.smithi069.stderr: 13950K .......... .......... .......... .......... .......... 10% 50.2M 10s 2024-02-21T07:44:06.366 INFO:tasks.workunit.client.0.smithi069.stderr: 14000K .......... .......... .......... .......... .......... 10% 75.8M 10s 2024-02-21T07:44:06.366 INFO:tasks.workunit.client.0.smithi069.stderr: 14050K .......... .......... .......... .......... .......... 10% 78.4M 10s 2024-02-21T07:44:06.377 INFO:tasks.workunit.client.0.smithi069.stderr: 14100K .......... .......... .......... .......... .......... 10% 4.23M 10s 2024-02-21T07:44:06.377 INFO:tasks.workunit.client.0.smithi069.stderr: 14150K .......... .......... .......... .......... .......... 10% 65.2M 10s 2024-02-21T07:44:06.377 INFO:tasks.workunit.client.0.smithi069.stderr: 14200K .......... .......... .......... .......... .......... 10% 74.6M 10s 2024-02-21T07:44:06.377 INFO:tasks.workunit.client.0.smithi069.stderr: 14250K .......... .......... .......... .......... .......... 10% 57.3M 10s 2024-02-21T07:44:06.379 INFO:tasks.workunit.client.0.smithi069.stderr: 14300K .......... .......... .......... .......... .......... 10% 64.0M 10s 2024-02-21T07:44:06.380 INFO:tasks.workunit.client.0.smithi069.stderr: 14350K .......... .......... .......... .......... .......... 10% 69.5M 10s 2024-02-21T07:44:06.380 INFO:tasks.workunit.client.0.smithi069.stderr: 14400K .......... .......... .......... .......... .......... 10% 83.3M 10s 2024-02-21T07:44:06.381 INFO:tasks.workunit.client.0.smithi069.stderr: 14450K .......... .......... .......... .......... .......... 10% 19.1M 10s 2024-02-21T07:44:06.392 INFO:tasks.workunit.client.0.smithi069.stderr: 14500K .......... .......... .......... .......... .......... 10% 4.64M 10s 2024-02-21T07:44:06.393 INFO:tasks.workunit.client.0.smithi069.stderr: 14550K .......... .......... .......... .......... .......... 10% 45.7M 10s 2024-02-21T07:44:06.401 INFO:tasks.workunit.client.0.smithi069.stderr: 14600K .......... .......... .......... .......... .......... 10% 38.3M 10s 2024-02-21T07:44:06.401 INFO:tasks.workunit.client.0.smithi069.stderr: 14650K .......... .......... .......... .......... .......... 10% 68.8M 10s 2024-02-21T07:44:06.401 INFO:tasks.workunit.client.0.smithi069.stderr: 14700K .......... .......... .......... .......... .......... 10% 78.6M 10s 2024-02-21T07:44:06.401 INFO:tasks.workunit.client.0.smithi069.stderr: 14750K .......... .......... .......... .......... .......... 10% 43.7M 10s 2024-02-21T07:44:06.401 INFO:tasks.workunit.client.0.smithi069.stderr: 14800K .......... .......... .......... .......... .......... 10% 66.7M 10s 2024-02-21T07:44:06.401 INFO:tasks.workunit.client.0.smithi069.stderr: 14850K .......... .......... .......... .......... .......... 10% 78.9M 10s 2024-02-21T07:44:06.401 INFO:tasks.workunit.client.0.smithi069.stderr: 14900K .......... .......... .......... .......... .......... 11% 77.5M 9s 2024-02-21T07:44:06.401 INFO:tasks.workunit.client.0.smithi069.stderr: 14950K .......... .......... .......... .......... .......... 11% 63.8M 9s 2024-02-21T07:44:06.401 INFO:tasks.workunit.client.0.smithi069.stderr: 15000K .......... .......... .......... .......... .......... 11% 76.9M 9s 2024-02-21T07:44:06.411 INFO:tasks.workunit.client.0.smithi069.stderr: 15050K .......... .......... .......... .......... .......... 11% 4.71M 9s 2024-02-21T07:44:06.412 INFO:tasks.workunit.client.0.smithi069.stderr: 15100K .......... .......... .......... .......... .......... 11% 61.0M 9s 2024-02-21T07:44:06.412 INFO:tasks.workunit.client.0.smithi069.stderr: 15150K .......... .......... .......... .......... .......... 11% 69.7M 9s 2024-02-21T07:44:06.413 INFO:tasks.workunit.client.0.smithi069.stderr: 15200K .......... .......... .......... .......... .......... 11% 68.2M 9s 2024-02-21T07:44:06.415 INFO:tasks.workunit.client.0.smithi069.stderr: 15250K .......... .......... .......... .......... .......... 11% 58.8M 9s 2024-02-21T07:44:06.416 INFO:tasks.workunit.client.0.smithi069.stderr: 15300K .......... .......... .......... .......... .......... 11% 81.6M 9s 2024-02-21T07:44:06.416 INFO:tasks.workunit.client.0.smithi069.stderr: 15350K .......... .......... .......... .......... .......... 11% 76.7M 9s 2024-02-21T07:44:06.418 INFO:tasks.workunit.client.0.smithi069.stderr: 15400K .......... .......... .......... .......... .......... 11% 15.3M 9s 2024-02-21T07:44:06.428 INFO:tasks.workunit.client.0.smithi069.stderr: 15450K .......... .......... .......... .......... .......... 11% 5.12M 9s 2024-02-21T07:44:06.428 INFO:tasks.workunit.client.0.smithi069.stderr: 15500K .......... .......... .......... .......... .......... 11% 57.5M 9s 2024-02-21T07:44:06.429 INFO:tasks.workunit.client.0.smithi069.stderr: 15550K .......... .......... .......... .......... .......... 11% 69.1M 9s 2024-02-21T07:44:06.434 INFO:tasks.workunit.client.0.smithi069.stderr: 15600K .......... .......... .......... .......... .......... 11% 67.5M 9s 2024-02-21T07:44:06.434 INFO:tasks.workunit.client.0.smithi069.stderr: 15650K .......... .......... .......... .......... .......... 11% 67.2M 9s 2024-02-21T07:44:06.434 INFO:tasks.workunit.client.0.smithi069.stderr: 15700K .......... .......... .......... .......... .......... 11% 62.7M 9s 2024-02-21T07:44:06.434 INFO:tasks.workunit.client.0.smithi069.stderr: 15750K .......... .......... .......... .......... .......... 11% 79.5M 9s 2024-02-21T07:44:06.434 INFO:tasks.workunit.client.0.smithi069.stderr: 15800K .......... .......... .......... .......... .......... 11% 75.7M 9s 2024-02-21T07:44:06.435 INFO:tasks.workunit.client.0.smithi069.stderr: 15850K .......... .......... .......... .......... .......... 11% 73.0M 9s 2024-02-21T07:44:06.435 INFO:tasks.workunit.client.0.smithi069.stderr: 15900K .......... .......... .......... .......... .......... 11% 65.7M 9s 2024-02-21T07:44:06.437 INFO:tasks.workunit.client.0.smithi069.stderr: 15950K .......... .......... .......... .......... .......... 11% 35.4M 9s 2024-02-21T07:44:06.447 INFO:tasks.workunit.client.0.smithi069.stderr: 16000K .......... .......... .......... .......... .......... 11% 4.70M 9s 2024-02-21T07:44:06.447 INFO:tasks.workunit.client.0.smithi069.stderr: 16050K .......... .......... .......... .......... .......... 11% 72.2M 9s 2024-02-21T07:44:06.448 INFO:tasks.workunit.client.0.smithi069.stderr: 16100K .......... .......... .......... .......... .......... 11% 73.2M 9s 2024-02-21T07:44:06.449 INFO:tasks.workunit.client.0.smithi069.stderr: 16150K .......... .......... .......... .......... .......... 11% 57.1M 9s 2024-02-21T07:44:06.449 INFO:tasks.workunit.client.0.smithi069.stderr: 16200K .......... .......... .......... .......... .......... 11% 66.3M 9s 2024-02-21T07:44:06.453 INFO:tasks.workunit.client.0.smithi069.stderr: 16250K .......... .......... .......... .......... .......... 12% 69.9M 9s 2024-02-21T07:44:06.453 INFO:tasks.workunit.client.0.smithi069.stderr: 16300K .......... .......... .......... .......... .......... 12% 81.8M 9s 2024-02-21T07:44:06.453 INFO:tasks.workunit.client.0.smithi069.stderr: 16350K .......... .......... .......... .......... .......... 12% 64.9M 9s 2024-02-21T07:44:06.453 INFO:tasks.workunit.client.0.smithi069.stderr: 16400K .......... .......... .......... .......... .......... 12% 18.0M 9s 2024-02-21T07:44:06.463 INFO:tasks.workunit.client.0.smithi069.stderr: 16450K .......... .......... .......... .......... .......... 12% 5.07M 9s 2024-02-21T07:44:06.464 INFO:tasks.workunit.client.0.smithi069.stderr: 16500K .......... .......... .......... .......... .......... 12% 63.3M 9s 2024-02-21T07:44:06.465 INFO:tasks.workunit.client.0.smithi069.stderr: 16550K .......... .......... .......... .......... .......... 12% 66.1M 9s 2024-02-21T07:44:06.466 INFO:tasks.workunit.client.0.smithi069.stderr: 16600K .......... .......... .......... .......... .......... 12% 57.4M 9s 2024-02-21T07:44:06.470 INFO:tasks.workunit.client.0.smithi069.stderr: 16650K .......... .......... .......... .......... .......... 12% 69.7M 9s 2024-02-21T07:44:06.470 INFO:tasks.workunit.client.0.smithi069.stderr: 16700K .......... .......... .......... .......... .......... 12% 73.2M 9s 2024-02-21T07:44:06.470 INFO:tasks.workunit.client.0.smithi069.stderr: 16750K .......... .......... .......... .......... .......... 12% 73.9M 9s 2024-02-21T07:44:06.470 INFO:tasks.workunit.client.0.smithi069.stderr: 16800K .......... .......... .......... .......... .......... 12% 69.5M 9s 2024-02-21T07:44:06.470 INFO:tasks.workunit.client.0.smithi069.stderr: 16850K .......... .......... .......... .......... .......... 12% 72.8M 9s 2024-02-21T07:44:06.470 INFO:tasks.workunit.client.0.smithi069.stderr: 16900K .......... .......... .......... .......... .......... 12% 76.2M 9s 2024-02-21T07:44:06.471 INFO:tasks.workunit.client.0.smithi069.stderr: 16950K .......... .......... .......... .......... .......... 12% 41.8M 9s 2024-02-21T07:44:06.473 INFO:tasks.workunit.client.0.smithi069.stderr: 17000K .......... .......... .......... .......... .......... 12% 22.7M 9s 2024-02-21T07:44:06.483 INFO:tasks.workunit.client.0.smithi069.stderr: 17050K .......... .......... .......... .......... .......... 12% 5.45M 9s 2024-02-21T07:44:06.483 INFO:tasks.workunit.client.0.smithi069.stderr: 17100K .......... .......... .......... .......... .......... 12% 76.7M 9s 2024-02-21T07:44:06.487 INFO:tasks.workunit.client.0.smithi069.stderr: 17150K .......... .......... .......... .......... .......... 12% 67.0M 9s 2024-02-21T07:44:06.487 INFO:tasks.workunit.client.0.smithi069.stderr: 17200K .......... .......... .......... .......... .......... 12% 53.1M 9s 2024-02-21T07:44:06.487 INFO:tasks.workunit.client.0.smithi069.stderr: 17250K .......... .......... .......... .......... .......... 12% 50.5M 9s 2024-02-21T07:44:06.487 INFO:tasks.workunit.client.0.smithi069.stderr: 17300K .......... .......... .......... .......... .......... 12% 71.4M 9s 2024-02-21T07:44:06.487 INFO:tasks.workunit.client.0.smithi069.stderr: 17350K .......... .......... .......... .......... .......... 12% 73.5M 9s 2024-02-21T07:44:06.488 INFO:tasks.workunit.client.0.smithi069.stderr: 17400K .......... .......... .......... .......... .......... 12% 39.4M 9s 2024-02-21T07:44:06.489 INFO:tasks.workunit.client.0.smithi069.stderr: 17450K .......... .......... .......... .......... .......... 12% 27.6M 9s 2024-02-21T07:44:06.499 INFO:tasks.workunit.client.0.smithi069.stderr: 17500K .......... .......... .......... .......... .......... 12% 5.33M 9s 2024-02-21T07:44:06.499 INFO:tasks.workunit.client.0.smithi069.stderr: 17550K .......... .......... .......... .......... .......... 12% 55.3M 9s 2024-02-21T07:44:06.500 INFO:tasks.workunit.client.0.smithi069.stderr: 17600K .......... .......... .......... .......... .......... 13% 56.1M 9s 2024-02-21T07:44:06.501 INFO:tasks.workunit.client.0.smithi069.stderr: 17650K .......... .......... .......... .......... .......... 13% 60.3M 9s 2024-02-21T07:44:06.503 INFO:tasks.workunit.client.0.smithi069.stderr: 17700K .......... .......... .......... .......... .......... 13% 68.0M 8s 2024-02-21T07:44:06.503 INFO:tasks.workunit.client.0.smithi069.stderr: 17750K .......... .......... .......... .......... .......... 13% 60.3M 8s 2024-02-21T07:44:06.506 INFO:tasks.workunit.client.0.smithi069.stderr: 17800K .......... .......... .......... .......... .......... 13% 78.6M 8s 2024-02-21T07:44:06.506 INFO:tasks.workunit.client.0.smithi069.stderr: 17850K .......... .......... .......... .......... .......... 13% 74.4M 8s 2024-02-21T07:44:06.506 INFO:tasks.workunit.client.0.smithi069.stderr: 17900K .......... .......... .......... .......... .......... 13% 72.2M 8s 2024-02-21T07:44:06.507 INFO:tasks.workunit.client.0.smithi069.stderr: 17950K .......... .......... .......... .......... .......... 13% 69.4M 8s 2024-02-21T07:44:06.507 INFO:tasks.workunit.client.0.smithi069.stderr: 18000K .......... .......... .......... .......... .......... 13% 41.6M 8s 2024-02-21T07:44:06.509 INFO:tasks.workunit.client.0.smithi069.stderr: 18050K .......... .......... .......... .......... .......... 13% 26.1M 8s 2024-02-21T07:44:06.510 INFO:tasks.workunit.client.0.smithi069.stderr: 18100K .......... .......... .......... .......... .......... 13% 26.4M 8s 2024-02-21T07:44:06.518 INFO:tasks.workunit.client.0.smithi069.stderr: 18150K .......... .......... .......... .......... .......... 13% 6.49M 8s 2024-02-21T07:44:06.519 INFO:tasks.workunit.client.0.smithi069.stderr: 18200K .......... .......... .......... .......... .......... 13% 33.4M 8s 2024-02-21T07:44:06.523 INFO:tasks.workunit.client.0.smithi069.stderr: 18250K .......... .......... .......... .......... .......... 13% 66.4M 8s 2024-02-21T07:44:06.523 INFO:tasks.workunit.client.0.smithi069.stderr: 18300K .......... .......... .......... .......... .......... 13% 74.6M 8s 2024-02-21T07:44:06.523 INFO:tasks.workunit.client.0.smithi069.stderr: 18350K .......... .......... .......... .......... .......... 13% 75.1M 8s 2024-02-21T07:44:06.524 INFO:tasks.workunit.client.0.smithi069.stderr: 18400K .......... .......... .......... .......... .......... 13% 67.8M 8s 2024-02-21T07:44:06.524 INFO:tasks.workunit.client.0.smithi069.stderr: 18450K .......... .......... .......... .......... .......... 13% 70.7M 8s 2024-02-21T07:44:06.524 INFO:tasks.workunit.client.0.smithi069.stderr: 18500K .......... .......... .......... .......... .......... 13% 75.5M 8s 2024-02-21T07:44:06.526 INFO:tasks.workunit.client.0.smithi069.stderr: 18550K .......... .......... .......... .......... .......... 13% 19.2M 8s 2024-02-21T07:44:06.534 INFO:tasks.workunit.client.0.smithi069.stderr: 18600K .......... .......... .......... .......... .......... 13% 5.78M 8s 2024-02-21T07:44:06.535 INFO:tasks.workunit.client.0.smithi069.stderr: 18650K .......... .......... .......... .......... .......... 13% 63.0M 8s 2024-02-21T07:44:06.536 INFO:tasks.workunit.client.0.smithi069.stderr: 18700K .......... .......... .......... .......... .......... 13% 69.7M 8s 2024-02-21T07:44:06.540 INFO:tasks.workunit.client.0.smithi069.stderr: 18750K .......... .......... .......... .......... .......... 13% 65.7M 8s 2024-02-21T07:44:06.540 INFO:tasks.workunit.client.0.smithi069.stderr: 18800K .......... .......... .......... .......... .......... 13% 59.7M 8s 2024-02-21T07:44:06.540 INFO:tasks.workunit.client.0.smithi069.stderr: 18850K .......... .......... .......... .......... .......... 13% 73.4M 8s 2024-02-21T07:44:06.541 INFO:tasks.workunit.client.0.smithi069.stderr: 18900K .......... .......... .......... .......... .......... 13% 77.4M 8s 2024-02-21T07:44:06.541 INFO:tasks.workunit.client.0.smithi069.stderr: 18950K .......... .......... .......... .......... .......... 13% 76.4M 8s 2024-02-21T07:44:06.541 INFO:tasks.workunit.client.0.smithi069.stderr: 19000K .......... .......... .......... .......... .......... 14% 62.6M 8s 2024-02-21T07:44:06.542 INFO:tasks.workunit.client.0.smithi069.stderr: 19050K .......... .......... .......... .......... .......... 14% 27.8M 8s 2024-02-21T07:44:06.543 INFO:tasks.workunit.client.0.smithi069.stderr: 19100K .......... .......... .......... .......... .......... 14% 30.3M 8s 2024-02-21T07:44:06.546 INFO:tasks.workunit.client.0.smithi069.stderr: 19150K .......... .......... .......... .......... .......... 14% 22.3M 8s 2024-02-21T07:44:06.547 INFO:tasks.workunit.client.0.smithi069.stderr: 19200K .......... .......... .......... .......... .......... 14% 49.5M 8s 2024-02-21T07:44:06.552 INFO:tasks.workunit.client.0.smithi069.stderr: 19250K .......... .......... .......... .......... .......... 14% 8.94M 8s 2024-02-21T07:44:06.554 INFO:tasks.workunit.client.0.smithi069.stderr: 19300K .......... .......... .......... .......... .......... 14% 33.0M 8s 2024-02-21T07:44:06.554 INFO:tasks.workunit.client.0.smithi069.stderr: 19350K .......... .......... .......... .......... .......... 14% 58.0M 8s 2024-02-21T07:44:06.557 INFO:tasks.workunit.client.0.smithi069.stderr: 19400K .......... .......... .......... .......... .......... 14% 70.4M 8s 2024-02-21T07:44:06.557 INFO:tasks.workunit.client.0.smithi069.stderr: 19450K .......... .......... .......... .......... .......... 14% 75.7M 8s 2024-02-21T07:44:06.557 INFO:tasks.workunit.client.0.smithi069.stderr: 19500K .......... .......... .......... .......... .......... 14% 43.5M 8s 2024-02-21T07:44:06.559 INFO:tasks.workunit.client.0.smithi069.stderr: 19550K .......... .......... .......... .......... .......... 14% 29.6M 8s 2024-02-21T07:44:06.561 INFO:tasks.workunit.client.0.smithi069.stderr: 19600K .......... .......... .......... .......... .......... 14% 24.2M 8s 2024-02-21T07:44:06.562 INFO:tasks.workunit.client.0.smithi069.stderr: 19650K .......... .......... .......... .......... .......... 14% 29.4M 8s 2024-02-21T07:44:06.563 INFO:tasks.workunit.client.0.smithi069.stderr: 19700K .......... .......... .......... .......... .......... 14% 48.1M 8s 2024-02-21T07:44:06.577 INFO:tasks.workunit.client.0.smithi069.stderr: 19750K .......... .......... .......... .......... .......... 14% 7.70M 8s 2024-02-21T07:44:06.577 INFO:tasks.workunit.client.0.smithi069.stderr: 19800K .......... .......... .......... .......... .......... 14% 50.8M 8s 2024-02-21T07:44:06.577 INFO:tasks.workunit.client.0.smithi069.stderr: 19850K .......... .......... .......... .......... .......... 14% 47.6M 8s 2024-02-21T07:44:06.577 INFO:tasks.workunit.client.0.smithi069.stderr: 19900K .......... .......... .......... .......... .......... 14% 71.7M 8s 2024-02-21T07:44:06.577 INFO:tasks.workunit.client.0.smithi069.stderr: 19950K .......... .......... .......... .......... .......... 14% 61.7M 8s 2024-02-21T07:44:06.577 INFO:tasks.workunit.client.0.smithi069.stderr: 20000K .......... .......... .......... .......... .......... 14% 29.1M 8s 2024-02-21T07:44:06.577 INFO:tasks.workunit.client.0.smithi069.stderr: 20050K .......... .......... .......... .......... .......... 14% 41.9M 8s 2024-02-21T07:44:06.579 INFO:tasks.workunit.client.0.smithi069.stderr: 20100K .......... .......... .......... .......... .......... 14% 23.4M 8s 2024-02-21T07:44:06.580 INFO:tasks.workunit.client.0.smithi069.stderr: 20150K .......... .......... .......... .......... .......... 14% 29.4M 8s 2024-02-21T07:44:06.582 INFO:tasks.workunit.client.0.smithi069.stderr: 20200K .......... .......... .......... .......... .......... 14% 71.2M 8s 2024-02-21T07:44:06.582 INFO:tasks.workunit.client.0.smithi069.stderr: 20250K .......... .......... .......... .......... .......... 14% 29.6M 8s 2024-02-21T07:44:06.584 INFO:tasks.workunit.client.0.smithi069.stderr: 20300K .......... .......... .......... .......... .......... 14% 23.4M 8s 2024-02-21T07:44:06.585 INFO:tasks.workunit.client.0.smithi069.stderr: 20350K .......... .......... .......... .......... .......... 15% 31.0M 8s 2024-02-21T07:44:06.588 INFO:tasks.workunit.client.0.smithi069.stderr: 20400K .......... .......... .......... .......... .......... 15% 25.5M 8s 2024-02-21T07:44:06.590 INFO:tasks.workunit.client.0.smithi069.stderr: 20450K .......... .......... .......... .......... .......... 15% 24.0M 8s 2024-02-21T07:44:06.590 INFO:tasks.workunit.client.0.smithi069.stderr: 20500K .......... .......... .......... .......... .......... 15% 54.9M 8s 2024-02-21T07:44:06.592 INFO:tasks.workunit.client.0.smithi069.stderr: 20550K .......... .......... .......... .......... .......... 15% 30.5M 8s 2024-02-21T07:44:06.594 INFO:tasks.workunit.client.0.smithi069.stderr: 20600K .......... .......... .......... .......... .......... 15% 19.6M 8s 2024-02-21T07:44:06.598 INFO:tasks.workunit.client.0.smithi069.stderr: 20650K .......... .......... .......... .......... .......... 15% 14.4M 8s 2024-02-21T07:44:06.601 INFO:tasks.workunit.client.0.smithi069.stderr: 20700K .......... .......... .......... .......... .......... 15% 15.5M 8s 2024-02-21T07:44:06.603 INFO:tasks.workunit.client.0.smithi069.stderr: 20750K .......... .......... .......... .......... .......... 15% 20.9M 8s 2024-02-21T07:44:06.605 INFO:tasks.workunit.client.0.smithi069.stderr: 20800K .......... .......... .......... .......... .......... 15% 36.1M 8s 2024-02-21T07:44:06.608 INFO:tasks.workunit.client.0.smithi069.stderr: 20850K .......... .......... .......... .......... .......... 15% 58.2M 8s 2024-02-21T07:44:06.608 INFO:tasks.workunit.client.0.smithi069.stderr: 20900K .......... .......... .......... .......... .......... 15% 73.6M 8s 2024-02-21T07:44:06.608 INFO:tasks.workunit.client.0.smithi069.stderr: 20950K .......... .......... .......... .......... .......... 15% 66.8M 8s 2024-02-21T07:44:06.608 INFO:tasks.workunit.client.0.smithi069.stderr: 21000K .......... .......... .......... .......... .......... 15% 78.3M 8s 2024-02-21T07:44:06.610 INFO:tasks.workunit.client.0.smithi069.stderr: 21050K .......... .......... .......... .......... .......... 15% 30.1M 8s 2024-02-21T07:44:06.613 INFO:tasks.workunit.client.0.smithi069.stderr: 21100K .......... .......... .......... .......... .......... 15% 12.7M 8s 2024-02-21T07:44:06.617 INFO:tasks.workunit.client.0.smithi069.stderr: 21150K .......... .......... .......... .......... .......... 15% 13.2M 8s 2024-02-21T07:44:06.621 INFO:tasks.workunit.client.0.smithi069.stderr: 21200K .......... .......... .......... .......... .......... 15% 11.0M 8s 2024-02-21T07:44:06.623 INFO:tasks.workunit.client.0.smithi069.stderr: 21250K .......... .......... .......... .......... .......... 15% 21.9M 8s 2024-02-21T07:44:06.626 INFO:tasks.workunit.client.0.smithi069.stderr: 21300K .......... .......... .......... .......... .......... 15% 18.0M 7s 2024-02-21T07:44:06.627 INFO:tasks.workunit.client.0.smithi069.stderr: 21350K .......... .......... .......... .......... .......... 15% 57.8M 7s 2024-02-21T07:44:06.628 INFO:tasks.workunit.client.0.smithi069.stderr: 21400K .......... .......... .......... .......... .......... 15% 67.2M 7s 2024-02-21T07:44:06.629 INFO:tasks.workunit.client.0.smithi069.stderr: 21450K .......... .......... .......... .......... .......... 15% 67.4M 7s 2024-02-21T07:44:06.633 INFO:tasks.workunit.client.0.smithi069.stderr: 21500K .......... .......... .......... .......... .......... 15% 71.5M 7s 2024-02-21T07:44:06.633 INFO:tasks.workunit.client.0.smithi069.stderr: 21550K .......... .......... .......... .......... .......... 15% 59.4M 7s 2024-02-21T07:44:06.633 INFO:tasks.workunit.client.0.smithi069.stderr: 21600K .......... .......... .......... .......... .......... 15% 73.3M 7s 2024-02-21T07:44:06.633 INFO:tasks.workunit.client.0.smithi069.stderr: 21650K .......... .......... .......... .......... .......... 15% 76.9M 7s 2024-02-21T07:44:06.633 INFO:tasks.workunit.client.0.smithi069.stderr: 21700K .......... .......... .......... .......... .......... 16% 77.1M 7s 2024-02-21T07:44:06.633 INFO:tasks.workunit.client.0.smithi069.stderr: 21750K .......... .......... .......... .......... .......... 16% 63.2M 7s 2024-02-21T07:44:06.634 INFO:tasks.workunit.client.0.smithi069.stderr: 21800K .......... .......... .......... .......... .......... 16% 26.2M 7s 2024-02-21T07:44:06.637 INFO:tasks.workunit.client.0.smithi069.stderr: 21850K .......... .......... .......... .......... .......... 16% 26.0M 7s 2024-02-21T07:44:06.638 INFO:tasks.workunit.client.0.smithi069.stderr: 21900K .......... .......... .......... .......... .......... 16% 37.5M 7s 2024-02-21T07:44:06.640 INFO:tasks.workunit.client.0.smithi069.stderr: 21950K .......... .......... .......... .......... .......... 16% 26.1M 7s 2024-02-21T07:44:06.641 INFO:tasks.workunit.client.0.smithi069.stderr: 22000K .......... .......... .......... .......... .......... 16% 40.4M 7s 2024-02-21T07:44:06.643 INFO:tasks.workunit.client.0.smithi069.stderr: 22050K .......... .......... .......... .......... .......... 16% 25.8M 7s 2024-02-21T07:44:06.644 INFO:tasks.workunit.client.0.smithi069.stderr: 22100K .......... .......... .......... .......... .......... 16% 31.8M 7s 2024-02-21T07:44:06.646 INFO:tasks.workunit.client.0.smithi069.stderr: 22150K .......... .......... .......... .......... .......... 16% 24.3M 7s 2024-02-21T07:44:06.649 INFO:tasks.workunit.client.0.smithi069.stderr: 22200K .......... .......... .......... .......... .......... 16% 27.6M 7s 2024-02-21T07:44:06.649 INFO:tasks.workunit.client.0.smithi069.stderr: 22250K .......... .......... .......... .......... .......... 16% 43.0M 7s 2024-02-21T07:44:06.651 INFO:tasks.workunit.client.0.smithi069.stderr: 22300K .......... .......... .......... .......... .......... 16% 26.0M 7s 2024-02-21T07:44:06.652 INFO:tasks.workunit.client.0.smithi069.stderr: 22350K .......... .......... .......... .......... .......... 16% 33.8M 7s 2024-02-21T07:44:06.654 INFO:tasks.workunit.client.0.smithi069.stderr: 22400K .......... .......... .......... .......... .......... 16% 28.2M 7s 2024-02-21T07:44:06.656 INFO:tasks.workunit.client.0.smithi069.stderr: 22450K .......... .......... .......... .......... .......... 16% 27.4M 7s 2024-02-21T07:44:06.657 INFO:tasks.workunit.client.0.smithi069.stderr: 22500K .......... .......... .......... .......... .......... 16% 32.3M 7s 2024-02-21T07:44:06.663 INFO:tasks.workunit.client.0.smithi069.stderr: 22550K .......... .......... .......... .......... .......... 16% 13.2M 7s 2024-02-21T07:44:06.663 INFO:tasks.workunit.client.0.smithi069.stderr: 22600K .......... .......... .......... .......... .......... 16% 56.4M 7s 2024-02-21T07:44:06.663 INFO:tasks.workunit.client.0.smithi069.stderr: 22650K .......... .......... .......... .......... .......... 16% 61.0M 7s 2024-02-21T07:44:06.665 INFO:tasks.workunit.client.0.smithi069.stderr: 22700K .......... .......... .......... .......... .......... 16% 25.3M 7s 2024-02-21T07:44:06.666 INFO:tasks.workunit.client.0.smithi069.stderr: 22750K .......... .......... .......... .......... .......... 16% 34.0M 7s 2024-02-21T07:44:06.668 INFO:tasks.workunit.client.0.smithi069.stderr: 22800K .......... .......... .......... .......... .......... 16% 26.4M 7s 2024-02-21T07:44:06.669 INFO:tasks.workunit.client.0.smithi069.stderr: 22850K .......... .......... .......... .......... .......... 16% 36.0M 7s 2024-02-21T07:44:06.671 INFO:tasks.workunit.client.0.smithi069.stderr: 22900K .......... .......... .......... .......... .......... 16% 23.8M 7s 2024-02-21T07:44:06.673 INFO:tasks.workunit.client.0.smithi069.stderr: 22950K .......... .......... .......... .......... .......... 16% 27.9M 7s 2024-02-21T07:44:06.674 INFO:tasks.workunit.client.0.smithi069.stderr: 23000K .......... .......... .......... .......... .......... 16% 38.4M 7s 2024-02-21T07:44:06.676 INFO:tasks.workunit.client.0.smithi069.stderr: 23050K .......... .......... .......... .......... .......... 17% 24.7M 7s 2024-02-21T07:44:06.677 INFO:tasks.workunit.client.0.smithi069.stderr: 23100K .......... .......... .......... .......... .......... 17% 35.4M 7s 2024-02-21T07:44:06.680 INFO:tasks.workunit.client.0.smithi069.stderr: 23150K .......... .......... .......... .......... .......... 17% 23.7M 7s 2024-02-21T07:44:06.681 INFO:tasks.workunit.client.0.smithi069.stderr: 23200K .......... .......... .......... .......... .......... 17% 31.2M 7s 2024-02-21T07:44:06.683 INFO:tasks.workunit.client.0.smithi069.stderr: 23250K .......... .......... .......... .......... .......... 17% 34.9M 7s 2024-02-21T07:44:06.685 INFO:tasks.workunit.client.0.smithi069.stderr: 23300K .......... .......... .......... .......... .......... 17% 26.2M 7s 2024-02-21T07:44:06.687 INFO:tasks.workunit.client.0.smithi069.stderr: 23350K .......... .......... .......... .......... .......... 17% 23.6M 7s 2024-02-21T07:44:06.688 INFO:tasks.workunit.client.0.smithi069.stderr: 23400K .......... .......... .......... .......... .......... 17% 40.1M 7s 2024-02-21T07:44:06.690 INFO:tasks.workunit.client.0.smithi069.stderr: 23450K .......... .......... .......... .......... .......... 17% 24.0M 7s 2024-02-21T07:44:06.691 INFO:tasks.workunit.client.0.smithi069.stderr: 23500K .......... .......... .......... .......... .......... 17% 35.1M 7s 2024-02-21T07:44:06.693 INFO:tasks.workunit.client.0.smithi069.stderr: 23550K .......... .......... .......... .......... .......... 17% 28.6M 7s 2024-02-21T07:44:06.695 INFO:tasks.workunit.client.0.smithi069.stderr: 23600K .......... .......... .......... .......... .......... 17% 28.0M 7s 2024-02-21T07:44:06.697 INFO:tasks.workunit.client.0.smithi069.stderr: 23650K .......... .......... .......... .......... .......... 17% 24.1M 7s 2024-02-21T07:44:06.698 INFO:tasks.workunit.client.0.smithi069.stderr: 23700K .......... .......... .......... .......... .......... 17% 35.5M 7s 2024-02-21T07:44:06.700 INFO:tasks.workunit.client.0.smithi069.stderr: 23750K .......... .......... .......... .......... .......... 17% 31.7M 7s 2024-02-21T07:44:06.701 INFO:tasks.workunit.client.0.smithi069.stderr: 23800K .......... .......... .......... .......... .......... 17% 27.7M 7s 2024-02-21T07:44:06.704 INFO:tasks.workunit.client.0.smithi069.stderr: 23850K .......... .......... .......... .......... .......... 17% 24.0M 7s 2024-02-21T07:44:06.706 INFO:tasks.workunit.client.0.smithi069.stderr: 23900K .......... .......... .......... .......... .......... 17% 53.7M 7s 2024-02-21T07:44:06.709 INFO:tasks.workunit.client.0.smithi069.stderr: 23950K .......... .......... .......... .......... .......... 17% 12.9M 7s 2024-02-21T07:44:06.710 INFO:tasks.workunit.client.0.smithi069.stderr: 24000K .......... .......... .......... .......... .......... 17% 49.9M 7s 2024-02-21T07:44:06.710 INFO:tasks.workunit.client.0.smithi069.stderr: 24050K .......... .......... .......... .......... .......... 17% 48.7M 7s 2024-02-21T07:44:06.711 INFO:tasks.workunit.client.0.smithi069.stderr: 24100K .......... .......... .......... .......... .......... 17% 37.2M 7s 2024-02-21T07:44:06.714 INFO:tasks.workunit.client.0.smithi069.stderr: 24150K .......... .......... .......... .......... .......... 17% 23.6M 7s 2024-02-21T07:44:06.715 INFO:tasks.workunit.client.0.smithi069.stderr: 24200K .......... .......... .......... .......... .......... 17% 31.1M 7s 2024-02-21T07:44:06.716 INFO:tasks.workunit.client.0.smithi069.stderr: 24250K .......... .......... .......... .......... .......... 17% 46.5M 7s 2024-02-21T07:44:06.718 INFO:tasks.workunit.client.0.smithi069.stderr: 24300K .......... .......... .......... .......... .......... 17% 23.0M 7s 2024-02-21T07:44:06.720 INFO:tasks.workunit.client.0.smithi069.stderr: 24350K .......... .......... .......... .......... .......... 17% 34.7M 7s 2024-02-21T07:44:06.723 INFO:tasks.workunit.client.0.smithi069.stderr: 24400K .......... .......... .......... .......... .......... 18% 19.8M 7s 2024-02-21T07:44:06.723 INFO:tasks.workunit.client.0.smithi069.stderr: 24450K .......... .......... .......... .......... .......... 18% 40.9M 7s 2024-02-21T07:44:06.725 INFO:tasks.workunit.client.0.smithi069.stderr: 24500K .......... .......... .......... .......... .......... 18% 35.6M 7s 2024-02-21T07:44:06.727 INFO:tasks.workunit.client.0.smithi069.stderr: 24550K .......... .......... .......... .......... .......... 18% 26.0M 7s 2024-02-21T07:44:06.729 INFO:tasks.workunit.client.0.smithi069.stderr: 24600K .......... .......... .......... .......... .......... 18% 24.1M 7s 2024-02-21T07:44:06.730 INFO:tasks.workunit.client.0.smithi069.stderr: 24650K .......... .......... .......... .......... .......... 18% 39.4M 7s 2024-02-21T07:44:06.732 INFO:tasks.workunit.client.0.smithi069.stderr: 24700K .......... .......... .......... .......... .......... 18% 23.2M 7s 2024-02-21T07:44:06.733 INFO:tasks.workunit.client.0.smithi069.stderr: 24750K .......... .......... .......... .......... .......... 18% 37.0M 7s 2024-02-21T07:44:06.735 INFO:tasks.workunit.client.0.smithi069.stderr: 24800K .......... .......... .......... .......... .......... 18% 26.7M 7s 2024-02-21T07:44:06.737 INFO:tasks.workunit.client.0.smithi069.stderr: 24850K .......... .......... .......... .......... .......... 18% 31.9M 7s 2024-02-21T07:44:06.739 INFO:tasks.workunit.client.0.smithi069.stderr: 24900K .......... .......... .......... .......... .......... 18% 29.2M 7s 2024-02-21T07:44:06.741 INFO:tasks.workunit.client.0.smithi069.stderr: 24950K .......... .......... .......... .......... .......... 18% 21.9M 7s 2024-02-21T07:44:06.741 INFO:tasks.workunit.client.0.smithi069.stderr: 25000K .......... .......... .......... .......... .......... 18% 67.9M 7s 2024-02-21T07:44:06.743 INFO:tasks.workunit.client.0.smithi069.stderr: 25050K .......... .......... .......... .......... .......... 18% 26.4M 7s 2024-02-21T07:44:06.746 INFO:tasks.workunit.client.0.smithi069.stderr: 25100K .......... .......... .......... .......... .......... 18% 27.1M 7s 2024-02-21T07:44:06.748 INFO:tasks.workunit.client.0.smithi069.stderr: 25150K .......... .......... .......... .......... .......... 18% 20.3M 7s 2024-02-21T07:44:06.749 INFO:tasks.workunit.client.0.smithi069.stderr: 25200K .......... .......... .......... .......... .......... 18% 31.5M 7s 2024-02-21T07:44:06.750 INFO:tasks.workunit.client.0.smithi069.stderr: 25250K .......... .......... .......... .......... .......... 18% 51.9M 7s 2024-02-21T07:44:06.752 INFO:tasks.workunit.client.0.smithi069.stderr: 25300K .......... .......... .......... .......... .......... 18% 25.6M 7s 2024-02-21T07:44:06.758 INFO:tasks.workunit.client.0.smithi069.stderr: 25350K .......... .......... .......... .......... .......... 18% 23.1M 7s 2024-02-21T07:44:06.758 INFO:tasks.workunit.client.0.smithi069.stderr: 25400K .......... .......... .......... .......... .......... 18% 31.0M 7s 2024-02-21T07:44:06.758 INFO:tasks.workunit.client.0.smithi069.stderr: 25450K .......... .......... .......... .......... .......... 18% 27.8M 7s 2024-02-21T07:44:06.759 INFO:tasks.workunit.client.0.smithi069.stderr: 25500K .......... .......... .......... .......... .......... 18% 50.2M 7s 2024-02-21T07:44:06.761 INFO:tasks.workunit.client.0.smithi069.stderr: 25550K .......... .......... .......... .......... .......... 18% 21.7M 7s 2024-02-21T07:44:06.762 INFO:tasks.workunit.client.0.smithi069.stderr: 25600K .......... .......... .......... .......... .......... 18% 29.9M 7s 2024-02-21T07:44:06.764 INFO:tasks.workunit.client.0.smithi069.stderr: 25650K .......... .......... .......... .......... .......... 18% 25.3M 7s 2024-02-21T07:44:06.766 INFO:tasks.workunit.client.0.smithi069.stderr: 25700K .......... .......... .......... .......... .......... 18% 32.3M 7s 2024-02-21T07:44:06.767 INFO:tasks.workunit.client.0.smithi069.stderr: 25750K .......... .......... .......... .......... .......... 19% 37.7M 7s 2024-02-21T07:44:06.769 INFO:tasks.workunit.client.0.smithi069.stderr: 25800K .......... .......... .......... .......... .......... 19% 27.2M 7s 2024-02-21T07:44:06.770 INFO:tasks.workunit.client.0.smithi069.stderr: 25850K .......... .......... .......... .......... .......... 19% 32.7M 7s 2024-02-21T07:44:06.773 INFO:tasks.workunit.client.0.smithi069.stderr: 25900K .......... .......... .......... .......... .......... 19% 22.7M 7s 2024-02-21T07:44:06.775 INFO:tasks.workunit.client.0.smithi069.stderr: 25950K .......... .......... .......... .......... .......... 19% 25.7M 7s 2024-02-21T07:44:06.776 INFO:tasks.workunit.client.0.smithi069.stderr: 26000K .......... .......... .......... .......... .......... 19% 26.6M 7s 2024-02-21T07:44:06.777 INFO:tasks.workunit.client.0.smithi069.stderr: 26050K .......... .......... .......... .......... .......... 19% 46.6M 7s 2024-02-21T07:44:06.779 INFO:tasks.workunit.client.0.smithi069.stderr: 26100K .......... .......... .......... .......... .......... 19% 26.2M 7s 2024-02-21T07:44:06.781 INFO:tasks.workunit.client.0.smithi069.stderr: 26150K .......... .......... .......... .......... .......... 19% 27.7M 6s 2024-02-21T07:44:06.783 INFO:tasks.workunit.client.0.smithi069.stderr: 26200K .......... .......... .......... .......... .......... 19% 26.2M 6s 2024-02-21T07:44:06.785 INFO:tasks.workunit.client.0.smithi069.stderr: 26250K .......... .......... .......... .......... .......... 19% 26.1M 6s 2024-02-21T07:44:06.785 INFO:tasks.workunit.client.0.smithi069.stderr: 26300K .......... .......... .......... .......... .......... 19% 61.9M 6s 2024-02-21T07:44:06.787 INFO:tasks.workunit.client.0.smithi069.stderr: 26350K .......... .......... .......... .......... .......... 19% 23.7M 6s 2024-02-21T07:44:06.789 INFO:tasks.workunit.client.0.smithi069.stderr: 26400K .......... .......... .......... .......... .......... 19% 27.1M 6s 2024-02-21T07:44:06.791 INFO:tasks.workunit.client.0.smithi069.stderr: 26450K .......... .......... .......... .......... .......... 19% 25.4M 6s 2024-02-21T07:44:06.794 INFO:tasks.workunit.client.0.smithi069.stderr: 26500K .......... .......... .......... .......... .......... 19% 28.3M 6s 2024-02-21T07:44:06.794 INFO:tasks.workunit.client.0.smithi069.stderr: 26550K .......... .......... .......... .......... .......... 19% 56.9M 6s 2024-02-21T07:44:06.796 INFO:tasks.workunit.client.0.smithi069.stderr: 26600K .......... .......... .......... .......... .......... 19% 23.7M 6s 2024-02-21T07:44:06.798 INFO:tasks.workunit.client.0.smithi069.stderr: 26650K .......... .......... .......... .......... .......... 19% 23.7M 6s 2024-02-21T07:44:06.800 INFO:tasks.workunit.client.0.smithi069.stderr: 26700K .......... .......... .......... .......... .......... 19% 27.0M 6s 2024-02-21T07:44:06.801 INFO:tasks.workunit.client.0.smithi069.stderr: 26750K .......... .......... .......... .......... .......... 19% 32.8M 6s 2024-02-21T07:44:06.802 INFO:tasks.workunit.client.0.smithi069.stderr: 26800K .......... .......... .......... .......... .......... 19% 36.3M 6s 2024-02-21T07:44:06.814 INFO:tasks.workunit.client.0.smithi069.stderr: 26850K .......... .......... .......... .......... .......... 19% 26.1M 6s 2024-02-21T07:44:06.814 INFO:tasks.workunit.client.0.smithi069.stderr: 26900K .......... .......... .......... .......... .......... 19% 25.5M 6s 2024-02-21T07:44:06.814 INFO:tasks.workunit.client.0.smithi069.stderr: 26950K .......... .......... .......... .......... .......... 19% 51.8M 6s 2024-02-21T07:44:06.814 INFO:tasks.workunit.client.0.smithi069.stderr: 27000K .......... .......... .......... .......... .......... 19% 20.5M 6s 2024-02-21T07:44:06.814 INFO:tasks.workunit.client.0.smithi069.stderr: 27050K .......... .......... .......... .......... .......... 19% 39.4M 6s 2024-02-21T07:44:06.814 INFO:tasks.workunit.client.0.smithi069.stderr: 27100K .......... .......... .......... .......... .......... 19% 24.1M 6s 2024-02-21T07:44:06.814 INFO:tasks.workunit.client.0.smithi069.stderr: 27150K .......... .......... .......... .......... .......... 20% 48.2M 6s 2024-02-21T07:44:06.816 INFO:tasks.workunit.client.0.smithi069.stderr: 27200K .......... .......... .......... .......... .......... 20% 23.2M 6s 2024-02-21T07:44:06.820 INFO:tasks.workunit.client.0.smithi069.stderr: 27250K .......... .......... .......... .......... .......... 20% 13.0M 6s 2024-02-21T07:44:06.825 INFO:tasks.workunit.client.0.smithi069.stderr: 27300K .......... .......... .......... .......... .......... 20% 24.6M 6s 2024-02-21T07:44:06.825 INFO:tasks.workunit.client.0.smithi069.stderr: 27350K .......... .......... .......... .......... .......... 20% 40.0M 6s 2024-02-21T07:44:06.825 INFO:tasks.workunit.client.0.smithi069.stderr: 27400K .......... .......... .......... .......... .......... 20% 60.0M 6s 2024-02-21T07:44:06.825 INFO:tasks.workunit.client.0.smithi069.stderr: 27450K .......... .......... .......... .......... .......... 20% 73.8M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 27500K .......... .......... .......... .......... .......... 20% 1.07M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 27550K .......... .......... .......... .......... .......... 20% 64.9M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 27600K .......... .......... .......... .......... .......... 20% 64.5M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 27650K .......... .......... .......... .......... .......... 20% 58.7M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 27700K .......... .......... .......... .......... .......... 20% 66.5M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 27750K .......... .......... .......... .......... .......... 20% 68.3M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 27800K .......... .......... .......... .......... .......... 20% 67.6M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 27850K .......... .......... .......... .......... .......... 20% 64.8M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 27900K .......... .......... .......... .......... .......... 20% 69.7M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 27950K .......... .......... .......... .......... .......... 20% 69.2M 6s 2024-02-21T07:44:06.879 INFO:tasks.workunit.client.0.smithi069.stderr: 28000K .......... .......... .......... .......... .......... 20% 36.9M 6s 2024-02-21T07:44:06.881 INFO:tasks.workunit.client.0.smithi069.stderr: 28050K .......... .......... .......... .......... .......... 20% 22.4M 6s 2024-02-21T07:44:06.881 INFO:tasks.workunit.client.0.smithi069.stderr: 28100K .......... .......... .......... .......... .......... 20% 59.3M 6s 2024-02-21T07:44:06.884 INFO:tasks.workunit.client.0.smithi069.stderr: 28150K .......... .......... .......... .......... .......... 20% 20.9M 6s 2024-02-21T07:44:06.885 INFO:tasks.workunit.client.0.smithi069.stderr: 28200K .......... .......... .......... .......... .......... 20% 32.9M 6s 2024-02-21T07:44:06.887 INFO:tasks.workunit.client.0.smithi069.stderr: 28250K .......... .......... .......... .......... .......... 20% 23.7M 6s 2024-02-21T07:44:06.888 INFO:tasks.workunit.client.0.smithi069.stderr: 28300K .......... .......... .......... .......... .......... 20% 36.6M 6s 2024-02-21T07:44:06.889 INFO:tasks.workunit.client.0.smithi069.stderr: 28350K .......... .......... .......... .......... .......... 20% 39.6M 6s 2024-02-21T07:44:06.892 INFO:tasks.workunit.client.0.smithi069.stderr: 28400K .......... .......... .......... .......... .......... 20% 19.4M 6s 2024-02-21T07:44:06.894 INFO:tasks.workunit.client.0.smithi069.stderr: 28450K .......... .......... .......... .......... .......... 20% 35.9M 6s 2024-02-21T07:44:06.895 INFO:tasks.workunit.client.0.smithi069.stderr: 28500K .......... .......... .......... .......... .......... 21% 26.5M 6s 2024-02-21T07:44:06.896 INFO:tasks.workunit.client.0.smithi069.stderr: 28550K .......... .......... .......... .......... .......... 21% 34.1M 6s 2024-02-21T07:44:06.898 INFO:tasks.workunit.client.0.smithi069.stderr: 28600K .......... .......... .......... .......... .......... 21% 36.7M 6s 2024-02-21T07:44:06.899 INFO:tasks.workunit.client.0.smithi069.stderr: 28650K .......... .......... .......... .......... .......... 21% 26.1M 6s 2024-02-21T07:44:06.902 INFO:tasks.workunit.client.0.smithi069.stderr: 28700K .......... .......... .......... .......... .......... 21% 24.0M 6s 2024-02-21T07:44:06.904 INFO:tasks.workunit.client.0.smithi069.stderr: 28750K .......... .......... .......... .......... .......... 21% 29.4M 6s 2024-02-21T07:44:06.905 INFO:tasks.workunit.client.0.smithi069.stderr: 28800K .......... .......... .......... .......... .......... 21% 33.1M 6s 2024-02-21T07:44:06.906 INFO:tasks.workunit.client.0.smithi069.stderr: 28850K .......... .......... .......... .......... .......... 21% 36.2M 6s 2024-02-21T07:44:06.908 INFO:tasks.workunit.client.0.smithi069.stderr: 28900K .......... .......... .......... .......... .......... 21% 25.3M 6s 2024-02-21T07:44:06.910 INFO:tasks.workunit.client.0.smithi069.stderr: 28950K .......... .......... .......... .......... .......... 21% 24.0M 6s 2024-02-21T07:44:06.911 INFO:tasks.workunit.client.0.smithi069.stderr: 29000K .......... .......... .......... .......... .......... 21% 56.7M 6s 2024-02-21T07:44:06.914 INFO:tasks.workunit.client.0.smithi069.stderr: 29050K .......... .......... .......... .......... .......... 21% 18.4M 6s 2024-02-21T07:44:06.916 INFO:tasks.workunit.client.0.smithi069.stderr: 29100K .......... .......... .......... .......... .......... 21% 28.8M 6s 2024-02-21T07:44:06.918 INFO:tasks.workunit.client.0.smithi069.stderr: 29150K .......... .......... .......... .......... .......... 21% 28.1M 6s 2024-02-21T07:44:06.920 INFO:tasks.workunit.client.0.smithi069.stderr: 29200K .......... .......... .......... .......... .......... 21% 24.2M 6s 2024-02-21T07:44:06.920 INFO:tasks.workunit.client.0.smithi069.stderr: 29250K .......... .......... .......... .......... .......... 21% 64.1M 6s 2024-02-21T07:44:06.922 INFO:tasks.workunit.client.0.smithi069.stderr: 29300K .......... .......... .......... .......... .......... 21% 24.4M 6s 2024-02-21T07:44:06.924 INFO:tasks.workunit.client.0.smithi069.stderr: 29350K .......... .......... .......... .......... .......... 21% 25.3M 6s 2024-02-21T07:44:06.926 INFO:tasks.workunit.client.0.smithi069.stderr: 29400K .......... .......... .......... .......... .......... 21% 25.3M 6s 2024-02-21T07:44:06.928 INFO:tasks.workunit.client.0.smithi069.stderr: 29450K .......... .......... .......... .......... .......... 21% 28.8M 6s 2024-02-21T07:44:06.928 INFO:tasks.workunit.client.0.smithi069.stderr: 29500K .......... .......... .......... .......... .......... 21% 66.0M 6s 2024-02-21T07:44:06.930 INFO:tasks.workunit.client.0.smithi069.stderr: 29550K .......... .......... .......... .......... .......... 21% 22.9M 6s 2024-02-21T07:44:06.933 INFO:tasks.workunit.client.0.smithi069.stderr: 29600K .......... .......... .......... .......... .......... 21% 24.8M 6s 2024-02-21T07:44:06.935 INFO:tasks.workunit.client.0.smithi069.stderr: 29650K .......... .......... .......... .......... .......... 21% 74.7M 6s 2024-02-21T07:44:06.937 INFO:tasks.workunit.client.0.smithi069.stderr: 29700K .......... .......... .......... .......... .......... 21% 17.0M 6s 2024-02-21T07:44:06.937 INFO:tasks.workunit.client.0.smithi069.stderr: 29750K .......... .......... .......... .......... .......... 21% 63.1M 6s 2024-02-21T07:44:06.939 INFO:tasks.workunit.client.0.smithi069.stderr: 29800K .......... .......... .......... .......... .......... 21% 25.6M 6s 2024-02-21T07:44:06.941 INFO:tasks.workunit.client.0.smithi069.stderr: 29850K .......... .......... .......... .......... .......... 22% 24.5M 6s 2024-02-21T07:44:06.943 INFO:tasks.workunit.client.0.smithi069.stderr: 29900K .......... .......... .......... .......... .......... 22% 28.0M 6s 2024-02-21T07:44:06.945 INFO:tasks.workunit.client.0.smithi069.stderr: 29950K .......... .......... .......... .......... .......... 22% 27.5M 6s 2024-02-21T07:44:06.945 INFO:tasks.workunit.client.0.smithi069.stderr: 30000K .......... .......... .......... .......... .......... 22% 62.0M 6s 2024-02-21T07:44:06.947 INFO:tasks.workunit.client.0.smithi069.stderr: 30050K .......... .......... .......... .......... .......... 22% 24.4M 6s 2024-02-21T07:44:06.949 INFO:tasks.workunit.client.0.smithi069.stderr: 30100K .......... .......... .......... .......... .......... 22% 23.4M 6s 2024-02-21T07:44:06.950 INFO:tasks.workunit.client.0.smithi069.stderr: 30150K .......... .......... .......... .......... .......... 22% 45.9M 6s 2024-02-21T07:44:06.952 INFO:tasks.workunit.client.0.smithi069.stderr: 30200K .......... .......... .......... .......... .......... 22% 21.6M 6s 2024-02-21T07:44:06.953 INFO:tasks.workunit.client.0.smithi069.stderr: 30250K .......... .......... .......... .......... .......... 22% 42.7M 6s 2024-02-21T07:44:06.956 INFO:tasks.workunit.client.0.smithi069.stderr: 30300K .......... .......... .......... .......... .......... 22% 23.8M 6s 2024-02-21T07:44:06.957 INFO:tasks.workunit.client.0.smithi069.stderr: 30350K .......... .......... .......... .......... .......... 22% 31.2M 6s 2024-02-21T07:44:06.960 INFO:tasks.workunit.client.0.smithi069.stderr: 30400K .......... .......... .......... .......... .......... 22% 27.1M 6s 2024-02-21T07:44:06.960 INFO:tasks.workunit.client.0.smithi069.stderr: 30450K .......... .......... .......... .......... .......... 22% 41.6M 6s 2024-02-21T07:44:06.962 INFO:tasks.workunit.client.0.smithi069.stderr: 30500K .......... .......... .......... .......... .......... 22% 29.3M 6s 2024-02-21T07:44:06.963 INFO:tasks.workunit.client.0.smithi069.stderr: 30550K .......... .......... .......... .......... .......... 22% 32.0M 6s 2024-02-21T07:44:06.966 INFO:tasks.workunit.client.0.smithi069.stderr: 30600K .......... .......... .......... .......... .......... 22% 19.8M 6s 2024-02-21T07:44:06.968 INFO:tasks.workunit.client.0.smithi069.stderr: 30650K .......... .......... .......... .......... .......... 22% 31.4M 6s 2024-02-21T07:44:06.969 INFO:tasks.workunit.client.0.smithi069.stderr: 30700K .......... .......... .......... .......... .......... 22% 29.6M 6s 2024-02-21T07:44:06.971 INFO:tasks.workunit.client.0.smithi069.stderr: 30750K .......... .......... .......... .......... .......... 22% 24.5M 6s 2024-02-21T07:44:06.973 INFO:tasks.workunit.client.0.smithi069.stderr: 30800K .......... .......... .......... .......... .......... 22% 34.7M 6s 2024-02-21T07:44:06.974 INFO:tasks.workunit.client.0.smithi069.stderr: 30850K .......... .......... .......... .......... .......... 22% 29.7M 6s 2024-02-21T07:44:06.977 INFO:tasks.workunit.client.0.smithi069.stderr: 30900K .......... .......... .......... .......... .......... 22% 24.2M 6s 2024-02-21T07:44:06.977 INFO:tasks.workunit.client.0.smithi069.stderr: 30950K .......... .......... .......... .......... .......... 22% 44.5M 6s 2024-02-21T07:44:06.980 INFO:tasks.workunit.client.0.smithi069.stderr: 31000K .......... .......... .......... .......... .......... 22% 17.9M 6s 2024-02-21T07:44:06.987 INFO:tasks.workunit.client.0.smithi069.stderr: 31050K .......... .......... .......... .......... .......... 22% 39.3M 6s 2024-02-21T07:44:06.987 INFO:tasks.workunit.client.0.smithi069.stderr: 31100K .......... .......... .......... .......... .......... 22% 30.4M 6s 2024-02-21T07:44:06.987 INFO:tasks.workunit.client.0.smithi069.stderr: 31150K .......... .......... .......... .......... .......... 22% 34.9M 6s 2024-02-21T07:44:06.987 INFO:tasks.workunit.client.0.smithi069.stderr: 31200K .......... .......... .......... .......... .......... 23% 26.3M 6s 2024-02-21T07:44:06.988 INFO:tasks.workunit.client.0.smithi069.stderr: 31250K .......... .......... .......... .......... .......... 23% 34.1M 6s 2024-02-21T07:44:06.989 INFO:tasks.workunit.client.0.smithi069.stderr: 31300K .......... .......... .......... .......... .......... 23% 27.0M 6s 2024-02-21T07:44:06.991 INFO:tasks.workunit.client.0.smithi069.stderr: 31350K .......... .......... .......... .......... .......... 23% 27.8M 6s 2024-02-21T07:44:06.993 INFO:tasks.workunit.client.0.smithi069.stderr: 31400K .......... .......... .......... .......... .......... 23% 26.5M 6s 2024-02-21T07:44:06.994 INFO:tasks.workunit.client.0.smithi069.stderr: 31450K .......... .......... .......... .......... .......... 23% 27.7M 6s 2024-02-21T07:44:06.995 INFO:tasks.workunit.client.0.smithi069.stderr: 31500K .......... .......... .......... .......... .......... 23% 40.4M 6s 2024-02-21T07:44:06.997 INFO:tasks.workunit.client.0.smithi069.stderr: 31550K .......... .......... .......... .......... .......... 23% 27.7M 6s 2024-02-21T07:44:06.999 INFO:tasks.workunit.client.0.smithi069.stderr: 31600K .......... .......... .......... .......... .......... 23% 28.3M 6s 2024-02-21T07:44:07.001 INFO:tasks.workunit.client.0.smithi069.stderr: 31650K .......... .......... .......... .......... .......... 23% 25.2M 6s 2024-02-21T07:44:07.003 INFO:tasks.workunit.client.0.smithi069.stderr: 31700K .......... .......... .......... .......... .......... 23% 27.8M 6s 2024-02-21T07:44:07.004 INFO:tasks.workunit.client.0.smithi069.stderr: 31750K .......... .......... .......... .......... .......... 23% 39.5M 6s 2024-02-21T07:44:07.006 INFO:tasks.workunit.client.0.smithi069.stderr: 31800K .......... .......... .......... .......... .......... 23% 27.9M 6s 2024-02-21T07:44:07.008 INFO:tasks.workunit.client.0.smithi069.stderr: 31850K .......... .......... .......... .......... .......... 23% 24.7M 6s 2024-02-21T07:44:07.009 INFO:tasks.workunit.client.0.smithi069.stderr: 31900K .......... .......... .......... .......... .......... 23% 39.0M 6s 2024-02-21T07:44:07.011 INFO:tasks.workunit.client.0.smithi069.stderr: 31950K .......... .......... .......... .......... .......... 23% 23.9M 6s 2024-02-21T07:44:07.012 INFO:tasks.workunit.client.0.smithi069.stderr: 32000K .......... .......... .......... .......... .......... 23% 39.0M 6s 2024-02-21T07:44:07.014 INFO:tasks.workunit.client.0.smithi069.stderr: 32050K .......... .......... .......... .......... .......... 23% 26.0M 6s 2024-02-21T07:44:07.017 INFO:tasks.workunit.client.0.smithi069.stderr: 32100K .......... .......... .......... .......... .......... 23% 24.2M 6s 2024-02-21T07:44:07.019 INFO:tasks.workunit.client.0.smithi069.stderr: 32150K .......... .......... .......... .......... .......... 23% 26.4M 6s 2024-02-21T07:44:07.021 INFO:tasks.workunit.client.0.smithi069.stderr: 32200K .......... .......... .......... .......... .......... 23% 32.7M 6s 2024-02-21T07:44:07.021 INFO:tasks.workunit.client.0.smithi069.stderr: 32250K .......... .......... .......... .......... .......... 23% 40.2M 6s 2024-02-21T07:44:07.023 INFO:tasks.workunit.client.0.smithi069.stderr: 32300K .......... .......... .......... .......... .......... 23% 23.3M 6s 2024-02-21T07:44:07.025 INFO:tasks.workunit.client.0.smithi069.stderr: 32350K .......... .......... .......... .......... .......... 23% 30.4M 6s 2024-02-21T07:44:07.026 INFO:tasks.workunit.client.0.smithi069.stderr: 32400K .......... .......... .......... .......... .......... 23% 36.6M 6s 2024-02-21T07:44:07.028 INFO:tasks.workunit.client.0.smithi069.stderr: 32450K .......... .......... .......... .......... .......... 23% 26.6M 6s 2024-02-21T07:44:07.029 INFO:tasks.workunit.client.0.smithi069.stderr: 32500K .......... .......... .......... .......... .......... 23% 38.0M 6s 2024-02-21T07:44:07.031 INFO:tasks.workunit.client.0.smithi069.stderr: 32550K .......... .......... .......... .......... .......... 24% 24.6M 6s 2024-02-21T07:44:07.033 INFO:tasks.workunit.client.0.smithi069.stderr: 32600K .......... .......... .......... .......... .......... 24% 27.8M 6s 2024-02-21T07:44:07.035 INFO:tasks.workunit.client.0.smithi069.stderr: 32650K .......... .......... .......... .......... .......... 24% 25.3M 6s 2024-02-21T07:44:07.037 INFO:tasks.workunit.client.0.smithi069.stderr: 32700K .......... .......... .......... .......... .......... 24% 29.4M 6s 2024-02-21T07:44:07.039 INFO:tasks.workunit.client.0.smithi069.stderr: 32750K .......... .......... .......... .......... .......... 24% 64.8M 6s 2024-02-21T07:44:07.039 INFO:tasks.workunit.client.0.smithi069.stderr: 32800K .......... .......... .......... .......... .......... 24% 21.3M 6s 2024-02-21T07:44:07.041 INFO:tasks.workunit.client.0.smithi069.stderr: 32850K .......... .......... .......... .......... .......... 24% 25.1M 6s 2024-02-21T07:44:07.042 INFO:tasks.workunit.client.0.smithi069.stderr: 32900K .......... .......... .......... .......... .......... 24% 38.6M 6s 2024-02-21T07:44:07.044 INFO:tasks.workunit.client.0.smithi069.stderr: 32950K .......... .......... .......... .......... .......... 24% 34.6M 6s 2024-02-21T07:44:07.047 INFO:tasks.workunit.client.0.smithi069.stderr: 33000K .......... .......... .......... .......... .......... 24% 28.7M 6s 2024-02-21T07:44:07.048 INFO:tasks.workunit.client.0.smithi069.stderr: 33050K .......... .......... .......... .......... .......... 24% 25.2M 6s 2024-02-21T07:44:07.050 INFO:tasks.workunit.client.0.smithi069.stderr: 33100K .......... .......... .......... .......... .......... 24% 26.6M 6s 2024-02-21T07:44:07.052 INFO:tasks.workunit.client.0.smithi069.stderr: 33150K .......... .......... .......... .......... .......... 24% 23.8M 6s 2024-02-21T07:44:07.054 INFO:tasks.workunit.client.0.smithi069.stderr: 33200K .......... .......... .......... .......... .......... 24% 27.0M 6s 2024-02-21T07:44:07.056 INFO:tasks.workunit.client.0.smithi069.stderr: 33250K .......... .......... .......... .......... .......... 24% 25.0M 6s 2024-02-21T07:44:07.056 INFO:tasks.workunit.client.0.smithi069.stderr: 33300K .......... .......... .......... .......... .......... 24% 51.5M 6s 2024-02-21T07:44:07.058 INFO:tasks.workunit.client.0.smithi069.stderr: 33350K .......... .......... .......... .......... .......... 24% 28.1M 6s 2024-02-21T07:44:07.060 INFO:tasks.workunit.client.0.smithi069.stderr: 33400K .......... .......... .......... .......... .......... 24% 25.4M 6s 2024-02-21T07:44:07.063 INFO:tasks.workunit.client.0.smithi069.stderr: 33450K .......... .......... .......... .......... .......... 24% 23.6M 6s 2024-02-21T07:44:07.063 INFO:tasks.workunit.client.0.smithi069.stderr: 33500K .......... .......... .......... .......... .......... 24% 52.8M 6s 2024-02-21T07:44:07.065 INFO:tasks.workunit.client.0.smithi069.stderr: 33550K .......... .......... .......... .......... .......... 24% 26.5M 6s 2024-02-21T07:44:07.067 INFO:tasks.workunit.client.0.smithi069.stderr: 33600K .......... .......... .......... .......... .......... 24% 27.2M 6s 2024-02-21T07:44:07.068 INFO:tasks.workunit.client.0.smithi069.stderr: 33650K .......... .......... .......... .......... .......... 24% 30.9M 6s 2024-02-21T07:44:07.070 INFO:tasks.workunit.client.0.smithi069.stderr: 33700K .......... .......... .......... .......... .......... 24% 26.7M 6s 2024-02-21T07:44:07.072 INFO:tasks.workunit.client.0.smithi069.stderr: 33750K .......... .......... .......... .......... .......... 24% 30.5M 6s 2024-02-21T07:44:07.074 INFO:tasks.workunit.client.0.smithi069.stderr: 33800K .......... .......... .......... .......... .......... 24% 26.1M 6s 2024-02-21T07:44:07.075 INFO:tasks.workunit.client.0.smithi069.stderr: 33850K .......... .......... .......... .......... .......... 24% 31.8M 6s 2024-02-21T07:44:07.077 INFO:tasks.workunit.client.0.smithi069.stderr: 33900K .......... .......... .......... .......... .......... 25% 28.1M 6s 2024-02-21T07:44:07.079 INFO:tasks.workunit.client.0.smithi069.stderr: 33950K .......... .......... .......... .......... .......... 25% 26.0M 6s 2024-02-21T07:44:07.080 INFO:tasks.workunit.client.0.smithi069.stderr: 34000K .......... .......... .......... .......... .......... 25% 28.5M 6s 2024-02-21T07:44:07.081 INFO:tasks.workunit.client.0.smithi069.stderr: 34050K .......... .......... .......... .......... .......... 25% 38.2M 6s 2024-02-21T07:44:07.083 INFO:tasks.workunit.client.0.smithi069.stderr: 34100K .......... .......... .......... .......... .......... 25% 29.0M 6s 2024-02-21T07:44:07.085 INFO:tasks.workunit.client.0.smithi069.stderr: 34150K .......... .......... .......... .......... .......... 25% 27.6M 6s 2024-02-21T07:44:07.087 INFO:tasks.workunit.client.0.smithi069.stderr: 34200K .......... .......... .......... .......... .......... 25% 26.4M 6s 2024-02-21T07:44:07.088 INFO:tasks.workunit.client.0.smithi069.stderr: 34250K .......... .......... .......... .......... .......... 25% 26.9M 6s 2024-02-21T07:44:07.090 INFO:tasks.workunit.client.0.smithi069.stderr: 34300K .......... .......... .......... .......... .......... 25% 40.5M 6s 2024-02-21T07:44:07.092 INFO:tasks.workunit.client.0.smithi069.stderr: 34350K .......... .......... .......... .......... .......... 25% 25.5M 5s 2024-02-21T07:44:07.093 INFO:tasks.workunit.client.0.smithi069.stderr: 34400K .......... .......... .......... .......... .......... 25% 30.3M 5s 2024-02-21T07:44:07.095 INFO:tasks.workunit.client.0.smithi069.stderr: 34450K .......... .......... .......... .......... .......... 25% 27.6M 5s 2024-02-21T07:44:07.097 INFO:tasks.workunit.client.0.smithi069.stderr: 34500K .......... .......... .......... .......... .......... 25% 27.1M 5s 2024-02-21T07:44:07.098 INFO:tasks.workunit.client.0.smithi069.stderr: 34550K .......... .......... .......... .......... .......... 25% 37.9M 5s 2024-02-21T07:44:07.100 INFO:tasks.workunit.client.0.smithi069.stderr: 34600K .......... .......... .......... .......... .......... 25% 28.1M 5s 2024-02-21T07:44:07.102 INFO:tasks.workunit.client.0.smithi069.stderr: 34650K .......... .......... .......... .......... .......... 25% 25.6M 5s 2024-02-21T07:44:07.104 INFO:tasks.workunit.client.0.smithi069.stderr: 34700K .......... .......... .......... .......... .......... 25% 26.7M 5s 2024-02-21T07:44:07.105 INFO:tasks.workunit.client.0.smithi069.stderr: 34750K .......... .......... .......... .......... .......... 25% 29.2M 5s 2024-02-21T07:44:07.107 INFO:tasks.workunit.client.0.smithi069.stderr: 34800K .......... .......... .......... .......... .......... 25% 41.7M 5s 2024-02-21T07:44:07.108 INFO:tasks.workunit.client.0.smithi069.stderr: 34850K .......... .......... .......... .......... .......... 25% 25.5M 5s 2024-02-21T07:44:07.110 INFO:tasks.workunit.client.0.smithi069.stderr: 34900K .......... .......... .......... .......... .......... 25% 27.1M 5s 2024-02-21T07:44:07.111 INFO:tasks.workunit.client.0.smithi069.stderr: 34950K .......... .......... .......... .......... .......... 25% 37.6M 5s 2024-02-21T07:44:07.113 INFO:tasks.workunit.client.0.smithi069.stderr: 35000K .......... .......... .......... .......... .......... 25% 24.8M 5s 2024-02-21T07:44:07.115 INFO:tasks.workunit.client.0.smithi069.stderr: 35050K .......... .......... .......... .......... .......... 25% 34.4M 5s 2024-02-21T07:44:07.117 INFO:tasks.workunit.client.0.smithi069.stderr: 35100K .......... .......... .......... .......... .......... 25% 24.8M 5s 2024-02-21T07:44:07.118 INFO:tasks.workunit.client.0.smithi069.stderr: 35150K .......... .......... .......... .......... .......... 25% 30.5M 5s 2024-02-21T07:44:07.121 INFO:tasks.workunit.client.0.smithi069.stderr: 35200K .......... .......... .......... .......... .......... 25% 29.0M 5s 2024-02-21T07:44:07.122 INFO:tasks.workunit.client.0.smithi069.stderr: 35250K .......... .......... .......... .......... .......... 26% 25.9M 5s 2024-02-21T07:44:07.123 INFO:tasks.workunit.client.0.smithi069.stderr: 35300K .......... .......... .......... .......... .......... 26% 37.8M 5s 2024-02-21T07:44:07.125 INFO:tasks.workunit.client.0.smithi069.stderr: 35350K .......... .......... .......... .......... .......... 26% 25.8M 5s 2024-02-21T07:44:07.127 INFO:tasks.workunit.client.0.smithi069.stderr: 35400K .......... .......... .......... .......... .......... 26% 29.6M 5s 2024-02-21T07:44:07.129 INFO:tasks.workunit.client.0.smithi069.stderr: 35450K .......... .......... .......... .......... .......... 26% 26.1M 5s 2024-02-21T07:44:07.130 INFO:tasks.workunit.client.0.smithi069.stderr: 35500K .......... .......... .......... .......... .......... 26% 28.2M 5s 2024-02-21T07:44:07.132 INFO:tasks.workunit.client.0.smithi069.stderr: 35550K .......... .......... .......... .......... .......... 26% 42.5M 5s 2024-02-21T07:44:07.133 INFO:tasks.workunit.client.0.smithi069.stderr: 35600K .......... .......... .......... .......... .......... 26% 25.8M 5s 2024-02-21T07:44:07.135 INFO:tasks.workunit.client.0.smithi069.stderr: 35650K .......... .......... .......... .......... .......... 26% 26.2M 5s 2024-02-21T07:44:07.138 INFO:tasks.workunit.client.0.smithi069.stderr: 35700K .......... .......... .......... .......... .......... 26% 60.8M 5s 2024-02-21T07:44:07.139 INFO:tasks.workunit.client.0.smithi069.stderr: 35750K .......... .......... .......... .......... .......... 26% 19.2M 5s 2024-02-21T07:44:07.140 INFO:tasks.workunit.client.0.smithi069.stderr: 35800K .......... .......... .......... .......... .......... 26% 42.7M 5s 2024-02-21T07:44:07.142 INFO:tasks.workunit.client.0.smithi069.stderr: 35850K .......... .......... .......... .......... .......... 26% 26.0M 5s 2024-02-21T07:44:07.144 INFO:tasks.workunit.client.0.smithi069.stderr: 35900K .......... .......... .......... .......... .......... 26% 29.0M 5s 2024-02-21T07:44:07.146 INFO:tasks.workunit.client.0.smithi069.stderr: 35950K .......... .......... .......... .......... .......... 26% 23.4M 5s 2024-02-21T07:44:07.148 INFO:tasks.workunit.client.0.smithi069.stderr: 36000K .......... .......... .......... .......... .......... 26% 28.7M 5s 2024-02-21T07:44:07.148 INFO:tasks.workunit.client.0.smithi069.stderr: 36050K .......... .......... .......... .......... .......... 26% 43.6M 5s 2024-02-21T07:44:07.151 INFO:tasks.workunit.client.0.smithi069.stderr: 36100K .......... .......... .......... .......... .......... 26% 24.6M 5s 2024-02-21T07:44:07.153 INFO:tasks.workunit.client.0.smithi069.stderr: 36150K .......... .......... .......... .......... .......... 26% 24.3M 5s 2024-02-21T07:44:07.155 INFO:tasks.workunit.client.0.smithi069.stderr: 36200K .......... .......... .......... .......... .......... 26% 29.0M 5s 2024-02-21T07:44:07.156 INFO:tasks.workunit.client.0.smithi069.stderr: 36250K .......... .......... .......... .......... .......... 26% 31.0M 5s 2024-02-21T07:44:07.156 INFO:tasks.workunit.client.0.smithi069.stderr: 36300K .......... .......... .......... .......... .......... 26% 48.1M 5s 2024-02-21T07:44:07.159 INFO:tasks.workunit.client.0.smithi069.stderr: 36350K .......... .......... .......... .......... .......... 26% 22.1M 5s 2024-02-21T07:44:07.161 INFO:tasks.workunit.client.0.smithi069.stderr: 36400K .......... .......... .......... .......... .......... 26% 23.1M 5s 2024-02-21T07:44:07.163 INFO:tasks.workunit.client.0.smithi069.stderr: 36450K .......... .......... .......... .......... .......... 26% 33.4M 5s 2024-02-21T07:44:07.165 INFO:tasks.workunit.client.0.smithi069.stderr: 36500K .......... .......... .......... .......... .......... 26% 28.0M 5s 2024-02-21T07:44:07.165 INFO:tasks.workunit.client.0.smithi069.stderr: 36550K .......... .......... .......... .......... .......... 26% 52.5M 5s 2024-02-21T07:44:07.167 INFO:tasks.workunit.client.0.smithi069.stderr: 36600K .......... .......... .......... .......... .......... 26% 28.0M 5s 2024-02-21T07:44:07.169 INFO:tasks.workunit.client.0.smithi069.stderr: 36650K .......... .......... .......... .......... .......... 27% 23.7M 5s 2024-02-21T07:44:07.171 INFO:tasks.workunit.client.0.smithi069.stderr: 36700K .......... .......... .......... .......... .......... 27% 25.6M 5s 2024-02-21T07:44:07.173 INFO:tasks.workunit.client.0.smithi069.stderr: 36750K .......... .......... .......... .......... .......... 27% 29.1M 5s 2024-02-21T07:44:07.174 INFO:tasks.workunit.client.0.smithi069.stderr: 36800K .......... .......... .......... .......... .......... 27% 45.3M 5s 2024-02-21T07:44:07.176 INFO:tasks.workunit.client.0.smithi069.stderr: 36850K .......... .......... .......... .......... .......... 27% 23.9M 5s 2024-02-21T07:44:07.177 INFO:tasks.workunit.client.0.smithi069.stderr: 36900K .......... .......... .......... .......... .......... 27% 26.4M 5s 2024-02-21T07:44:07.179 INFO:tasks.workunit.client.0.smithi069.stderr: 36950K .......... .......... .......... .......... .......... 27% 44.7M 5s 2024-02-21T07:44:07.181 INFO:tasks.workunit.client.0.smithi069.stderr: 37000K .......... .......... .......... .......... .......... 27% 20.4M 5s 2024-02-21T07:44:07.184 INFO:tasks.workunit.client.0.smithi069.stderr: 37050K .......... .......... .......... .......... .......... 27% 62.5M 5s 2024-02-21T07:44:07.185 INFO:tasks.workunit.client.0.smithi069.stderr: 37100K .......... .......... .......... .......... .......... 27% 22.1M 5s 2024-02-21T07:44:07.185 INFO:tasks.workunit.client.0.smithi069.stderr: 37150K .......... .......... .......... .......... .......... 27% 34.1M 5s 2024-02-21T07:44:07.188 INFO:tasks.workunit.client.0.smithi069.stderr: 37200K .......... .......... .......... .......... .......... 27% 25.2M 5s 2024-02-21T07:44:07.188 INFO:tasks.workunit.client.0.smithi069.stderr: 37250K .......... .......... .......... .......... .......... 27% 46.6M 5s 2024-02-21T07:44:07.190 INFO:tasks.workunit.client.0.smithi069.stderr: 37300K .......... .......... .......... .......... .......... 27% 23.5M 5s 2024-02-21T07:44:07.193 INFO:tasks.workunit.client.0.smithi069.stderr: 37350K .......... .......... .......... .......... .......... 27% 29.5M 5s 2024-02-21T07:44:07.195 INFO:tasks.workunit.client.0.smithi069.stderr: 37400K .......... .......... .......... .......... .......... 27% 24.8M 5s 2024-02-21T07:44:07.197 INFO:tasks.workunit.client.0.smithi069.stderr: 37450K .......... .......... .......... .......... .......... 27% 27.2M 5s 2024-02-21T07:44:07.197 INFO:tasks.workunit.client.0.smithi069.stderr: 37500K .......... .......... .......... .......... .......... 27% 46.4M 5s 2024-02-21T07:44:07.199 INFO:tasks.workunit.client.0.smithi069.stderr: 37550K .......... .......... .......... .......... .......... 27% 26.5M 5s 2024-02-21T07:44:07.200 INFO:tasks.workunit.client.0.smithi069.stderr: 37600K .......... .......... .......... .......... .......... 27% 26.6M 5s 2024-02-21T07:44:07.203 INFO:tasks.workunit.client.0.smithi069.stderr: 37650K .......... .......... .......... .......... .......... 27% 23.7M 5s 2024-02-21T07:44:07.204 INFO:tasks.workunit.client.0.smithi069.stderr: 37700K .......... .......... .......... .......... .......... 27% 35.0M 5s 2024-02-21T07:44:07.206 INFO:tasks.workunit.client.0.smithi069.stderr: 37750K .......... .......... .......... .......... .......... 27% 30.1M 5s 2024-02-21T07:44:07.207 INFO:tasks.workunit.client.0.smithi069.stderr: 37800K .......... .......... .......... .......... .......... 27% 33.6M 5s 2024-02-21T07:44:07.209 INFO:tasks.workunit.client.0.smithi069.stderr: 37850K .......... .......... .......... .......... .......... 27% 26.6M 5s 2024-02-21T07:44:07.211 INFO:tasks.workunit.client.0.smithi069.stderr: 37900K .......... .......... .......... .......... .......... 27% 27.4M 5s 2024-02-21T07:44:07.213 INFO:tasks.workunit.client.0.smithi069.stderr: 37950K .......... .......... .......... .......... .......... 27% 26.3M 5s 2024-02-21T07:44:07.215 INFO:tasks.workunit.client.0.smithi069.stderr: 38000K .......... .......... .......... .......... .......... 28% 26.5M 5s 2024-02-21T07:44:07.216 INFO:tasks.workunit.client.0.smithi069.stderr: 38050K .......... .......... .......... .......... .......... 28% 61.6M 5s 2024-02-21T07:44:07.217 INFO:tasks.workunit.client.0.smithi069.stderr: 38100K .......... .......... .......... .......... .......... 28% 24.6M 5s 2024-02-21T07:44:07.219 INFO:tasks.workunit.client.0.smithi069.stderr: 38150K .......... .......... .......... .......... .......... 28% 26.3M 5s 2024-02-21T07:44:07.221 INFO:tasks.workunit.client.0.smithi069.stderr: 38200K .......... .......... .......... .......... .......... 28% 27.8M 5s 2024-02-21T07:44:07.223 INFO:tasks.workunit.client.0.smithi069.stderr: 38250K .......... .......... .......... .......... .......... 28% 24.4M 5s 2024-02-21T07:44:07.225 INFO:tasks.workunit.client.0.smithi069.stderr: 38300K .......... .......... .......... .......... .......... 28% 55.5M 5s 2024-02-21T07:44:07.226 INFO:tasks.workunit.client.0.smithi069.stderr: 38350K .......... .......... .......... .......... .......... 28% 26.5M 5s 2024-02-21T07:44:07.228 INFO:tasks.workunit.client.0.smithi069.stderr: 38400K .......... .......... .......... .......... .......... 28% 22.5M 5s 2024-02-21T07:44:07.230 INFO:tasks.workunit.client.0.smithi069.stderr: 38450K .......... .......... .......... .......... .......... 28% 48.9M 5s 2024-02-21T07:44:07.231 INFO:tasks.workunit.client.0.smithi069.stderr: 38500K .......... .......... .......... .......... .......... 28% 20.7M 5s 2024-02-21T07:44:07.234 INFO:tasks.workunit.client.0.smithi069.stderr: 38550K .......... .......... .......... .......... .......... 28% 26.3M 5s 2024-02-21T07:44:07.234 INFO:tasks.workunit.client.0.smithi069.stderr: 38600K .......... .......... .......... .......... .......... 28% 39.7M 5s 2024-02-21T07:44:07.237 INFO:tasks.workunit.client.0.smithi069.stderr: 38650K .......... .......... .......... .......... .......... 28% 28.0M 5s 2024-02-21T07:44:07.239 INFO:tasks.workunit.client.0.smithi069.stderr: 38700K .......... .......... .......... .......... .......... 28% 24.1M 5s 2024-02-21T07:44:07.241 INFO:tasks.workunit.client.0.smithi069.stderr: 38750K .......... .......... .......... .......... .......... 28% 29.5M 5s 2024-02-21T07:44:07.241 INFO:tasks.workunit.client.0.smithi069.stderr: 38800K .......... .......... .......... .......... .......... 28% 47.2M 5s 2024-02-21T07:44:07.242 INFO:tasks.workunit.client.0.smithi069.stderr: 38850K .......... .......... .......... .......... .......... 28% 27.0M 5s 2024-02-21T07:44:07.244 INFO:tasks.workunit.client.0.smithi069.stderr: 38900K .......... .......... .......... .......... .......... 28% 28.7M 5s 2024-02-21T07:44:07.246 INFO:tasks.workunit.client.0.smithi069.stderr: 38950K .......... .......... .......... .......... .......... 28% 28.1M 5s 2024-02-21T07:44:07.247 INFO:tasks.workunit.client.0.smithi069.stderr: 39000K .......... .......... .......... .......... .......... 28% 27.3M 5s 2024-02-21T07:44:07.251 INFO:tasks.workunit.client.0.smithi069.stderr: 39050K .......... .......... .......... .......... .......... 28% 25.0M 5s 2024-02-21T07:44:07.251 INFO:tasks.workunit.client.0.smithi069.stderr: 39100K .......... .......... .......... .......... .......... 28% 47.1M 5s 2024-02-21T07:44:07.253 INFO:tasks.workunit.client.0.smithi069.stderr: 39150K .......... .......... .......... .......... .......... 28% 26.2M 5s 2024-02-21T07:44:07.255 INFO:tasks.workunit.client.0.smithi069.stderr: 39200K .......... .......... .......... .......... .......... 28% 27.5M 5s 2024-02-21T07:44:07.256 INFO:tasks.workunit.client.0.smithi069.stderr: 39250K .......... .......... .......... .......... .......... 28% 26.6M 5s 2024-02-21T07:44:07.258 INFO:tasks.workunit.client.0.smithi069.stderr: 39300K .......... .......... .......... .......... .......... 28% 25.6M 5s 2024-02-21T07:44:07.259 INFO:tasks.workunit.client.0.smithi069.stderr: 39350K .......... .......... .......... .......... .......... 29% 54.5M 5s 2024-02-21T07:44:07.261 INFO:tasks.workunit.client.0.smithi069.stderr: 39400K .......... .......... .......... .......... .......... 29% 23.2M 5s 2024-02-21T07:44:07.263 INFO:tasks.workunit.client.0.smithi069.stderr: 39450K .......... .......... .......... .......... .......... 29% 30.5M 5s 2024-02-21T07:44:07.265 INFO:tasks.workunit.client.0.smithi069.stderr: 39500K .......... .......... .......... .......... .......... 29% 26.0M 5s 2024-02-21T07:44:07.265 INFO:tasks.workunit.client.0.smithi069.stderr: 39550K .......... .......... .......... .......... .......... 29% 49.3M 5s 2024-02-21T07:44:07.268 INFO:tasks.workunit.client.0.smithi069.stderr: 39600K .......... .......... .......... .......... .......... 29% 24.5M 5s 2024-02-21T07:44:07.270 INFO:tasks.workunit.client.0.smithi069.stderr: 39650K .......... .......... .......... .......... .......... 29% 22.5M 5s 2024-02-21T07:44:07.272 INFO:tasks.workunit.client.0.smithi069.stderr: 39700K .......... .......... .......... .......... .......... 29% 33.3M 5s 2024-02-21T07:44:07.273 INFO:tasks.workunit.client.0.smithi069.stderr: 39750K .......... .......... .......... .......... .......... 29% 29.5M 5s 2024-02-21T07:44:07.275 INFO:tasks.workunit.client.0.smithi069.stderr: 39800K .......... .......... .......... .......... .......... 29% 22.1M 5s 2024-02-21T07:44:07.276 INFO:tasks.workunit.client.0.smithi069.stderr: 39850K .......... .......... .......... .......... .......... 29% 49.4M 5s 2024-02-21T07:44:07.278 INFO:tasks.workunit.client.0.smithi069.stderr: 39900K .......... .......... .......... .......... .......... 29% 26.6M 5s 2024-02-21T07:44:07.280 INFO:tasks.workunit.client.0.smithi069.stderr: 39950K .......... .......... .......... .......... .......... 29% 27.7M 5s 2024-02-21T07:44:07.282 INFO:tasks.workunit.client.0.smithi069.stderr: 40000K .......... .......... .......... .......... .......... 29% 24.5M 5s 2024-02-21T07:44:07.283 INFO:tasks.workunit.client.0.smithi069.stderr: 40050K .......... .......... .......... .......... .......... 29% 52.8M 5s 2024-02-21T07:44:07.285 INFO:tasks.workunit.client.0.smithi069.stderr: 40100K .......... .......... .......... .......... .......... 29% 24.8M 5s 2024-02-21T07:44:07.286 INFO:tasks.workunit.client.0.smithi069.stderr: 40150K .......... .......... .......... .......... .......... 29% 24.7M 5s 2024-02-21T07:44:07.289 INFO:tasks.workunit.client.0.smithi069.stderr: 40200K .......... .......... .......... .......... .......... 29% 25.0M 5s 2024-02-21T07:44:07.289 INFO:tasks.workunit.client.0.smithi069.stderr: 40250K .......... .......... .......... .......... .......... 29% 46.8M 5s 2024-02-21T07:44:07.292 INFO:tasks.workunit.client.0.smithi069.stderr: 40300K .......... .......... .......... .......... .......... 29% 26.9M 5s 2024-02-21T07:44:07.293 INFO:tasks.workunit.client.0.smithi069.stderr: 40350K .......... .......... .......... .......... .......... 29% 29.1M 5s 2024-02-21T07:44:07.295 INFO:tasks.workunit.client.0.smithi069.stderr: 40400K .......... .......... .......... .......... .......... 29% 29.3M 5s 2024-02-21T07:44:07.297 INFO:tasks.workunit.client.0.smithi069.stderr: 40450K .......... .......... .......... .......... .......... 29% 28.8M 5s 2024-02-21T07:44:07.299 INFO:tasks.workunit.client.0.smithi069.stderr: 40500K .......... .......... .......... .......... .......... 29% 26.4M 5s 2024-02-21T07:44:07.301 INFO:tasks.workunit.client.0.smithi069.stderr: 40550K .......... .......... .......... .......... .......... 29% 26.4M 5s 2024-02-21T07:44:07.301 INFO:tasks.workunit.client.0.smithi069.stderr: 40600K .......... .......... .......... .......... .......... 29% 45.5M 5s 2024-02-21T07:44:07.303 INFO:tasks.workunit.client.0.smithi069.stderr: 40650K .......... .......... .......... .......... .......... 29% 25.5M 5s 2024-02-21T07:44:07.305 INFO:tasks.workunit.client.0.smithi069.stderr: 40700K .......... .......... .......... .......... .......... 30% 27.3M 5s 2024-02-21T07:44:07.307 INFO:tasks.workunit.client.0.smithi069.stderr: 40750K .......... .......... .......... .......... .......... 30% 26.2M 5s 2024-02-21T07:44:07.309 INFO:tasks.workunit.client.0.smithi069.stderr: 40800K .......... .......... .......... .......... .......... 30% 26.9M 5s 2024-02-21T07:44:07.310 INFO:tasks.workunit.client.0.smithi069.stderr: 40850K .......... .......... .......... .......... .......... 30% 43.8M 5s 2024-02-21T07:44:07.312 INFO:tasks.workunit.client.0.smithi069.stderr: 40900K .......... .......... .......... .......... .......... 30% 24.0M 5s 2024-02-21T07:44:07.314 INFO:tasks.workunit.client.0.smithi069.stderr: 40950K .......... .......... .......... .......... .......... 30% 27.2M 5s 2024-02-21T07:44:07.316 INFO:tasks.workunit.client.0.smithi069.stderr: 41000K .......... .......... .......... .......... .......... 30% 25.0M 5s 2024-02-21T07:44:07.318 INFO:tasks.workunit.client.0.smithi069.stderr: 41050K .......... .......... .......... .......... .......... 30% 33.2M 5s 2024-02-21T07:44:07.318 INFO:tasks.workunit.client.0.smithi069.stderr: 41100K .......... .......... .......... .......... .......... 30% 46.0M 5s 2024-02-21T07:44:07.320 INFO:tasks.workunit.client.0.smithi069.stderr: 41150K .......... .......... .......... .......... .......... 30% 26.2M 5s 2024-02-21T07:44:07.321 INFO:tasks.workunit.client.0.smithi069.stderr: 41200K .......... .......... .......... .......... .......... 30% 33.3M 5s 2024-02-21T07:44:07.323 INFO:tasks.workunit.client.0.smithi069.stderr: 41250K .......... .......... .......... .......... .......... 30% 32.6M 5s 2024-02-21T07:44:07.324 INFO:tasks.workunit.client.0.smithi069.stderr: 41300K .......... .......... .......... .......... .......... 30% 29.9M 5s 2024-02-21T07:44:07.326 INFO:tasks.workunit.client.0.smithi069.stderr: 41350K .......... .......... .......... .......... .......... 30% 27.7M 5s 2024-02-21T07:44:07.329 INFO:tasks.workunit.client.0.smithi069.stderr: 41400K .......... .......... .......... .......... .......... 30% 22.8M 5s 2024-02-21T07:44:07.331 INFO:tasks.workunit.client.0.smithi069.stderr: 41450K .......... .......... .......... .......... .......... 30% 24.8M 5s 2024-02-21T07:44:07.331 INFO:tasks.workunit.client.0.smithi069.stderr: 41500K .......... .......... .......... .......... .......... 30% 56.8M 5s 2024-02-21T07:44:07.333 INFO:tasks.workunit.client.0.smithi069.stderr: 41550K .......... .......... .......... .......... .......... 30% 25.5M 5s 2024-02-21T07:44:07.335 INFO:tasks.workunit.client.0.smithi069.stderr: 41600K .......... .......... .......... .......... .......... 30% 27.8M 5s 2024-02-21T07:44:07.336 INFO:tasks.workunit.client.0.smithi069.stderr: 41650K .......... .......... .......... .......... .......... 30% 28.5M 5s 2024-02-21T07:44:07.339 INFO:tasks.workunit.client.0.smithi069.stderr: 41700K .......... .......... .......... .......... .......... 30% 23.6M 5s 2024-02-21T07:44:07.341 INFO:tasks.workunit.client.0.smithi069.stderr: 41750K .......... .......... .......... .......... .......... 30% 32.3M 5s 2024-02-21T07:44:07.342 INFO:tasks.workunit.client.0.smithi069.stderr: 41800K .......... .......... .......... .......... .......... 30% 24.7M 5s 2024-02-21T07:44:07.344 INFO:tasks.workunit.client.0.smithi069.stderr: 41850K .......... .......... .......... .......... .......... 30% 31.2M 5s 2024-02-21T07:44:07.345 INFO:tasks.workunit.client.0.smithi069.stderr: 41900K .......... .......... .......... .......... .......... 30% 32.0M 5s 2024-02-21T07:44:07.347 INFO:tasks.workunit.client.0.smithi069.stderr: 41950K .......... .......... .......... .......... .......... 30% 30.1M 5s 2024-02-21T07:44:07.350 INFO:tasks.workunit.client.0.smithi069.stderr: 42000K .......... .......... .......... .......... .......... 30% 24.3M 5s 2024-02-21T07:44:07.350 INFO:tasks.workunit.client.0.smithi069.stderr: 42050K .......... .......... .......... .......... .......... 31% 62.5M 5s 2024-02-21T07:44:07.352 INFO:tasks.workunit.client.0.smithi069.stderr: 42100K .......... .......... .......... .......... .......... 31% 20.2M 5s 2024-02-21T07:44:07.354 INFO:tasks.workunit.client.0.smithi069.stderr: 42150K .......... .......... .......... .......... .......... 31% 53.7M 5s 2024-02-21T07:44:07.356 INFO:tasks.workunit.client.0.smithi069.stderr: 42200K .......... .......... .......... .......... .......... 31% 22.5M 5s 2024-02-21T07:44:07.357 INFO:tasks.workunit.client.0.smithi069.stderr: 42250K .......... .......... .......... .......... .......... 31% 24.8M 5s 2024-02-21T07:44:07.358 INFO:tasks.workunit.client.0.smithi069.stderr: 42300K .......... .......... .......... .......... .......... 31% 35.2M 5s 2024-02-21T07:44:07.361 INFO:tasks.workunit.client.0.smithi069.stderr: 42350K .......... .......... .......... .......... .......... 31% 23.9M 5s 2024-02-21T07:44:07.363 INFO:tasks.workunit.client.0.smithi069.stderr: 42400K .......... .......... .......... .......... .......... 31% 52.1M 5s 2024-02-21T07:44:07.363 INFO:tasks.workunit.client.0.smithi069.stderr: 42450K .......... .......... .......... .......... .......... 31% 26.5M 5s 2024-02-21T07:44:07.365 INFO:tasks.workunit.client.0.smithi069.stderr: 42500K .......... .......... .......... .......... .......... 31% 25.2M 5s 2024-02-21T07:44:07.367 INFO:tasks.workunit.client.0.smithi069.stderr: 42550K .......... .......... .......... .......... .......... 31% 30.0M 5s 2024-02-21T07:44:07.369 INFO:tasks.workunit.client.0.smithi069.stderr: 42600K .......... .......... .......... .......... .......... 31% 27.6M 5s 2024-02-21T07:44:07.371 INFO:tasks.workunit.client.0.smithi069.stderr: 42650K .......... .......... .......... .......... .......... 31% 26.8M 5s 2024-02-21T07:44:07.372 INFO:tasks.workunit.client.0.smithi069.stderr: 42700K .......... .......... .......... .......... .......... 31% 36.3M 5s 2024-02-21T07:44:07.374 INFO:tasks.workunit.client.0.smithi069.stderr: 42750K .......... .......... .......... .......... .......... 31% 25.1M 5s 2024-02-21T07:44:07.376 INFO:tasks.workunit.client.0.smithi069.stderr: 42800K .......... .......... .......... .......... .......... 31% 26.9M 5s 2024-02-21T07:44:07.377 INFO:tasks.workunit.client.0.smithi069.stderr: 42850K .......... .......... .......... .......... .......... 31% 40.0M 5s 2024-02-21T07:44:07.380 INFO:tasks.workunit.client.0.smithi069.stderr: 42900K .......... .......... .......... .......... .......... 31% 21.7M 5s 2024-02-21T07:44:07.381 INFO:tasks.workunit.client.0.smithi069.stderr: 42950K .......... .......... .......... .......... .......... 31% 28.4M 5s 2024-02-21T07:44:07.382 INFO:tasks.workunit.client.0.smithi069.stderr: 43000K .......... .......... .......... .......... .......... 31% 35.1M 5s 2024-02-21T07:44:07.384 INFO:tasks.workunit.client.0.smithi069.stderr: 43050K .......... .......... .......... .......... .......... 31% 33.0M 5s 2024-02-21T07:44:07.385 INFO:tasks.workunit.client.0.smithi069.stderr: 43100K .......... .......... .......... .......... .......... 31% 28.8M 5s 2024-02-21T07:44:07.388 INFO:tasks.workunit.client.0.smithi069.stderr: 43150K .......... .......... .......... .......... .......... 31% 22.7M 5s 2024-02-21T07:44:07.388 INFO:tasks.workunit.client.0.smithi069.stderr: 43200K .......... .......... .......... .......... .......... 31% 68.6M 5s 2024-02-21T07:44:07.390 INFO:tasks.workunit.client.0.smithi069.stderr: 43250K .......... .......... .......... .......... .......... 31% 23.2M 5s 2024-02-21T07:44:07.392 INFO:tasks.workunit.client.0.smithi069.stderr: 43300K .......... .......... .......... .......... .......... 31% 30.6M 5s 2024-02-21T07:44:07.394 INFO:tasks.workunit.client.0.smithi069.stderr: 43350K .......... .......... .......... .......... .......... 31% 24.4M 5s 2024-02-21T07:44:07.395 INFO:tasks.workunit.client.0.smithi069.stderr: 43400K .......... .......... .......... .......... .......... 32% 36.7M 5s 2024-02-21T07:44:07.396 INFO:tasks.workunit.client.0.smithi069.stderr: 43450K .......... .......... .......... .......... .......... 32% 31.8M 5s 2024-02-21T07:44:07.398 INFO:tasks.workunit.client.0.smithi069.stderr: 43500K .......... .......... .......... .......... .......... 32% 24.2M 5s 2024-02-21T07:44:07.401 INFO:tasks.workunit.client.0.smithi069.stderr: 43550K .......... .......... .......... .......... .......... 32% 27.8M 5s 2024-02-21T07:44:07.403 INFO:tasks.workunit.client.0.smithi069.stderr: 43600K .......... .......... .......... .......... .......... 32% 25.1M 5s 2024-02-21T07:44:07.404 INFO:tasks.workunit.client.0.smithi069.stderr: 43650K .......... .......... .......... .......... .......... 32% 35.2M 5s 2024-02-21T07:44:07.405 INFO:tasks.workunit.client.0.smithi069.stderr: 43700K .......... .......... .......... .......... .......... 32% 36.5M 5s 2024-02-21T07:44:07.407 INFO:tasks.workunit.client.0.smithi069.stderr: 43750K .......... .......... .......... .......... .......... 32% 26.9M 5s 2024-02-21T07:44:07.409 INFO:tasks.workunit.client.0.smithi069.stderr: 43800K .......... .......... .......... .......... .......... 32% 21.6M 5s 2024-02-21T07:44:07.411 INFO:tasks.workunit.client.0.smithi069.stderr: 43850K .......... .......... .......... .......... .......... 32% 30.2M 5s 2024-02-21T07:44:07.412 INFO:tasks.workunit.client.0.smithi069.stderr: 43900K .......... .......... .......... .......... .......... 32% 29.6M 5s 2024-02-21T07:44:07.414 INFO:tasks.workunit.client.0.smithi069.stderr: 43950K .......... .......... .......... .......... .......... 32% 32.5M 5s 2024-02-21T07:44:07.416 INFO:tasks.workunit.client.0.smithi069.stderr: 44000K .......... .......... .......... .......... .......... 32% 29.1M 5s 2024-02-21T07:44:07.418 INFO:tasks.workunit.client.0.smithi069.stderr: 44050K .......... .......... .......... .......... .......... 32% 27.8M 5s 2024-02-21T07:44:07.418 INFO:tasks.workunit.client.0.smithi069.stderr: 44100K .......... .......... .......... .......... .......... 32% 39.7M 5s 2024-02-21T07:44:07.425 INFO:tasks.workunit.client.0.smithi069.stderr: 44150K .......... .......... .......... .......... .......... 32% 7.16M 5s 2024-02-21T07:44:07.427 INFO:tasks.workunit.client.0.smithi069.stderr: 44200K .......... .......... .......... .......... .......... 32% 37.1M 5s 2024-02-21T07:44:07.428 INFO:tasks.workunit.client.0.smithi069.stderr: 44250K .......... .......... .......... .......... .......... 32% 40.9M 5s 2024-02-21T07:44:07.429 INFO:tasks.workunit.client.0.smithi069.stderr: 44300K .......... .......... .......... .......... .......... 32% 38.5M 5s 2024-02-21T07:44:07.431 INFO:tasks.workunit.client.0.smithi069.stderr: 44350K .......... .......... .......... .......... .......... 32% 34.8M 5s 2024-02-21T07:44:07.432 INFO:tasks.workunit.client.0.smithi069.stderr: 44400K .......... .......... .......... .......... .......... 32% 40.4M 5s 2024-02-21T07:44:07.434 INFO:tasks.workunit.client.0.smithi069.stderr: 44450K .......... .......... .......... .......... .......... 32% 40.0M 5s 2024-02-21T07:44:07.435 INFO:tasks.workunit.client.0.smithi069.stderr: 44500K .......... .......... .......... .......... .......... 32% 40.9M 5s 2024-02-21T07:44:07.436 INFO:tasks.workunit.client.0.smithi069.stderr: 44550K .......... .......... .......... .......... .......... 32% 34.4M 5s 2024-02-21T07:44:07.437 INFO:tasks.workunit.client.0.smithi069.stderr: 44600K .......... .......... .......... .......... .......... 32% 47.2M 5s 2024-02-21T07:44:07.438 INFO:tasks.workunit.client.0.smithi069.stderr: 44650K .......... .......... .......... .......... .......... 32% 41.5M 5s 2024-02-21T07:44:07.439 INFO:tasks.workunit.client.0.smithi069.stderr: 44700K .......... .......... .......... .......... .......... 32% 35.6M 4s 2024-02-21T07:44:07.441 INFO:tasks.workunit.client.0.smithi069.stderr: 44750K .......... .......... .......... .......... .......... 33% 26.7M 4s 2024-02-21T07:44:07.443 INFO:tasks.workunit.client.0.smithi069.stderr: 44800K .......... .......... .......... .......... .......... 33% 26.6M 4s 2024-02-21T07:44:07.444 INFO:tasks.workunit.client.0.smithi069.stderr: 44850K .......... .......... .......... .......... .......... 33% 32.4M 4s 2024-02-21T07:44:07.446 INFO:tasks.workunit.client.0.smithi069.stderr: 44900K .......... .......... .......... .......... .......... 33% 31.8M 4s 2024-02-21T07:44:07.449 INFO:tasks.workunit.client.0.smithi069.stderr: 44950K .......... .......... .......... .......... .......... 33% 30.7M 4s 2024-02-21T07:44:07.450 INFO:tasks.workunit.client.0.smithi069.stderr: 45000K .......... .......... .......... .......... .......... 33% 20.7M 4s 2024-02-21T07:44:07.451 INFO:tasks.workunit.client.0.smithi069.stderr: 45050K .......... .......... .......... .......... .......... 33% 39.4M 4s 2024-02-21T07:44:07.453 INFO:tasks.workunit.client.0.smithi069.stderr: 45100K .......... .......... .......... .......... .......... 33% 33.7M 4s 2024-02-21T07:44:07.455 INFO:tasks.workunit.client.0.smithi069.stderr: 45150K .......... .......... .......... .......... .......... 33% 24.9M 4s 2024-02-21T07:44:07.456 INFO:tasks.workunit.client.0.smithi069.stderr: 45200K .......... .......... .......... .......... .......... 33% 34.6M 4s 2024-02-21T07:44:07.457 INFO:tasks.workunit.client.0.smithi069.stderr: 45250K .......... .......... .......... .......... .......... 33% 33.5M 4s 2024-02-21T07:44:07.459 INFO:tasks.workunit.client.0.smithi069.stderr: 45300K .......... .......... .......... .......... .......... 33% 22.4M 4s 2024-02-21T07:44:07.461 INFO:tasks.workunit.client.0.smithi069.stderr: 45350K .......... .......... .......... .......... .......... 33% 34.3M 4s 2024-02-21T07:44:07.463 INFO:tasks.workunit.client.0.smithi069.stderr: 45400K .......... .......... .......... .......... .......... 33% 28.5M 4s 2024-02-21T07:44:07.464 INFO:tasks.workunit.client.0.smithi069.stderr: 45450K .......... .......... .......... .......... .......... 33% 29.4M 4s 2024-02-21T07:44:07.466 INFO:tasks.workunit.client.0.smithi069.stderr: 45500K .......... .......... .......... .......... .......... 33% 30.5M 4s 2024-02-21T07:44:07.468 INFO:tasks.workunit.client.0.smithi069.stderr: 45550K .......... .......... .......... .......... .......... 33% 25.7M 4s 2024-02-21T07:44:07.470 INFO:tasks.workunit.client.0.smithi069.stderr: 45600K .......... .......... .......... .......... .......... 33% 27.4M 4s 2024-02-21T07:44:07.471 INFO:tasks.workunit.client.0.smithi069.stderr: 45650K .......... .......... .......... .......... .......... 33% 31.5M 4s 2024-02-21T07:44:07.473 INFO:tasks.workunit.client.0.smithi069.stderr: 45700K .......... .......... .......... .......... .......... 33% 29.8M 4s 2024-02-21T07:44:07.475 INFO:tasks.workunit.client.0.smithi069.stderr: 45750K .......... .......... .......... .......... .......... 33% 27.7M 4s 2024-02-21T07:44:07.476 INFO:tasks.workunit.client.0.smithi069.stderr: 45800K .......... .......... .......... .......... .......... 33% 33.3M 4s 2024-02-21T07:44:07.478 INFO:tasks.workunit.client.0.smithi069.stderr: 45850K .......... .......... .......... .......... .......... 33% 24.5M 4s 2024-02-21T07:44:07.479 INFO:tasks.workunit.client.0.smithi069.stderr: 45900K .......... .......... .......... .......... .......... 33% 31.7M 4s 2024-02-21T07:44:07.481 INFO:tasks.workunit.client.0.smithi069.stderr: 45950K .......... .......... .......... .......... .......... 33% 29.0M 4s 2024-02-21T07:44:07.483 INFO:tasks.workunit.client.0.smithi069.stderr: 46000K .......... .......... .......... .......... .......... 33% 29.7M 4s 2024-02-21T07:44:07.484 INFO:tasks.workunit.client.0.smithi069.stderr: 46050K .......... .......... .......... .......... .......... 33% 29.8M 4s 2024-02-21T07:44:07.680 INFO:tasks.workunit.client.0.smithi069.stderr: 46100K .......... .......... .......... .......... .......... 33% 26.4M 4s 2024-02-21T07:44:07.680 INFO:tasks.workunit.client.0.smithi069.stderr: 46150K .......... .......... .......... .......... .......... 34% 41.4M 4s 2024-02-21T07:44:07.680 INFO:tasks.workunit.client.0.smithi069.stderr: 46200K .......... .......... .......... .......... .......... 34% 27.1M 4s 2024-02-21T07:44:07.680 INFO:tasks.workunit.client.0.smithi069.stderr: 46250K .......... .......... .......... .......... .......... 34% 31.0M 4s 2024-02-21T07:44:07.680 INFO:tasks.workunit.client.0.smithi069.stderr: 46300K .......... .......... .......... .......... .......... 34% 21.6M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46350K .......... .......... .......... .......... .......... 34% 27.6M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46400K .......... .......... .......... .......... .......... 34% 43.7M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46450K .......... .......... .......... .......... .......... 34% 30.8M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46500K .......... .......... .......... .......... .......... 34% 20.9M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46550K .......... .......... .......... .......... .......... 34% 24.7M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46600K .......... .......... .......... .......... .......... 34% 26.0M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46650K .......... .......... .......... .......... .......... 34% 42.5M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46700K .......... .......... .......... .......... .......... 34% 28.6M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46750K .......... .......... .......... .......... .......... 34% 26.3M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46800K .......... .......... .......... .......... .......... 34% 26.0M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46850K .......... .......... .......... .......... .......... 34% 37.7M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46900K .......... .......... .......... .......... .......... 34% 29.7M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 46950K .......... .......... .......... .......... .......... 34% 29.9M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 47000K .......... .......... .......... .......... .......... 34% 32.8M 4s 2024-02-21T07:44:07.681 INFO:tasks.workunit.client.0.smithi069.stderr: 47050K .......... .......... .......... .......... .......... 34% 36.8M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47100K .......... .......... .......... .......... .......... 34% 29.8M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47150K .......... .......... .......... .......... .......... 34% 29.1M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47200K .......... .......... .......... .......... .......... 34% 25.5M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47250K .......... .......... .......... .......... .......... 34% 23.4M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47300K .......... .......... .......... .......... .......... 34% 33.9M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47350K .......... .......... .......... .......... .......... 34% 43.5M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47400K .......... .......... .......... .......... .......... 34% 22.8M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47450K .......... .......... .......... .......... .......... 34% 35.2M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47500K .......... .......... .......... .......... .......... 35% 19.9M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47550K .......... .......... .......... .......... .......... 35% 25.1M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47600K .......... .......... .......... .......... .......... 35% 42.4M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47650K .......... .......... .......... .......... .......... 35% 34.7M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47700K .......... .......... .......... .......... .......... 35% 29.2M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47750K .......... .......... .......... .......... .......... 35% 23.2M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47800K .......... .......... .......... .......... .......... 35% 35.2M 4s 2024-02-21T07:44:07.682 INFO:tasks.workunit.client.0.smithi069.stderr: 47850K .......... .......... .......... .......... .......... 35% 42.8M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 47900K .......... .......... .......... .......... .......... 35% 23.1M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 47950K .......... .......... .......... .......... .......... 35% 26.6M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48000K .......... .......... .......... .......... .......... 35% 42.3M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48050K .......... .......... .......... .......... .......... 35% 19.8M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48100K .......... .......... .......... .......... .......... 35% 41.6M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48150K .......... .......... .......... .......... .......... 35% 31.0M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48200K .......... .......... .......... .......... .......... 35% 23.1M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48250K .......... .......... .......... .......... .......... 35% 32.8M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48300K .......... .......... .......... .......... .......... 35% 34.6M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48350K .......... .......... .......... .......... .......... 35% 27.7M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48400K .......... .......... .......... .......... .......... 35% 29.3M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48450K .......... .......... .......... .......... .......... 35% 27.8M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48500K .......... .......... .......... .......... .......... 35% 24.6M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48550K .......... .......... .......... .......... .......... 35% 31.9M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48600K .......... .......... .......... .......... .......... 35% 37.3M 4s 2024-02-21T07:44:07.683 INFO:tasks.workunit.client.0.smithi069.stderr: 48650K .......... .......... .......... .......... .......... 35% 29.1M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 48700K .......... .......... .......... .......... .......... 35% 24.4M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 48750K .......... .......... .......... .......... .......... 35% 26.1M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 48800K .......... .......... .......... .......... .......... 35% 40.1M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 48850K .......... .......... .......... .......... .......... 36% 27.4M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 48900K .......... .......... .......... .......... .......... 36% 27.5M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 48950K .......... .......... .......... .......... .......... 36% 31.7M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 49000K .......... .......... .......... .......... .......... 36% 34.0M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 49050K .......... .......... .......... .......... .......... 36% 24.7M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 49100K .......... .......... .......... .......... .......... 36% 23.6M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 49150K .......... .......... .......... .......... .......... 36% 37.1M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 49200K .......... .......... .......... .......... .......... 36% 29.9M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 49250K .......... .......... .......... .......... .......... 36% 26.8M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 49300K .......... .......... .......... .......... .......... 36% 28.6M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 49350K .......... .......... .......... .......... .......... 36% 26.0M 4s 2024-02-21T07:44:07.684 INFO:tasks.workunit.client.0.smithi069.stderr: 49400K .......... .......... .......... .......... .......... 36% 39.8M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49450K .......... .......... .......... .......... .......... 36% 26.1M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49500K .......... .......... .......... .......... .......... 36% 26.0M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49550K .......... .......... .......... .......... .......... 36% 26.8M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49600K .......... .......... .......... .......... .......... 36% 29.2M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49650K .......... .......... .......... .......... .......... 36% 45.2M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49700K .......... .......... .......... .......... .......... 36% 26.7M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49750K .......... .......... .......... .......... .......... 36% 27.4M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49800K .......... .......... .......... .......... .......... 36% 27.5M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49850K .......... .......... .......... .......... .......... 36% 32.7M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49900K .......... .......... .......... .......... .......... 36% 28.0M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 49950K .......... .......... .......... .......... .......... 36% 31.3M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 50000K .......... .......... .......... .......... .......... 36% 28.3M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 50050K .......... .......... .......... .......... .......... 36% 26.4M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 50100K .......... .......... .......... .......... .......... 36% 27.2M 4s 2024-02-21T07:44:07.685 INFO:tasks.workunit.client.0.smithi069.stderr: 50150K .......... .......... .......... .......... .......... 36% 41.1M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50200K .......... .......... .......... .......... .......... 37% 27.0M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50250K .......... .......... .......... .......... .......... 37% 27.2M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50300K .......... .......... .......... .......... .......... 37% 26.8M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50350K .......... .......... .......... .......... .......... 37% 27.3M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50400K .......... .......... .......... .......... .......... 37% 43.4M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50450K .......... .......... .......... .......... .......... 37% 25.4M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50500K .......... .......... .......... .......... .......... 37% 26.4M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50550K .......... .......... .......... .......... .......... 37% 24.5M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50600K .......... .......... .......... .......... .......... 37% 37.4M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50650K .......... .......... .......... .......... .......... 37% 30.2M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50700K .......... .......... .......... .......... .......... 37% 31.1M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50750K .......... .......... .......... .......... .......... 37% 25.7M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50800K .......... .......... .......... .......... .......... 37% 38.0M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50850K .......... .......... .......... .......... .......... 37% 27.2M 4s 2024-02-21T07:44:07.686 INFO:tasks.workunit.client.0.smithi069.stderr: 50900K .......... .......... .......... .......... .......... 37% 31.0M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 50950K .......... .......... .......... .......... .......... 37% 26.8M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51000K .......... .......... .......... .......... .......... 37% 26.3M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51050K .......... .......... .......... .......... .......... 37% 36.9M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51100K .......... .......... .......... .......... .......... 37% 25.5M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51150K .......... .......... .......... .......... .......... 37% 28.7M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51200K .......... .......... .......... .......... .......... 37% 38.3M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51250K .......... .......... .......... .......... .......... 37% 24.4M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51300K .......... .......... .......... .......... .......... 37% 29.4M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51350K .......... .......... .......... .......... .......... 37% 25.1M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51400K .......... .......... .......... .......... .......... 37% 26.9M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51450K .......... .......... .......... .......... .......... 37% 44.8M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51500K .......... .......... .......... .......... .......... 37% 27.3M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51550K .......... .......... .......... .......... .......... 38% 24.3M 4s 2024-02-21T07:44:07.687 INFO:tasks.workunit.client.0.smithi069.stderr: 51600K .......... .......... .......... .......... .......... 38% 32.4M 4s 2024-02-21T07:44:07.688 INFO:tasks.workunit.client.0.smithi069.stderr: 51650K .......... .......... .......... .......... .......... 38% 25.9M 4s 2024-02-21T07:44:07.688 INFO:tasks.workunit.client.0.smithi069.stderr: 51700K .......... .......... .......... .......... .......... 38% 40.2M 4s 2024-02-21T07:44:07.688 INFO:tasks.workunit.client.0.smithi069.stderr: 51750K .......... .......... .......... .......... .......... 38% 28.3M 4s 2024-02-21T07:44:07.688 INFO:tasks.workunit.client.0.smithi069.stderr: 51800K .......... .......... .......... .......... .......... 38% 22.8M 4s 2024-02-21T07:44:07.688 INFO:tasks.workunit.client.0.smithi069.stderr: 51850K .......... .......... .......... .......... .......... 38% 28.2M 4s 2024-02-21T07:44:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: 51900K .......... .......... .......... .......... .......... 38% 31.1M 4s 2024-02-21T07:44:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: 51950K .......... .......... .......... .......... .......... 38% 38.5M 4s 2024-02-21T07:44:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: 52000K .......... .......... .......... .......... .......... 38% 25.8M 4s 2024-02-21T07:44:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: 52050K .......... .......... .......... .......... .......... 38% 24.1M 4s 2024-02-21T07:44:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: 52100K .......... .......... .......... .......... .......... 38% 36.7M 4s 2024-02-21T07:44:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: 52150K .......... .......... .......... .......... .......... 38% 25.7M 4s 2024-02-21T07:44:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: 52200K .......... .......... .......... .......... .......... 38% 27.5M 4s 2024-02-21T07:44:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: 52250K .......... .......... .......... .......... .......... 38% 42.7M 4s 2024-02-21T07:44:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: 52300K .......... .......... .......... .......... .......... 38% 26.1M 4s 2024-02-21T07:44:07.696 INFO:tasks.workunit.client.0.smithi069.stderr: 52350K .......... .......... .......... .......... .......... 38% 27.1M 4s 2024-02-21T07:44:07.698 INFO:tasks.workunit.client.0.smithi069.stderr: 52400K .......... .......... .......... .......... .......... 38% 25.2M 4s 2024-02-21T07:44:07.701 INFO:tasks.workunit.client.0.smithi069.stderr: 52450K .......... .......... .......... .......... .......... 38% 26.2M 4s 2024-02-21T07:44:07.701 INFO:tasks.workunit.client.0.smithi069.stderr: 52500K .......... .......... .......... .......... .......... 38% 44.2M 4s 2024-02-21T07:44:07.703 INFO:tasks.workunit.client.0.smithi069.stderr: 52550K .......... .......... .......... .......... .......... 38% 27.1M 4s 2024-02-21T07:44:07.705 INFO:tasks.workunit.client.0.smithi069.stderr: 52600K .......... .......... .......... .......... .......... 38% 26.6M 4s 2024-02-21T07:44:07.706 INFO:tasks.workunit.client.0.smithi069.stderr: 52650K .......... .......... .......... .......... .......... 38% 29.2M 4s 2024-02-21T07:44:07.709 INFO:tasks.workunit.client.0.smithi069.stderr: 52700K .......... .......... .......... .......... .......... 38% 27.0M 4s 2024-02-21T07:44:07.709 INFO:tasks.workunit.client.0.smithi069.stderr: 52750K .......... .......... .......... .......... .......... 38% 36.3M 4s 2024-02-21T07:44:07.711 INFO:tasks.workunit.client.0.smithi069.stderr: 52800K .......... .......... .......... .......... .......... 38% 31.0M 4s 2024-02-21T07:44:07.713 INFO:tasks.workunit.client.0.smithi069.stderr: 52850K .......... .......... .......... .......... .......... 38% 26.2M 4s 2024-02-21T07:44:07.716 INFO:tasks.workunit.client.0.smithi069.stderr: 52900K .......... .......... .......... .......... .......... 39% 27.0M 4s 2024-02-21T07:44:07.718 INFO:tasks.workunit.client.0.smithi069.stderr: 52950K .......... .......... .......... .......... .......... 39% 27.6M 4s 2024-02-21T07:44:07.718 INFO:tasks.workunit.client.0.smithi069.stderr: 53000K .......... .......... .......... .......... .......... 39% 38.5M 4s 2024-02-21T07:44:07.720 INFO:tasks.workunit.client.0.smithi069.stderr: 53050K .......... .......... .......... .......... .......... 39% 22.8M 4s 2024-02-21T07:44:07.722 INFO:tasks.workunit.client.0.smithi069.stderr: 53100K .......... .......... .......... .......... .......... 39% 32.9M 4s 2024-02-21T07:44:07.724 INFO:tasks.workunit.client.0.smithi069.stderr: 53150K .......... .......... .......... .......... .......... 39% 29.1M 4s 2024-02-21T07:44:07.724 INFO:tasks.workunit.client.0.smithi069.stderr: 53200K .......... .......... .......... .......... .......... 39% 37.4M 4s 2024-02-21T07:44:07.727 INFO:tasks.workunit.client.0.smithi069.stderr: 53250K .......... .......... .......... .......... .......... 39% 25.9M 4s 2024-02-21T07:44:07.728 INFO:tasks.workunit.client.0.smithi069.stderr: 53300K .......... .......... .......... .......... .......... 39% 26.9M 4s 2024-02-21T07:44:07.730 INFO:tasks.workunit.client.0.smithi069.stderr: 53350K .......... .......... .......... .......... .......... 39% 29.2M 4s 2024-02-21T07:44:07.731 INFO:tasks.workunit.client.0.smithi069.stderr: 53400K .......... .......... .......... .......... .......... 39% 28.2M 4s 2024-02-21T07:44:07.733 INFO:tasks.workunit.client.0.smithi069.stderr: 53450K .......... .......... .......... .......... .......... 39% 36.3M 4s 2024-02-21T07:44:07.735 INFO:tasks.workunit.client.0.smithi069.stderr: 53500K .......... .......... .......... .......... .......... 39% 26.3M 4s 2024-02-21T07:44:07.736 INFO:tasks.workunit.client.0.smithi069.stderr: 53550K .......... .......... .......... .......... .......... 39% 31.5M 4s 2024-02-21T07:44:07.738 INFO:tasks.workunit.client.0.smithi069.stderr: 53600K .......... .......... .......... .......... .......... 39% 26.5M 4s 2024-02-21T07:44:07.740 INFO:tasks.workunit.client.0.smithi069.stderr: 53650K .......... .......... .......... .......... .......... 39% 24.1M 4s 2024-02-21T07:44:07.741 INFO:tasks.workunit.client.0.smithi069.stderr: 53700K .......... .......... .......... .......... .......... 39% 44.1M 4s 2024-02-21T07:44:07.743 INFO:tasks.workunit.client.0.smithi069.stderr: 53750K .......... .......... .......... .......... .......... 39% 28.1M 4s 2024-02-21T07:44:07.745 INFO:tasks.workunit.client.0.smithi069.stderr: 53800K .......... .......... .......... .......... .......... 39% 26.1M 4s 2024-02-21T07:44:07.747 INFO:tasks.workunit.client.0.smithi069.stderr: 53850K .......... .......... .......... .......... .......... 39% 27.6M 4s 2024-02-21T07:44:07.749 INFO:tasks.workunit.client.0.smithi069.stderr: 53900K .......... .......... .......... .......... .......... 39% 28.2M 4s 2024-02-21T07:44:07.749 INFO:tasks.workunit.client.0.smithi069.stderr: 53950K .......... .......... .......... .......... .......... 39% 41.1M 4s 2024-02-21T07:44:07.751 INFO:tasks.workunit.client.0.smithi069.stderr: 54000K .......... .......... .......... .......... .......... 39% 27.9M 4s 2024-02-21T07:44:07.753 INFO:tasks.workunit.client.0.smithi069.stderr: 54050K .......... .......... .......... .......... .......... 39% 25.4M 4s 2024-02-21T07:44:07.755 INFO:tasks.workunit.client.0.smithi069.stderr: 54100K .......... .......... .......... .......... .......... 39% 30.6M 4s 2024-02-21T07:44:07.757 INFO:tasks.workunit.client.0.smithi069.stderr: 54150K .......... .......... .......... .......... .......... 39% 26.3M 4s 2024-02-21T07:44:07.758 INFO:tasks.workunit.client.0.smithi069.stderr: 54200K .......... .......... .......... .......... .......... 39% 44.4M 4s 2024-02-21T07:44:07.760 INFO:tasks.workunit.client.0.smithi069.stderr: 54250K .......... .......... .......... .......... .......... 39% 25.9M 4s 2024-02-21T07:44:07.762 INFO:tasks.workunit.client.0.smithi069.stderr: 54300K .......... .......... .......... .......... .......... 40% 24.8M 4s 2024-02-21T07:44:07.764 INFO:tasks.workunit.client.0.smithi069.stderr: 54350K .......... .......... .......... .......... .......... 40% 26.8M 4s 2024-02-21T07:44:07.765 INFO:tasks.workunit.client.0.smithi069.stderr: 54400K .......... .......... .......... .......... .......... 40% 28.2M 4s 2024-02-21T07:44:07.767 INFO:tasks.workunit.client.0.smithi069.stderr: 54450K .......... .......... .......... .......... .......... 40% 44.2M 4s 2024-02-21T07:44:07.768 INFO:tasks.workunit.client.0.smithi069.stderr: 54500K .......... .......... .......... .......... .......... 40% 26.0M 4s 2024-02-21T07:44:07.770 INFO:tasks.workunit.client.0.smithi069.stderr: 54550K .......... .......... .......... .......... .......... 40% 26.2M 4s 2024-02-21T07:44:07.773 INFO:tasks.workunit.client.0.smithi069.stderr: 54600K .......... .......... .......... .......... .......... 40% 25.5M 4s 2024-02-21T07:44:07.774 INFO:tasks.workunit.client.0.smithi069.stderr: 54650K .......... .......... .......... .......... .......... 40% 26.6M 4s 2024-02-21T07:44:07.776 INFO:tasks.workunit.client.0.smithi069.stderr: 54700K .......... .......... .......... .......... .......... 40% 29.3M 4s 2024-02-21T07:44:07.777 INFO:tasks.workunit.client.0.smithi069.stderr: 54750K .......... .......... .......... .......... .......... 40% 44.6M 4s 2024-02-21T07:44:07.778 INFO:tasks.workunit.client.0.smithi069.stderr: 54800K .......... .......... .......... .......... .......... 40% 26.9M 4s 2024-02-21T07:44:07.780 INFO:tasks.workunit.client.0.smithi069.stderr: 54850K .......... .......... .......... .......... .......... 40% 28.0M 4s 2024-02-21T07:44:07.783 INFO:tasks.workunit.client.0.smithi069.stderr: 54900K .......... .......... .......... .......... .......... 40% 24.5M 4s 2024-02-21T07:44:07.783 INFO:tasks.workunit.client.0.smithi069.stderr: 54950K .......... .......... .......... .......... .......... 40% 44.5M 4s 2024-02-21T07:44:07.785 INFO:tasks.workunit.client.0.smithi069.stderr: 55000K .......... .......... .......... .......... .......... 40% 28.4M 4s 2024-02-21T07:44:07.788 INFO:tasks.workunit.client.0.smithi069.stderr: 55050K .......... .......... .......... .......... .......... 40% 24.9M 4s 2024-02-21T07:44:07.790 INFO:tasks.workunit.client.0.smithi069.stderr: 55100K .......... .......... .......... .......... .......... 40% 26.9M 4s 2024-02-21T07:44:07.790 INFO:tasks.workunit.client.0.smithi069.stderr: 55150K .......... .......... .......... .......... .......... 40% 45.3M 4s 2024-02-21T07:44:07.792 INFO:tasks.workunit.client.0.smithi069.stderr: 55200K .......... .......... .......... .......... .......... 40% 23.0M 4s 2024-02-21T07:44:07.800 INFO:tasks.workunit.client.0.smithi069.stderr: 55250K .......... .......... .......... .......... .......... 40% 22.9M 4s 2024-02-21T07:44:07.800 INFO:tasks.workunit.client.0.smithi069.stderr: 55300K .......... .......... .......... .......... .......... 40% 33.9M 4s 2024-02-21T07:44:07.801 INFO:tasks.workunit.client.0.smithi069.stderr: 55350K .......... .......... .......... .......... .......... 40% 27.7M 4s 2024-02-21T07:44:07.801 INFO:tasks.workunit.client.0.smithi069.stderr: 55400K .......... .......... .......... .......... .......... 40% 31.8M 4s 2024-02-21T07:44:07.802 INFO:tasks.workunit.client.0.smithi069.stderr: 55450K .......... .......... .......... .......... .......... 40% 28.5M 4s 2024-02-21T07:44:07.802 INFO:tasks.workunit.client.0.smithi069.stderr: 55500K .......... .......... .......... .......... .......... 40% 29.7M 4s 2024-02-21T07:44:07.896 INFO:tasks.workunit.client.0.smithi069.stderr: 55550K .......... .......... .......... .......... .......... 40% 535K 4s 2024-02-21T07:44:07.897 INFO:tasks.workunit.client.0.smithi069.stderr: 55600K .......... .......... .......... .......... .......... 40% 40.5M 4s 2024-02-21T07:44:07.898 INFO:tasks.workunit.client.0.smithi069.stderr: 55650K .......... .......... .......... .......... .......... 41% 42.2M 4s 2024-02-21T07:44:07.899 INFO:tasks.workunit.client.0.smithi069.stderr: 55700K .......... .......... .......... .......... .......... 41% 37.6M 4s 2024-02-21T07:44:07.902 INFO:tasks.workunit.client.0.smithi069.stderr: 55750K .......... .......... .......... .......... .......... 41% 43.0M 4s 2024-02-21T07:44:07.902 INFO:tasks.workunit.client.0.smithi069.stderr: 55800K .......... .......... .......... .......... .......... 41% 41.8M 4s 2024-02-21T07:44:07.903 INFO:tasks.workunit.client.0.smithi069.stderr: 55850K .......... .......... .......... .......... .......... 41% 43.0M 4s 2024-02-21T07:44:07.904 INFO:tasks.workunit.client.0.smithi069.stderr: 55900K .......... .......... .......... .......... .......... 41% 33.3M 4s 2024-02-21T07:44:07.906 INFO:tasks.workunit.client.0.smithi069.stderr: 55950K .......... .......... .......... .......... .......... 41% 42.4M 4s 2024-02-21T07:44:07.906 INFO:tasks.workunit.client.0.smithi069.stderr: 56000K .......... .......... .......... .......... .......... 41% 42.7M 4s 2024-02-21T07:44:07.907 INFO:tasks.workunit.client.0.smithi069.stderr: 56050K .......... .......... .......... .......... .......... 41% 42.4M 4s 2024-02-21T07:44:07.909 INFO:tasks.workunit.client.0.smithi069.stderr: 56100K .......... .......... .......... .......... .......... 41% 36.5M 4s 2024-02-21T07:44:07.910 INFO:tasks.workunit.client.0.smithi069.stderr: 56150K .......... .......... .......... .......... .......... 41% 42.8M 4s 2024-02-21T07:44:07.912 INFO:tasks.workunit.client.0.smithi069.stderr: 56200K .......... .......... .......... .......... .......... 41% 42.8M 4s 2024-02-21T07:44:07.912 INFO:tasks.workunit.client.0.smithi069.stderr: 56250K .......... .......... .......... .......... .......... 41% 42.9M 4s 2024-02-21T07:44:07.915 INFO:tasks.workunit.client.0.smithi069.stderr: 56300K .......... .......... .......... .......... .......... 41% 36.7M 4s 2024-02-21T07:44:07.915 INFO:tasks.workunit.client.0.smithi069.stderr: 56350K .......... .......... .......... .......... .......... 41% 42.5M 4s 2024-02-21T07:44:07.916 INFO:tasks.workunit.client.0.smithi069.stderr: 56400K .......... .......... .......... .......... .......... 41% 42.9M 4s 2024-02-21T07:44:07.917 INFO:tasks.workunit.client.0.smithi069.stderr: 56450K .......... .......... .......... .......... .......... 41% 42.8M 4s 2024-02-21T07:44:07.918 INFO:tasks.workunit.client.0.smithi069.stderr: 56500K .......... .......... .......... .......... .......... 41% 36.5M 4s 2024-02-21T07:44:07.920 INFO:tasks.workunit.client.0.smithi069.stderr: 56550K .......... .......... .......... .......... .......... 41% 42.8M 4s 2024-02-21T07:44:07.921 INFO:tasks.workunit.client.0.smithi069.stderr: 56600K .......... .......... .......... .......... .......... 41% 43.3M 4s 2024-02-21T07:44:07.922 INFO:tasks.workunit.client.0.smithi069.stderr: 56650K .......... .......... .......... .......... .......... 41% 42.2M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 56700K .......... .......... .......... .......... .......... 41% 44.5M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 56750K .......... .......... .......... .......... .......... 41% 69.5M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 56800K .......... .......... .......... .......... .......... 41% 70.1M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 56850K .......... .......... .......... .......... .......... 41% 69.9M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 56900K .......... .......... .......... .......... .......... 41% 62.4M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 56950K .......... .......... .......... .......... .......... 41% 60.1M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 57000K .......... .......... .......... .......... .......... 42% 74.8M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 57050K .......... .......... .......... .......... .......... 42% 71.0M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 57100K .......... .......... .......... .......... .......... 42% 57.5M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 57150K .......... .......... .......... .......... .......... 42% 70.8M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 57200K .......... .......... .......... .......... .......... 42% 72.7M 4s 2024-02-21T07:44:07.970 INFO:tasks.workunit.client.0.smithi069.stderr: 57250K .......... .......... .......... .......... .......... 42% 70.1M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57300K .......... .......... .......... .......... .......... 42% 54.4M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57350K .......... .......... .......... .......... .......... 42% 63.4M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57400K .......... .......... .......... .......... .......... 42% 62.4M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57450K .......... .......... .......... .......... .......... 42% 56.7M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57500K .......... .......... .......... .......... .......... 42% 61.2M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57550K .......... .......... .......... .......... .......... 42% 66.4M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57600K .......... .......... .......... .......... .......... 42% 78.6M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57650K .......... .......... .......... .......... .......... 42% 66.2M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57700K .......... .......... .......... .......... .......... 42% 70.9M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57750K .......... .......... .......... .......... .......... 42% 74.7M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57800K .......... .......... .......... .......... .......... 42% 77.7M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57850K .......... .......... .......... .......... .......... 42% 79.6M 4s 2024-02-21T07:44:07.971 INFO:tasks.workunit.client.0.smithi069.stderr: 57900K .......... .......... .......... .......... .......... 42% 63.6M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 57950K .......... .......... .......... .......... .......... 42% 89.0M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58000K .......... .......... .......... .......... .......... 42% 79.6M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58050K .......... .......... .......... .......... .......... 42% 86.0M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58100K .......... .......... .......... .......... .......... 42% 63.9M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58150K .......... .......... .......... .......... .......... 42% 88.3M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58200K .......... .......... .......... .......... .......... 42% 54.3M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58250K .......... .......... .......... .......... .......... 42% 80.9M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58300K .......... .......... .......... .......... .......... 42% 75.0M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58350K .......... .......... .......... .......... .......... 43% 101M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58400K .......... .......... .......... .......... .......... 43% 90.9M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58450K .......... .......... .......... .......... .......... 43% 89.9M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58500K .......... .......... .......... .......... .......... 43% 81.4M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58550K .......... .......... .......... .......... .......... 43% 105M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58600K .......... .......... .......... .......... .......... 43% 89.7M 4s 2024-02-21T07:44:07.972 INFO:tasks.workunit.client.0.smithi069.stderr: 58650K .......... .......... .......... .......... .......... 43% 82.9M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 58700K .......... .......... .......... .......... .......... 43% 91.4M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 58750K .......... .......... .......... .......... .......... 43% 92.7M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 58800K .......... .......... .......... .......... .......... 43% 93.9M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 58850K .......... .......... .......... .......... .......... 43% 80.1M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 58900K .......... .......... .......... .......... .......... 43% 94.0M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 58950K .......... .......... .......... .......... .......... 43% 104M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 59000K .......... .......... .......... .......... .......... 43% 103M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 59050K .......... .......... .......... .......... .......... 43% 83.9M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 59100K .......... .......... .......... .......... .......... 43% 96.4M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 59150K .......... .......... .......... .......... .......... 43% 105M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 59200K .......... .......... .......... .......... .......... 43% 115M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 59250K .......... .......... .......... .......... .......... 43% 84.6M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 59300K .......... .......... .......... .......... .......... 43% 100M 4s 2024-02-21T07:44:07.973 INFO:tasks.workunit.client.0.smithi069.stderr: 59350K .......... .......... .......... .......... .......... 43% 109M 4s 2024-02-21T07:44:07.974 INFO:tasks.workunit.client.0.smithi069.stderr: 59400K .......... .......... .......... .......... .......... 43% 107M 4s 2024-02-21T07:44:07.974 INFO:tasks.workunit.client.0.smithi069.stderr: 59450K .......... .......... .......... .......... .......... 43% 79.8M 3s 2024-02-21T07:44:07.974 INFO:tasks.workunit.client.0.smithi069.stderr: 59500K .......... .......... .......... .......... .......... 43% 54.2M 3s 2024-02-21T07:44:07.974 INFO:tasks.workunit.client.0.smithi069.stderr: 59550K .......... .......... .......... .......... .......... 43% 14.1M 3s 2024-02-21T07:44:07.974 INFO:tasks.workunit.client.0.smithi069.stderr: 59600K .......... .......... .......... .......... .......... 43% 68.0M 3s 2024-02-21T07:44:07.974 INFO:tasks.workunit.client.0.smithi069.stderr: 59650K .......... .......... .......... .......... .......... 43% 85.2M 3s 2024-02-21T07:44:07.974 INFO:tasks.workunit.client.0.smithi069.stderr: 59700K .......... .......... .......... .......... .......... 44% 21.1M 3s 2024-02-21T07:44:07.974 INFO:tasks.workunit.client.0.smithi069.stderr: 59750K .......... .......... .......... .......... .......... 44% 27.8M 3s 2024-02-21T07:44:07.974 INFO:tasks.workunit.client.0.smithi069.stderr: 59800K .......... .......... .......... .......... .......... 44% 24.2M 3s 2024-02-21T07:44:07.978 INFO:tasks.workunit.client.0.smithi069.stderr: 59850K .......... .......... .......... .......... .......... 44% 26.8M 3s 2024-02-21T07:44:07.978 INFO:tasks.workunit.client.0.smithi069.stderr: 59900K .......... .......... .......... .......... .......... 44% 68.2M 3s 2024-02-21T07:44:07.979 INFO:tasks.workunit.client.0.smithi069.stderr: 59950K .......... .......... .......... .......... .......... 44% 23.0M 3s 2024-02-21T07:44:07.979 INFO:tasks.workunit.client.0.smithi069.stderr: 60000K .......... .......... .......... .......... .......... 44% 25.5M 3s 2024-02-21T07:44:07.979 INFO:tasks.workunit.client.0.smithi069.stderr: 60050K .......... .......... .......... .......... .......... 44% 25.1M 3s 2024-02-21T07:44:07.980 INFO:tasks.workunit.client.0.smithi069.stderr: 60100K .......... .......... .......... .......... .......... 44% 27.5M 3s 2024-02-21T07:44:07.982 INFO:tasks.workunit.client.0.smithi069.stderr: 60150K .......... .......... .......... .......... .......... 44% 25.0M 3s 2024-02-21T07:44:07.982 INFO:tasks.workunit.client.0.smithi069.stderr: 60200K .......... .......... .......... .......... .......... 44% 59.3M 3s 2024-02-21T07:44:07.984 INFO:tasks.workunit.client.0.smithi069.stderr: 60250K .......... .......... .......... .......... .......... 44% 28.6M 3s 2024-02-21T07:44:07.986 INFO:tasks.workunit.client.0.smithi069.stderr: 60300K .......... .......... .......... .......... .......... 44% 24.5M 3s 2024-02-21T07:44:07.989 INFO:tasks.workunit.client.0.smithi069.stderr: 60350K .......... .......... .......... .......... .......... 44% 25.6M 3s 2024-02-21T07:44:07.991 INFO:tasks.workunit.client.0.smithi069.stderr: 60400K .......... .......... .......... .......... .......... 44% 25.4M 3s 2024-02-21T07:44:07.991 INFO:tasks.workunit.client.0.smithi069.stderr: 60450K .......... .......... .......... .......... .......... 44% 57.7M 3s 2024-02-21T07:44:07.993 INFO:tasks.workunit.client.0.smithi069.stderr: 60500K .......... .......... .......... .......... .......... 44% 27.8M 3s 2024-02-21T07:44:07.995 INFO:tasks.workunit.client.0.smithi069.stderr: 60550K .......... .......... .......... .......... .......... 44% 24.0M 3s 2024-02-21T07:44:08.004 INFO:tasks.workunit.client.0.smithi069.stderr: 60600K .......... .......... .......... .......... .......... 44% 26.6M 3s 2024-02-21T07:44:08.004 INFO:tasks.workunit.client.0.smithi069.stderr: 60650K .......... .......... .......... .......... .......... 44% 26.5M 3s 2024-02-21T07:44:08.004 INFO:tasks.workunit.client.0.smithi069.stderr: 60700K .......... .......... .......... .......... .......... 44% 61.1M 3s 2024-02-21T07:44:08.004 INFO:tasks.workunit.client.0.smithi069.stderr: 60750K .......... .......... .......... .......... .......... 44% 25.5M 3s 2024-02-21T07:44:08.004 INFO:tasks.workunit.client.0.smithi069.stderr: 60800K .......... .......... .......... .......... .......... 44% 25.9M 3s 2024-02-21T07:44:08.007 INFO:tasks.workunit.client.0.smithi069.stderr: 60850K .......... .......... .......... .......... .......... 44% 26.4M 3s 2024-02-21T07:44:08.007 INFO:tasks.workunit.client.0.smithi069.stderr: 60900K .......... .......... .......... .......... .......... 44% 46.4M 3s 2024-02-21T07:44:08.007 INFO:tasks.workunit.client.0.smithi069.stderr: 60950K .......... .......... .......... .......... .......... 44% 62.6M 3s 2024-02-21T07:44:08.009 INFO:tasks.workunit.client.0.smithi069.stderr: 61000K .......... .......... .......... .......... .......... 44% 20.1M 3s 2024-02-21T07:44:08.012 INFO:tasks.workunit.client.0.smithi069.stderr: 61050K .......... .......... .......... .......... .......... 45% 27.6M 3s 2024-02-21T07:44:08.012 INFO:tasks.workunit.client.0.smithi069.stderr: 61100K .......... .......... .......... .......... .......... 45% 48.1M 3s 2024-02-21T07:44:08.014 INFO:tasks.workunit.client.0.smithi069.stderr: 61150K .......... .......... .......... .......... .......... 45% 28.3M 3s 2024-02-21T07:44:08.015 INFO:tasks.workunit.client.0.smithi069.stderr: 61200K .......... .......... .......... .......... .......... 45% 23.5M 3s 2024-02-21T07:44:08.018 INFO:tasks.workunit.client.0.smithi069.stderr: 61250K .......... .......... .......... .......... .......... 45% 22.5M 3s 2024-02-21T07:44:08.020 INFO:tasks.workunit.client.0.smithi069.stderr: 61300K .......... .......... .......... .......... .......... 45% 28.6M 3s 2024-02-21T07:44:08.020 INFO:tasks.workunit.client.0.smithi069.stderr: 61350K .......... .......... .......... .......... .......... 45% 73.4M 3s 2024-02-21T07:44:08.022 INFO:tasks.workunit.client.0.smithi069.stderr: 61400K .......... .......... .......... .......... .......... 45% 26.4M 3s 2024-02-21T07:44:08.024 INFO:tasks.workunit.client.0.smithi069.stderr: 61450K .......... .......... .......... .......... .......... 45% 25.3M 3s 2024-02-21T07:44:08.026 INFO:tasks.workunit.client.0.smithi069.stderr: 61500K .......... .......... .......... .......... .......... 45% 26.0M 3s 2024-02-21T07:44:08.028 INFO:tasks.workunit.client.0.smithi069.stderr: 61550K .......... .......... .......... .......... .......... 45% 23.0M 3s 2024-02-21T07:44:08.030 INFO:tasks.workunit.client.0.smithi069.stderr: 61600K .......... .......... .......... .......... .......... 45% 30.3M 3s 2024-02-21T07:44:08.032 INFO:tasks.workunit.client.0.smithi069.stderr: 61650K .......... .......... .......... .......... .......... 45% 21.5M 3s 2024-02-21T07:44:08.032 INFO:tasks.workunit.client.0.smithi069.stderr: 61700K .......... .......... .......... .......... .......... 45% 117M 3s 2024-02-21T07:44:08.034 INFO:tasks.workunit.client.0.smithi069.stderr: 61750K .......... .......... .......... .......... .......... 45% 26.9M 3s 2024-02-21T07:44:08.036 INFO:tasks.workunit.client.0.smithi069.stderr: 61800K .......... .......... .......... .......... .......... 45% 25.9M 3s 2024-02-21T07:44:08.038 INFO:tasks.workunit.client.0.smithi069.stderr: 61850K .......... .......... .......... .......... .......... 45% 22.3M 3s 2024-02-21T07:44:08.041 INFO:tasks.workunit.client.0.smithi069.stderr: 61900K .......... .......... .......... .......... .......... 45% 23.9M 3s 2024-02-21T07:44:08.041 INFO:tasks.workunit.client.0.smithi069.stderr: 61950K .......... .......... .......... .......... .......... 45% 58.8M 3s 2024-02-21T07:44:08.043 INFO:tasks.workunit.client.0.smithi069.stderr: 62000K .......... .......... .......... .......... .......... 45% 25.7M 3s 2024-02-21T07:44:08.045 INFO:tasks.workunit.client.0.smithi069.stderr: 62050K .......... .......... .......... .......... .......... 45% 24.9M 3s 2024-02-21T07:44:08.047 INFO:tasks.workunit.client.0.smithi069.stderr: 62100K .......... .......... .......... .......... .......... 45% 27.3M 3s 2024-02-21T07:44:08.049 INFO:tasks.workunit.client.0.smithi069.stderr: 62150K .......... .......... .......... .......... .......... 45% 30.7M 3s 2024-02-21T07:44:08.049 INFO:tasks.workunit.client.0.smithi069.stderr: 62200K .......... .......... .......... .......... .......... 45% 54.3M 3s 2024-02-21T07:44:08.051 INFO:tasks.workunit.client.0.smithi069.stderr: 62250K .......... .......... .......... .......... .......... 45% 27.3M 3s 2024-02-21T07:44:08.054 INFO:tasks.workunit.client.0.smithi069.stderr: 62300K .......... .......... .......... .......... .......... 45% 20.1M 3s 2024-02-21T07:44:08.055 INFO:tasks.workunit.client.0.smithi069.stderr: 62350K .......... .......... .......... .......... .......... 45% 35.3M 3s 2024-02-21T07:44:08.056 INFO:tasks.workunit.client.0.smithi069.stderr: 62400K .......... .......... .......... .......... .......... 46% 32.5M 3s 2024-02-21T07:44:08.059 INFO:tasks.workunit.client.0.smithi069.stderr: 62450K .......... .......... .......... .......... .......... 46% 23.4M 3s 2024-02-21T07:44:08.059 INFO:tasks.workunit.client.0.smithi069.stderr: 62500K .......... .......... .......... .......... .......... 46% 41.0M 3s 2024-02-21T07:44:08.061 INFO:tasks.workunit.client.0.smithi069.stderr: 62550K .......... .......... .......... .......... .......... 46% 27.6M 3s 2024-02-21T07:44:08.063 INFO:tasks.workunit.client.0.smithi069.stderr: 62600K .......... .......... .......... .......... .......... 46% 31.8M 3s 2024-02-21T07:44:08.065 INFO:tasks.workunit.client.0.smithi069.stderr: 62650K .......... .......... .......... .......... .......... 46% 24.5M 3s 2024-02-21T07:44:08.066 INFO:tasks.workunit.client.0.smithi069.stderr: 62700K .......... .......... .......... .......... .......... 46% 33.5M 3s 2024-02-21T07:44:08.068 INFO:tasks.workunit.client.0.smithi069.stderr: 62750K .......... .......... .......... .......... .......... 46% 32.4M 3s 2024-02-21T07:44:08.069 INFO:tasks.workunit.client.0.smithi069.stderr: 62800K .......... .......... .......... .......... .......... 46% 28.5M 3s 2024-02-21T07:44:08.072 INFO:tasks.workunit.client.0.smithi069.stderr: 62850K .......... .......... .......... .......... .......... 46% 24.4M 3s 2024-02-21T07:44:08.073 INFO:tasks.workunit.client.0.smithi069.stderr: 62900K .......... .......... .......... .......... .......... 46% 28.1M 3s 2024-02-21T07:44:08.075 INFO:tasks.workunit.client.0.smithi069.stderr: 62950K .......... .......... .......... .......... .......... 46% 31.7M 3s 2024-02-21T07:44:08.076 INFO:tasks.workunit.client.0.smithi069.stderr: 63000K .......... .......... .......... .......... .......... 46% 34.9M 3s 2024-02-21T07:44:08.078 INFO:tasks.workunit.client.0.smithi069.stderr: 63050K .......... .......... .......... .......... .......... 46% 26.8M 3s 2024-02-21T07:44:08.081 INFO:tasks.workunit.client.0.smithi069.stderr: 63100K .......... .......... .......... .......... .......... 46% 24.8M 3s 2024-02-21T07:44:08.081 INFO:tasks.workunit.client.0.smithi069.stderr: 63150K .......... .......... .......... .......... .......... 46% 46.9M 3s 2024-02-21T07:44:08.093 INFO:tasks.workunit.client.0.smithi069.stderr: 63200K .......... .......... .......... .......... .......... 46% 4.33M 3s 2024-02-21T07:44:08.093 INFO:tasks.workunit.client.0.smithi069.stderr: 63250K .......... .......... .......... .......... .......... 46% 57.0M 3s 2024-02-21T07:44:08.119 INFO:tasks.workunit.client.0.smithi069.stderr: 63300K .......... .......... .......... .......... .......... 46% 3.49M 3s 2024-02-21T07:44:08.119 INFO:tasks.workunit.client.0.smithi069.stderr: 63350K .......... .......... .......... .......... .......... 46% 55.4M 3s 2024-02-21T07:44:08.119 INFO:tasks.workunit.client.0.smithi069.stderr: 63400K .......... .......... .......... .......... .......... 46% 58.3M 3s 2024-02-21T07:44:08.119 INFO:tasks.workunit.client.0.smithi069.stderr: 63450K .......... .......... .......... .......... .......... 46% 47.2M 3s 2024-02-21T07:44:08.119 INFO:tasks.workunit.client.0.smithi069.stderr: 63500K .......... .......... .......... .......... .......... 46% 67.5M 3s 2024-02-21T07:44:08.120 INFO:tasks.workunit.client.0.smithi069.stderr: 63550K .......... .......... .......... .......... .......... 46% 69.4M 3s 2024-02-21T07:44:08.120 INFO:tasks.workunit.client.0.smithi069.stderr: 63600K .......... .......... .......... .......... .......... 46% 63.3M 3s 2024-02-21T07:44:08.120 INFO:tasks.workunit.client.0.smithi069.stderr: 63650K .......... .......... .......... .......... .......... 46% 60.2M 3s 2024-02-21T07:44:08.120 INFO:tasks.workunit.client.0.smithi069.stderr: 63700K .......... .......... .......... .......... .......... 46% 63.7M 3s 2024-02-21T07:44:08.120 INFO:tasks.workunit.client.0.smithi069.stderr: 63750K .......... .......... .......... .......... .......... 46% 65.1M 3s 2024-02-21T07:44:08.120 INFO:tasks.workunit.client.0.smithi069.stderr: 63800K .......... .......... .......... .......... .......... 47% 29.6M 3s 2024-02-21T07:44:08.120 INFO:tasks.workunit.client.0.smithi069.stderr: 63850K .......... .......... .......... .......... .......... 47% 48.4M 3s 2024-02-21T07:44:08.120 INFO:tasks.workunit.client.0.smithi069.stderr: 63900K .......... .......... .......... .......... .......... 47% 25.1M 3s 2024-02-21T07:44:08.121 INFO:tasks.workunit.client.0.smithi069.stderr: 63950K .......... .......... .......... .......... .......... 47% 27.4M 3s 2024-02-21T07:44:08.123 INFO:tasks.workunit.client.0.smithi069.stderr: 64000K .......... .......... .......... .......... .......... 47% 24.9M 3s 2024-02-21T07:44:08.126 INFO:tasks.workunit.client.0.smithi069.stderr: 64050K .......... .......... .......... .......... .......... 47% 25.8M 3s 2024-02-21T07:44:08.126 INFO:tasks.workunit.client.0.smithi069.stderr: 64100K .......... .......... .......... .......... .......... 47% 60.0M 3s 2024-02-21T07:44:08.127 INFO:tasks.workunit.client.0.smithi069.stderr: 64150K .......... .......... .......... .......... .......... 47% 25.4M 3s 2024-02-21T07:44:08.130 INFO:tasks.workunit.client.0.smithi069.stderr: 64200K .......... .......... .......... .......... .......... 47% 26.1M 3s 2024-02-21T07:44:08.132 INFO:tasks.workunit.client.0.smithi069.stderr: 64250K .......... .......... .......... .......... .......... 47% 25.1M 3s 2024-02-21T07:44:08.132 INFO:tasks.workunit.client.0.smithi069.stderr: 64300K .......... .......... .......... .......... .......... 47% 53.3M 3s 2024-02-21T07:44:08.134 INFO:tasks.workunit.client.0.smithi069.stderr: 64350K .......... .......... .......... .......... .......... 47% 25.4M 3s 2024-02-21T07:44:08.136 INFO:tasks.workunit.client.0.smithi069.stderr: 64400K .......... .......... .......... .......... .......... 47% 27.0M 3s 2024-02-21T07:44:08.151 INFO:tasks.workunit.client.0.smithi069.stderr: 64450K .......... .......... .......... .......... .......... 47% 4.22M 3s 2024-02-21T07:44:08.151 INFO:tasks.workunit.client.0.smithi069.stderr: 64500K .......... .......... .......... .......... .......... 47% 55.9M 3s 2024-02-21T07:44:08.151 INFO:tasks.workunit.client.0.smithi069.stderr: 64550K .......... .......... .......... .......... .......... 47% 59.4M 3s 2024-02-21T07:44:08.152 INFO:tasks.workunit.client.0.smithi069.stderr: 64600K .......... .......... .......... .......... .......... 47% 66.6M 3s 2024-02-21T07:44:08.152 INFO:tasks.workunit.client.0.smithi069.stderr: 64650K .......... .......... .......... .......... .......... 47% 61.8M 3s 2024-02-21T07:44:08.169 INFO:tasks.workunit.client.0.smithi069.stderr: 64700K .......... .......... .......... .......... .......... 47% 3.31M 3s 2024-02-21T07:44:08.169 INFO:tasks.workunit.client.0.smithi069.stderr: 64750K .......... .......... .......... .......... .......... 47% 55.9M 3s 2024-02-21T07:44:08.169 INFO:tasks.workunit.client.0.smithi069.stderr: 64800K .......... .......... .......... .......... .......... 47% 59.4M 3s 2024-02-21T07:44:08.170 INFO:tasks.workunit.client.0.smithi069.stderr: 64850K .......... .......... .......... .......... .......... 47% 54.9M 3s 2024-02-21T07:44:08.170 INFO:tasks.workunit.client.0.smithi069.stderr: 64900K .......... .......... .......... .......... .......... 47% 72.0M 3s 2024-02-21T07:44:08.179 INFO:tasks.workunit.client.0.smithi069.stderr: 64950K .......... .......... .......... .......... .......... 47% 8.12M 3s 2024-02-21T07:44:08.179 INFO:tasks.workunit.client.0.smithi069.stderr: 65000K .......... .......... .......... .......... .......... 47% 53.1M 3s 2024-02-21T07:44:08.179 INFO:tasks.workunit.client.0.smithi069.stderr: 65050K .......... .......... .......... .......... .......... 47% 52.1M 3s 2024-02-21T07:44:08.179 INFO:tasks.workunit.client.0.smithi069.stderr: 65100K .......... .......... .......... .......... .......... 47% 67.0M 3s 2024-02-21T07:44:08.179 INFO:tasks.workunit.client.0.smithi069.stderr: 65150K .......... .......... .......... .......... .......... 48% 68.5M 3s 2024-02-21T07:44:08.179 INFO:tasks.workunit.client.0.smithi069.stderr: 65200K .......... .......... .......... .......... .......... 48% 65.9M 3s 2024-02-21T07:44:08.192 INFO:tasks.workunit.client.0.smithi069.stderr: 65250K .......... .......... .......... .......... .......... 48% 7.51M 3s 2024-02-21T07:44:08.192 INFO:tasks.workunit.client.0.smithi069.stderr: 65300K .......... .......... .......... .......... .......... 48% 60.3M 3s 2024-02-21T07:44:08.192 INFO:tasks.workunit.client.0.smithi069.stderr: 65350K .......... .......... .......... .......... .......... 48% 57.9M 3s 2024-02-21T07:44:08.192 INFO:tasks.workunit.client.0.smithi069.stderr: 65400K .......... .......... .......... .......... .......... 48% 72.1M 3s 2024-02-21T07:44:08.192 INFO:tasks.workunit.client.0.smithi069.stderr: 65450K .......... .......... .......... .......... .......... 48% 60.5M 3s 2024-02-21T07:44:08.196 INFO:tasks.workunit.client.0.smithi069.stderr: 65500K .......... .......... .......... .......... .......... 48% 7.55M 3s 2024-02-21T07:44:08.196 INFO:tasks.workunit.client.0.smithi069.stderr: 65550K .......... .......... .......... .......... .......... 48% 60.8M 3s 2024-02-21T07:44:08.205 INFO:tasks.workunit.client.0.smithi069.stderr: 65600K .......... .......... .......... .......... .......... 48% 6.06M 3s 2024-02-21T07:44:08.205 INFO:tasks.workunit.client.0.smithi069.stderr: 65650K .......... .......... .......... .......... .......... 48% 54.7M 3s 2024-02-21T07:44:08.205 INFO:tasks.workunit.client.0.smithi069.stderr: 65700K .......... .......... .......... .......... .......... 48% 75.3M 3s 2024-02-21T07:44:08.224 INFO:tasks.workunit.client.0.smithi069.stderr: 65750K .......... .......... .......... .......... .......... 48% 2.93M 3s 2024-02-21T07:44:08.224 INFO:tasks.workunit.client.0.smithi069.stderr: 65800K .......... .......... .......... .......... .......... 48% 58.1M 3s 2024-02-21T07:44:08.224 INFO:tasks.workunit.client.0.smithi069.stderr: 65850K .......... .......... .......... .......... .......... 48% 45.3M 3s 2024-02-21T07:44:08.225 INFO:tasks.workunit.client.0.smithi069.stderr: 65900K .......... .......... .......... .......... .......... 48% 49.4M 3s 2024-02-21T07:44:08.234 INFO:tasks.workunit.client.0.smithi069.stderr: 65950K .......... .......... .......... .......... .......... 48% 29.9M 3s 2024-02-21T07:44:08.234 INFO:tasks.workunit.client.0.smithi069.stderr: 66000K .......... .......... .......... .......... .......... 48% 48.5M 3s 2024-02-21T07:44:08.234 INFO:tasks.workunit.client.0.smithi069.stderr: 66050K .......... .......... .......... .......... .......... 48% 56.5M 3s 2024-02-21T07:44:08.234 INFO:tasks.workunit.client.0.smithi069.stderr: 66100K .......... .......... .......... .......... .......... 48% 58.5M 3s 2024-02-21T07:44:08.234 INFO:tasks.workunit.client.0.smithi069.stderr: 66150K .......... .......... .......... .......... .......... 48% 68.2M 3s 2024-02-21T07:44:08.234 INFO:tasks.workunit.client.0.smithi069.stderr: 66200K .......... .......... .......... .......... .......... 48% 66.9M 3s 2024-02-21T07:44:08.234 INFO:tasks.workunit.client.0.smithi069.stderr: 66250K .......... .......... .......... .......... .......... 48% 32.8M 3s 2024-02-21T07:44:08.234 INFO:tasks.workunit.client.0.smithi069.stderr: 66300K .......... .......... .......... .......... .......... 48% 61.2M 3s 2024-02-21T07:44:08.234 INFO:tasks.workunit.client.0.smithi069.stderr: 66350K .......... .......... .......... .......... .......... 48% 67.2M 3s 2024-02-21T07:44:08.236 INFO:tasks.workunit.client.0.smithi069.stderr: 66400K .......... .......... .......... .......... .......... 48% 25.6M 3s 2024-02-21T07:44:08.238 INFO:tasks.workunit.client.0.smithi069.stderr: 66450K .......... .......... .......... .......... .......... 48% 23.9M 3s 2024-02-21T07:44:08.240 INFO:tasks.workunit.client.0.smithi069.stderr: 66500K .......... .......... .......... .......... .......... 49% 26.9M 3s 2024-02-21T07:44:08.242 INFO:tasks.workunit.client.0.smithi069.stderr: 66550K .......... .......... .......... .......... .......... 49% 26.1M 3s 2024-02-21T07:44:08.242 INFO:tasks.workunit.client.0.smithi069.stderr: 66600K .......... .......... .......... .......... .......... 49% 50.7M 3s 2024-02-21T07:44:08.244 INFO:tasks.workunit.client.0.smithi069.stderr: 66650K .......... .......... .......... .......... .......... 49% 24.9M 3s 2024-02-21T07:44:08.246 INFO:tasks.workunit.client.0.smithi069.stderr: 66700K .......... .......... .......... .......... .......... 49% 27.1M 3s 2024-02-21T07:44:08.249 INFO:tasks.workunit.client.0.smithi069.stderr: 66750K .......... .......... .......... .......... .......... 49% 25.7M 3s 2024-02-21T07:44:08.251 INFO:tasks.workunit.client.0.smithi069.stderr: 66800K .......... .......... .......... .......... .......... 49% 25.7M 3s 2024-02-21T07:44:08.251 INFO:tasks.workunit.client.0.smithi069.stderr: 66850K .......... .......... .......... .......... .......... 49% 51.6M 3s 2024-02-21T07:44:08.252 INFO:tasks.workunit.client.0.smithi069.stderr: 66900K .......... .......... .......... .......... .......... 49% 27.0M 3s 2024-02-21T07:44:08.255 INFO:tasks.workunit.client.0.smithi069.stderr: 66950K .......... .......... .......... .......... .......... 49% 26.4M 3s 2024-02-21T07:44:08.257 INFO:tasks.workunit.client.0.smithi069.stderr: 67000K .......... .......... .......... .......... .......... 49% 24.7M 3s 2024-02-21T07:44:08.257 INFO:tasks.workunit.client.0.smithi069.stderr: 67050K .......... .......... .......... .......... .......... 49% 57.6M 3s 2024-02-21T07:44:08.259 INFO:tasks.workunit.client.0.smithi069.stderr: 67100K .......... .......... .......... .......... .......... 49% 26.6M 3s 2024-02-21T07:44:08.261 INFO:tasks.workunit.client.0.smithi069.stderr: 67150K .......... .......... .......... .......... .......... 49% 25.3M 3s 2024-02-21T07:44:08.263 INFO:tasks.workunit.client.0.smithi069.stderr: 67200K .......... .......... .......... .......... .......... 49% 24.7M 3s 2024-02-21T07:44:08.266 INFO:tasks.workunit.client.0.smithi069.stderr: 67250K .......... .......... .......... .......... .......... 49% 25.6M 3s 2024-02-21T07:44:08.266 INFO:tasks.workunit.client.0.smithi069.stderr: 67300K .......... .......... .......... .......... .......... 49% 55.6M 3s 2024-02-21T07:44:08.268 INFO:tasks.workunit.client.0.smithi069.stderr: 67350K .......... .......... .......... .......... .......... 49% 27.2M 3s 2024-02-21T07:44:08.270 INFO:tasks.workunit.client.0.smithi069.stderr: 67400K .......... .......... .......... .......... .......... 49% 24.4M 3s 2024-02-21T07:44:08.272 INFO:tasks.workunit.client.0.smithi069.stderr: 67450K .......... .......... .......... .......... .......... 49% 24.5M 3s 2024-02-21T07:44:08.272 INFO:tasks.workunit.client.0.smithi069.stderr: 67500K .......... .......... .......... .......... .......... 49% 66.6M 3s 2024-02-21T07:44:08.274 INFO:tasks.workunit.client.0.smithi069.stderr: 67550K .......... .......... .......... .......... .......... 49% 23.9M 3s 2024-02-21T07:44:08.276 INFO:tasks.workunit.client.0.smithi069.stderr: 67600K .......... .......... .......... .......... .......... 49% 28.1M 3s 2024-02-21T07:44:08.278 INFO:tasks.workunit.client.0.smithi069.stderr: 67650K .......... .......... .......... .......... .......... 49% 23.7M 3s 2024-02-21T07:44:08.281 INFO:tasks.workunit.client.0.smithi069.stderr: 67700K .......... .......... .......... .......... .......... 49% 28.3M 3s 2024-02-21T07:44:08.281 INFO:tasks.workunit.client.0.smithi069.stderr: 67750K .......... .......... .......... .......... .......... 49% 57.2M 3s 2024-02-21T07:44:08.283 INFO:tasks.workunit.client.0.smithi069.stderr: 67800K .......... .......... .......... .......... .......... 49% 25.2M 3s 2024-02-21T07:44:08.285 INFO:tasks.workunit.client.0.smithi069.stderr: 67850K .......... .......... .......... .......... .......... 50% 24.9M 3s 2024-02-21T07:44:08.286 INFO:tasks.workunit.client.0.smithi069.stderr: 67900K .......... .......... .......... .......... .......... 50% 48.3M 3s 2024-02-21T07:44:08.287 INFO:tasks.workunit.client.0.smithi069.stderr: 67950K .......... .......... .......... .......... .......... 50% 50.2M 3s 2024-02-21T07:44:08.289 INFO:tasks.workunit.client.0.smithi069.stderr: 68000K .......... .......... .......... .......... .......... 50% 18.7M 3s 2024-02-21T07:44:08.291 INFO:tasks.workunit.client.0.smithi069.stderr: 68050K .......... .......... .......... .......... .......... 50% 23.0M 3s 2024-02-21T07:44:08.294 INFO:tasks.workunit.client.0.smithi069.stderr: 68100K .......... .......... .......... .......... .......... 50% 29.0M 3s 2024-02-21T07:44:08.296 INFO:tasks.workunit.client.0.smithi069.stderr: 68150K .......... .......... .......... .......... .......... 50% 25.6M 3s 2024-02-21T07:44:08.296 INFO:tasks.workunit.client.0.smithi069.stderr: 68200K .......... .......... .......... .......... .......... 50% 57.3M 3s 2024-02-21T07:44:08.298 INFO:tasks.workunit.client.0.smithi069.stderr: 68250K .......... .......... .......... .......... .......... 50% 22.2M 3s 2024-02-21T07:44:08.300 INFO:tasks.workunit.client.0.smithi069.stderr: 68300K .......... .......... .......... .......... .......... 50% 29.7M 3s 2024-02-21T07:44:08.300 INFO:tasks.workunit.client.0.smithi069.stderr: 68350K .......... .......... .......... .......... .......... 50% 52.5M 3s 2024-02-21T07:44:08.302 INFO:tasks.workunit.client.0.smithi069.stderr: 68400K .......... .......... .......... .......... .......... 50% 27.8M 3s 2024-02-21T07:44:08.305 INFO:tasks.workunit.client.0.smithi069.stderr: 68450K .......... .......... .......... .......... .......... 50% 26.7M 3s 2024-02-21T07:44:08.306 INFO:tasks.workunit.client.0.smithi069.stderr: 68500K .......... .......... .......... .......... .......... 50% 31.8M 3s 2024-02-21T07:44:08.306 INFO:tasks.workunit.client.0.smithi069.stderr: 68550K .......... .......... .......... .......... .......... 50% 50.2M 3s 2024-02-21T07:44:08.309 INFO:tasks.workunit.client.0.smithi069.stderr: 68600K .......... .......... .......... .......... .......... 50% 23.8M 3s 2024-02-21T07:44:08.310 INFO:tasks.workunit.client.0.smithi069.stderr: 68650K .......... .......... .......... .......... .......... 50% 28.9M 3s 2024-02-21T07:44:08.312 INFO:tasks.workunit.client.0.smithi069.stderr: 68700K .......... .......... .......... .......... .......... 50% 22.2M 3s 2024-02-21T07:44:08.315 INFO:tasks.workunit.client.0.smithi069.stderr: 68750K .......... .......... .......... .......... .......... 50% 28.1M 3s 2024-02-21T07:44:08.317 INFO:tasks.workunit.client.0.smithi069.stderr: 68800K .......... .......... .......... .......... .......... 50% 23.0M 3s 2024-02-21T07:44:08.319 INFO:tasks.workunit.client.0.smithi069.stderr: 68850K .......... .......... .......... .......... .......... 50% 28.9M 3s 2024-02-21T07:44:08.319 INFO:tasks.workunit.client.0.smithi069.stderr: 68900K .......... .......... .......... .......... .......... 50% 51.5M 3s 2024-02-21T07:44:08.322 INFO:tasks.workunit.client.0.smithi069.stderr: 68950K .......... .......... .......... .......... .......... 50% 23.9M 3s 2024-02-21T07:44:08.322 INFO:tasks.workunit.client.0.smithi069.stderr: 69000K .......... .......... .......... .......... .......... 50% 60.6M 3s 2024-02-21T07:44:08.324 INFO:tasks.workunit.client.0.smithi069.stderr: 69050K .......... .......... .......... .......... .......... 50% 19.8M 3s 2024-02-21T07:44:08.327 INFO:tasks.workunit.client.0.smithi069.stderr: 69100K .......... .......... .......... .......... .......... 50% 27.1M 3s 2024-02-21T07:44:08.328 INFO:tasks.workunit.client.0.smithi069.stderr: 69150K .......... .......... .......... .......... .......... 50% 28.7M 3s 2024-02-21T07:44:08.329 INFO:tasks.workunit.client.0.smithi069.stderr: 69200K .......... .......... .......... .......... .......... 51% 50.0M 3s 2024-02-21T07:44:08.331 INFO:tasks.workunit.client.0.smithi069.stderr: 69250K .......... .......... .......... .......... .......... 51% 28.9M 3s 2024-02-21T07:44:08.333 INFO:tasks.workunit.client.0.smithi069.stderr: 69300K .......... .......... .......... .......... .......... 51% 25.8M 3s 2024-02-21T07:44:08.335 INFO:tasks.workunit.client.0.smithi069.stderr: 69350K .......... .......... .......... .......... .......... 51% 26.5M 3s 2024-02-21T07:44:08.337 INFO:tasks.workunit.client.0.smithi069.stderr: 69400K .......... .......... .......... .......... .......... 51% 25.7M 3s 2024-02-21T07:44:08.337 INFO:tasks.workunit.client.0.smithi069.stderr: 69450K .......... .......... .......... .......... .......... 51% 52.9M 3s 2024-02-21T07:44:08.339 INFO:tasks.workunit.client.0.smithi069.stderr: 69500K .......... .......... .......... .......... .......... 51% 28.0M 3s 2024-02-21T07:44:08.340 INFO:tasks.workunit.client.0.smithi069.stderr: 69550K .......... .......... .......... .......... .......... 51% 29.0M 3s 2024-02-21T07:44:08.342 INFO:tasks.workunit.client.0.smithi069.stderr: 69600K .......... .......... .......... .......... .......... 51% 32.5M 3s 2024-02-21T07:44:08.344 INFO:tasks.workunit.client.0.smithi069.stderr: 69650K .......... .......... .......... .......... .......... 51% 25.3M 3s 2024-02-21T07:44:08.346 INFO:tasks.workunit.client.0.smithi069.stderr: 69700K .......... .......... .......... .......... .......... 51% 23.1M 3s 2024-02-21T07:44:08.348 INFO:tasks.workunit.client.0.smithi069.stderr: 69750K .......... .......... .......... .......... .......... 51% 30.3M 3s 2024-02-21T07:44:08.349 INFO:tasks.workunit.client.0.smithi069.stderr: 69800K .......... .......... .......... .......... .......... 51% 34.1M 3s 2024-02-21T07:44:08.351 INFO:tasks.workunit.client.0.smithi069.stderr: 69850K .......... .......... .......... .......... .......... 51% 28.8M 3s 2024-02-21T07:44:08.353 INFO:tasks.workunit.client.0.smithi069.stderr: 69900K .......... .......... .......... .......... .......... 51% 26.0M 3s 2024-02-21T07:44:08.355 INFO:tasks.workunit.client.0.smithi069.stderr: 69950K .......... .......... .......... .......... .......... 51% 26.4M 3s 2024-02-21T07:44:08.356 INFO:tasks.workunit.client.0.smithi069.stderr: 70000K .......... .......... .......... .......... .......... 51% 34.8M 3s 2024-02-21T07:44:08.358 INFO:tasks.workunit.client.0.smithi069.stderr: 70050K .......... .......... .......... .......... .......... 51% 24.4M 3s 2024-02-21T07:44:08.359 INFO:tasks.workunit.client.0.smithi069.stderr: 70100K .......... .......... .......... .......... .......... 51% 59.8M 3s 2024-02-21T07:44:08.361 INFO:tasks.workunit.client.0.smithi069.stderr: 70150K .......... .......... .......... .......... .......... 51% 25.1M 3s 2024-02-21T07:44:08.363 INFO:tasks.workunit.client.0.smithi069.stderr: 70200K .......... .......... .......... .......... .......... 51% 23.7M 3s 2024-02-21T07:44:08.365 INFO:tasks.workunit.client.0.smithi069.stderr: 70250K .......... .......... .......... .......... .......... 51% 31.1M 3s 2024-02-21T07:44:08.365 INFO:tasks.workunit.client.0.smithi069.stderr: 70300K .......... .......... .......... .......... .......... 51% 44.8M 3s 2024-02-21T07:44:08.367 INFO:tasks.workunit.client.0.smithi069.stderr: 70350K .......... .......... .......... .......... .......... 51% 26.4M 3s 2024-02-21T07:44:08.369 INFO:tasks.workunit.client.0.smithi069.stderr: 70400K .......... .......... .......... .......... .......... 51% 24.2M 3s 2024-02-21T07:44:08.371 INFO:tasks.workunit.client.0.smithi069.stderr: 70450K .......... .......... .......... .......... .......... 51% 34.3M 3s 2024-02-21T07:44:08.373 INFO:tasks.workunit.client.0.smithi069.stderr: 70500K .......... .......... .......... .......... .......... 51% 25.3M 3s 2024-02-21T07:44:08.375 INFO:tasks.workunit.client.0.smithi069.stderr: 70550K .......... .......... .......... .......... .......... 52% 28.7M 3s 2024-02-21T07:44:08.375 INFO:tasks.workunit.client.0.smithi069.stderr: 70600K .......... .......... .......... .......... .......... 52% 48.1M 3s 2024-02-21T07:44:08.377 INFO:tasks.workunit.client.0.smithi069.stderr: 70650K .......... .......... .......... .......... .......... 52% 23.3M 3s 2024-02-21T07:44:08.379 INFO:tasks.workunit.client.0.smithi069.stderr: 70700K .......... .......... .......... .......... .......... 52% 30.4M 3s 2024-02-21T07:44:08.382 INFO:tasks.workunit.client.0.smithi069.stderr: 70750K .......... .......... .......... .......... .......... 52% 25.5M 3s 2024-02-21T07:44:08.383 INFO:tasks.workunit.client.0.smithi069.stderr: 70800K .......... .......... .......... .......... .......... 52% 26.9M 3s 2024-02-21T07:44:08.385 INFO:tasks.workunit.client.0.smithi069.stderr: 70850K .......... .......... .......... .......... .......... 52% 36.5M 3s 2024-02-21T07:44:08.386 INFO:tasks.workunit.client.0.smithi069.stderr: 70900K .......... .......... .......... .......... .......... 52% 26.9M 3s 2024-02-21T07:44:08.388 INFO:tasks.workunit.client.0.smithi069.stderr: 70950K .......... .......... .......... .......... .......... 52% 34.0M 3s 2024-02-21T07:44:08.389 INFO:tasks.workunit.client.0.smithi069.stderr: 71000K .......... .......... .......... .......... .......... 52% 25.2M 3s 2024-02-21T07:44:08.392 INFO:tasks.workunit.client.0.smithi069.stderr: 71050K .......... .......... .......... .......... .......... 52% 25.6M 3s 2024-02-21T07:44:08.392 INFO:tasks.workunit.client.0.smithi069.stderr: 71100K .......... .......... .......... .......... .......... 52% 56.9M 3s 2024-02-21T07:44:08.394 INFO:tasks.workunit.client.0.smithi069.stderr: 71150K .......... .......... .......... .......... .......... 52% 23.1M 3s 2024-02-21T07:44:08.397 INFO:tasks.workunit.client.0.smithi069.stderr: 71200K .......... .......... .......... .......... .......... 52% 26.2M 3s 2024-02-21T07:44:08.399 INFO:tasks.workunit.client.0.smithi069.stderr: 71250K .......... .......... .......... .......... .......... 52% 27.1M 3s 2024-02-21T07:44:08.399 INFO:tasks.workunit.client.0.smithi069.stderr: 71300K .......... .......... .......... .......... .......... 52% 39.8M 3s 2024-02-21T07:44:08.401 INFO:tasks.workunit.client.0.smithi069.stderr: 71350K .......... .......... .......... .......... .......... 52% 28.8M 3s 2024-02-21T07:44:08.404 INFO:tasks.workunit.client.0.smithi069.stderr: 71400K .......... .......... .......... .......... .......... 52% 23.7M 3s 2024-02-21T07:44:08.414 INFO:tasks.workunit.client.0.smithi069.stderr: 71450K .......... .......... .......... .......... .......... 52% 27.5M 3s 2024-02-21T07:44:08.414 INFO:tasks.workunit.client.0.smithi069.stderr: 71500K .......... .......... .......... .......... .......... 52% 38.3M 3s 2024-02-21T07:44:08.414 INFO:tasks.workunit.client.0.smithi069.stderr: 71550K .......... .......... .......... .......... .......... 52% 24.2M 3s 2024-02-21T07:44:08.414 INFO:tasks.workunit.client.0.smithi069.stderr: 71600K .......... .......... .......... .......... .......... 52% 43.9M 3s 2024-02-21T07:44:08.414 INFO:tasks.workunit.client.0.smithi069.stderr: 71650K .......... .......... .......... .......... .......... 52% 30.6M 3s 2024-02-21T07:44:08.414 INFO:tasks.workunit.client.0.smithi069.stderr: 71700K .......... .......... .......... .......... .......... 52% 24.9M 3s 2024-02-21T07:44:08.415 INFO:tasks.workunit.client.0.smithi069.stderr: 71750K .......... .......... .......... .......... .......... 52% 24.6M 3s 2024-02-21T07:44:08.417 INFO:tasks.workunit.client.0.smithi069.stderr: 71800K .......... .......... .......... .......... .......... 52% 27.6M 3s 2024-02-21T07:44:08.417 INFO:tasks.workunit.client.0.smithi069.stderr: 71850K .......... .......... .......... .......... .......... 52% 39.7M 3s 2024-02-21T07:44:08.419 INFO:tasks.workunit.client.0.smithi069.stderr: 71900K .......... .......... .......... .......... .......... 53% 29.1M 3s 2024-02-21T07:44:08.421 INFO:tasks.workunit.client.0.smithi069.stderr: 71950K .......... .......... .......... .......... .......... 53% 27.6M 3s 2024-02-21T07:44:08.424 INFO:tasks.workunit.client.0.smithi069.stderr: 72000K .......... .......... .......... .......... .......... 53% 23.0M 3s 2024-02-21T07:44:08.424 INFO:tasks.workunit.client.0.smithi069.stderr: 72050K .......... .......... .......... .......... .......... 53% 58.2M 3s 2024-02-21T07:44:08.426 INFO:tasks.workunit.client.0.smithi069.stderr: 72100K .......... .......... .......... .......... .......... 53% 27.4M 3s 2024-02-21T07:44:08.428 INFO:tasks.workunit.client.0.smithi069.stderr: 72150K .......... .......... .......... .......... .......... 53% 23.1M 3s 2024-02-21T07:44:08.430 INFO:tasks.workunit.client.0.smithi069.stderr: 72200K .......... .......... .......... .......... .......... 53% 33.6M 3s 2024-02-21T07:44:08.432 INFO:tasks.workunit.client.0.smithi069.stderr: 72250K .......... .......... .......... .......... .......... 53% 27.2M 3s 2024-02-21T07:44:08.434 INFO:tasks.workunit.client.0.smithi069.stderr: 72300K .......... .......... .......... .......... .......... 53% 23.3M 3s 2024-02-21T07:44:08.434 INFO:tasks.workunit.client.0.smithi069.stderr: 72350K .......... .......... .......... .......... .......... 53% 58.3M 3s 2024-02-21T07:44:08.436 INFO:tasks.workunit.client.0.smithi069.stderr: 72400K .......... .......... .......... .......... .......... 53% 23.0M 3s 2024-02-21T07:44:08.438 INFO:tasks.workunit.client.0.smithi069.stderr: 72450K .......... .......... .......... .......... .......... 53% 25.2M 3s 2024-02-21T07:44:08.440 INFO:tasks.workunit.client.0.smithi069.stderr: 72500K .......... .......... .......... .......... .......... 53% 25.3M 3s 2024-02-21T07:44:08.441 INFO:tasks.workunit.client.0.smithi069.stderr: 72550K .......... .......... .......... .......... .......... 53% 36.7M 3s 2024-02-21T07:44:08.442 INFO:tasks.workunit.client.0.smithi069.stderr: 72600K .......... .......... .......... .......... .......... 53% 41.2M 3s 2024-02-21T07:44:08.445 INFO:tasks.workunit.client.0.smithi069.stderr: 72650K .......... .......... .......... .......... .......... 53% 26.4M 3s 2024-02-21T07:44:08.447 INFO:tasks.workunit.client.0.smithi069.stderr: 72700K .......... .......... .......... .......... .......... 53% 24.4M 3s 2024-02-21T07:44:08.448 INFO:tasks.workunit.client.0.smithi069.stderr: 72750K .......... .......... .......... .......... .......... 53% 28.0M 3s 2024-02-21T07:44:08.451 INFO:tasks.workunit.client.0.smithi069.stderr: 72800K .......... .......... .......... .......... .......... 53% 27.0M 3s 2024-02-21T07:44:08.453 INFO:tasks.workunit.client.0.smithi069.stderr: 72850K .......... .......... .......... .......... .......... 53% 56.5M 3s 2024-02-21T07:44:08.453 INFO:tasks.workunit.client.0.smithi069.stderr: 72900K .......... .......... .......... .......... .......... 53% 24.9M 3s 2024-02-21T07:44:08.455 INFO:tasks.workunit.client.0.smithi069.stderr: 72950K .......... .......... .......... .......... .......... 53% 25.8M 3s 2024-02-21T07:44:08.457 INFO:tasks.workunit.client.0.smithi069.stderr: 73000K .......... .......... .......... .......... .......... 53% 27.4M 3s 2024-02-21T07:44:08.459 INFO:tasks.workunit.client.0.smithi069.stderr: 73050K .......... .......... .......... .......... .......... 53% 27.3M 3s 2024-02-21T07:44:08.459 INFO:tasks.workunit.client.0.smithi069.stderr: 73100K .......... .......... .......... .......... .......... 53% 48.7M 3s 2024-02-21T07:44:08.461 INFO:tasks.workunit.client.0.smithi069.stderr: 73150K .......... .......... .......... .......... .......... 53% 25.2M 3s 2024-02-21T07:44:08.463 INFO:tasks.workunit.client.0.smithi069.stderr: 73200K .......... .......... .......... .......... .......... 53% 26.7M 3s 2024-02-21T07:44:08.464 INFO:tasks.workunit.client.0.smithi069.stderr: 73250K .......... .......... .......... .......... .......... 53% 37.7M 3s 2024-02-21T07:44:08.466 INFO:tasks.workunit.client.0.smithi069.stderr: 73300K .......... .......... .......... .......... .......... 54% 24.3M 3s 2024-02-21T07:44:08.468 INFO:tasks.workunit.client.0.smithi069.stderr: 73350K .......... .......... .......... .......... .......... 54% 27.9M 3s 2024-02-21T07:44:08.470 INFO:tasks.workunit.client.0.smithi069.stderr: 73400K .......... .......... .......... .......... .......... 54% 28.1M 3s 2024-02-21T07:44:08.471 INFO:tasks.workunit.client.0.smithi069.stderr: 73450K .......... .......... .......... .......... .......... 54% 30.2M 3s 2024-02-21T07:44:08.472 INFO:tasks.workunit.client.0.smithi069.stderr: 73500K .......... .......... .......... .......... .......... 54% 32.6M 3s 2024-02-21T07:44:08.475 INFO:tasks.workunit.client.0.smithi069.stderr: 73550K .......... .......... .......... .......... .......... 54% 26.1M 3s 2024-02-21T07:44:08.478 INFO:tasks.workunit.client.0.smithi069.stderr: 73600K .......... .......... .......... .......... .......... 54% 23.8M 3s 2024-02-21T07:44:08.478 INFO:tasks.workunit.client.0.smithi069.stderr: 73650K .......... .......... .......... .......... .......... 54% 43.5M 3s 2024-02-21T07:44:08.480 INFO:tasks.workunit.client.0.smithi069.stderr: 73700K .......... .......... .......... .......... .......... 54% 27.3M 3s 2024-02-21T07:44:08.482 INFO:tasks.workunit.client.0.smithi069.stderr: 73750K .......... .......... .......... .......... .......... 54% 28.8M 3s 2024-02-21T07:44:08.484 INFO:tasks.workunit.client.0.smithi069.stderr: 73800K .......... .......... .......... .......... .......... 54% 23.7M 3s 2024-02-21T07:44:08.484 INFO:tasks.workunit.client.0.smithi069.stderr: 73850K .......... .......... .......... .......... .......... 54% 47.9M 3s 2024-02-21T07:44:08.486 INFO:tasks.workunit.client.0.smithi069.stderr: 73900K .......... .......... .......... .......... .......... 54% 30.8M 3s 2024-02-21T07:44:08.489 INFO:tasks.workunit.client.0.smithi069.stderr: 73950K .......... .......... .......... .......... .......... 54% 22.3M 3s 2024-02-21T07:44:08.491 INFO:tasks.workunit.client.0.smithi069.stderr: 74000K .......... .......... .......... .......... .......... 54% 32.4M 3s 2024-02-21T07:44:08.491 INFO:tasks.workunit.client.0.smithi069.stderr: 74050K .......... .......... .......... .......... .......... 54% 40.7M 3s 2024-02-21T07:44:08.493 INFO:tasks.workunit.client.0.smithi069.stderr: 74100K .......... .......... .......... .......... .......... 54% 24.7M 3s 2024-02-21T07:44:08.495 INFO:tasks.workunit.client.0.smithi069.stderr: 74150K .......... .......... .......... .......... .......... 54% 27.0M 3s 2024-02-21T07:44:08.497 INFO:tasks.workunit.client.0.smithi069.stderr: 74200K .......... .......... .......... .......... .......... 54% 25.3M 3s 2024-02-21T07:44:08.498 INFO:tasks.workunit.client.0.smithi069.stderr: 74250K .......... .......... .......... .......... .......... 54% 33.4M 3s 2024-02-21T07:44:08.502 INFO:tasks.workunit.client.0.smithi069.stderr: 74300K .......... .......... .......... .......... .......... 54% 19.7M 3s 2024-02-21T07:44:08.502 INFO:tasks.workunit.client.0.smithi069.stderr: 74350K .......... .......... .......... .......... .......... 54% 54.2M 3s 2024-02-21T07:44:08.503 INFO:tasks.workunit.client.0.smithi069.stderr: 74400K .......... .......... .......... .......... .......... 54% 22.4M 3s 2024-02-21T07:44:08.506 INFO:tasks.workunit.client.0.smithi069.stderr: 74450K .......... .......... .......... .......... .......... 54% 22.4M 3s 2024-02-21T07:44:08.507 INFO:tasks.workunit.client.0.smithi069.stderr: 74500K .......... .......... .......... .......... .......... 54% 42.8M 3s 2024-02-21T07:44:08.509 INFO:tasks.workunit.client.0.smithi069.stderr: 74550K .......... .......... .......... .......... .......... 54% 37.6M 3s 2024-02-21T07:44:08.512 INFO:tasks.workunit.client.0.smithi069.stderr: 74600K .......... .......... .......... .......... .......... 54% 22.0M 3s 2024-02-21T07:44:08.512 INFO:tasks.workunit.client.0.smithi069.stderr: 74650K .......... .......... .......... .......... .......... 55% 56.7M 3s 2024-02-21T07:44:08.513 INFO:tasks.workunit.client.0.smithi069.stderr: 74700K .......... .......... .......... .......... .......... 55% 28.3M 3s 2024-02-21T07:44:08.515 INFO:tasks.workunit.client.0.smithi069.stderr: 74750K .......... .......... .......... .......... .......... 55% 26.8M 3s 2024-02-21T07:44:08.516 INFO:tasks.workunit.client.0.smithi069.stderr: 74800K .......... .......... .......... .......... .......... 55% 28.5M 3s 2024-02-21T07:44:08.520 INFO:tasks.workunit.client.0.smithi069.stderr: 74850K .......... .......... .......... .......... .......... 55% 22.1M 3s 2024-02-21T07:44:08.520 INFO:tasks.workunit.client.0.smithi069.stderr: 74900K .......... .......... .......... .......... .......... 55% 50.5M 3s 2024-02-21T07:44:08.522 INFO:tasks.workunit.client.0.smithi069.stderr: 74950K .......... .......... .......... .......... .......... 55% 25.1M 3s 2024-02-21T07:44:08.524 INFO:tasks.workunit.client.0.smithi069.stderr: 75000K .......... .......... .......... .......... .......... 55% 29.0M 3s 2024-02-21T07:44:08.525 INFO:tasks.workunit.client.0.smithi069.stderr: 75050K .......... .......... .......... .......... .......... 55% 32.4M 3s 2024-02-21T07:44:08.527 INFO:tasks.workunit.client.0.smithi069.stderr: 75100K .......... .......... .......... .......... .......... 55% 21.8M 3s 2024-02-21T07:44:08.528 INFO:tasks.workunit.client.0.smithi069.stderr: 75150K .......... .......... .......... .......... .......... 55% 45.2M 3s 2024-02-21T07:44:08.530 INFO:tasks.workunit.client.0.smithi069.stderr: 75200K .......... .......... .......... .......... .......... 55% 25.5M 3s 2024-02-21T07:44:08.532 INFO:tasks.workunit.client.0.smithi069.stderr: 75250K .......... .......... .......... .......... .......... 55% 23.2M 3s 2024-02-21T07:44:08.534 INFO:tasks.workunit.client.0.smithi069.stderr: 75300K .......... .......... .......... .......... .......... 55% 32.4M 3s 2024-02-21T07:44:08.536 INFO:tasks.workunit.client.0.smithi069.stderr: 75350K .......... .......... .......... .......... .......... 55% 26.6M 3s 2024-02-21T07:44:08.536 INFO:tasks.workunit.client.0.smithi069.stderr: 75400K .......... .......... .......... .......... .......... 55% 44.6M 3s 2024-02-21T07:44:08.539 INFO:tasks.workunit.client.0.smithi069.stderr: 75450K .......... .......... .......... .......... .......... 55% 24.0M 3s 2024-02-21T07:44:08.540 INFO:tasks.workunit.client.0.smithi069.stderr: 75500K .......... .......... .......... .......... .......... 55% 37.1M 3s 2024-02-21T07:44:08.543 INFO:tasks.workunit.client.0.smithi069.stderr: 75550K .......... .......... .......... .......... .......... 55% 25.4M 3s 2024-02-21T07:44:08.545 INFO:tasks.workunit.client.0.smithi069.stderr: 75600K .......... .......... .......... .......... .......... 55% 25.5M 3s 2024-02-21T07:44:08.545 INFO:tasks.workunit.client.0.smithi069.stderr: 75650K .......... .......... .......... .......... .......... 55% 43.2M 3s 2024-02-21T07:44:08.547 INFO:tasks.workunit.client.0.smithi069.stderr: 75700K .......... .......... .......... .......... .......... 55% 24.3M 3s 2024-02-21T07:44:08.549 INFO:tasks.workunit.client.0.smithi069.stderr: 75750K .......... .......... .......... .......... .......... 55% 25.3M 3s 2024-02-21T07:44:08.550 INFO:tasks.workunit.client.0.smithi069.stderr: 75800K .......... .......... .......... .......... .......... 55% 35.4M 3s 2024-02-21T07:44:08.552 INFO:tasks.workunit.client.0.smithi069.stderr: 75850K .......... .......... .......... .......... .......... 55% 26.7M 3s 2024-02-21T07:44:08.553 INFO:tasks.workunit.client.0.smithi069.stderr: 75900K .......... .......... .......... .......... .......... 55% 39.4M 3s 2024-02-21T07:44:08.555 INFO:tasks.workunit.client.0.smithi069.stderr: 75950K .......... .......... .......... .......... .......... 55% 26.4M 3s 2024-02-21T07:44:08.557 INFO:tasks.workunit.client.0.smithi069.stderr: 76000K .......... .......... .......... .......... .......... 56% 29.6M 3s 2024-02-21T07:44:08.560 INFO:tasks.workunit.client.0.smithi069.stderr: 76050K .......... .......... .......... .......... .......... 56% 24.5M 3s 2024-02-21T07:44:08.560 INFO:tasks.workunit.client.0.smithi069.stderr: 76100K .......... .......... .......... .......... .......... 56% 30.1M 3s 2024-02-21T07:44:08.561 INFO:tasks.workunit.client.0.smithi069.stderr: 76150K .......... .......... .......... .......... .......... 56% 37.4M 3s 2024-02-21T07:44:08.564 INFO:tasks.workunit.client.0.smithi069.stderr: 76200K .......... .......... .......... .......... .......... 56% 24.9M 3s 2024-02-21T07:44:08.566 INFO:tasks.workunit.client.0.smithi069.stderr: 76250K .......... .......... .......... .......... .......... 56% 29.8M 3s 2024-02-21T07:44:08.568 INFO:tasks.workunit.client.0.smithi069.stderr: 76300K .......... .......... .......... .......... .......... 56% 29.0M 3s 2024-02-21T07:44:08.569 INFO:tasks.workunit.client.0.smithi069.stderr: 76350K .......... .......... .......... .......... .......... 56% 26.8M 3s 2024-02-21T07:44:08.570 INFO:tasks.workunit.client.0.smithi069.stderr: 76400K .......... .......... .......... .......... .......... 56% 43.5M 3s 2024-02-21T07:44:08.572 INFO:tasks.workunit.client.0.smithi069.stderr: 76450K .......... .......... .......... .......... .......... 56% 25.1M 3s 2024-02-21T07:44:08.574 INFO:tasks.workunit.client.0.smithi069.stderr: 76500K .......... .......... .......... .......... .......... 56% 29.1M 3s 2024-02-21T07:44:08.576 INFO:tasks.workunit.client.0.smithi069.stderr: 76550K .......... .......... .......... .......... .......... 56% 25.2M 3s 2024-02-21T07:44:08.577 INFO:tasks.workunit.client.0.smithi069.stderr: 76600K .......... .......... .......... .......... .......... 56% 29.8M 3s 2024-02-21T07:44:08.578 INFO:tasks.workunit.client.0.smithi069.stderr: 76650K .......... .......... .......... .......... .......... 56% 38.9M 3s 2024-02-21T07:44:08.580 INFO:tasks.workunit.client.0.smithi069.stderr: 76700K .......... .......... .......... .......... .......... 56% 24.5M 3s 2024-02-21T07:44:08.582 INFO:tasks.workunit.client.0.smithi069.stderr: 76750K .......... .......... .......... .......... .......... 56% 33.2M 3s 2024-02-21T07:44:08.585 INFO:tasks.workunit.client.0.smithi069.stderr: 76800K .......... .......... .......... .......... .......... 56% 26.5M 3s 2024-02-21T07:44:08.586 INFO:tasks.workunit.client.0.smithi069.stderr: 76850K .......... .......... .......... .......... .......... 56% 24.4M 3s 2024-02-21T07:44:08.587 INFO:tasks.workunit.client.0.smithi069.stderr: 76900K .......... .......... .......... .......... .......... 56% 47.3M 3s 2024-02-21T07:44:08.589 INFO:tasks.workunit.client.0.smithi069.stderr: 76950K .......... .......... .......... .......... .......... 56% 26.6M 3s 2024-02-21T07:44:08.590 INFO:tasks.workunit.client.0.smithi069.stderr: 77000K .......... .......... .......... .......... .......... 56% 29.7M 3s 2024-02-21T07:44:08.593 INFO:tasks.workunit.client.0.smithi069.stderr: 77050K .......... .......... .......... .......... .......... 56% 25.7M 3s 2024-02-21T07:44:08.595 INFO:tasks.workunit.client.0.smithi069.stderr: 77100K .......... .......... .......... .......... .......... 56% 23.9M 3s 2024-02-21T07:44:08.595 INFO:tasks.workunit.client.0.smithi069.stderr: 77150K .......... .......... .......... .......... .......... 56% 61.1M 3s 2024-02-21T07:44:08.597 INFO:tasks.workunit.client.0.smithi069.stderr: 77200K .......... .......... .......... .......... .......... 56% 28.3M 3s 2024-02-21T07:44:08.599 INFO:tasks.workunit.client.0.smithi069.stderr: 77250K .......... .......... .......... .......... .......... 56% 24.9M 3s 2024-02-21T07:44:08.601 INFO:tasks.workunit.client.0.smithi069.stderr: 77300K .......... .......... .......... .......... .......... 56% 25.1M 3s 2024-02-21T07:44:08.603 INFO:tasks.workunit.client.0.smithi069.stderr: 77350K .......... .......... .......... .......... .......... 57% 26.6M 3s 2024-02-21T07:44:08.603 INFO:tasks.workunit.client.0.smithi069.stderr: 77400K .......... .......... .......... .......... .......... 57% 44.6M 3s 2024-02-21T07:44:08.606 INFO:tasks.workunit.client.0.smithi069.stderr: 77450K .......... .......... .......... .......... .......... 57% 26.2M 3s 2024-02-21T07:44:08.608 INFO:tasks.workunit.client.0.smithi069.stderr: 77500K .......... .......... .......... .......... .......... 57% 25.4M 3s 2024-02-21T07:44:08.609 INFO:tasks.workunit.client.0.smithi069.stderr: 77550K .......... .......... .......... .......... .......... 57% 32.1M 3s 2024-02-21T07:44:08.612 INFO:tasks.workunit.client.0.smithi069.stderr: 77600K .......... .......... .......... .......... .......... 57% 24.4M 3s 2024-02-21T07:44:08.612 INFO:tasks.workunit.client.0.smithi069.stderr: 77650K .......... .......... .......... .......... .......... 57% 50.0M 3s 2024-02-21T07:44:08.619 INFO:tasks.workunit.client.0.smithi069.stderr: 77700K .......... .......... .......... .......... .......... 57% 26.0M 3s 2024-02-21T07:44:08.619 INFO:tasks.workunit.client.0.smithi069.stderr: 77750K .......... .......... .......... .......... .......... 57% 26.5M 3s 2024-02-21T07:44:08.619 INFO:tasks.workunit.client.0.smithi069.stderr: 77800K .......... .......... .......... .......... .......... 57% 29.3M 3s 2024-02-21T07:44:08.620 INFO:tasks.workunit.client.0.smithi069.stderr: 77850K .......... .......... .......... .......... .......... 57% 24.8M 3s 2024-02-21T07:44:08.620 INFO:tasks.workunit.client.0.smithi069.stderr: 77900K .......... .......... .......... .......... .......... 57% 64.6M 3s 2024-02-21T07:44:08.622 INFO:tasks.workunit.client.0.smithi069.stderr: 77950K .......... .......... .......... .......... .......... 57% 22.1M 3s 2024-02-21T07:44:08.624 INFO:tasks.workunit.client.0.smithi069.stderr: 78000K .......... .......... .......... .......... .......... 57% 26.2M 3s 2024-02-21T07:44:08.626 INFO:tasks.workunit.client.0.smithi069.stderr: 78050K .......... .......... .......... .......... .......... 57% 29.0M 3s 2024-02-21T07:44:08.628 INFO:tasks.workunit.client.0.smithi069.stderr: 78100K .......... .......... .......... .......... .......... 57% 26.6M 3s 2024-02-21T07:44:08.630 INFO:tasks.workunit.client.0.smithi069.stderr: 78150K .......... .......... .......... .......... .......... 57% 62.3M 3s 2024-02-21T07:44:08.630 INFO:tasks.workunit.client.0.smithi069.stderr: 78200K .......... .......... .......... .......... .......... 57% 25.1M 3s 2024-02-21T07:44:08.632 INFO:tasks.workunit.client.0.smithi069.stderr: 78250K .......... .......... .......... .......... .......... 57% 26.1M 2s 2024-02-21T07:44:08.634 INFO:tasks.workunit.client.0.smithi069.stderr: 78300K .......... .......... .......... .......... .......... 57% 25.5M 2s 2024-02-21T07:44:08.636 INFO:tasks.workunit.client.0.smithi069.stderr: 78350K .......... .......... .......... .......... .......... 57% 25.1M 2s 2024-02-21T07:44:08.638 INFO:tasks.workunit.client.0.smithi069.stderr: 78400K .......... .......... .......... .......... .......... 57% 25.9M 2s 2024-02-21T07:44:08.639 INFO:tasks.workunit.client.0.smithi069.stderr: 78450K .......... .......... .......... .......... .......... 57% 47.1M 2s 2024-02-21T07:44:08.641 INFO:tasks.workunit.client.0.smithi069.stderr: 78500K .......... .......... .......... .......... .......... 57% 31.7M 2s 2024-02-21T07:44:08.643 INFO:tasks.workunit.client.0.smithi069.stderr: 78550K .......... .......... .......... .......... .......... 57% 24.6M 2s 2024-02-21T07:44:08.644 INFO:tasks.workunit.client.0.smithi069.stderr: 78600K .......... .......... .......... .......... .......... 57% 26.1M 2s 2024-02-21T07:44:08.647 INFO:tasks.workunit.client.0.smithi069.stderr: 78650K .......... .......... .......... .......... .......... 57% 26.1M 2s 2024-02-21T07:44:08.647 INFO:tasks.workunit.client.0.smithi069.stderr: 78700K .......... .......... .......... .......... .......... 58% 64.5M 2s 2024-02-21T07:44:08.649 INFO:tasks.workunit.client.0.smithi069.stderr: 78750K .......... .......... .......... .......... .......... 58% 25.6M 2s 2024-02-21T07:44:08.651 INFO:tasks.workunit.client.0.smithi069.stderr: 78800K .......... .......... .......... .......... .......... 58% 25.4M 2s 2024-02-21T07:44:08.653 INFO:tasks.workunit.client.0.smithi069.stderr: 78850K .......... .......... .......... .......... .......... 58% 28.6M 2s 2024-02-21T07:44:08.655 INFO:tasks.workunit.client.0.smithi069.stderr: 78900K .......... .......... .......... .......... .......... 58% 23.0M 2s 2024-02-21T07:44:08.656 INFO:tasks.workunit.client.0.smithi069.stderr: 78950K .......... .......... .......... .......... .......... 58% 46.9M 2s 2024-02-21T07:44:08.657 INFO:tasks.workunit.client.0.smithi069.stderr: 79000K .......... .......... .......... .......... .......... 58% 30.1M 2s 2024-02-21T07:44:08.660 INFO:tasks.workunit.client.0.smithi069.stderr: 79050K .......... .......... .......... .......... .......... 58% 25.8M 2s 2024-02-21T07:44:08.662 INFO:tasks.workunit.client.0.smithi069.stderr: 79100K .......... .......... .......... .......... .......... 58% 25.6M 2s 2024-02-21T07:44:08.664 INFO:tasks.workunit.client.0.smithi069.stderr: 79150K .......... .......... .......... .......... .......... 58% 26.9M 2s 2024-02-21T07:44:08.664 INFO:tasks.workunit.client.0.smithi069.stderr: 79200K .......... .......... .......... .......... .......... 58% 65.6M 2s 2024-02-21T07:44:08.666 INFO:tasks.workunit.client.0.smithi069.stderr: 79250K .......... .......... .......... .......... .......... 58% 22.4M 2s 2024-02-21T07:44:08.668 INFO:tasks.workunit.client.0.smithi069.stderr: 79300K .......... .......... .......... .......... .......... 58% 25.2M 2s 2024-02-21T07:44:08.670 INFO:tasks.workunit.client.0.smithi069.stderr: 79350K .......... .......... .......... .......... .......... 58% 27.2M 2s 2024-02-21T07:44:08.672 INFO:tasks.workunit.client.0.smithi069.stderr: 79400K .......... .......... .......... .......... .......... 58% 25.0M 2s 2024-02-21T07:44:08.672 INFO:tasks.workunit.client.0.smithi069.stderr: 79450K .......... .......... .......... .......... .......... 58% 47.2M 2s 2024-02-21T07:44:08.674 INFO:tasks.workunit.client.0.smithi069.stderr: 79500K .......... .......... .......... .......... .......... 58% 26.3M 2s 2024-02-21T07:44:08.676 INFO:tasks.workunit.client.0.smithi069.stderr: 79550K .......... .......... .......... .......... .......... 58% 30.5M 2s 2024-02-21T07:44:08.679 INFO:tasks.workunit.client.0.smithi069.stderr: 79600K .......... .......... .......... .......... .......... 58% 26.0M 2s 2024-02-21T07:44:08.681 INFO:tasks.workunit.client.0.smithi069.stderr: 79650K .......... .......... .......... .......... .......... 58% 24.5M 2s 2024-02-21T07:44:08.681 INFO:tasks.workunit.client.0.smithi069.stderr: 79700K .......... .......... .......... .......... .......... 58% 50.1M 2s 2024-02-21T07:44:08.683 INFO:tasks.workunit.client.0.smithi069.stderr: 79750K .......... .......... .......... .......... .......... 58% 25.0M 2s 2024-02-21T07:44:08.685 INFO:tasks.workunit.client.0.smithi069.stderr: 79800K .......... .......... .......... .......... .......... 58% 30.2M 2s 2024-02-21T07:44:08.686 INFO:tasks.workunit.client.0.smithi069.stderr: 79850K .......... .......... .......... .......... .......... 58% 24.8M 2s 2024-02-21T07:44:08.688 INFO:tasks.workunit.client.0.smithi069.stderr: 79900K .......... .......... .......... .......... .......... 58% 26.0M 2s 2024-02-21T07:44:08.690 INFO:tasks.workunit.client.0.smithi069.stderr: 79950K .......... .......... .......... .......... .......... 58% 43.2M 2s 2024-02-21T07:44:08.691 INFO:tasks.workunit.client.0.smithi069.stderr: 80000K .......... .......... .......... .......... .......... 58% 27.6M 2s 2024-02-21T07:44:08.693 INFO:tasks.workunit.client.0.smithi069.stderr: 80050K .......... .......... .......... .......... .......... 59% 29.9M 2s 2024-02-21T07:44:08.695 INFO:tasks.workunit.client.0.smithi069.stderr: 80100K .......... .......... .......... .......... .......... 59% 25.2M 2s 2024-02-21T07:44:08.698 INFO:tasks.workunit.client.0.smithi069.stderr: 80150K .......... .......... .......... .......... .......... 59% 25.5M 2s 2024-02-21T07:44:08.698 INFO:tasks.workunit.client.0.smithi069.stderr: 80200K .......... .......... .......... .......... .......... 59% 52.6M 2s 2024-02-21T07:44:08.700 INFO:tasks.workunit.client.0.smithi069.stderr: 80250K .......... .......... .......... .......... .......... 59% 24.4M 2s 2024-02-21T07:44:08.701 INFO:tasks.workunit.client.0.smithi069.stderr: 80300K .......... .......... .......... .......... .......... 59% 30.1M 2s 2024-02-21T07:44:08.704 INFO:tasks.workunit.client.0.smithi069.stderr: 80350K .......... .......... .......... .......... .......... 59% 18.8M 2s 2024-02-21T07:44:08.706 INFO:tasks.workunit.client.0.smithi069.stderr: 80400K .......... .......... .......... .......... .......... 59% 28.0M 2s 2024-02-21T07:44:08.708 INFO:tasks.workunit.client.0.smithi069.stderr: 80450K .......... .......... .......... .......... .......... 59% 30.3M 2s 2024-02-21T07:44:08.709 INFO:tasks.workunit.client.0.smithi069.stderr: 80500K .......... .......... .......... .......... .......... 59% 29.2M 2s 2024-02-21T07:44:08.710 INFO:tasks.workunit.client.0.smithi069.stderr: 80550K .......... .......... .......... .......... .......... 59% 30.5M 2s 2024-02-21T07:44:08.712 INFO:tasks.workunit.client.0.smithi069.stderr: 80600K .......... .......... .......... .......... .......... 59% 34.5M 2s 2024-02-21T07:44:08.713 INFO:tasks.workunit.client.0.smithi069.stderr: 80650K .......... .......... .......... .......... .......... 59% 31.7M 2s 2024-02-21T07:44:08.714 INFO:tasks.workunit.client.0.smithi069.stderr: 80700K .......... .......... .......... .......... .......... 59% 38.2M 2s 2024-02-21T07:44:08.716 INFO:tasks.workunit.client.0.smithi069.stderr: 80750K .......... .......... .......... .......... .......... 59% 26.6M 2s 2024-02-21T07:44:08.719 INFO:tasks.workunit.client.0.smithi069.stderr: 80800K .......... .......... .......... .......... .......... 59% 17.7M 2s 2024-02-21T07:44:08.721 INFO:tasks.workunit.client.0.smithi069.stderr: 80850K .......... .......... .......... .......... .......... 59% 22.6M 2s 2024-02-21T07:44:08.723 INFO:tasks.workunit.client.0.smithi069.stderr: 80900K .......... .......... .......... .......... .......... 59% 26.2M 2s 2024-02-21T07:44:08.724 INFO:tasks.workunit.client.0.smithi069.stderr: 80950K .......... .......... .......... .......... .......... 59% 37.1M 2s 2024-02-21T07:44:08.726 INFO:tasks.workunit.client.0.smithi069.stderr: 81000K .......... .......... .......... .......... .......... 59% 41.1M 2s 2024-02-21T07:44:08.727 INFO:tasks.workunit.client.0.smithi069.stderr: 81050K .......... .......... .......... .......... .......... 59% 39.2M 2s 2024-02-21T07:44:08.728 INFO:tasks.workunit.client.0.smithi069.stderr: 81100K .......... .......... .......... .......... .......... 59% 32.8M 2s 2024-02-21T07:44:08.730 INFO:tasks.workunit.client.0.smithi069.stderr: 81150K .......... .......... .......... .......... .......... 59% 40.1M 2s 2024-02-21T07:44:08.732 INFO:tasks.workunit.client.0.smithi069.stderr: 81200K .......... .......... .......... .......... .......... 59% 26.2M 2s 2024-02-21T07:44:08.734 INFO:tasks.workunit.client.0.smithi069.stderr: 81250K .......... .......... .......... .......... .......... 59% 19.5M 2s 2024-02-21T07:44:08.736 INFO:tasks.workunit.client.0.smithi069.stderr: 81300K .......... .......... .......... .......... .......... 59% 20.2M 2s 2024-02-21T07:44:08.738 INFO:tasks.workunit.client.0.smithi069.stderr: 81350K .......... .......... .......... .......... .......... 59% 27.7M 2s 2024-02-21T07:44:08.740 INFO:tasks.workunit.client.0.smithi069.stderr: 81400K .......... .......... .......... .......... .......... 59% 33.4M 2s 2024-02-21T07:44:08.741 INFO:tasks.workunit.client.0.smithi069.stderr: 81450K .......... .......... .......... .......... .......... 60% 34.6M 2s 2024-02-21T07:44:08.742 INFO:tasks.workunit.client.0.smithi069.stderr: 81500K .......... .......... .......... .......... .......... 60% 38.5M 2s 2024-02-21T07:44:08.743 INFO:tasks.workunit.client.0.smithi069.stderr: 81550K .......... .......... .......... .......... .......... 60% 38.3M 2s 2024-02-21T07:44:08.746 INFO:tasks.workunit.client.0.smithi069.stderr: 81600K .......... .......... .......... .......... .......... 60% 29.1M 2s 2024-02-21T07:44:08.746 INFO:tasks.workunit.client.0.smithi069.stderr: 81650K .......... .......... .......... .......... .......... 60% 42.1M 2s 2024-02-21T07:44:08.748 INFO:tasks.workunit.client.0.smithi069.stderr: 81700K .......... .......... .......... .......... .......... 60% 25.0M 2s 2024-02-21T07:44:08.750 INFO:tasks.workunit.client.0.smithi069.stderr: 81750K .......... .......... .......... .......... .......... 60% 28.3M 2s 2024-02-21T07:44:08.752 INFO:tasks.workunit.client.0.smithi069.stderr: 81800K .......... .......... .......... .......... .......... 60% 26.9M 2s 2024-02-21T07:44:08.754 INFO:tasks.workunit.client.0.smithi069.stderr: 81850K .......... .......... .......... .......... .......... 60% 29.7M 2s 2024-02-21T07:44:08.755 INFO:tasks.workunit.client.0.smithi069.stderr: 81900K .......... .......... .......... .......... .......... 60% 33.2M 2s 2024-02-21T07:44:08.757 INFO:tasks.workunit.client.0.smithi069.stderr: 81950K .......... .......... .......... .......... .......... 60% 26.8M 2s 2024-02-21T07:44:08.759 INFO:tasks.workunit.client.0.smithi069.stderr: 82000K .......... .......... .......... .......... .......... 60% 30.5M 2s 2024-02-21T07:44:08.761 INFO:tasks.workunit.client.0.smithi069.stderr: 82050K .......... .......... .......... .......... .......... 60% 26.6M 2s 2024-02-21T07:44:08.762 INFO:tasks.workunit.client.0.smithi069.stderr: 82100K .......... .......... .......... .......... .......... 60% 29.1M 2s 2024-02-21T07:44:08.763 INFO:tasks.workunit.client.0.smithi069.stderr: 82150K .......... .......... .......... .......... .......... 60% 38.2M 2s 2024-02-21T07:44:08.772 INFO:tasks.workunit.client.0.smithi069.stderr: 82200K .......... .......... .......... .......... .......... 60% 25.6M 2s 2024-02-21T07:44:08.772 INFO:tasks.workunit.client.0.smithi069.stderr: 82250K .......... .......... .......... .......... .......... 60% 25.4M 2s 2024-02-21T07:44:08.772 INFO:tasks.workunit.client.0.smithi069.stderr: 82300K .......... .......... .......... .......... .......... 60% 27.5M 2s 2024-02-21T07:44:08.772 INFO:tasks.workunit.client.0.smithi069.stderr: 82350K .......... .......... .......... .......... .......... 60% 38.3M 2s 2024-02-21T07:44:08.772 INFO:tasks.workunit.client.0.smithi069.stderr: 82400K .......... .......... .......... .......... .......... 60% 35.0M 2s 2024-02-21T07:44:08.774 INFO:tasks.workunit.client.0.smithi069.stderr: 82450K .......... .......... .......... .......... .......... 60% 27.7M 2s 2024-02-21T07:44:08.776 INFO:tasks.workunit.client.0.smithi069.stderr: 82500K .......... .......... .......... .......... .......... 60% 23.2M 2s 2024-02-21T07:44:08.778 INFO:tasks.workunit.client.0.smithi069.stderr: 82550K .......... .......... .......... .......... .......... 60% 27.6M 2s 2024-02-21T07:44:08.780 INFO:tasks.workunit.client.0.smithi069.stderr: 82600K .......... .......... .......... .......... .......... 60% 28.0M 2s 2024-02-21T07:44:08.780 INFO:tasks.workunit.client.0.smithi069.stderr: 82650K .......... .......... .......... .......... .......... 60% 52.2M 2s 2024-02-21T07:44:08.782 INFO:tasks.workunit.client.0.smithi069.stderr: 82700K .......... .......... .......... .......... .......... 60% 27.8M 2s 2024-02-21T07:44:08.784 INFO:tasks.workunit.client.0.smithi069.stderr: 82750K .......... .......... .......... .......... .......... 60% 23.2M 2s 2024-02-21T07:44:08.786 INFO:tasks.workunit.client.0.smithi069.stderr: 82800K .......... .......... .......... .......... .......... 61% 26.2M 2s 2024-02-21T07:44:08.788 INFO:tasks.workunit.client.0.smithi069.stderr: 82850K .......... .......... .......... .......... .......... 61% 31.9M 2s 2024-02-21T07:44:08.794 INFO:tasks.workunit.client.0.smithi069.stderr: 82900K .......... .......... .......... .......... .......... 61% 8.13M 2s 2024-02-21T07:44:08.794 INFO:tasks.workunit.client.0.smithi069.stderr: 82950K .......... .......... .......... .......... .......... 61% 57.7M 2s 2024-02-21T07:44:08.799 INFO:tasks.workunit.client.0.smithi069.stderr: 83000K .......... .......... .......... .......... .......... 61% 43.6M 2s 2024-02-21T07:44:08.799 INFO:tasks.workunit.client.0.smithi069.stderr: 83050K .......... .......... .......... .......... .......... 61% 59.2M 2s 2024-02-21T07:44:08.799 INFO:tasks.workunit.client.0.smithi069.stderr: 83100K .......... .......... .......... .......... .......... 61% 66.1M 2s 2024-02-21T07:44:08.799 INFO:tasks.workunit.client.0.smithi069.stderr: 83150K .......... .......... .......... .......... .......... 61% 67.1M 2s 2024-02-21T07:44:08.801 INFO:tasks.workunit.client.0.smithi069.stderr: 83200K .......... .......... .......... .......... .......... 61% 48.2M 2s 2024-02-21T07:44:08.801 INFO:tasks.workunit.client.0.smithi069.stderr: 83250K .......... .......... .......... .......... .......... 61% 24.4M 2s 2024-02-21T07:44:08.803 INFO:tasks.workunit.client.0.smithi069.stderr: 83300K .......... .......... .......... .......... .......... 61% 24.1M 2s 2024-02-21T07:44:08.804 INFO:tasks.workunit.client.0.smithi069.stderr: 83350K .......... .......... .......... .......... .......... 61% 37.4M 2s 2024-02-21T07:44:08.806 INFO:tasks.workunit.client.0.smithi069.stderr: 83400K .......... .......... .......... .......... .......... 61% 26.3M 2s 2024-02-21T07:44:08.808 INFO:tasks.workunit.client.0.smithi069.stderr: 83450K .......... .......... .......... .......... .......... 61% 37.6M 2s 2024-02-21T07:44:08.809 INFO:tasks.workunit.client.0.smithi069.stderr: 83500K .......... .......... .......... .......... .......... 61% 25.2M 2s 2024-02-21T07:44:08.811 INFO:tasks.workunit.client.0.smithi069.stderr: 83550K .......... .......... .......... .......... .......... 61% 26.8M 2s 2024-02-21T07:44:08.812 INFO:tasks.workunit.client.0.smithi069.stderr: 83600K .......... .......... .......... .......... .......... 61% 31.2M 2s 2024-02-21T07:44:08.814 INFO:tasks.workunit.client.0.smithi069.stderr: 83650K .......... .......... .......... .......... .......... 61% 26.2M 2s 2024-02-21T07:44:08.816 INFO:tasks.workunit.client.0.smithi069.stderr: 83700K .......... .......... .......... .......... .......... 61% 26.9M 2s 2024-02-21T07:44:08.817 INFO:tasks.workunit.client.0.smithi069.stderr: 83750K .......... .......... .......... .......... .......... 61% 39.3M 2s 2024-02-21T07:44:08.819 INFO:tasks.workunit.client.0.smithi069.stderr: 83800K .......... .......... .......... .......... .......... 61% 29.3M 2s 2024-02-21T07:44:08.822 INFO:tasks.workunit.client.0.smithi069.stderr: 83850K .......... .......... .......... .......... .......... 61% 22.7M 2s 2024-02-21T07:44:08.823 INFO:tasks.workunit.client.0.smithi069.stderr: 83900K .......... .......... .......... .......... .......... 61% 26.6M 2s 2024-02-21T07:44:08.824 INFO:tasks.workunit.client.0.smithi069.stderr: 83950K .......... .......... .......... .......... .......... 61% 38.6M 2s 2024-02-21T07:44:08.826 INFO:tasks.workunit.client.0.smithi069.stderr: 84000K .......... .......... .......... .......... .......... 61% 31.6M 2s 2024-02-21T07:44:08.827 INFO:tasks.workunit.client.0.smithi069.stderr: 84050K .......... .......... .......... .......... .......... 61% 26.2M 2s 2024-02-21T07:44:08.830 INFO:tasks.workunit.client.0.smithi069.stderr: 84100K .......... .......... .......... .......... .......... 61% 25.2M 2s 2024-02-21T07:44:08.830 INFO:tasks.workunit.client.0.smithi069.stderr: 84150K .......... .......... .......... .......... .......... 62% 43.1M 2s 2024-02-21T07:44:08.833 INFO:tasks.workunit.client.0.smithi069.stderr: 84200K .......... .......... .......... .......... .......... 62% 22.1M 2s 2024-02-21T07:44:08.834 INFO:tasks.workunit.client.0.smithi069.stderr: 84250K .......... .......... .......... .......... .......... 62% 36.4M 2s 2024-02-21T07:44:08.836 INFO:tasks.workunit.client.0.smithi069.stderr: 84300K .......... .......... .......... .......... .......... 62% 27.0M 2s 2024-02-21T07:44:08.837 INFO:tasks.workunit.client.0.smithi069.stderr: 84350K .......... .......... .......... .......... .......... 62% 33.7M 2s 2024-02-21T07:44:08.839 INFO:tasks.workunit.client.0.smithi069.stderr: 84400K .......... .......... .......... .......... .......... 62% 34.6M 2s 2024-02-21T07:44:08.841 INFO:tasks.workunit.client.0.smithi069.stderr: 84450K .......... .......... .......... .......... .......... 62% 21.7M 2s 2024-02-21T07:44:08.843 INFO:tasks.workunit.client.0.smithi069.stderr: 84500K .......... .......... .......... .......... .......... 62% 32.2M 2s 2024-02-21T07:44:08.848 INFO:tasks.workunit.client.0.smithi069.stderr: 84550K .......... .......... .......... .......... .......... 62% 16.6M 2s 2024-02-21T07:44:08.848 INFO:tasks.workunit.client.0.smithi069.stderr: 84600K .......... .......... .......... .......... .......... 62% 63.2M 2s 2024-02-21T07:44:08.848 INFO:tasks.workunit.client.0.smithi069.stderr: 84650K .......... .......... .......... .......... .......... 62% 45.3M 2s 2024-02-21T07:44:08.850 INFO:tasks.workunit.client.0.smithi069.stderr: 84700K .......... .......... .......... .......... .......... 62% 28.9M 2s 2024-02-21T07:44:08.851 INFO:tasks.workunit.client.0.smithi069.stderr: 84750K .......... .......... .......... .......... .......... 62% 24.4M 2s 2024-02-21T07:44:08.855 INFO:tasks.workunit.client.0.smithi069.stderr: 84800K .......... .......... .......... .......... .......... 62% 16.1M 2s 2024-02-21T07:44:08.855 INFO:tasks.workunit.client.0.smithi069.stderr: 84850K .......... .......... .......... .......... .......... 62% 65.0M 2s 2024-02-21T07:44:08.856 INFO:tasks.workunit.client.0.smithi069.stderr: 84900K .......... .......... .......... .......... .......... 62% 42.1M 2s 2024-02-21T07:44:08.857 INFO:tasks.workunit.client.0.smithi069.stderr: 84950K .......... .......... .......... .......... .......... 62% 33.7M 2s 2024-02-21T07:44:08.860 INFO:tasks.workunit.client.0.smithi069.stderr: 85000K .......... .......... .......... .......... .......... 62% 22.6M 2s 2024-02-21T07:44:08.862 INFO:tasks.workunit.client.0.smithi069.stderr: 85050K .......... .......... .......... .......... .......... 62% 26.3M 2s 2024-02-21T07:44:08.863 INFO:tasks.workunit.client.0.smithi069.stderr: 85100K .......... .......... .......... .......... .......... 62% 32.6M 2s 2024-02-21T07:44:08.864 INFO:tasks.workunit.client.0.smithi069.stderr: 85150K .......... .......... .......... .......... .......... 62% 41.8M 2s 2024-02-21T07:44:08.866 INFO:tasks.workunit.client.0.smithi069.stderr: 85200K .......... .......... .......... .......... .......... 62% 27.0M 2s 2024-02-21T07:44:08.867 INFO:tasks.workunit.client.0.smithi069.stderr: 85250K .......... .......... .......... .......... .......... 62% 32.2M 2s 2024-02-21T07:44:08.869 INFO:tasks.workunit.client.0.smithi069.stderr: 85300K .......... .......... .......... .......... .......... 62% 34.1M 2s 2024-02-21T07:44:08.873 INFO:tasks.workunit.client.0.smithi069.stderr: 85350K .......... .......... .......... .......... .......... 62% 17.9M 2s 2024-02-21T07:44:08.873 INFO:tasks.workunit.client.0.smithi069.stderr: 85400K .......... .......... .......... .......... .......... 62% 51.1M 2s 2024-02-21T07:44:08.875 INFO:tasks.workunit.client.0.smithi069.stderr: 85450K .......... .......... .......... .......... .......... 62% 22.5M 2s 2024-02-21T07:44:08.877 INFO:tasks.workunit.client.0.smithi069.stderr: 85500K .......... .......... .......... .......... .......... 63% 30.3M 2s 2024-02-21T07:44:08.878 INFO:tasks.workunit.client.0.smithi069.stderr: 85550K .......... .......... .......... .......... .......... 63% 32.0M 2s 2024-02-21T07:44:08.880 INFO:tasks.workunit.client.0.smithi069.stderr: 85600K .......... .......... .......... .......... .......... 63% 25.9M 2s 2024-02-21T07:44:08.882 INFO:tasks.workunit.client.0.smithi069.stderr: 85650K .......... .......... .......... .......... .......... 63% 27.8M 2s 2024-02-21T07:44:08.953 INFO:tasks.workunit.client.0.smithi069.stderr: 85700K .......... .......... .......... .......... .......... 63% 814K 2s 2024-02-21T07:44:08.953 INFO:tasks.workunit.client.0.smithi069.stderr: 85750K .......... .......... .......... .......... .......... 63% 55.9M 2s 2024-02-21T07:44:08.953 INFO:tasks.workunit.client.0.smithi069.stderr: 85800K .......... .......... .......... .......... .......... 63% 59.7M 2s 2024-02-21T07:44:08.953 INFO:tasks.workunit.client.0.smithi069.stderr: 85850K .......... .......... .......... .......... .......... 63% 49.3M 2s 2024-02-21T07:44:08.953 INFO:tasks.workunit.client.0.smithi069.stderr: 85900K .......... .......... .......... .......... .......... 63% 66.8M 2s 2024-02-21T07:44:08.953 INFO:tasks.workunit.client.0.smithi069.stderr: 85950K .......... .......... .......... .......... .......... 63% 69.7M 2s 2024-02-21T07:44:08.953 INFO:tasks.workunit.client.0.smithi069.stderr: 86000K .......... .......... .......... .......... .......... 63% 62.9M 2s 2024-02-21T07:44:08.953 INFO:tasks.workunit.client.0.smithi069.stderr: 86050K .......... .......... .......... .......... .......... 63% 57.2M 2s 2024-02-21T07:44:08.953 INFO:tasks.workunit.client.0.smithi069.stderr: 86100K .......... .......... .......... .......... .......... 63% 63.8M 2s 2024-02-21T07:44:08.954 INFO:tasks.workunit.client.0.smithi069.stderr: 86150K .......... .......... .......... .......... .......... 63% 66.2M 2s 2024-02-21T07:44:08.954 INFO:tasks.workunit.client.0.smithi069.stderr: 86200K .......... .......... .......... .......... .......... 63% 74.5M 2s 2024-02-21T07:44:08.954 INFO:tasks.workunit.client.0.smithi069.stderr: 86250K .......... .......... .......... .......... .......... 63% 29.9M 2s 2024-02-21T07:44:08.955 INFO:tasks.workunit.client.0.smithi069.stderr: 86300K .......... .......... .......... .......... .......... 63% 30.5M 2s 2024-02-21T07:44:08.957 INFO:tasks.workunit.client.0.smithi069.stderr: 86350K .......... .......... .......... .......... .......... 63% 21.6M 2s 2024-02-21T07:44:08.959 INFO:tasks.workunit.client.0.smithi069.stderr: 86400K .......... .......... .......... .......... .......... 63% 30.7M 2s 2024-02-21T07:44:08.959 INFO:tasks.workunit.client.0.smithi069.stderr: 86450K .......... .......... .......... .......... .......... 63% 60.4M 2s 2024-02-21T07:44:08.961 INFO:tasks.workunit.client.0.smithi069.stderr: 86500K .......... .......... .......... .......... .......... 63% 22.6M 2s 2024-02-21T07:44:08.963 INFO:tasks.workunit.client.0.smithi069.stderr: 86550K .......... .......... .......... .......... .......... 63% 29.4M 2s 2024-02-21T07:44:08.965 INFO:tasks.workunit.client.0.smithi069.stderr: 86600K .......... .......... .......... .......... .......... 63% 23.4M 2s 2024-02-21T07:44:08.968 INFO:tasks.workunit.client.0.smithi069.stderr: 86650K .......... .......... .......... .......... .......... 63% 26.9M 2s 2024-02-21T07:44:08.968 INFO:tasks.workunit.client.0.smithi069.stderr: 86700K .......... .......... .......... .......... .......... 63% 64.5M 2s 2024-02-21T07:44:08.969 INFO:tasks.workunit.client.0.smithi069.stderr: 86750K .......... .......... .......... .......... .......... 63% 23.9M 2s 2024-02-21T07:44:08.971 INFO:tasks.workunit.client.0.smithi069.stderr: 86800K .......... .......... .......... .......... .......... 63% 29.0M 2s 2024-02-21T07:44:08.988 INFO:tasks.workunit.client.0.smithi069.stderr: 86850K .......... .......... .......... .......... .......... 64% 2.92M 2s 2024-02-21T07:44:08.993 INFO:tasks.workunit.client.0.smithi069.stderr: 86900K .......... .......... .......... .......... .......... 64% 31.4M 2s 2024-02-21T07:44:08.993 INFO:tasks.workunit.client.0.smithi069.stderr: 86950K .......... .......... .......... .......... .......... 64% 62.5M 2s 2024-02-21T07:44:08.993 INFO:tasks.workunit.client.0.smithi069.stderr: 87000K .......... .......... .......... .......... .......... 64% 64.7M 2s 2024-02-21T07:44:08.993 INFO:tasks.workunit.client.0.smithi069.stderr: 87050K .......... .......... .......... .......... .......... 64% 58.8M 2s 2024-02-21T07:44:09.001 INFO:tasks.workunit.client.0.smithi069.stderr: 87100K .......... .......... .......... .......... .......... 64% 5.64M 2s 2024-02-21T07:44:09.006 INFO:tasks.workunit.client.0.smithi069.stderr: 87150K .......... .......... .......... .......... .......... 64% 27.6M 2s 2024-02-21T07:44:09.006 INFO:tasks.workunit.client.0.smithi069.stderr: 87200K .......... .......... .......... .......... .......... 64% 55.3M 2s 2024-02-21T07:44:09.006 INFO:tasks.workunit.client.0.smithi069.stderr: 87250K .......... .......... .......... .......... .......... 64% 59.1M 2s 2024-02-21T07:44:09.006 INFO:tasks.workunit.client.0.smithi069.stderr: 87300K .......... .......... .......... .......... .......... 64% 65.6M 2s 2024-02-21T07:44:09.006 INFO:tasks.workunit.client.0.smithi069.stderr: 87350K .......... .......... .......... .......... .......... 64% 72.7M 2s 2024-02-21T07:44:09.017 INFO:tasks.workunit.client.0.smithi069.stderr: 87400K .......... .......... .......... .......... .......... 64% 4.39M 2s 2024-02-21T07:44:09.018 INFO:tasks.workunit.client.0.smithi069.stderr: 87450K .......... .......... .......... .......... .......... 64% 58.6M 2s 2024-02-21T07:44:09.024 INFO:tasks.workunit.client.0.smithi069.stderr: 87500K .......... .......... .......... .......... .......... 64% 19.2M 2s 2024-02-21T07:44:09.024 INFO:tasks.workunit.client.0.smithi069.stderr: 87550K .......... .......... .......... .......... .......... 64% 35.0M 2s 2024-02-21T07:44:09.024 INFO:tasks.workunit.client.0.smithi069.stderr: 87600K .......... .......... .......... .......... .......... 64% 65.8M 2s 2024-02-21T07:44:09.027 INFO:tasks.workunit.client.0.smithi069.stderr: 87650K .......... .......... .......... .......... .......... 64% 60.6M 2s 2024-02-21T07:44:09.027 INFO:tasks.workunit.client.0.smithi069.stderr: 87700K .......... .......... .......... .......... .......... 64% 68.7M 2s 2024-02-21T07:44:09.031 INFO:tasks.workunit.client.0.smithi069.stderr: 87750K .......... .......... .......... .......... .......... 64% 8.43M 2s 2024-02-21T07:44:09.031 INFO:tasks.workunit.client.0.smithi069.stderr: 87800K .......... .......... .......... .......... .......... 64% 43.8M 2s 2024-02-21T07:44:09.031 INFO:tasks.workunit.client.0.smithi069.stderr: 87850K .......... .......... .......... .......... .......... 64% 60.8M 2s 2024-02-21T07:44:09.043 INFO:tasks.workunit.client.0.smithi069.stderr: 87900K .......... .......... .......... .......... .......... 64% 8.98M 2s 2024-02-21T07:44:09.043 INFO:tasks.workunit.client.0.smithi069.stderr: 87950K .......... .......... .......... .......... .......... 64% 42.6M 2s 2024-02-21T07:44:09.043 INFO:tasks.workunit.client.0.smithi069.stderr: 88000K .......... .......... .......... .......... .......... 64% 71.4M 2s 2024-02-21T07:44:09.043 INFO:tasks.workunit.client.0.smithi069.stderr: 88050K .......... .......... .......... .......... .......... 64% 34.5M 2s 2024-02-21T07:44:09.043 INFO:tasks.workunit.client.0.smithi069.stderr: 88100K .......... .......... .......... .......... .......... 64% 66.8M 2s 2024-02-21T07:44:09.043 INFO:tasks.workunit.client.0.smithi069.stderr: 88150K .......... .......... .......... .......... .......... 64% 68.4M 2s 2024-02-21T07:44:09.043 INFO:tasks.workunit.client.0.smithi069.stderr: 88200K .......... .......... .......... .......... .......... 65% 69.4M 2s 2024-02-21T07:44:09.054 INFO:tasks.workunit.client.0.smithi069.stderr: 88250K .......... .......... .......... .......... .......... 65% 5.18M 2s 2024-02-21T07:44:09.054 INFO:tasks.workunit.client.0.smithi069.stderr: 88300K .......... .......... .......... .......... .......... 65% 37.5M 2s 2024-02-21T07:44:09.054 INFO:tasks.workunit.client.0.smithi069.stderr: 88350K .......... .......... .......... .......... .......... 65% 71.9M 2s 2024-02-21T07:44:09.060 INFO:tasks.workunit.client.0.smithi069.stderr: 88400K .......... .......... .......... .......... .......... 65% 24.5M 2s 2024-02-21T07:44:09.060 INFO:tasks.workunit.client.0.smithi069.stderr: 88450K .......... .......... .......... .......... .......... 65% 31.0M 2s 2024-02-21T07:44:09.060 INFO:tasks.workunit.client.0.smithi069.stderr: 88500K .......... .......... .......... .......... .......... 65% 68.7M 2s 2024-02-21T07:44:09.060 INFO:tasks.workunit.client.0.smithi069.stderr: 88550K .......... .......... .......... .......... .......... 65% 67.3M 2s 2024-02-21T07:44:09.060 INFO:tasks.workunit.client.0.smithi069.stderr: 88600K .......... .......... .......... .......... .......... 65% 69.7M 2s 2024-02-21T07:44:09.073 INFO:tasks.workunit.client.0.smithi069.stderr: 88650K .......... .......... .......... .......... .......... 65% 3.59M 2s 2024-02-21T07:44:09.080 INFO:tasks.workunit.client.0.smithi069.stderr: 88700K .......... .......... .......... .......... .......... 65% 29.1M 2s 2024-02-21T07:44:09.080 INFO:tasks.workunit.client.0.smithi069.stderr: 88750K .......... .......... .......... .......... .......... 65% 39.4M 2s 2024-02-21T07:44:09.080 INFO:tasks.workunit.client.0.smithi069.stderr: 88800K .......... .......... .......... .......... .......... 65% 67.9M 2s 2024-02-21T07:44:09.080 INFO:tasks.workunit.client.0.smithi069.stderr: 88850K .......... .......... .......... .......... .......... 65% 60.6M 2s 2024-02-21T07:44:09.080 INFO:tasks.workunit.client.0.smithi069.stderr: 88900K .......... .......... .......... .......... .......... 65% 65.3M 2s 2024-02-21T07:44:09.080 INFO:tasks.workunit.client.0.smithi069.stderr: 88950K .......... .......... .......... .......... .......... 65% 68.2M 2s 2024-02-21T07:44:09.080 INFO:tasks.workunit.client.0.smithi069.stderr: 89000K .......... .......... .......... .......... .......... 65% 67.6M 2s 2024-02-21T07:44:09.091 INFO:tasks.workunit.client.0.smithi069.stderr: 89050K .......... .......... .......... .......... .......... 65% 11.2M 2s 2024-02-21T07:44:09.092 INFO:tasks.workunit.client.0.smithi069.stderr: 89100K .......... .......... .......... .......... .......... 65% 51.4M 2s 2024-02-21T07:44:09.092 INFO:tasks.workunit.client.0.smithi069.stderr: 89150K .......... .......... .......... .......... .......... 65% 44.7M 2s 2024-02-21T07:44:09.092 INFO:tasks.workunit.client.0.smithi069.stderr: 89200K .......... .......... .......... .......... .......... 65% 66.8M 2s 2024-02-21T07:44:09.092 INFO:tasks.workunit.client.0.smithi069.stderr: 89250K .......... .......... .......... .......... .......... 65% 51.4M 2s 2024-02-21T07:44:09.092 INFO:tasks.workunit.client.0.smithi069.stderr: 89300K .......... .......... .......... .......... .......... 65% 46.8M 2s 2024-02-21T07:44:09.092 INFO:tasks.workunit.client.0.smithi069.stderr: 89350K .......... .......... .......... .......... .......... 65% 71.8M 2s 2024-02-21T07:44:09.092 INFO:tasks.workunit.client.0.smithi069.stderr: 89400K .......... .......... .......... .......... .......... 65% 43.4M 2s 2024-02-21T07:44:09.092 INFO:tasks.workunit.client.0.smithi069.stderr: 89450K .......... .......... .......... .......... .......... 65% 60.2M 2s 2024-02-21T07:44:09.093 INFO:tasks.workunit.client.0.smithi069.stderr: 89500K .......... .......... .......... .......... .......... 65% 33.6M 2s 2024-02-21T07:44:09.095 INFO:tasks.workunit.client.0.smithi069.stderr: 89550K .......... .......... .......... .......... .......... 66% 23.5M 2s 2024-02-21T07:44:09.097 INFO:tasks.workunit.client.0.smithi069.stderr: 89600K .......... .......... .......... .......... .......... 66% 33.3M 2s 2024-02-21T07:44:09.097 INFO:tasks.workunit.client.0.smithi069.stderr: 89650K .......... .......... .......... .......... .......... 66% 42.8M 2s 2024-02-21T07:44:09.099 INFO:tasks.workunit.client.0.smithi069.stderr: 89700K .......... .......... .......... .......... .......... 66% 25.7M 2s 2024-02-21T07:44:09.101 INFO:tasks.workunit.client.0.smithi069.stderr: 89750K .......... .......... .......... .......... .......... 66% 25.4M 2s 2024-02-21T07:44:09.136 INFO:tasks.workunit.client.0.smithi069.stderr: 89800K .......... .......... .......... .......... .......... 66% 1.46M 2s 2024-02-21T07:44:09.137 INFO:tasks.workunit.client.0.smithi069.stderr: 89850K .......... .......... .......... .......... .......... 66% 43.8M 2s 2024-02-21T07:44:09.137 INFO:tasks.workunit.client.0.smithi069.stderr: 89900K .......... .......... .......... .......... .......... 66% 72.1M 2s 2024-02-21T07:44:09.157 INFO:tasks.workunit.client.0.smithi069.stderr: 89950K .......... .......... .......... .......... .......... 66% 2.39M 2s 2024-02-21T07:44:09.157 INFO:tasks.workunit.client.0.smithi069.stderr: 90000K .......... .......... .......... .......... .......... 66% 66.6M 2s 2024-02-21T07:44:09.166 INFO:tasks.workunit.client.0.smithi069.stderr: 90050K .......... .......... .......... .......... .......... 66% 26.6M 2s 2024-02-21T07:44:09.166 INFO:tasks.workunit.client.0.smithi069.stderr: 90100K .......... .......... .......... .......... .......... 66% 37.0M 2s 2024-02-21T07:44:09.166 INFO:tasks.workunit.client.0.smithi069.stderr: 90150K .......... .......... .......... .......... .......... 66% 67.7M 2s 2024-02-21T07:44:09.166 INFO:tasks.workunit.client.0.smithi069.stderr: 90200K .......... .......... .......... .......... .......... 66% 57.3M 2s 2024-02-21T07:44:09.166 INFO:tasks.workunit.client.0.smithi069.stderr: 90250K .......... .......... .......... .......... .......... 66% 48.5M 2s 2024-02-21T07:44:09.166 INFO:tasks.workunit.client.0.smithi069.stderr: 90300K .......... .......... .......... .......... .......... 66% 64.6M 2s 2024-02-21T07:44:09.167 INFO:tasks.workunit.client.0.smithi069.stderr: 90350K .......... .......... .......... .......... .......... 66% 44.3M 2s 2024-02-21T07:44:09.167 INFO:tasks.workunit.client.0.smithi069.stderr: 90400K .......... .......... .......... .......... .......... 66% 61.2M 2s 2024-02-21T07:44:09.170 INFO:tasks.workunit.client.0.smithi069.stderr: 90450K .......... .......... .......... .......... .......... 66% 36.3M 2s 2024-02-21T07:44:09.171 INFO:tasks.workunit.client.0.smithi069.stderr: 90500K .......... .......... .......... .......... .......... 66% 69.5M 2s 2024-02-21T07:44:09.171 INFO:tasks.workunit.client.0.smithi069.stderr: 90550K .......... .......... .......... .......... .......... 66% 57.6M 2s 2024-02-21T07:44:09.171 INFO:tasks.workunit.client.0.smithi069.stderr: 90600K .......... .......... .......... .......... .......... 66% 34.5M 2s 2024-02-21T07:44:09.172 INFO:tasks.workunit.client.0.smithi069.stderr: 90650K .......... .......... .......... .......... .......... 66% 25.2M 2s 2024-02-21T07:44:09.174 INFO:tasks.workunit.client.0.smithi069.stderr: 90700K .......... .......... .......... .......... .......... 66% 29.2M 2s 2024-02-21T07:44:09.177 INFO:tasks.workunit.client.0.smithi069.stderr: 90750K .......... .......... .......... .......... .......... 66% 28.5M 2s 2024-02-21T07:44:09.177 INFO:tasks.workunit.client.0.smithi069.stderr: 90800K .......... .......... .......... .......... .......... 66% 40.8M 2s 2024-02-21T07:44:09.179 INFO:tasks.workunit.client.0.smithi069.stderr: 90850K .......... .......... .......... .......... .......... 66% 27.4M 2s 2024-02-21T07:44:09.190 INFO:tasks.workunit.client.0.smithi069.stderr: 90900K .......... .......... .......... .......... .......... 66% 4.26M 2s 2024-02-21T07:44:09.191 INFO:tasks.workunit.client.0.smithi069.stderr: 90950K .......... .......... .......... .......... .......... 67% 26.7M 2s 2024-02-21T07:44:09.193 INFO:tasks.workunit.client.0.smithi069.stderr: 91000K .......... .......... .......... .......... .......... 67% 30.7M 2s 2024-02-21T07:44:09.196 INFO:tasks.workunit.client.0.smithi069.stderr: 91050K .......... .......... .......... .......... .......... 67% 30.7M 2s 2024-02-21T07:44:09.196 INFO:tasks.workunit.client.0.smithi069.stderr: 91100K .......... .......... .......... .......... .......... 67% 34.7M 2s 2024-02-21T07:44:09.198 INFO:tasks.workunit.client.0.smithi069.stderr: 91150K .......... .......... .......... .......... .......... 67% 31.8M 2s 2024-02-21T07:44:09.200 INFO:tasks.workunit.client.0.smithi069.stderr: 91200K .......... .......... .......... .......... .......... 67% 30.6M 2s 2024-02-21T07:44:09.201 INFO:tasks.workunit.client.0.smithi069.stderr: 91250K .......... .......... .......... .......... .......... 67% 29.7M 2s 2024-02-21T07:44:09.203 INFO:tasks.workunit.client.0.smithi069.stderr: 91300K .......... .......... .......... .......... .......... 67% 33.8M 2s 2024-02-21T07:44:09.204 INFO:tasks.workunit.client.0.smithi069.stderr: 91350K .......... .......... .......... .......... .......... 67% 30.8M 2s 2024-02-21T07:44:09.205 INFO:tasks.workunit.client.0.smithi069.stderr: 91400K .......... .......... .......... .......... .......... 67% 30.2M 2s 2024-02-21T07:44:09.208 INFO:tasks.workunit.client.0.smithi069.stderr: 91450K .......... .......... .......... .......... .......... 67% 36.7M 2s 2024-02-21T07:44:09.209 INFO:tasks.workunit.client.0.smithi069.stderr: 91500K .......... .......... .......... .......... .......... 67% 26.5M 2s 2024-02-21T07:44:09.210 INFO:tasks.workunit.client.0.smithi069.stderr: 91550K .......... .......... .......... .......... .......... 67% 30.7M 2s 2024-02-21T07:44:09.212 INFO:tasks.workunit.client.0.smithi069.stderr: 91600K .......... .......... .......... .......... .......... 67% 30.8M 2s 2024-02-21T07:44:09.214 INFO:tasks.workunit.client.0.smithi069.stderr: 91650K .......... .......... .......... .......... .......... 67% 43.4M 2s 2024-02-21T07:44:09.215 INFO:tasks.workunit.client.0.smithi069.stderr: 91700K .......... .......... .......... .......... .......... 67% 27.7M 2s 2024-02-21T07:44:09.217 INFO:tasks.workunit.client.0.smithi069.stderr: 91750K .......... .......... .......... .......... .......... 67% 37.1M 2s 2024-02-21T07:44:09.217 INFO:tasks.workunit.client.0.smithi069.stderr: 91800K .......... .......... .......... .......... .......... 67% 44.9M 2s 2024-02-21T07:44:09.219 INFO:tasks.workunit.client.0.smithi069.stderr: 91850K .......... .......... .......... .......... .......... 67% 36.8M 2s 2024-02-21T07:44:09.220 INFO:tasks.workunit.client.0.smithi069.stderr: 91900K .......... .......... .......... .......... .......... 67% 36.6M 2s 2024-02-21T07:44:09.226 INFO:tasks.workunit.client.0.smithi069.stderr: 91950K .......... .......... .......... .......... .......... 67% 37.9M 2s 2024-02-21T07:44:09.226 INFO:tasks.workunit.client.0.smithi069.stderr: 92000K .......... .......... .......... .......... .......... 67% 80.6M 2s 2024-02-21T07:44:09.226 INFO:tasks.workunit.client.0.smithi069.stderr: 92050K .......... .......... .......... .......... .......... 67% 71.9M 2s 2024-02-21T07:44:09.227 INFO:tasks.workunit.client.0.smithi069.stderr: 92100K .......... .......... .......... .......... .......... 67% 79.8M 2s 2024-02-21T07:44:09.227 INFO:tasks.workunit.client.0.smithi069.stderr: 92150K .......... .......... .......... .......... .......... 67% 102M 2s 2024-02-21T07:44:09.227 INFO:tasks.workunit.client.0.smithi069.stderr: 92200K .......... .......... .......... .......... .......... 67% 108M 2s 2024-02-21T07:44:09.227 INFO:tasks.workunit.client.0.smithi069.stderr: 92250K .......... .......... .......... .......... .......... 67% 43.0M 2s 2024-02-21T07:44:09.228 INFO:tasks.workunit.client.0.smithi069.stderr: 92300K .......... .......... .......... .......... .......... 68% 21.8M 2s 2024-02-21T07:44:09.230 INFO:tasks.workunit.client.0.smithi069.stderr: 92350K .......... .......... .......... .......... .......... 68% 28.1M 2s 2024-02-21T07:44:09.232 INFO:tasks.workunit.client.0.smithi069.stderr: 92400K .......... .......... .......... .......... .......... 68% 28.1M 2s 2024-02-21T07:44:09.232 INFO:tasks.workunit.client.0.smithi069.stderr: 92450K .......... .......... .......... .......... .......... 68% 51.1M 2s 2024-02-21T07:44:09.234 INFO:tasks.workunit.client.0.smithi069.stderr: 92500K .......... .......... .......... .......... .......... 68% 24.7M 2s 2024-02-21T07:44:09.238 INFO:tasks.workunit.client.0.smithi069.stderr: 92550K .......... .......... .......... .......... .......... 68% 20.4M 2s 2024-02-21T07:44:09.239 INFO:tasks.workunit.client.0.smithi069.stderr: 92600K .......... .......... .......... .......... .......... 68% 32.1M 2s 2024-02-21T07:44:09.239 INFO:tasks.workunit.client.0.smithi069.stderr: 92650K .......... .......... .......... .......... .......... 68% 76.0M 2s 2024-02-21T07:44:09.241 INFO:tasks.workunit.client.0.smithi069.stderr: 92700K .......... .......... .......... .......... .......... 68% 30.5M 2s 2024-02-21T07:44:09.242 INFO:tasks.workunit.client.0.smithi069.stderr: 92750K .......... .......... .......... .......... .......... 68% 36.6M 2s 2024-02-21T07:44:09.244 INFO:tasks.workunit.client.0.smithi069.stderr: 92800K .......... .......... .......... .......... .......... 68% 22.7M 2s 2024-02-21T07:44:09.246 INFO:tasks.workunit.client.0.smithi069.stderr: 92850K .......... .......... .......... .......... .......... 68% 25.7M 2s 2024-02-21T07:44:09.247 INFO:tasks.workunit.client.0.smithi069.stderr: 92900K .......... .......... .......... .......... .......... 68% 46.3M 2s 2024-02-21T07:44:09.248 INFO:tasks.workunit.client.0.smithi069.stderr: 92950K .......... .......... .......... .......... .......... 68% 29.2M 2s 2024-02-21T07:44:09.250 INFO:tasks.workunit.client.0.smithi069.stderr: 93000K .......... .......... .......... .......... .......... 68% 28.5M 2s 2024-02-21T07:44:09.252 INFO:tasks.workunit.client.0.smithi069.stderr: 93050K .......... .......... .......... .......... .......... 68% 21.4M 2s 2024-02-21T07:44:09.254 INFO:tasks.workunit.client.0.smithi069.stderr: 93100K .......... .......... .......... .......... .......... 68% 25.2M 2s 2024-02-21T07:44:09.256 INFO:tasks.workunit.client.0.smithi069.stderr: 93150K .......... .......... .......... .......... .......... 68% 27.9M 2s 2024-02-21T07:44:09.257 INFO:tasks.workunit.client.0.smithi069.stderr: 93200K .......... .......... .......... .......... .......... 68% 61.0M 2s 2024-02-21T07:44:09.259 INFO:tasks.workunit.client.0.smithi069.stderr: 93250K .......... .......... .......... .......... .......... 68% 23.6M 2s 2024-02-21T07:44:09.261 INFO:tasks.workunit.client.0.smithi069.stderr: 93300K .......... .......... .......... .......... .......... 68% 26.5M 2s 2024-02-21T07:44:09.263 INFO:tasks.workunit.client.0.smithi069.stderr: 93350K .......... .......... .......... .......... .......... 68% 25.6M 2s 2024-02-21T07:44:09.265 INFO:tasks.workunit.client.0.smithi069.stderr: 93400K .......... .......... .......... .......... .......... 68% 26.9M 2s 2024-02-21T07:44:09.265 INFO:tasks.workunit.client.0.smithi069.stderr: 93450K .......... .......... .......... .......... .......... 68% 61.1M 2s 2024-02-21T07:44:09.267 INFO:tasks.workunit.client.0.smithi069.stderr: 93500K .......... .......... .......... .......... .......... 68% 27.2M 2s 2024-02-21T07:44:09.269 INFO:tasks.workunit.client.0.smithi069.stderr: 93550K .......... .......... .......... .......... .......... 68% 24.8M 2s 2024-02-21T07:44:09.271 INFO:tasks.workunit.client.0.smithi069.stderr: 93600K .......... .......... .......... .......... .......... 68% 27.6M 2s 2024-02-21T07:44:09.273 INFO:tasks.workunit.client.0.smithi069.stderr: 93650K .......... .......... .......... .......... .......... 69% 27.4M 2s 2024-02-21T07:44:09.273 INFO:tasks.workunit.client.0.smithi069.stderr: 93700K .......... .......... .......... .......... .......... 69% 57.6M 2s 2024-02-21T07:44:09.275 INFO:tasks.workunit.client.0.smithi069.stderr: 93750K .......... .......... .......... .......... .......... 69% 25.4M 2s 2024-02-21T07:44:09.278 INFO:tasks.workunit.client.0.smithi069.stderr: 93800K .......... .......... .......... .......... .......... 69% 25.7M 2s 2024-02-21T07:44:09.280 INFO:tasks.workunit.client.0.smithi069.stderr: 93850K .......... .......... .......... .......... .......... 69% 29.2M 2s 2024-02-21T07:44:09.280 INFO:tasks.workunit.client.0.smithi069.stderr: 93900K .......... .......... .......... .......... .......... 69% 46.7M 2s 2024-02-21T07:44:09.282 INFO:tasks.workunit.client.0.smithi069.stderr: 93950K .......... .......... .......... .......... .......... 69% 25.1M 2s 2024-02-21T07:44:09.284 INFO:tasks.workunit.client.0.smithi069.stderr: 94000K .......... .......... .......... .......... .......... 69% 29.3M 2s 2024-02-21T07:44:09.286 INFO:tasks.workunit.client.0.smithi069.stderr: 94050K .......... .......... .......... .......... .......... 69% 23.0M 2s 2024-02-21T07:44:09.288 INFO:tasks.workunit.client.0.smithi069.stderr: 94100K .......... .......... .......... .......... .......... 69% 29.5M 2s 2024-02-21T07:44:09.289 INFO:tasks.workunit.client.0.smithi069.stderr: 94150K .......... .......... .......... .......... .......... 69% 40.6M 2s 2024-02-21T07:44:09.290 INFO:tasks.workunit.client.0.smithi069.stderr: 94200K .......... .......... .......... .......... .......... 69% 29.7M 2s 2024-02-21T07:44:09.292 INFO:tasks.workunit.client.0.smithi069.stderr: 94250K .......... .......... .......... .......... .......... 69% 24.8M 2s 2024-02-21T07:44:09.295 INFO:tasks.workunit.client.0.smithi069.stderr: 94300K .......... .......... .......... .......... .......... 69% 23.2M 2s 2024-02-21T07:44:09.296 INFO:tasks.workunit.client.0.smithi069.stderr: 94350K .......... .......... .......... .......... .......... 69% 28.6M 2s 2024-02-21T07:44:09.297 INFO:tasks.workunit.client.0.smithi069.stderr: 94400K .......... .......... .......... .......... .......... 69% 33.7M 2s 2024-02-21T07:44:09.298 INFO:tasks.workunit.client.0.smithi069.stderr: 94450K .......... .......... .......... .......... .......... 69% 50.7M 2s 2024-02-21T07:44:09.300 INFO:tasks.workunit.client.0.smithi069.stderr: 94500K .......... .......... .......... .......... .......... 69% 21.9M 2s 2024-02-21T07:44:09.302 INFO:tasks.workunit.client.0.smithi069.stderr: 94550K .......... .......... .......... .......... .......... 69% 33.4M 2s 2024-02-21T07:44:09.304 INFO:tasks.workunit.client.0.smithi069.stderr: 94600K .......... .......... .......... .......... .......... 69% 28.0M 2s 2024-02-21T07:44:09.306 INFO:tasks.workunit.client.0.smithi069.stderr: 94650K .......... .......... .......... .......... .......... 69% 22.7M 2s 2024-02-21T07:44:09.309 INFO:tasks.workunit.client.0.smithi069.stderr: 94700K .......... .......... .......... .......... .......... 69% 49.1M 2s 2024-02-21T07:44:09.309 INFO:tasks.workunit.client.0.smithi069.stderr: 94750K .......... .......... .......... .......... .......... 69% 26.5M 2s 2024-02-21T07:44:09.311 INFO:tasks.workunit.client.0.smithi069.stderr: 94800K .......... .......... .......... .......... .......... 69% 26.1M 2s 2024-02-21T07:44:09.312 INFO:tasks.workunit.client.0.smithi069.stderr: 94850K .......... .......... .......... .......... .......... 69% 31.7M 2s 2024-02-21T07:44:09.314 INFO:tasks.workunit.client.0.smithi069.stderr: 94900K .......... .......... .......... .......... .......... 69% 27.3M 2s 2024-02-21T07:44:09.317 INFO:tasks.workunit.client.0.smithi069.stderr: 94950K .......... .......... .......... .......... .......... 69% 32.0M 2s 2024-02-21T07:44:09.317 INFO:tasks.workunit.client.0.smithi069.stderr: 95000K .......... .......... .......... .......... .......... 70% 28.7M 2s 2024-02-21T07:44:09.319 INFO:tasks.workunit.client.0.smithi069.stderr: 95050K .......... .......... .......... .......... .......... 70% 26.0M 2s 2024-02-21T07:44:09.322 INFO:tasks.workunit.client.0.smithi069.stderr: 95100K .......... .......... .......... .......... .......... 70% 29.2M 2s 2024-02-21T07:44:09.323 INFO:tasks.workunit.client.0.smithi069.stderr: 95150K .......... .......... .......... .......... .......... 70% 26.0M 2s 2024-02-21T07:44:09.325 INFO:tasks.workunit.client.0.smithi069.stderr: 95200K .......... .......... .......... .......... .......... 70% 26.3M 2s 2024-02-21T07:44:09.325 INFO:tasks.workunit.client.0.smithi069.stderr: 95250K .......... .......... .......... .......... .......... 70% 41.2M 2s 2024-02-21T07:44:09.328 INFO:tasks.workunit.client.0.smithi069.stderr: 95300K .......... .......... .......... .......... .......... 70% 28.0M 2s 2024-02-21T07:44:09.329 INFO:tasks.workunit.client.0.smithi069.stderr: 95350K .......... .......... .......... .......... .......... 70% 31.3M 2s 2024-02-21T07:44:09.331 INFO:tasks.workunit.client.0.smithi069.stderr: 95400K .......... .......... .......... .......... .......... 70% 25.0M 2s 2024-02-21T07:44:09.333 INFO:tasks.workunit.client.0.smithi069.stderr: 95450K .......... .......... .......... .......... .......... 70% 26.0M 2s 2024-02-21T07:44:09.334 INFO:tasks.workunit.client.0.smithi069.stderr: 95500K .......... .......... .......... .......... .......... 70% 46.3M 2s 2024-02-21T07:44:09.336 INFO:tasks.workunit.client.0.smithi069.stderr: 95550K .......... .......... .......... .......... .......... 70% 24.0M 2s 2024-02-21T07:44:09.337 INFO:tasks.workunit.client.0.smithi069.stderr: 95600K .......... .......... .......... .......... .......... 70% 32.1M 2s 2024-02-21T07:44:09.339 INFO:tasks.workunit.client.0.smithi069.stderr: 95650K .......... .......... .......... .......... .......... 70% 27.1M 2s 2024-02-21T07:44:09.341 INFO:tasks.workunit.client.0.smithi069.stderr: 95700K .......... .......... .......... .......... .......... 70% 25.5M 2s 2024-02-21T07:44:09.342 INFO:tasks.workunit.client.0.smithi069.stderr: 95750K .......... .......... .......... .......... .......... 70% 40.4M 2s 2024-02-21T07:44:09.344 INFO:tasks.workunit.client.0.smithi069.stderr: 95800K .......... .......... .......... .......... .......... 70% 26.8M 2s 2024-02-21T07:44:09.346 INFO:tasks.workunit.client.0.smithi069.stderr: 95850K .......... .......... .......... .......... .......... 70% 26.6M 2s 2024-02-21T07:44:09.348 INFO:tasks.workunit.client.0.smithi069.stderr: 95900K .......... .......... .......... .......... .......... 70% 27.7M 2s 2024-02-21T07:44:09.349 INFO:tasks.workunit.client.0.smithi069.stderr: 95950K .......... .......... .......... .......... .......... 70% 28.6M 2s 2024-02-21T07:44:09.350 INFO:tasks.workunit.client.0.smithi069.stderr: 96000K .......... .......... .......... .......... .......... 70% 38.9M 2s 2024-02-21T07:44:09.352 INFO:tasks.workunit.client.0.smithi069.stderr: 96050K .......... .......... .......... .......... .......... 70% 27.2M 2s 2024-02-21T07:44:09.354 INFO:tasks.workunit.client.0.smithi069.stderr: 96100K .......... .......... .......... .......... .......... 70% 29.0M 2s 2024-02-21T07:44:09.355 INFO:tasks.workunit.client.0.smithi069.stderr: 96150K .......... .......... .......... .......... .......... 70% 38.2M 2s 2024-02-21T07:44:09.357 INFO:tasks.workunit.client.0.smithi069.stderr: 96200K .......... .......... .......... .......... .......... 70% 24.8M 2s 2024-02-21T07:44:09.359 INFO:tasks.workunit.client.0.smithi069.stderr: 96250K .......... .......... .......... .......... .......... 70% 28.3M 2s 2024-02-21T07:44:09.361 INFO:tasks.workunit.client.0.smithi069.stderr: 96300K .......... .......... .......... .......... .......... 70% 27.4M 2s 2024-02-21T07:44:09.363 INFO:tasks.workunit.client.0.smithi069.stderr: 96350K .......... .......... .......... .......... .......... 71% 26.3M 2s 2024-02-21T07:44:09.364 INFO:tasks.workunit.client.0.smithi069.stderr: 96400K .......... .......... .......... .......... .......... 71% 39.9M 2s 2024-02-21T07:44:09.366 INFO:tasks.workunit.client.0.smithi069.stderr: 96450K .......... .......... .......... .......... .......... 71% 24.4M 2s 2024-02-21T07:44:09.368 INFO:tasks.workunit.client.0.smithi069.stderr: 96500K .......... .......... .......... .......... .......... 71% 30.9M 2s 2024-02-21T07:44:09.369 INFO:tasks.workunit.client.0.smithi069.stderr: 96550K .......... .......... .......... .......... .......... 71% 28.6M 2s 2024-02-21T07:44:09.372 INFO:tasks.workunit.client.0.smithi069.stderr: 96600K .......... .......... .......... .......... .......... 71% 25.0M 2s 2024-02-21T07:44:09.372 INFO:tasks.workunit.client.0.smithi069.stderr: 96650K .......... .......... .......... .......... .......... 71% 49.6M 2s 2024-02-21T07:44:09.375 INFO:tasks.workunit.client.0.smithi069.stderr: 96700K .......... .......... .......... .......... .......... 71% 20.3M 2s 2024-02-21T07:44:09.376 INFO:tasks.workunit.client.0.smithi069.stderr: 96750K .......... .......... .......... .......... .......... 71% 39.5M 2s 2024-02-21T07:44:09.378 INFO:tasks.workunit.client.0.smithi069.stderr: 96800K .......... .......... .......... .......... .......... 71% 25.7M 2s 2024-02-21T07:44:09.380 INFO:tasks.workunit.client.0.smithi069.stderr: 96850K .......... .......... .......... .......... .......... 71% 24.3M 2s 2024-02-21T07:44:09.381 INFO:tasks.workunit.client.0.smithi069.stderr: 96900K .......... .......... .......... .......... .......... 71% 44.1M 2s 2024-02-21T07:44:09.383 INFO:tasks.workunit.client.0.smithi069.stderr: 96950K .......... .......... .......... .......... .......... 71% 23.7M 2s 2024-02-21T07:44:09.385 INFO:tasks.workunit.client.0.smithi069.stderr: 97000K .......... .......... .......... .......... .......... 71% 29.1M 2s 2024-02-21T07:44:09.387 INFO:tasks.workunit.client.0.smithi069.stderr: 97050K .......... .......... .......... .......... .......... 71% 26.6M 2s 2024-02-21T07:44:09.388 INFO:tasks.workunit.client.0.smithi069.stderr: 97100K .......... .......... .......... .......... .......... 71% 42.2M 2s 2024-02-21T07:44:09.389 INFO:tasks.workunit.client.0.smithi069.stderr: 97150K .......... .......... .......... .......... .......... 71% 30.1M 2s 2024-02-21T07:44:09.391 INFO:tasks.workunit.client.0.smithi069.stderr: 97200K .......... .......... .......... .......... .......... 71% 25.3M 2s 2024-02-21T07:44:09.393 INFO:tasks.workunit.client.0.smithi069.stderr: 97250K .......... .......... .......... .......... .......... 71% 22.9M 2s 2024-02-21T07:44:09.396 INFO:tasks.workunit.client.0.smithi069.stderr: 97300K .......... .......... .......... .......... .......... 71% 24.9M 2s 2024-02-21T07:44:09.397 INFO:tasks.workunit.client.0.smithi069.stderr: 97350K .......... .......... .......... .......... .......... 71% 33.6M 2s 2024-02-21T07:44:09.398 INFO:tasks.workunit.client.0.smithi069.stderr: 97400K .......... .......... .......... .......... .......... 71% 42.2M 2s 2024-02-21T07:44:09.400 INFO:tasks.workunit.client.0.smithi069.stderr: 97450K .......... .......... .......... .......... .......... 71% 25.6M 2s 2024-02-21T07:44:09.401 INFO:tasks.workunit.client.0.smithi069.stderr: 97500K .......... .......... .......... .......... .......... 71% 27.5M 2s 2024-02-21T07:44:09.402 INFO:tasks.workunit.client.0.smithi069.stderr: 97550K .......... .......... .......... .......... .......... 71% 41.2M 2s 2024-02-21T07:44:09.405 INFO:tasks.workunit.client.0.smithi069.stderr: 97600K .......... .......... .......... .......... .......... 71% 21.5M 2s 2024-02-21T07:44:09.407 INFO:tasks.workunit.client.0.smithi069.stderr: 97650K .......... .......... .......... .......... .......... 71% 33.7M 2s 2024-02-21T07:44:09.408 INFO:tasks.workunit.client.0.smithi069.stderr: 97700K .......... .......... .......... .......... .......... 72% 27.0M 2s 2024-02-21T07:44:09.410 INFO:tasks.workunit.client.0.smithi069.stderr: 97750K .......... .......... .......... .......... .......... 72% 36.2M 2s 2024-02-21T07:44:09.411 INFO:tasks.workunit.client.0.smithi069.stderr: 97800K .......... .......... .......... .......... .......... 72% 28.4M 2s 2024-02-21T07:44:09.414 INFO:tasks.workunit.client.0.smithi069.stderr: 97850K .......... .......... .......... .......... .......... 72% 23.3M 2s 2024-02-21T07:44:09.415 INFO:tasks.workunit.client.0.smithi069.stderr: 97900K .......... .......... .......... .......... .......... 72% 34.4M 2s 2024-02-21T07:44:09.417 INFO:tasks.workunit.client.0.smithi069.stderr: 97950K .......... .......... .......... .......... .......... 72% 25.9M 2s 2024-02-21T07:44:09.418 INFO:tasks.workunit.client.0.smithi069.stderr: 98000K .......... .......... .......... .......... .......... 72% 35.4M 2s 2024-02-21T07:44:09.420 INFO:tasks.workunit.client.0.smithi069.stderr: 98050K .......... .......... .......... .......... .......... 72% 30.6M 2s 2024-02-21T07:44:09.422 INFO:tasks.workunit.client.0.smithi069.stderr: 98100K .......... .......... .......... .......... .......... 72% 30.3M 2s 2024-02-21T07:44:09.424 INFO:tasks.workunit.client.0.smithi069.stderr: 98150K .......... .......... .......... .......... .......... 72% 23.8M 2s 2024-02-21T07:44:09.426 INFO:tasks.workunit.client.0.smithi069.stderr: 98200K .......... .......... .......... .......... .......... 72% 25.3M 2s 2024-02-21T07:44:09.427 INFO:tasks.workunit.client.0.smithi069.stderr: 98250K .......... .......... .......... .......... .......... 72% 33.1M 2s 2024-02-21T07:44:09.429 INFO:tasks.workunit.client.0.smithi069.stderr: 98300K .......... .......... .......... .......... .......... 72% 24.3M 2s 2024-02-21T07:44:09.430 INFO:tasks.workunit.client.0.smithi069.stderr: 98350K .......... .......... .......... .......... .......... 72% 49.0M 2s 2024-02-21T07:44:09.437 INFO:tasks.workunit.client.0.smithi069.stderr: 98400K .......... .......... .......... .......... .......... 72% 22.9M 2s 2024-02-21T07:44:09.437 INFO:tasks.workunit.client.0.smithi069.stderr: 98450K .......... .......... .......... .......... .......... 72% 25.3M 2s 2024-02-21T07:44:09.437 INFO:tasks.workunit.client.0.smithi069.stderr: 98500K .......... .......... .......... .......... .......... 72% 37.4M 2s 2024-02-21T07:44:09.437 INFO:tasks.workunit.client.0.smithi069.stderr: 98550K .......... .......... .......... .......... .......... 72% 28.0M 2s 2024-02-21T07:44:09.439 INFO:tasks.workunit.client.0.smithi069.stderr: 98600K .......... .......... .......... .......... .......... 72% 24.1M 2s 2024-02-21T07:44:09.440 INFO:tasks.workunit.client.0.smithi069.stderr: 98650K .......... .......... .......... .......... .......... 72% 42.6M 2s 2024-02-21T07:44:09.441 INFO:tasks.workunit.client.0.smithi069.stderr: 98700K .......... .......... .......... .......... .......... 72% 33.6M 2s 2024-02-21T07:44:09.444 INFO:tasks.workunit.client.0.smithi069.stderr: 98750K .......... .......... .......... .......... .......... 72% 23.1M 2s 2024-02-21T07:44:09.445 INFO:tasks.workunit.client.0.smithi069.stderr: 98800K .......... .......... .......... .......... .......... 72% 39.9M 2s 2024-02-21T07:44:09.448 INFO:tasks.workunit.client.0.smithi069.stderr: 98850K .......... .......... .......... .......... .......... 72% 20.5M 2s 2024-02-21T07:44:09.448 INFO:tasks.workunit.client.0.smithi069.stderr: 98900K .......... .......... .......... .......... .......... 72% 62.2M 2s 2024-02-21T07:44:09.450 INFO:tasks.workunit.client.0.smithi069.stderr: 98950K .......... .......... .......... .......... .......... 72% 21.0M 2s 2024-02-21T07:44:09.452 INFO:tasks.workunit.client.0.smithi069.stderr: 99000K .......... .......... .......... .......... .......... 72% 33.5M 2s 2024-02-21T07:44:09.453 INFO:tasks.workunit.client.0.smithi069.stderr: 99050K .......... .......... .......... .......... .......... 73% 30.2M 2s 2024-02-21T07:44:09.456 INFO:tasks.workunit.client.0.smithi069.stderr: 99100K .......... .......... .......... .......... .......... 73% 20.9M 2s 2024-02-21T07:44:09.457 INFO:tasks.workunit.client.0.smithi069.stderr: 99150K .......... .......... .......... .......... .......... 73% 57.9M 2s 2024-02-21T07:44:09.459 INFO:tasks.workunit.client.0.smithi069.stderr: 99200K .......... .......... .......... .......... .......... 73% 24.1M 2s 2024-02-21T07:44:09.461 INFO:tasks.workunit.client.0.smithi069.stderr: 99250K .......... .......... .......... .......... .......... 73% 22.9M 2s 2024-02-21T07:44:09.462 INFO:tasks.workunit.client.0.smithi069.stderr: 99300K .......... .......... .......... .......... .......... 73% 39.7M 2s 2024-02-21T07:44:09.463 INFO:tasks.workunit.client.0.smithi069.stderr: 99350K .......... .......... .......... .......... .......... 73% 41.9M 2s 2024-02-21T07:44:09.465 INFO:tasks.workunit.client.0.smithi069.stderr: 99400K .......... .......... .......... .......... .......... 73% 25.4M 2s 2024-02-21T07:44:09.468 INFO:tasks.workunit.client.0.smithi069.stderr: 99450K .......... .......... .......... .......... .......... 73% 20.7M 2s 2024-02-21T07:44:09.469 INFO:tasks.workunit.client.0.smithi069.stderr: 99500K .......... .......... .......... .......... .......... 73% 31.8M 2s 2024-02-21T07:44:09.471 INFO:tasks.workunit.client.0.smithi069.stderr: 99550K .......... .......... .......... .......... .......... 73% 29.9M 2s 2024-02-21T07:44:09.473 INFO:tasks.workunit.client.0.smithi069.stderr: 99600K .......... .......... .......... .......... .......... 73% 25.8M 2s 2024-02-21T07:44:09.474 INFO:tasks.workunit.client.0.smithi069.stderr: 99650K .......... .......... .......... .......... .......... 73% 56.5M 2s 2024-02-21T07:44:09.475 INFO:tasks.workunit.client.0.smithi069.stderr: 99700K .......... .......... .......... .......... .......... 73% 22.8M 2s 2024-02-21T07:44:09.478 INFO:tasks.workunit.client.0.smithi069.stderr: 99750K .......... .......... .......... .......... .......... 73% 23.9M 2s 2024-02-21T07:44:09.478 INFO:tasks.workunit.client.0.smithi069.stderr: 99800K .......... .......... .......... .......... .......... 73% 55.1M 2s 2024-02-21T07:44:09.482 INFO:tasks.workunit.client.0.smithi069.stderr: 99850K .......... .......... .......... .......... .......... 73% 17.4M 2s 2024-02-21T07:44:09.482 INFO:tasks.workunit.client.0.smithi069.stderr: 99900K .......... .......... .......... .......... .......... 73% 63.3M 2s 2024-02-21T07:44:09.484 INFO:tasks.workunit.client.0.smithi069.stderr: 99950K .......... .......... .......... .......... .......... 73% 25.1M 2s 2024-02-21T07:44:09.485 INFO:tasks.workunit.client.0.smithi069.stderr:100000K .......... .......... .......... .......... .......... 73% 39.0M 2s 2024-02-21T07:44:09.487 INFO:tasks.workunit.client.0.smithi069.stderr:100050K .......... .......... .......... .......... .......... 73% 24.4M 2s 2024-02-21T07:44:09.490 INFO:tasks.workunit.client.0.smithi069.stderr:100100K .......... .......... .......... .......... .......... 73% 24.4M 2s 2024-02-21T07:44:09.490 INFO:tasks.workunit.client.0.smithi069.stderr:100150K .......... .......... .......... .......... .......... 73% 50.1M 2s 2024-02-21T07:44:09.492 INFO:tasks.workunit.client.0.smithi069.stderr:100200K .......... .......... .......... .......... .......... 73% 23.5M 2s 2024-02-21T07:44:09.494 INFO:tasks.workunit.client.0.smithi069.stderr:100250K .......... .......... .......... .......... .......... 73% 29.4M 2s 2024-02-21T07:44:09.496 INFO:tasks.workunit.client.0.smithi069.stderr:100300K .......... .......... .......... .......... .......... 73% 27.3M 2s 2024-02-21T07:44:09.498 INFO:tasks.workunit.client.0.smithi069.stderr:100350K .......... .......... .......... .......... .......... 73% 24.4M 2s 2024-02-21T07:44:09.498 INFO:tasks.workunit.client.0.smithi069.stderr:100400K .......... .......... .......... .......... .......... 73% 56.5M 2s 2024-02-21T07:44:09.500 INFO:tasks.workunit.client.0.smithi069.stderr:100450K .......... .......... .......... .......... .......... 74% 25.5M 1s 2024-02-21T07:44:09.502 INFO:tasks.workunit.client.0.smithi069.stderr:100500K .......... .......... .......... .......... .......... 74% 27.3M 1s 2024-02-21T07:44:09.505 INFO:tasks.workunit.client.0.smithi069.stderr:100550K .......... .......... .......... .......... .......... 74% 25.2M 1s 2024-02-21T07:44:09.506 INFO:tasks.workunit.client.0.smithi069.stderr:100600K .......... .......... .......... .......... .......... 74% 27.1M 1s 2024-02-21T07:44:09.507 INFO:tasks.workunit.client.0.smithi069.stderr:100650K .......... .......... .......... .......... .......... 74% 43.6M 1s 2024-02-21T07:44:09.509 INFO:tasks.workunit.client.0.smithi069.stderr:100700K .......... .......... .......... .......... .......... 74% 24.8M 1s 2024-02-21T07:44:09.511 INFO:tasks.workunit.client.0.smithi069.stderr:100750K .......... .......... .......... .......... .......... 74% 29.9M 1s 2024-02-21T07:44:09.513 INFO:tasks.workunit.client.0.smithi069.stderr:100800K .......... .......... .......... .......... .......... 74% 30.3M 1s 2024-02-21T07:44:09.514 INFO:tasks.workunit.client.0.smithi069.stderr:100850K .......... .......... .......... .......... .......... 74% 25.7M 1s 2024-02-21T07:44:09.515 INFO:tasks.workunit.client.0.smithi069.stderr:100900K .......... .......... .......... .......... .......... 74% 46.9M 1s 2024-02-21T07:44:09.518 INFO:tasks.workunit.client.0.smithi069.stderr:100950K .......... .......... .......... .......... .......... 74% 22.6M 1s 2024-02-21T07:44:09.519 INFO:tasks.workunit.client.0.smithi069.stderr:101000K .......... .......... .......... .......... .......... 74% 28.0M 1s 2024-02-21T07:44:09.521 INFO:tasks.workunit.client.0.smithi069.stderr:101050K .......... .......... .......... .......... .......... 74% 31.5M 1s 2024-02-21T07:44:09.522 INFO:tasks.workunit.client.0.smithi069.stderr:101100K .......... .......... .......... .......... .......... 74% 39.1M 1s 2024-02-21T07:44:09.524 INFO:tasks.workunit.client.0.smithi069.stderr:101150K .......... .......... .......... .......... .......... 74% 28.3M 1s 2024-02-21T07:44:09.526 INFO:tasks.workunit.client.0.smithi069.stderr:101200K .......... .......... .......... .......... .......... 74% 24.5M 1s 2024-02-21T07:44:09.528 INFO:tasks.workunit.client.0.smithi069.stderr:101250K .......... .......... .......... .......... .......... 74% 27.2M 1s 2024-02-21T07:44:09.529 INFO:tasks.workunit.client.0.smithi069.stderr:101300K .......... .......... .......... .......... .......... 74% 35.7M 1s 2024-02-21T07:44:09.531 INFO:tasks.workunit.client.0.smithi069.stderr:101350K .......... .......... .......... .......... .......... 74% 28.3M 1s 2024-02-21T07:44:09.532 INFO:tasks.workunit.client.0.smithi069.stderr:101400K .......... .......... .......... .......... .......... 74% 26.7M 1s 2024-02-21T07:44:09.534 INFO:tasks.workunit.client.0.smithi069.stderr:101450K .......... .......... .......... .......... .......... 74% 36.0M 1s 2024-02-21T07:44:09.536 INFO:tasks.workunit.client.0.smithi069.stderr:101500K .......... .......... .......... .......... .......... 74% 24.9M 1s 2024-02-21T07:44:09.538 INFO:tasks.workunit.client.0.smithi069.stderr:101550K .......... .......... .......... .......... .......... 74% 22.4M 1s 2024-02-21T07:44:09.538 INFO:tasks.workunit.client.0.smithi069.stderr:101600K .......... .......... .......... .......... .......... 74% 57.9M 1s 2024-02-21T07:44:09.540 INFO:tasks.workunit.client.0.smithi069.stderr:101650K .......... .......... .......... .......... .......... 74% 28.4M 1s 2024-02-21T07:44:09.542 INFO:tasks.workunit.client.0.smithi069.stderr:101700K .......... .......... .......... .......... .......... 74% 23.7M 1s 2024-02-21T07:44:09.545 INFO:tasks.workunit.client.0.smithi069.stderr:101750K .......... .......... .......... .......... .......... 74% 24.5M 1s 2024-02-21T07:44:09.546 INFO:tasks.workunit.client.0.smithi069.stderr:101800K .......... .......... .......... .......... .......... 75% 44.6M 1s 2024-02-21T07:44:09.548 INFO:tasks.workunit.client.0.smithi069.stderr:101850K .......... .......... .......... .......... .......... 75% 21.8M 1s 2024-02-21T07:44:09.549 INFO:tasks.workunit.client.0.smithi069.stderr:101900K .......... .......... .......... .......... .......... 75% 49.8M 1s 2024-02-21T07:44:09.551 INFO:tasks.workunit.client.0.smithi069.stderr:101950K .......... .......... .......... .......... .......... 75% 23.3M 1s 2024-02-21T07:44:09.553 INFO:tasks.workunit.client.0.smithi069.stderr:102000K .......... .......... .......... .......... .......... 75% 32.5M 1s 2024-02-21T07:44:09.555 INFO:tasks.workunit.client.0.smithi069.stderr:102050K .......... .......... .......... .......... .......... 75% 25.7M 1s 2024-02-21T07:44:09.556 INFO:tasks.workunit.client.0.smithi069.stderr:102100K .......... .......... .......... .......... .......... 75% 30.0M 1s 2024-02-21T07:44:09.557 INFO:tasks.workunit.client.0.smithi069.stderr:102150K .......... .......... .......... .......... .......... 75% 37.2M 1s 2024-02-21T07:44:09.560 INFO:tasks.workunit.client.0.smithi069.stderr:102200K .......... .......... .......... .......... .......... 75% 24.4M 1s 2024-02-21T07:44:09.561 INFO:tasks.workunit.client.0.smithi069.stderr:102250K .......... .......... .......... .......... .......... 75% 24.8M 1s 2024-02-21T07:44:09.563 INFO:tasks.workunit.client.0.smithi069.stderr:102300K .......... .......... .......... .......... .......... 75% 33.6M 1s 2024-02-21T07:44:09.564 INFO:tasks.workunit.client.0.smithi069.stderr:102350K .......... .......... .......... .......... .......... 75% 25.3M 1s 2024-02-21T07:44:09.565 INFO:tasks.workunit.client.0.smithi069.stderr:102400K .......... .......... .......... .......... .......... 75% 45.3M 1s 2024-02-21T07:44:09.568 INFO:tasks.workunit.client.0.smithi069.stderr:102450K .......... .......... .......... .......... .......... 75% 23.3M 1s 2024-02-21T07:44:09.570 INFO:tasks.workunit.client.0.smithi069.stderr:102500K .......... .......... .......... .......... .......... 75% 26.4M 1s 2024-02-21T07:44:09.571 INFO:tasks.workunit.client.0.smithi069.stderr:102550K .......... .......... .......... .......... .......... 75% 47.1M 1s 2024-02-21T07:44:09.572 INFO:tasks.workunit.client.0.smithi069.stderr:102600K .......... .......... .......... .......... .......... 75% 25.4M 1s 2024-02-21T07:44:09.574 INFO:tasks.workunit.client.0.smithi069.stderr:102650K .......... .......... .......... .......... .......... 75% 31.4M 1s 2024-02-21T07:44:09.576 INFO:tasks.workunit.client.0.smithi069.stderr:102700K .......... .......... .......... .......... .......... 75% 26.0M 1s 2024-02-21T07:44:09.578 INFO:tasks.workunit.client.0.smithi069.stderr:102750K .......... .......... .......... .......... .......... 75% 24.4M 1s 2024-02-21T07:44:09.579 INFO:tasks.workunit.client.0.smithi069.stderr:102800K .......... .......... .......... .......... .......... 75% 44.5M 1s 2024-02-21T07:44:09.581 INFO:tasks.workunit.client.0.smithi069.stderr:102850K .......... .......... .......... .......... .......... 75% 24.8M 1s 2024-02-21T07:44:09.582 INFO:tasks.workunit.client.0.smithi069.stderr:102900K .......... .......... .......... .......... .......... 75% 34.4M 1s 2024-02-21T07:44:09.584 INFO:tasks.workunit.client.0.smithi069.stderr:102950K .......... .......... .......... .......... .......... 75% 24.5M 1s 2024-02-21T07:44:09.586 INFO:tasks.workunit.client.0.smithi069.stderr:103000K .......... .......... .......... .......... .......... 75% 27.1M 1s 2024-02-21T07:44:09.588 INFO:tasks.workunit.client.0.smithi069.stderr:103050K .......... .......... .......... .......... .......... 75% 36.9M 1s 2024-02-21T07:44:09.590 INFO:tasks.workunit.client.0.smithi069.stderr:103100K .......... .......... .......... .......... .......... 75% 25.1M 1s 2024-02-21T07:44:09.593 INFO:tasks.workunit.client.0.smithi069.stderr:103150K .......... .......... .......... .......... .......... 76% 19.9M 1s 2024-02-21T07:44:09.593 INFO:tasks.workunit.client.0.smithi069.stderr:103200K .......... .......... .......... .......... .......... 76% 33.0M 1s 2024-02-21T07:44:09.598 INFO:tasks.workunit.client.0.smithi069.stderr:103250K .......... .......... .......... .......... .......... 76% 12.8M 1s 2024-02-21T07:44:09.598 INFO:tasks.workunit.client.0.smithi069.stderr:103300K .......... .......... .......... .......... .......... 76% 65.5M 1s 2024-02-21T07:44:09.600 INFO:tasks.workunit.client.0.smithi069.stderr:103350K .......... .......... .......... .......... .......... 76% 62.1M 1s 2024-02-21T07:44:09.605 INFO:tasks.workunit.client.0.smithi069.stderr:103400K .......... .......... .......... .......... .......... 76% 74.4M 1s 2024-02-21T07:44:09.605 INFO:tasks.workunit.client.0.smithi069.stderr:103450K .......... .......... .......... .......... .......... 76% 9.27M 1s 2024-02-21T07:44:09.606 INFO:tasks.workunit.client.0.smithi069.stderr:103500K .......... .......... .......... .......... .......... 76% 74.3M 1s 2024-02-21T07:44:09.607 INFO:tasks.workunit.client.0.smithi069.stderr:103550K .......... .......... .......... .......... .......... 76% 28.8M 1s 2024-02-21T07:44:09.611 INFO:tasks.workunit.client.0.smithi069.stderr:103600K .......... .......... .......... .......... .......... 76% 13.0M 1s 2024-02-21T07:44:09.613 INFO:tasks.workunit.client.0.smithi069.stderr:103650K .......... .......... .......... .......... .......... 76% 24.3M 1s 2024-02-21T07:44:09.614 INFO:tasks.workunit.client.0.smithi069.stderr:103700K .......... .......... .......... .......... .......... 76% 27.0M 1s 2024-02-21T07:44:09.618 INFO:tasks.workunit.client.0.smithi069.stderr:103750K .......... .......... .......... .......... .......... 76% 13.9M 1s 2024-02-21T07:44:09.621 INFO:tasks.workunit.client.0.smithi069.stderr:103800K .......... .......... .......... .......... .......... 76% 20.4M 1s 2024-02-21T07:44:09.623 INFO:tasks.workunit.client.0.smithi069.stderr:103850K .......... .......... .......... .......... .......... 76% 19.8M 1s 2024-02-21T07:44:09.626 INFO:tasks.workunit.client.0.smithi069.stderr:103900K .......... .......... .......... .......... .......... 76% 17.3M 1s 2024-02-21T07:44:09.628 INFO:tasks.workunit.client.0.smithi069.stderr:103950K .......... .......... .......... .......... .......... 76% 25.8M 1s 2024-02-21T07:44:09.631 INFO:tasks.workunit.client.0.smithi069.stderr:104000K .......... .......... .......... .......... .......... 76% 15.9M 1s 2024-02-21T07:44:09.634 INFO:tasks.workunit.client.0.smithi069.stderr:104050K .......... .......... .......... .......... .......... 76% 16.6M 1s 2024-02-21T07:44:09.643 INFO:tasks.workunit.client.0.smithi069.stderr:104100K .......... .......... .......... .......... .......... 76% 17.6M 1s 2024-02-21T07:44:09.643 INFO:tasks.workunit.client.0.smithi069.stderr:104150K .......... .......... .......... .......... .......... 76% 17.5M 1s 2024-02-21T07:44:09.643 INFO:tasks.workunit.client.0.smithi069.stderr:104200K .......... .......... .......... .......... .......... 76% 28.3M 1s 2024-02-21T07:44:09.644 INFO:tasks.workunit.client.0.smithi069.stderr:104250K .......... .......... .......... .......... .......... 76% 16.0M 1s 2024-02-21T07:44:09.646 INFO:tasks.workunit.client.0.smithi069.stderr:104300K .......... .......... .......... .......... .......... 76% 28.2M 1s 2024-02-21T07:44:09.650 INFO:tasks.workunit.client.0.smithi069.stderr:104350K .......... .......... .......... .......... .......... 76% 13.3M 1s 2024-02-21T07:44:09.653 INFO:tasks.workunit.client.0.smithi069.stderr:104400K .......... .......... .......... .......... .......... 76% 15.1M 1s 2024-02-21T07:44:09.655 INFO:tasks.workunit.client.0.smithi069.stderr:104450K .......... .......... .......... .......... .......... 76% 24.6M 1s 2024-02-21T07:44:09.658 INFO:tasks.workunit.client.0.smithi069.stderr:104500K .......... .......... .......... .......... .......... 77% 13.9M 1s 2024-02-21T07:44:09.660 INFO:tasks.workunit.client.0.smithi069.stderr:104550K .......... .......... .......... .......... .......... 77% 20.7M 1s 2024-02-21T07:44:09.665 INFO:tasks.workunit.client.0.smithi069.stderr:104600K .......... .......... .......... .......... .......... 77% 11.1M 1s 2024-02-21T07:44:09.670 INFO:tasks.workunit.client.0.smithi069.stderr:104650K .......... .......... .......... .......... .......... 77% 10.0M 1s 2024-02-21T07:44:09.671 INFO:tasks.workunit.client.0.smithi069.stderr:104700K .......... .......... .......... .......... .......... 77% 29.6M 1s 2024-02-21T07:44:09.674 INFO:tasks.workunit.client.0.smithi069.stderr:104750K .......... .......... .......... .......... .......... 77% 21.7M 1s 2024-02-21T07:44:09.675 INFO:tasks.workunit.client.0.smithi069.stderr:104800K .......... .......... .......... .......... .......... 77% 26.9M 1s 2024-02-21T07:44:09.678 INFO:tasks.workunit.client.0.smithi069.stderr:104850K .......... .......... .......... .......... .......... 77% 24.2M 1s 2024-02-21T07:44:09.680 INFO:tasks.workunit.client.0.smithi069.stderr:104900K .......... .......... .......... .......... .......... 77% 24.1M 1s 2024-02-21T07:44:09.681 INFO:tasks.workunit.client.0.smithi069.stderr:104950K .......... .......... .......... .......... .......... 77% 27.6M 1s 2024-02-21T07:44:09.683 INFO:tasks.workunit.client.0.smithi069.stderr:105000K .......... .......... .......... .......... .......... 77% 26.4M 1s 2024-02-21T07:44:09.684 INFO:tasks.workunit.client.0.smithi069.stderr:105050K .......... .......... .......... .......... .......... 77% 43.7M 1s 2024-02-21T07:44:09.686 INFO:tasks.workunit.client.0.smithi069.stderr:105100K .......... .......... .......... .......... .......... 77% 30.4M 1s 2024-02-21T07:44:09.687 INFO:tasks.workunit.client.0.smithi069.stderr:105150K .......... .......... .......... .......... .......... 77% 56.8M 1s 2024-02-21T07:44:09.688 INFO:tasks.workunit.client.0.smithi069.stderr:105200K .......... .......... .......... .......... .......... 77% 42.0M 1s 2024-02-21T07:44:09.689 INFO:tasks.workunit.client.0.smithi069.stderr:105250K .......... .......... .......... .......... .......... 77% 33.0M 1s 2024-02-21T07:44:09.690 INFO:tasks.workunit.client.0.smithi069.stderr:105300K .......... .......... .......... .......... .......... 77% 41.8M 1s 2024-02-21T07:44:09.694 INFO:tasks.workunit.client.0.smithi069.stderr:105350K .......... .......... .......... .......... .......... 77% 15.2M 1s 2024-02-21T07:44:09.697 INFO:tasks.workunit.client.0.smithi069.stderr:105400K .......... .......... .......... .......... .......... 77% 20.1M 1s 2024-02-21T07:44:09.698 INFO:tasks.workunit.client.0.smithi069.stderr:105450K .......... .......... .......... .......... .......... 77% 33.1M 1s 2024-02-21T07:44:09.700 INFO:tasks.workunit.client.0.smithi069.stderr:105500K .......... .......... .......... .......... .......... 77% 18.4M 1s 2024-02-21T07:44:09.701 INFO:tasks.workunit.client.0.smithi069.stderr:105550K .......... .......... .......... .......... .......... 77% 35.7M 1s 2024-02-21T07:44:09.705 INFO:tasks.workunit.client.0.smithi069.stderr:105600K .......... .......... .......... .......... .......... 77% 16.2M 1s 2024-02-21T07:44:09.706 INFO:tasks.workunit.client.0.smithi069.stderr:105650K .......... .......... .......... .......... .......... 77% 28.9M 1s 2024-02-21T07:44:09.708 INFO:tasks.workunit.client.0.smithi069.stderr:105700K .......... .......... .......... .......... .......... 77% 28.7M 1s 2024-02-21T07:44:09.711 INFO:tasks.workunit.client.0.smithi069.stderr:105750K .......... .......... .......... .......... .......... 77% 17.2M 1s 2024-02-21T07:44:09.713 INFO:tasks.workunit.client.0.smithi069.stderr:105800K .......... .......... .......... .......... .......... 77% 23.4M 1s 2024-02-21T07:44:09.716 INFO:tasks.workunit.client.0.smithi069.stderr:105850K .......... .......... .......... .......... .......... 78% 17.7M 1s 2024-02-21T07:44:09.720 INFO:tasks.workunit.client.0.smithi069.stderr:105900K .......... .......... .......... .......... .......... 78% 12.1M 1s 2024-02-21T07:44:09.722 INFO:tasks.workunit.client.0.smithi069.stderr:105950K .......... .......... .......... .......... .......... 78% 27.0M 1s 2024-02-21T07:44:09.724 INFO:tasks.workunit.client.0.smithi069.stderr:106000K .......... .......... .......... .......... .......... 78% 19.3M 1s 2024-02-21T07:44:09.726 INFO:tasks.workunit.client.0.smithi069.stderr:106050K .......... .......... .......... .......... .......... 78% 37.0M 1s 2024-02-21T07:44:09.727 INFO:tasks.workunit.client.0.smithi069.stderr:106100K .......... .......... .......... .......... .......... 78% 26.3M 1s 2024-02-21T07:44:09.729 INFO:tasks.workunit.client.0.smithi069.stderr:106150K .......... .......... .......... .......... .......... 78% 32.7M 1s 2024-02-21T07:44:09.730 INFO:tasks.workunit.client.0.smithi069.stderr:106200K .......... .......... .......... .......... .......... 78% 31.9M 1s 2024-02-21T07:44:09.732 INFO:tasks.workunit.client.0.smithi069.stderr:106250K .......... .......... .......... .......... .......... 78% 30.9M 1s 2024-02-21T07:44:09.733 INFO:tasks.workunit.client.0.smithi069.stderr:106300K .......... .......... .......... .......... .......... 78% 31.2M 1s 2024-02-21T07:44:09.735 INFO:tasks.workunit.client.0.smithi069.stderr:106350K .......... .......... .......... .......... .......... 78% 29.0M 1s 2024-02-21T07:44:09.737 INFO:tasks.workunit.client.0.smithi069.stderr:106400K .......... .......... .......... .......... .......... 78% 30.9M 1s 2024-02-21T07:44:09.738 INFO:tasks.workunit.client.0.smithi069.stderr:106450K .......... .......... .......... .......... .......... 78% 37.6M 1s 2024-02-21T07:44:09.740 INFO:tasks.workunit.client.0.smithi069.stderr:106500K .......... .......... .......... .......... .......... 78% 26.6M 1s 2024-02-21T07:44:09.741 INFO:tasks.workunit.client.0.smithi069.stderr:106550K .......... .......... .......... .......... .......... 78% 29.2M 1s 2024-02-21T07:44:09.743 INFO:tasks.workunit.client.0.smithi069.stderr:106600K .......... .......... .......... .......... .......... 78% 36.4M 1s 2024-02-21T07:44:09.745 INFO:tasks.workunit.client.0.smithi069.stderr:106650K .......... .......... .......... .......... .......... 78% 29.0M 1s 2024-02-21T07:44:09.746 INFO:tasks.workunit.client.0.smithi069.stderr:106700K .......... .......... .......... .......... .......... 78% 31.1M 1s 2024-02-21T07:44:09.748 INFO:tasks.workunit.client.0.smithi069.stderr:106750K .......... .......... .......... .......... .......... 78% 30.8M 1s 2024-02-21T07:44:09.749 INFO:tasks.workunit.client.0.smithi069.stderr:106800K .......... .......... .......... .......... .......... 78% 36.1M 1s 2024-02-21T07:44:09.752 INFO:tasks.workunit.client.0.smithi069.stderr:106850K .......... .......... .......... .......... .......... 78% 24.4M 1s 2024-02-21T07:44:09.752 INFO:tasks.workunit.client.0.smithi069.stderr:106900K .......... .......... .......... .......... .......... 78% 41.4M 1s 2024-02-21T07:44:09.754 INFO:tasks.workunit.client.0.smithi069.stderr:106950K .......... .......... .......... .......... .......... 78% 34.2M 1s 2024-02-21T07:44:09.755 INFO:tasks.workunit.client.0.smithi069.stderr:107000K .......... .......... .......... .......... .......... 78% 36.4M 1s 2024-02-21T07:44:09.756 INFO:tasks.workunit.client.0.smithi069.stderr:107050K .......... .......... .......... .......... .......... 78% 36.4M 1s 2024-02-21T07:44:09.758 INFO:tasks.workunit.client.0.smithi069.stderr:107100K .......... .......... .......... .......... .......... 78% 35.0M 1s 2024-02-21T07:44:09.759 INFO:tasks.workunit.client.0.smithi069.stderr:107150K .......... .......... .......... .......... .......... 78% 40.8M 1s 2024-02-21T07:44:09.760 INFO:tasks.workunit.client.0.smithi069.stderr:107200K .......... .......... .......... .......... .......... 79% 38.6M 1s 2024-02-21T07:44:09.763 INFO:tasks.workunit.client.0.smithi069.stderr:107250K .......... .......... .......... .......... .......... 79% 28.8M 1s 2024-02-21T07:44:09.763 INFO:tasks.workunit.client.0.smithi069.stderr:107300K .......... .......... .......... .......... .......... 79% 53.7M 1s 2024-02-21T07:44:09.764 INFO:tasks.workunit.client.0.smithi069.stderr:107350K .......... .......... .......... .......... .......... 79% 29.0M 1s 2024-02-21T07:44:09.766 INFO:tasks.workunit.client.0.smithi069.stderr:107400K .......... .......... .......... .......... .......... 79% 41.7M 1s 2024-02-21T07:44:09.767 INFO:tasks.workunit.client.0.smithi069.stderr:107450K .......... .......... .......... .......... .......... 79% 39.6M 1s 2024-02-21T07:44:09.769 INFO:tasks.workunit.client.0.smithi069.stderr:107500K .......... .......... .......... .......... .......... 79% 27.8M 1s 2024-02-21T07:44:09.771 INFO:tasks.workunit.client.0.smithi069.stderr:107550K .......... .......... .......... .......... .......... 79% 25.2M 1s 2024-02-21T07:44:09.773 INFO:tasks.workunit.client.0.smithi069.stderr:107600K .......... .......... .......... .......... .......... 79% 22.6M 1s 2024-02-21T07:44:09.777 INFO:tasks.workunit.client.0.smithi069.stderr:107650K .......... .......... .......... .......... .......... 79% 14.1M 1s 2024-02-21T07:44:09.777 INFO:tasks.workunit.client.0.smithi069.stderr:107700K .......... .......... .......... .......... .......... 79% 46.5M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:107750K .......... .......... .......... .......... .......... 79% 32.3M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:107800K .......... .......... .......... .......... .......... 79% 56.9M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:107850K .......... .......... .......... .......... .......... 79% 70.8M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:107900K .......... .......... .......... .......... .......... 79% 70.4M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:107950K .......... .......... .......... .......... .......... 79% 68.2M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:108000K .......... .......... .......... .......... .......... 79% 55.8M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:108050K .......... .......... .......... .......... .......... 79% 71.3M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:108100K .......... .......... .......... .......... .......... 79% 74.6M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:108150K .......... .......... .......... .......... .......... 79% 71.7M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:108200K .......... .......... .......... .......... .......... 79% 61.4M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:108250K .......... .......... .......... .......... .......... 79% 74.2M 1s 2024-02-21T07:44:09.806 INFO:tasks.workunit.client.0.smithi069.stderr:108300K .......... .......... .......... .......... .......... 79% 77.6M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108350K .......... .......... .......... .......... .......... 79% 76.5M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108400K .......... .......... .......... .......... .......... 79% 68.4M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108450K .......... .......... .......... .......... .......... 79% 77.2M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108500K .......... .......... .......... .......... .......... 79% 77.1M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108550K .......... .......... .......... .......... .......... 79% 80.6M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108600K .......... .......... .......... .......... .......... 80% 58.7M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108650K .......... .......... .......... .......... .......... 80% 81.9M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108700K .......... .......... .......... .......... .......... 80% 86.1M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108750K .......... .......... .......... .......... .......... 80% 83.6M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108800K .......... .......... .......... .......... .......... 80% 76.6M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108850K .......... .......... .......... .......... .......... 80% 82.7M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108900K .......... .......... .......... .......... .......... 80% 96.2M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:108950K .......... .......... .......... .......... .......... 80% 95.2M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:109000K .......... .......... .......... .......... .......... 80% 88.8M 1s 2024-02-21T07:44:09.807 INFO:tasks.workunit.client.0.smithi069.stderr:109050K .......... .......... .......... .......... .......... 80% 93.7M 1s 2024-02-21T07:44:09.808 INFO:tasks.workunit.client.0.smithi069.stderr:109100K .......... .......... .......... .......... .......... 80% 90.9M 1s 2024-02-21T07:44:09.808 INFO:tasks.workunit.client.0.smithi069.stderr:109150K .......... .......... .......... .......... .......... 80% 95.4M 1s 2024-02-21T07:44:09.808 INFO:tasks.workunit.client.0.smithi069.stderr:109200K .......... .......... .......... .......... .......... 80% 78.0M 1s 2024-02-21T07:44:09.808 INFO:tasks.workunit.client.0.smithi069.stderr:109250K .......... .......... .......... .......... .......... 80% 93.7M 1s 2024-02-21T07:44:09.808 INFO:tasks.workunit.client.0.smithi069.stderr:109300K .......... .......... .......... .......... .......... 80% 103M 1s 2024-02-21T07:44:09.808 INFO:tasks.workunit.client.0.smithi069.stderr:109350K .......... .......... .......... .......... .......... 80% 40.9M 1s 2024-02-21T07:44:09.808 INFO:tasks.workunit.client.0.smithi069.stderr:109400K .......... .......... .......... .......... .......... 80% 40.2M 1s 2024-02-21T07:44:09.808 INFO:tasks.workunit.client.0.smithi069.stderr:109450K .......... .......... .......... .......... .......... 80% 22.6M 1s 2024-02-21T07:44:09.808 INFO:tasks.workunit.client.0.smithi069.stderr:109500K .......... .......... .......... .......... .......... 80% 38.0M 1s 2024-02-21T07:44:09.811 INFO:tasks.workunit.client.0.smithi069.stderr:109550K .......... .......... .......... .......... .......... 80% 24.8M 1s 2024-02-21T07:44:09.811 INFO:tasks.workunit.client.0.smithi069.stderr:109600K .......... .......... .......... .......... .......... 80% 24.8M 1s 2024-02-21T07:44:09.811 INFO:tasks.workunit.client.0.smithi069.stderr:109650K .......... .......... .......... .......... .......... 80% 45.0M 1s 2024-02-21T07:44:09.812 INFO:tasks.workunit.client.0.smithi069.stderr:109700K .......... .......... .......... .......... .......... 80% 26.5M 1s 2024-02-21T07:44:09.813 INFO:tasks.workunit.client.0.smithi069.stderr:109750K .......... .......... .......... .......... .......... 80% 25.8M 1s 2024-02-21T07:44:09.815 INFO:tasks.workunit.client.0.smithi069.stderr:109800K .......... .......... .......... .......... .......... 80% 32.8M 1s 2024-02-21T07:44:09.817 INFO:tasks.workunit.client.0.smithi069.stderr:109850K .......... .......... .......... .......... .......... 80% 26.6M 1s 2024-02-21T07:44:09.818 INFO:tasks.workunit.client.0.smithi069.stderr:109900K .......... .......... .......... .......... .......... 80% 36.7M 1s 2024-02-21T07:44:09.820 INFO:tasks.workunit.client.0.smithi069.stderr:109950K .......... .......... .......... .......... .......... 81% 23.8M 1s 2024-02-21T07:44:09.822 INFO:tasks.workunit.client.0.smithi069.stderr:110000K .......... .......... .......... .......... .......... 81% 24.5M 1s 2024-02-21T07:44:09.823 INFO:tasks.workunit.client.0.smithi069.stderr:110050K .......... .......... .......... .......... .......... 81% 49.2M 1s 2024-02-21T07:44:09.825 INFO:tasks.workunit.client.0.smithi069.stderr:110100K .......... .......... .......... .......... .......... 81% 24.4M 1s 2024-02-21T07:44:09.827 INFO:tasks.workunit.client.0.smithi069.stderr:110150K .......... .......... .......... .......... .......... 81% 23.1M 1s 2024-02-21T07:44:09.829 INFO:tasks.workunit.client.0.smithi069.stderr:110200K .......... .......... .......... .......... .......... 81% 30.1M 1s 2024-02-21T07:44:09.829 INFO:tasks.workunit.client.0.smithi069.stderr:110250K .......... .......... .......... .......... .......... 81% 62.3M 1s 2024-02-21T07:44:09.832 INFO:tasks.workunit.client.0.smithi069.stderr:110300K .......... .......... .......... .......... .......... 81% 22.3M 1s 2024-02-21T07:44:09.834 INFO:tasks.workunit.client.0.smithi069.stderr:110350K .......... .......... .......... .......... .......... 81% 25.6M 1s 2024-02-21T07:44:09.837 INFO:tasks.workunit.client.0.smithi069.stderr:110400K .......... .......... .......... .......... .......... 81% 18.9M 1s 2024-02-21T07:44:09.838 INFO:tasks.workunit.client.0.smithi069.stderr:110450K .......... .......... .......... .......... .......... 81% 32.1M 1s 2024-02-21T07:44:09.838 INFO:tasks.workunit.client.0.smithi069.stderr:110500K .......... .......... .......... .......... .......... 81% 68.7M 1s 2024-02-21T07:44:09.844 INFO:tasks.workunit.client.0.smithi069.stderr:110550K .......... .......... .......... .......... .......... 81% 20.4M 1s 2024-02-21T07:44:09.844 INFO:tasks.workunit.client.0.smithi069.stderr:110600K .......... .......... .......... .......... .......... 81% 27.1M 1s 2024-02-21T07:44:09.849 INFO:tasks.workunit.client.0.smithi069.stderr:110650K .......... .......... .......... .......... .......... 81% 11.6M 1s 2024-02-21T07:44:09.849 INFO:tasks.workunit.client.0.smithi069.stderr:110700K .......... .......... .......... .......... .......... 81% 53.6M 1s 2024-02-21T07:44:09.849 INFO:tasks.workunit.client.0.smithi069.stderr:110750K .......... .......... .......... .......... .......... 81% 69.4M 1s 2024-02-21T07:44:09.870 INFO:tasks.workunit.client.0.smithi069.stderr:110800K .......... .......... .......... .......... .......... 81% 2.98M 1s 2024-02-21T07:44:09.871 INFO:tasks.workunit.client.0.smithi069.stderr:110850K .......... .......... .......... .......... .......... 81% 62.9M 1s 2024-02-21T07:44:09.871 INFO:tasks.workunit.client.0.smithi069.stderr:110900K .......... .......... .......... .......... .......... 81% 61.6M 1s 2024-02-21T07:44:09.871 INFO:tasks.workunit.client.0.smithi069.stderr:110950K .......... .......... .......... .......... .......... 81% 70.4M 1s 2024-02-21T07:44:09.871 INFO:tasks.workunit.client.0.smithi069.stderr:111000K .......... .......... .......... .......... .......... 81% 72.8M 1s 2024-02-21T07:44:09.871 INFO:tasks.workunit.client.0.smithi069.stderr:111050K .......... .......... .......... .......... .......... 81% 66.0M 1s 2024-02-21T07:44:09.871 INFO:tasks.workunit.client.0.smithi069.stderr:111100K .......... .......... .......... .......... .......... 81% 79.3M 1s 2024-02-21T07:44:09.883 INFO:tasks.workunit.client.0.smithi069.stderr:111150K .......... .......... .......... .......... .......... 81% 6.04M 1s 2024-02-21T07:44:09.883 INFO:tasks.workunit.client.0.smithi069.stderr:111200K .......... .......... .......... .......... .......... 81% 59.3M 1s 2024-02-21T07:44:09.883 INFO:tasks.workunit.client.0.smithi069.stderr:111250K .......... .......... .......... .......... .......... 81% 66.2M 1s 2024-02-21T07:44:09.883 INFO:tasks.workunit.client.0.smithi069.stderr:111300K .......... .......... .......... .......... .......... 82% 65.7M 1s 2024-02-21T07:44:09.883 INFO:tasks.workunit.client.0.smithi069.stderr:111350K .......... .......... .......... .......... .......... 82% 59.8M 1s 2024-02-21T07:44:09.883 INFO:tasks.workunit.client.0.smithi069.stderr:111400K .......... .......... .......... .......... .......... 82% 74.1M 1s 2024-02-21T07:44:09.883 INFO:tasks.workunit.client.0.smithi069.stderr:111450K .......... .......... .......... .......... .......... 82% 80.0M 1s 2024-02-21T07:44:09.883 INFO:tasks.workunit.client.0.smithi069.stderr:111500K .......... .......... .......... .......... .......... 82% 82.4M 1s 2024-02-21T07:44:09.891 INFO:tasks.workunit.client.0.smithi069.stderr:111550K .......... .......... .......... .......... .......... 82% 6.92M 1s 2024-02-21T07:44:09.891 INFO:tasks.workunit.client.0.smithi069.stderr:111600K .......... .......... .......... .......... .......... 82% 63.3M 1s 2024-02-21T07:44:09.891 INFO:tasks.workunit.client.0.smithi069.stderr:111650K .......... .......... .......... .......... .......... 82% 78.6M 1s 2024-02-21T07:44:09.900 INFO:tasks.workunit.client.0.smithi069.stderr:111700K .......... .......... .......... .......... .......... 82% 5.91M 1s 2024-02-21T07:44:09.900 INFO:tasks.workunit.client.0.smithi069.stderr:111750K .......... .......... .......... .......... .......... 82% 60.2M 1s 2024-02-21T07:44:09.913 INFO:tasks.workunit.client.0.smithi069.stderr:111800K .......... .......... .......... .......... .......... 82% 5.23M 1s 2024-02-21T07:44:09.913 INFO:tasks.workunit.client.0.smithi069.stderr:111850K .......... .......... .......... .......... .......... 82% 61.8M 1s 2024-02-21T07:44:09.913 INFO:tasks.workunit.client.0.smithi069.stderr:111900K .......... .......... .......... .......... .......... 82% 60.3M 1s 2024-02-21T07:44:09.913 INFO:tasks.workunit.client.0.smithi069.stderr:111950K .......... .......... .......... .......... .......... 82% 64.8M 1s 2024-02-21T07:44:09.913 INFO:tasks.workunit.client.0.smithi069.stderr:112000K .......... .......... .......... .......... .......... 82% 82.0M 1s 2024-02-21T07:44:09.921 INFO:tasks.workunit.client.0.smithi069.stderr:112050K .......... .......... .......... .......... .......... 82% 6.36M 1s 2024-02-21T07:44:09.921 INFO:tasks.workunit.client.0.smithi069.stderr:112100K .......... .......... .......... .......... .......... 82% 60.9M 1s 2024-02-21T07:44:09.921 INFO:tasks.workunit.client.0.smithi069.stderr:112150K .......... .......... .......... .......... .......... 82% 67.9M 1s 2024-02-21T07:44:09.931 INFO:tasks.workunit.client.0.smithi069.stderr:112200K .......... .......... .......... .......... .......... 82% 5.94M 1s 2024-02-21T07:44:09.931 INFO:tasks.workunit.client.0.smithi069.stderr:112250K .......... .......... .......... .......... .......... 82% 68.9M 1s 2024-02-21T07:44:09.931 INFO:tasks.workunit.client.0.smithi069.stderr:112300K .......... .......... .......... .......... .......... 82% 78.1M 1s 2024-02-21T07:44:09.945 INFO:tasks.workunit.client.0.smithi069.stderr:112350K .......... .......... .......... .......... .......... 82% 3.85M 1s 2024-02-21T07:44:09.945 INFO:tasks.workunit.client.0.smithi069.stderr:112400K .......... .......... .......... .......... .......... 82% 48.8M 1s 2024-02-21T07:44:09.945 INFO:tasks.workunit.client.0.smithi069.stderr:112450K .......... .......... .......... .......... .......... 82% 51.8M 1s 2024-02-21T07:44:09.952 INFO:tasks.workunit.client.0.smithi069.stderr:112500K .......... .......... .......... .......... .......... 82% 52.8M 1s 2024-02-21T07:44:09.953 INFO:tasks.workunit.client.0.smithi069.stderr:112550K .......... .......... .......... .......... .......... 82% 69.1M 1s 2024-02-21T07:44:09.953 INFO:tasks.workunit.client.0.smithi069.stderr:112600K .......... .......... .......... .......... .......... 82% 75.0M 1s 2024-02-21T07:44:09.953 INFO:tasks.workunit.client.0.smithi069.stderr:112650K .......... .......... .......... .......... .......... 83% 62.8M 1s 2024-02-21T07:44:09.953 INFO:tasks.workunit.client.0.smithi069.stderr:112700K .......... .......... .......... .......... .......... 83% 81.4M 1s 2024-02-21T07:44:09.953 INFO:tasks.workunit.client.0.smithi069.stderr:112750K .......... .......... .......... .......... .......... 83% 64.3M 1s 2024-02-21T07:44:09.953 INFO:tasks.workunit.client.0.smithi069.stderr:112800K .......... .......... .......... .......... .......... 83% 72.2M 1s 2024-02-21T07:44:09.953 INFO:tasks.workunit.client.0.smithi069.stderr:112850K .......... .......... .......... .......... .......... 83% 24.6M 1s 2024-02-21T07:44:09.955 INFO:tasks.workunit.client.0.smithi069.stderr:112900K .......... .......... .......... .......... .......... 83% 26.8M 1s 2024-02-21T07:44:09.956 INFO:tasks.workunit.client.0.smithi069.stderr:112950K .......... .......... .......... .......... .......... 83% 25.3M 1s 2024-02-21T07:44:09.957 INFO:tasks.workunit.client.0.smithi069.stderr:113000K .......... .......... .......... .......... .......... 83% 45.0M 1s 2024-02-21T07:44:09.959 INFO:tasks.workunit.client.0.smithi069.stderr:113050K .......... .......... .......... .......... .......... 83% 30.1M 1s 2024-02-21T07:44:09.961 INFO:tasks.workunit.client.0.smithi069.stderr:113100K .......... .......... .......... .......... .......... 83% 25.5M 1s 2024-02-21T07:44:09.963 INFO:tasks.workunit.client.0.smithi069.stderr:113150K .......... .......... .......... .......... .......... 83% 21.2M 1s 2024-02-21T07:44:09.966 INFO:tasks.workunit.client.0.smithi069.stderr:113200K .......... .......... .......... .......... .......... 83% 28.1M 1s 2024-02-21T07:44:09.966 INFO:tasks.workunit.client.0.smithi069.stderr:113250K .......... .......... .......... .......... .......... 83% 55.1M 1s 2024-02-21T07:44:09.968 INFO:tasks.workunit.client.0.smithi069.stderr:113300K .......... .......... .......... .......... .......... 83% 28.1M 1s 2024-02-21T07:44:09.970 INFO:tasks.workunit.client.0.smithi069.stderr:113350K .......... .......... .......... .......... .......... 83% 24.4M 1s 2024-02-21T07:44:09.972 INFO:tasks.workunit.client.0.smithi069.stderr:113400K .......... .......... .......... .......... .......... 83% 26.4M 1s 2024-02-21T07:44:09.972 INFO:tasks.workunit.client.0.smithi069.stderr:113450K .......... .......... .......... .......... .......... 83% 65.9M 1s 2024-02-21T07:44:09.974 INFO:tasks.workunit.client.0.smithi069.stderr:113500K .......... .......... .......... .......... .......... 83% 25.3M 1s 2024-02-21T07:44:09.976 INFO:tasks.workunit.client.0.smithi069.stderr:113550K .......... .......... .......... .......... .......... 83% 24.0M 1s 2024-02-21T07:44:09.979 INFO:tasks.workunit.client.0.smithi069.stderr:113600K .......... .......... .......... .......... .......... 83% 25.6M 1s 2024-02-21T07:44:09.981 INFO:tasks.workunit.client.0.smithi069.stderr:113650K .......... .......... .......... .......... .......... 83% 28.2M 1s 2024-02-21T07:44:09.981 INFO:tasks.workunit.client.0.smithi069.stderr:113700K .......... .......... .......... .......... .......... 83% 49.7M 1s 2024-02-21T07:44:09.983 INFO:tasks.workunit.client.0.smithi069.stderr:113750K .......... .......... .......... .......... .......... 83% 24.0M 1s 2024-02-21T07:44:09.985 INFO:tasks.workunit.client.0.smithi069.stderr:113800K .......... .......... .......... .......... .......... 83% 26.9M 1s 2024-02-21T07:44:09.987 INFO:tasks.workunit.client.0.smithi069.stderr:113850K .......... .......... .......... .......... .......... 83% 25.3M 1s 2024-02-21T07:44:09.989 INFO:tasks.workunit.client.0.smithi069.stderr:113900K .......... .......... .......... .......... .......... 83% 25.7M 1s 2024-02-21T07:44:09.989 INFO:tasks.workunit.client.0.smithi069.stderr:113950K .......... .......... .......... .......... .......... 83% 60.7M 1s 2024-02-21T07:44:09.991 INFO:tasks.workunit.client.0.smithi069.stderr:114000K .......... .......... .......... .......... .......... 84% 27.1M 1s 2024-02-21T07:44:09.993 INFO:tasks.workunit.client.0.smithi069.stderr:114050K .......... .......... .......... .......... .......... 84% 25.1M 1s 2024-02-21T07:44:09.995 INFO:tasks.workunit.client.0.smithi069.stderr:114100K .......... .......... .......... .......... .......... 84% 26.0M 1s 2024-02-21T07:44:09.995 INFO:tasks.workunit.client.0.smithi069.stderr:114150K .......... .......... .......... .......... .......... 84% 56.5M 1s 2024-02-21T07:44:09.998 INFO:tasks.workunit.client.0.smithi069.stderr:114200K .......... .......... .......... .......... .......... 84% 24.7M 1s 2024-02-21T07:44:10.000 INFO:tasks.workunit.client.0.smithi069.stderr:114250K .......... .......... .......... .......... .......... 84% 25.3M 1s 2024-02-21T07:44:10.002 INFO:tasks.workunit.client.0.smithi069.stderr:114300K .......... .......... .......... .......... .......... 84% 24.7M 1s 2024-02-21T07:44:10.004 INFO:tasks.workunit.client.0.smithi069.stderr:114350K .......... .......... .......... .......... .......... 84% 25.5M 1s 2024-02-21T07:44:10.004 INFO:tasks.workunit.client.0.smithi069.stderr:114400K .......... .......... .......... .......... .......... 84% 68.7M 1s 2024-02-21T07:44:10.006 INFO:tasks.workunit.client.0.smithi069.stderr:114450K .......... .......... .......... .......... .......... 84% 25.8M 1s 2024-02-21T07:44:10.008 INFO:tasks.workunit.client.0.smithi069.stderr:114500K .......... .......... .......... .......... .......... 84% 25.5M 1s 2024-02-21T07:44:10.011 INFO:tasks.workunit.client.0.smithi069.stderr:114550K .......... .......... .......... .......... .......... 84% 22.7M 1s 2024-02-21T07:44:10.011 INFO:tasks.workunit.client.0.smithi069.stderr:114600K .......... .......... .......... .......... .......... 84% 68.1M 1s 2024-02-21T07:44:10.013 INFO:tasks.workunit.client.0.smithi069.stderr:114650K .......... .......... .......... .......... .......... 84% 22.0M 1s 2024-02-21T07:44:10.015 INFO:tasks.workunit.client.0.smithi069.stderr:114700K .......... .......... .......... .......... .......... 84% 32.5M 1s 2024-02-21T07:44:10.015 INFO:tasks.workunit.client.0.smithi069.stderr:114750K .......... .......... .......... .......... .......... 84% 71.7M 1s 2024-02-21T07:44:10.018 INFO:tasks.workunit.client.0.smithi069.stderr:114800K .......... .......... .......... .......... .......... 84% 21.1M 1s 2024-02-21T07:44:10.020 INFO:tasks.workunit.client.0.smithi069.stderr:114850K .......... .......... .......... .......... .......... 84% 23.7M 1s 2024-02-21T07:44:10.022 INFO:tasks.workunit.client.0.smithi069.stderr:114900K .......... .......... .......... .......... .......... 84% 23.9M 1s 2024-02-21T07:44:10.024 INFO:tasks.workunit.client.0.smithi069.stderr:114950K .......... .......... .......... .......... .......... 84% 28.7M 1s 2024-02-21T07:44:10.026 INFO:tasks.workunit.client.0.smithi069.stderr:115000K .......... .......... .......... .......... .......... 84% 71.0M 1s 2024-02-21T07:44:10.026 INFO:tasks.workunit.client.0.smithi069.stderr:115050K .......... .......... .......... .......... .......... 84% 24.6M 1s 2024-02-21T07:44:10.028 INFO:tasks.workunit.client.0.smithi069.stderr:115100K .......... .......... .......... .......... .......... 84% 26.4M 1s 2024-02-21T07:44:10.030 INFO:tasks.workunit.client.0.smithi069.stderr:115150K .......... .......... .......... .......... .......... 84% 31.2M 1s 2024-02-21T07:44:10.033 INFO:tasks.workunit.client.0.smithi069.stderr:115200K .......... .......... .......... .......... .......... 84% 65.5M 1s 2024-02-21T07:44:10.033 INFO:tasks.workunit.client.0.smithi069.stderr:115250K .......... .......... .......... .......... .......... 84% 18.6M 1s 2024-02-21T07:44:10.035 INFO:tasks.workunit.client.0.smithi069.stderr:115300K .......... .......... .......... .......... .......... 84% 27.7M 1s 2024-02-21T07:44:10.037 INFO:tasks.workunit.client.0.smithi069.stderr:115350K .......... .......... .......... .......... .......... 85% 26.5M 1s 2024-02-21T07:44:10.039 INFO:tasks.workunit.client.0.smithi069.stderr:115400K .......... .......... .......... .......... .......... 85% 75.7M 1s 2024-02-21T07:44:10.039 INFO:tasks.workunit.client.0.smithi069.stderr:115450K .......... .......... .......... .......... .......... 85% 23.8M 1s 2024-02-21T07:44:10.041 INFO:tasks.workunit.client.0.smithi069.stderr:115500K .......... .......... .......... .......... .......... 85% 25.9M 1s 2024-02-21T07:44:10.043 INFO:tasks.workunit.client.0.smithi069.stderr:115550K .......... .......... .......... .......... .......... 85% 27.6M 1s 2024-02-21T07:44:10.051 INFO:tasks.workunit.client.0.smithi069.stderr:115600K .......... .......... .......... .......... .......... 85% 24.4M 1s 2024-02-21T07:44:10.051 INFO:tasks.workunit.client.0.smithi069.stderr:115650K .......... .......... .......... .......... .......... 85% 67.6M 1s 2024-02-21T07:44:10.052 INFO:tasks.workunit.client.0.smithi069.stderr:115700K .......... .......... .......... .......... .......... 85% 25.4M 1s 2024-02-21T07:44:10.052 INFO:tasks.workunit.client.0.smithi069.stderr:115750K .......... .......... .......... .......... .......... 85% 29.4M 1s 2024-02-21T07:44:10.052 INFO:tasks.workunit.client.0.smithi069.stderr:115800K .......... .......... .......... .......... .......... 85% 26.1M 1s 2024-02-21T07:44:10.054 INFO:tasks.workunit.client.0.smithi069.stderr:115850K .......... .......... .......... .......... .......... 85% 36.3M 1s 2024-02-21T07:44:10.055 INFO:tasks.workunit.client.0.smithi069.stderr:115900K .......... .......... .......... .......... .......... 85% 24.7M 1s 2024-02-21T07:44:10.057 INFO:tasks.workunit.client.0.smithi069.stderr:115950K .......... .......... .......... .......... .......... 85% 22.9M 1s 2024-02-21T07:44:10.057 INFO:tasks.workunit.client.0.smithi069.stderr:116000K .......... .......... .......... .......... .......... 85% 61.6M 1s 2024-02-21T07:44:10.059 INFO:tasks.workunit.client.0.smithi069.stderr:116050K .......... .......... .......... .......... .......... 85% 25.7M 1s 2024-02-21T07:44:10.061 INFO:tasks.workunit.client.0.smithi069.stderr:116100K .......... .......... .......... .......... .......... 85% 29.7M 1s 2024-02-21T07:44:10.064 INFO:tasks.workunit.client.0.smithi069.stderr:116150K .......... .......... .......... .......... .......... 85% 20.6M 1s 2024-02-21T07:44:10.066 INFO:tasks.workunit.client.0.smithi069.stderr:116200K .......... .......... .......... .......... .......... 85% 27.2M 1s 2024-02-21T07:44:10.066 INFO:tasks.workunit.client.0.smithi069.stderr:116250K .......... .......... .......... .......... .......... 85% 61.9M 1s 2024-02-21T07:44:10.068 INFO:tasks.workunit.client.0.smithi069.stderr:116300K .......... .......... .......... .......... .......... 85% 27.1M 1s 2024-02-21T07:44:10.070 INFO:tasks.workunit.client.0.smithi069.stderr:116350K .......... .......... .......... .......... .......... 85% 25.5M 1s 2024-02-21T07:44:10.072 INFO:tasks.workunit.client.0.smithi069.stderr:116400K .......... .......... .......... .......... .......... 85% 26.2M 1s 2024-02-21T07:44:10.074 INFO:tasks.workunit.client.0.smithi069.stderr:116450K .......... .......... .......... .......... .......... 85% 25.7M 1s 2024-02-21T07:44:10.074 INFO:tasks.workunit.client.0.smithi069.stderr:116500K .......... .......... .......... .......... .......... 85% 64.9M 1s 2024-02-21T07:44:10.076 INFO:tasks.workunit.client.0.smithi069.stderr:116550K .......... .......... .......... .......... .......... 85% 23.3M 1s 2024-02-21T07:44:10.078 INFO:tasks.workunit.client.0.smithi069.stderr:116600K .......... .......... .......... .......... .......... 85% 29.3M 1s 2024-02-21T07:44:10.081 INFO:tasks.workunit.client.0.smithi069.stderr:116650K .......... .......... .......... .......... .......... 85% 26.7M 1s 2024-02-21T07:44:10.081 INFO:tasks.workunit.client.0.smithi069.stderr:116700K .......... .......... .......... .......... .......... 86% 27.5M 1s 2024-02-21T07:44:10.082 INFO:tasks.workunit.client.0.smithi069.stderr:116750K .......... .......... .......... .......... .......... 86% 53.0M 1s 2024-02-21T07:44:10.084 INFO:tasks.workunit.client.0.smithi069.stderr:116800K .......... .......... .......... .......... .......... 86% 23.3M 1s 2024-02-21T07:44:10.086 INFO:tasks.workunit.client.0.smithi069.stderr:116850K .......... .......... .......... .......... .......... 86% 33.0M 1s 2024-02-21T07:44:10.087 INFO:tasks.workunit.client.0.smithi069.stderr:116900K .......... .......... .......... .......... .......... 86% 32.4M 1s 2024-02-21T07:44:10.090 INFO:tasks.workunit.client.0.smithi069.stderr:116950K .......... .......... .......... .......... .......... 86% 22.2M 1s 2024-02-21T07:44:10.091 INFO:tasks.workunit.client.0.smithi069.stderr:117000K .......... .......... .......... .......... .......... 86% 33.9M 1s 2024-02-21T07:44:10.093 INFO:tasks.workunit.client.0.smithi069.stderr:117050K .......... .......... .......... .......... .......... 86% 26.1M 1s 2024-02-21T07:44:10.094 INFO:tasks.workunit.client.0.smithi069.stderr:117100K .......... .......... .......... .......... .......... 86% 32.2M 1s 2024-02-21T07:44:10.096 INFO:tasks.workunit.client.0.smithi069.stderr:117150K .......... .......... .......... .......... .......... 86% 33.4M 1s 2024-02-21T07:44:10.097 INFO:tasks.workunit.client.0.smithi069.stderr:117200K .......... .......... .......... .......... .......... 86% 30.6M 1s 2024-02-21T07:44:10.100 INFO:tasks.workunit.client.0.smithi069.stderr:117250K .......... .......... .......... .......... .......... 86% 21.9M 1s 2024-02-21T07:44:10.101 INFO:tasks.workunit.client.0.smithi069.stderr:117300K .......... .......... .......... .......... .......... 86% 31.4M 1s 2024-02-21T07:44:10.103 INFO:tasks.workunit.client.0.smithi069.stderr:117350K .......... .......... .......... .......... .......... 86% 33.1M 1s 2024-02-21T07:44:10.104 INFO:tasks.workunit.client.0.smithi069.stderr:117400K .......... .......... .......... .......... .......... 86% 30.3M 1s 2024-02-21T07:44:10.106 INFO:tasks.workunit.client.0.smithi069.stderr:117450K .......... .......... .......... .......... .......... 86% 29.9M 1s 2024-02-21T07:44:10.109 INFO:tasks.workunit.client.0.smithi069.stderr:117500K .......... .......... .......... .......... .......... 86% 22.2M 1s 2024-02-21T07:44:10.110 INFO:tasks.workunit.client.0.smithi069.stderr:117550K .......... .......... .......... .......... .......... 86% 25.9M 1s 2024-02-21T07:44:10.111 INFO:tasks.workunit.client.0.smithi069.stderr:117600K .......... .......... .......... .......... .......... 86% 34.7M 1s 2024-02-21T07:44:10.113 INFO:tasks.workunit.client.0.smithi069.stderr:117650K .......... .......... .......... .......... .......... 86% 35.3M 1s 2024-02-21T07:44:10.115 INFO:tasks.workunit.client.0.smithi069.stderr:117700K .......... .......... .......... .......... .......... 86% 26.6M 1s 2024-02-21T07:44:10.117 INFO:tasks.workunit.client.0.smithi069.stderr:117750K .......... .......... .......... .......... .......... 86% 22.8M 1s 2024-02-21T07:44:10.118 INFO:tasks.workunit.client.0.smithi069.stderr:117800K .......... .......... .......... .......... .......... 86% 53.6M 1s 2024-02-21T07:44:10.120 INFO:tasks.workunit.client.0.smithi069.stderr:117850K .......... .......... .......... .......... .......... 86% 22.4M 1s 2024-02-21T07:44:10.121 INFO:tasks.workunit.client.0.smithi069.stderr:117900K .......... .......... .......... .......... .......... 86% 34.0M 1s 2024-02-21T07:44:10.123 INFO:tasks.workunit.client.0.smithi069.stderr:117950K .......... .......... .......... .......... .......... 86% 25.2M 1s 2024-02-21T07:44:10.124 INFO:tasks.workunit.client.0.smithi069.stderr:118000K .......... .......... .......... .......... .......... 86% 43.7M 1s 2024-02-21T07:44:10.126 INFO:tasks.workunit.client.0.smithi069.stderr:118050K .......... .......... .......... .......... .......... 86% 30.0M 1s 2024-02-21T07:44:10.129 INFO:tasks.workunit.client.0.smithi069.stderr:118100K .......... .......... .......... .......... .......... 87% 19.8M 1s 2024-02-21T07:44:10.130 INFO:tasks.workunit.client.0.smithi069.stderr:118150K .......... .......... .......... .......... .......... 87% 34.5M 1s 2024-02-21T07:44:10.132 INFO:tasks.workunit.client.0.smithi069.stderr:118200K .......... .......... .......... .......... .......... 87% 26.1M 1s 2024-02-21T07:44:10.133 INFO:tasks.workunit.client.0.smithi069.stderr:118250K .......... .......... .......... .......... .......... 87% 30.8M 1s 2024-02-21T07:44:10.135 INFO:tasks.workunit.client.0.smithi069.stderr:118300K .......... .......... .......... .......... .......... 87% 35.9M 1s 2024-02-21T07:44:10.136 INFO:tasks.workunit.client.0.smithi069.stderr:118350K .......... .......... .......... .......... .......... 87% 28.0M 1s 2024-02-21T07:44:10.138 INFO:tasks.workunit.client.0.smithi069.stderr:118400K .......... .......... .......... .......... .......... 87% 35.4M 1s 2024-02-21T07:44:10.140 INFO:tasks.workunit.client.0.smithi069.stderr:118450K .......... .......... .......... .......... .......... 87% 25.6M 1s 2024-02-21T07:44:10.142 INFO:tasks.workunit.client.0.smithi069.stderr:118500K .......... .......... .......... .......... .......... 87% 25.5M 1s 2024-02-21T07:44:10.143 INFO:tasks.workunit.client.0.smithi069.stderr:118550K .......... .......... .......... .......... .......... 87% 39.4M 1s 2024-02-21T07:44:10.145 INFO:tasks.workunit.client.0.smithi069.stderr:118600K .......... .......... .......... .......... .......... 87% 21.0M 1s 2024-02-21T07:44:10.146 INFO:tasks.workunit.client.0.smithi069.stderr:118650K .......... .......... .......... .......... .......... 87% 37.2M 1s 2024-02-21T07:44:10.148 INFO:tasks.workunit.client.0.smithi069.stderr:118700K .......... .......... .......... .......... .......... 87% 31.3M 1s 2024-02-21T07:44:10.150 INFO:tasks.workunit.client.0.smithi069.stderr:118750K .......... .......... .......... .......... .......... 87% 25.5M 1s 2024-02-21T07:44:10.152 INFO:tasks.workunit.client.0.smithi069.stderr:118800K .......... .......... .......... .......... .......... 87% 36.1M 1s 2024-02-21T07:44:10.160 INFO:tasks.workunit.client.0.smithi069.stderr:118850K .......... .......... .......... .......... .......... 87% 7.22M 1s 2024-02-21T07:44:10.160 INFO:tasks.workunit.client.0.smithi069.stderr:118900K .......... .......... .......... .......... .......... 87% 57.5M 1s 2024-02-21T07:44:10.160 INFO:tasks.workunit.client.0.smithi069.stderr:118950K .......... .......... .......... .......... .......... 87% 61.9M 1s 2024-02-21T07:44:10.175 INFO:tasks.workunit.client.0.smithi069.stderr:119000K .......... .......... .......... .......... .......... 87% 3.19M 1s 2024-02-21T07:44:10.176 INFO:tasks.workunit.client.0.smithi069.stderr:119050K .......... .......... .......... .......... .......... 87% 55.4M 1s 2024-02-21T07:44:10.179 INFO:tasks.workunit.client.0.smithi069.stderr:119100K .......... .......... .......... .......... .......... 87% 55.7M 1s 2024-02-21T07:44:10.179 INFO:tasks.workunit.client.0.smithi069.stderr:119150K .......... .......... .......... .......... .......... 87% 64.0M 1s 2024-02-21T07:44:10.179 INFO:tasks.workunit.client.0.smithi069.stderr:119200K .......... .......... .......... .......... .......... 87% 67.1M 1s 2024-02-21T07:44:10.183 INFO:tasks.workunit.client.0.smithi069.stderr:119250K .......... .......... .......... .......... .......... 87% 22.7M 1s 2024-02-21T07:44:10.183 INFO:tasks.workunit.client.0.smithi069.stderr:119300K .......... .......... .......... .......... .......... 87% 63.7M 1s 2024-02-21T07:44:10.183 INFO:tasks.workunit.client.0.smithi069.stderr:119350K .......... .......... .......... .......... .......... 87% 49.0M 1s 2024-02-21T07:44:10.183 INFO:tasks.workunit.client.0.smithi069.stderr:119400K .......... .......... .......... .......... .......... 87% 62.4M 1s 2024-02-21T07:44:10.186 INFO:tasks.workunit.client.0.smithi069.stderr:119450K .......... .......... .......... .......... .......... 88% 70.9M 1s 2024-02-21T07:44:10.186 INFO:tasks.workunit.client.0.smithi069.stderr:119500K .......... .......... .......... .......... .......... 88% 71.4M 1s 2024-02-21T07:44:10.186 INFO:tasks.workunit.client.0.smithi069.stderr:119550K .......... .......... .......... .......... .......... 88% 59.1M 1s 2024-02-21T07:44:10.187 INFO:tasks.workunit.client.0.smithi069.stderr:119600K .......... .......... .......... .......... .......... 88% 27.6M 1s 2024-02-21T07:44:10.188 INFO:tasks.workunit.client.0.smithi069.stderr:119650K .......... .......... .......... .......... .......... 88% 39.4M 1s 2024-02-21T07:44:10.190 INFO:tasks.workunit.client.0.smithi069.stderr:119700K .......... .......... .......... .......... .......... 88% 32.3M 1s 2024-02-21T07:44:10.192 INFO:tasks.workunit.client.0.smithi069.stderr:119750K .......... .......... .......... .......... .......... 88% 24.1M 1s 2024-02-21T07:44:10.194 INFO:tasks.workunit.client.0.smithi069.stderr:119800K .......... .......... .......... .......... .......... 88% 25.4M 1s 2024-02-21T07:44:10.195 INFO:tasks.workunit.client.0.smithi069.stderr:119850K .......... .......... .......... .......... .......... 88% 52.5M 1s 2024-02-21T07:44:10.197 INFO:tasks.workunit.client.0.smithi069.stderr:119900K .......... .......... .......... .......... .......... 88% 23.9M 1s 2024-02-21T07:44:10.199 INFO:tasks.workunit.client.0.smithi069.stderr:119950K .......... .......... .......... .......... .......... 88% 32.7M 1s 2024-02-21T07:44:10.200 INFO:tasks.workunit.client.0.smithi069.stderr:120000K .......... .......... .......... .......... .......... 88% 24.5M 1s 2024-02-21T07:44:10.201 INFO:tasks.workunit.client.0.smithi069.stderr:120050K .......... .......... .......... .......... .......... 88% 31.9M 1s 2024-02-21T07:44:10.203 INFO:tasks.workunit.client.0.smithi069.stderr:120100K .......... .......... .......... .......... .......... 88% 34.9M 1s 2024-02-21T07:44:10.205 INFO:tasks.workunit.client.0.smithi069.stderr:120150K .......... .......... .......... .......... .......... 88% 22.2M 1s 2024-02-21T07:44:10.207 INFO:tasks.workunit.client.0.smithi069.stderr:120200K .......... .......... .......... .......... .......... 88% 34.7M 1s 2024-02-21T07:44:10.209 INFO:tasks.workunit.client.0.smithi069.stderr:120250K .......... .......... .......... .......... .......... 88% 26.2M 1s 2024-02-21T07:44:10.209 INFO:tasks.workunit.client.0.smithi069.stderr:120300K .......... .......... .......... .......... .......... 88% 41.3M 1s 2024-02-21T07:44:10.212 INFO:tasks.workunit.client.0.smithi069.stderr:120350K .......... .......... .......... .......... .......... 88% 25.1M 1s 2024-02-21T07:44:10.214 INFO:tasks.workunit.client.0.smithi069.stderr:120400K .......... .......... .......... .......... .......... 88% 35.8M 1s 2024-02-21T07:44:10.215 INFO:tasks.workunit.client.0.smithi069.stderr:120450K .......... .......... .......... .......... .......... 88% 22.9M 1s 2024-02-21T07:44:10.272 INFO:tasks.workunit.client.0.smithi069.stderr:120500K .......... .......... .......... .......... .......... 88% 918K 1s 2024-02-21T07:44:10.272 INFO:tasks.workunit.client.0.smithi069.stderr:120550K .......... .......... .......... .......... .......... 88% 50.0M 1s 2024-02-21T07:44:10.272 INFO:tasks.workunit.client.0.smithi069.stderr:120600K .......... .......... .......... .......... .......... 88% 76.2M 1s 2024-02-21T07:44:10.278 INFO:tasks.workunit.client.0.smithi069.stderr:120650K .......... .......... .......... .......... .......... 88% 7.67M 1s 2024-02-21T07:44:10.279 INFO:tasks.workunit.client.0.smithi069.stderr:120700K .......... .......... .......... .......... .......... 88% 51.4M 1s 2024-02-21T07:44:10.279 INFO:tasks.workunit.client.0.smithi069.stderr:120750K .......... .......... .......... .......... .......... 88% 52.9M 1s 2024-02-21T07:44:10.288 INFO:tasks.workunit.client.0.smithi069.stderr:120800K .......... .......... .......... .......... .......... 89% 56.1M 1s 2024-02-21T07:44:10.288 INFO:tasks.workunit.client.0.smithi069.stderr:120850K .......... .......... .......... .......... .......... 89% 72.5M 1s 2024-02-21T07:44:10.288 INFO:tasks.workunit.client.0.smithi069.stderr:120900K .......... .......... .......... .......... .......... 89% 67.1M 1s 2024-02-21T07:44:10.288 INFO:tasks.workunit.client.0.smithi069.stderr:120950K .......... .......... .......... .......... .......... 89% 60.0M 1s 2024-02-21T07:44:10.288 INFO:tasks.workunit.client.0.smithi069.stderr:121000K .......... .......... .......... .......... .......... 89% 69.6M 1s 2024-02-21T07:44:10.288 INFO:tasks.workunit.client.0.smithi069.stderr:121050K .......... .......... .......... .......... .......... 89% 70.5M 1s 2024-02-21T07:44:10.289 INFO:tasks.workunit.client.0.smithi069.stderr:121100K .......... .......... .......... .......... .......... 89% 67.8M 1s 2024-02-21T07:44:10.289 INFO:tasks.workunit.client.0.smithi069.stderr:121150K .......... .......... .......... .......... .......... 89% 34.0M 1s 2024-02-21T07:44:10.289 INFO:tasks.workunit.client.0.smithi069.stderr:121200K .......... .......... .......... .......... .......... 89% 32.4M 1s 2024-02-21T07:44:10.290 INFO:tasks.workunit.client.0.smithi069.stderr:121250K .......... .......... .......... .......... .......... 89% 34.5M 1s 2024-02-21T07:44:10.295 INFO:tasks.workunit.client.0.smithi069.stderr:121300K .......... .......... .......... .......... .......... 89% 9.67M 1s 2024-02-21T07:44:10.296 INFO:tasks.workunit.client.0.smithi069.stderr:121350K .......... .......... .......... .......... .......... 89% 49.7M 1s 2024-02-21T07:44:10.297 INFO:tasks.workunit.client.0.smithi069.stderr:121400K .......... .......... .......... .......... .......... 89% 26.2M 1s 2024-02-21T07:44:10.302 INFO:tasks.workunit.client.0.smithi069.stderr:121450K .......... .......... .......... .......... .......... 89% 54.0M 1s 2024-02-21T07:44:10.302 INFO:tasks.workunit.client.0.smithi069.stderr:121500K .......... .......... .......... .......... .......... 89% 72.5M 1s 2024-02-21T07:44:10.302 INFO:tasks.workunit.client.0.smithi069.stderr:121550K .......... .......... .......... .......... .......... 89% 42.8M 1s 2024-02-21T07:44:10.302 INFO:tasks.workunit.client.0.smithi069.stderr:121600K .......... .......... .......... .......... .......... 89% 37.8M 1s 2024-02-21T07:44:10.304 INFO:tasks.workunit.client.0.smithi069.stderr:121650K .......... .......... .......... .......... .......... 89% 23.1M 1s 2024-02-21T07:44:10.305 INFO:tasks.workunit.client.0.smithi069.stderr:121700K .......... .......... .......... .......... .......... 89% 27.3M 1s 2024-02-21T07:44:10.306 INFO:tasks.workunit.client.0.smithi069.stderr:121750K .......... .......... .......... .......... .......... 89% 45.7M 1s 2024-02-21T07:44:10.340 INFO:tasks.workunit.client.0.smithi069.stderr:121800K .......... .......... .......... .......... .......... 89% 1.42M 1s 2024-02-21T07:44:10.344 INFO:tasks.workunit.client.0.smithi069.stderr:121850K .......... .......... .......... .......... .......... 89% 54.3M 1s 2024-02-21T07:44:10.344 INFO:tasks.workunit.client.0.smithi069.stderr:121900K .......... .......... .......... .......... .......... 89% 55.2M 1s 2024-02-21T07:44:10.344 INFO:tasks.workunit.client.0.smithi069.stderr:121950K .......... .......... .......... .......... .......... 89% 64.1M 1s 2024-02-21T07:44:10.344 INFO:tasks.workunit.client.0.smithi069.stderr:122000K .......... .......... .......... .......... .......... 89% 74.4M 1s 2024-02-21T07:44:10.353 INFO:tasks.workunit.client.0.smithi069.stderr:122050K .......... .......... .......... .......... .......... 89% 5.24M 1s 2024-02-21T07:44:10.357 INFO:tasks.workunit.client.0.smithi069.stderr:122100K .......... .......... .......... .......... .......... 89% 62.1M 1s 2024-02-21T07:44:10.357 INFO:tasks.workunit.client.0.smithi069.stderr:122150K .......... .......... .......... .......... .......... 90% 59.6M 1s 2024-02-21T07:44:10.357 INFO:tasks.workunit.client.0.smithi069.stderr:122200K .......... .......... .......... .......... .......... 90% 75.4M 1s 2024-02-21T07:44:10.357 INFO:tasks.workunit.client.0.smithi069.stderr:122250K .......... .......... .......... .......... .......... 90% 48.9M 1s 2024-02-21T07:44:10.362 INFO:tasks.workunit.client.0.smithi069.stderr:122300K .......... .......... .......... .......... .......... 90% 62.2M 1s 2024-02-21T07:44:10.362 INFO:tasks.workunit.client.0.smithi069.stderr:122350K .......... .......... .......... .......... .......... 90% 49.4M 1s 2024-02-21T07:44:10.363 INFO:tasks.workunit.client.0.smithi069.stderr:122400K .......... .......... .......... .......... .......... 90% 73.5M 1s 2024-02-21T07:44:10.363 INFO:tasks.workunit.client.0.smithi069.stderr:122450K .......... .......... .......... .......... .......... 90% 67.5M 1s 2024-02-21T07:44:10.363 INFO:tasks.workunit.client.0.smithi069.stderr:122500K .......... .......... .......... .......... .......... 90% 68.7M 1s 2024-02-21T07:44:10.363 INFO:tasks.workunit.client.0.smithi069.stderr:122550K .......... .......... .......... .......... .......... 90% 37.3M 1s 2024-02-21T07:44:10.363 INFO:tasks.workunit.client.0.smithi069.stderr:122600K .......... .......... .......... .......... .......... 90% 51.0M 1s 2024-02-21T07:44:10.364 INFO:tasks.workunit.client.0.smithi069.stderr:122650K .......... .......... .......... .......... .......... 90% 27.8M 1s 2024-02-21T07:44:10.366 INFO:tasks.workunit.client.0.smithi069.stderr:122700K .......... .......... .......... .......... .......... 90% 26.2M 1s 2024-02-21T07:44:10.368 INFO:tasks.workunit.client.0.smithi069.stderr:122750K .......... .......... .......... .......... .......... 90% 24.6M 1s 2024-02-21T07:44:10.370 INFO:tasks.workunit.client.0.smithi069.stderr:122800K .......... .......... .......... .......... .......... 90% 26.4M 1s 2024-02-21T07:44:10.371 INFO:tasks.workunit.client.0.smithi069.stderr:122850K .......... .......... .......... .......... .......... 90% 57.3M 1s 2024-02-21T07:44:10.373 INFO:tasks.workunit.client.0.smithi069.stderr:122900K .......... .......... .......... .......... .......... 90% 25.9M 1s 2024-02-21T07:44:10.375 INFO:tasks.workunit.client.0.smithi069.stderr:122950K .......... .......... .......... .......... .......... 90% 23.6M 1s 2024-02-21T07:44:10.377 INFO:tasks.workunit.client.0.smithi069.stderr:123000K .......... .......... .......... .......... .......... 90% 23.9M 1s 2024-02-21T07:44:10.377 INFO:tasks.workunit.client.0.smithi069.stderr:123050K .......... .......... .......... .......... .......... 90% 69.3M 1s 2024-02-21T07:44:10.379 INFO:tasks.workunit.client.0.smithi069.stderr:123100K .......... .......... .......... .......... .......... 90% 28.0M 1s 2024-02-21T07:44:10.381 INFO:tasks.workunit.client.0.smithi069.stderr:123150K .......... .......... .......... .......... .......... 90% 24.7M 1s 2024-02-21T07:44:10.383 INFO:tasks.workunit.client.0.smithi069.stderr:123200K .......... .......... .......... .......... .......... 90% 24.8M 1s 2024-02-21T07:44:10.386 INFO:tasks.workunit.client.0.smithi069.stderr:123250K .......... .......... .......... .......... .......... 90% 27.9M 1s 2024-02-21T07:44:10.386 INFO:tasks.workunit.client.0.smithi069.stderr:123300K .......... .......... .......... .......... .......... 90% 57.8M 1s 2024-02-21T07:44:10.388 INFO:tasks.workunit.client.0.smithi069.stderr:123350K .......... .......... .......... .......... .......... 90% 23.3M 1s 2024-02-21T07:44:10.390 INFO:tasks.workunit.client.0.smithi069.stderr:123400K .......... .......... .......... .......... .......... 90% 24.8M 1s 2024-02-21T07:44:10.392 INFO:tasks.workunit.client.0.smithi069.stderr:123450K .......... .......... .......... .......... .......... 90% 24.6M 1s 2024-02-21T07:44:10.394 INFO:tasks.workunit.client.0.smithi069.stderr:123500K .......... .......... .......... .......... .......... 91% 20.5M 1s 2024-02-21T07:44:10.396 INFO:tasks.workunit.client.0.smithi069.stderr:123550K .......... .......... .......... .......... .......... 91% 41.9M 1s 2024-02-21T07:44:10.396 INFO:tasks.workunit.client.0.smithi069.stderr:123600K .......... .......... .......... .......... .......... 91% 56.6M 1s 2024-02-21T07:44:10.398 INFO:tasks.workunit.client.0.smithi069.stderr:123650K .......... .......... .......... .......... .......... 91% 26.5M 1s 2024-02-21T07:44:10.400 INFO:tasks.workunit.client.0.smithi069.stderr:123700K .......... .......... .......... .......... .......... 91% 25.6M 1s 2024-02-21T07:44:10.401 INFO:tasks.workunit.client.0.smithi069.stderr:123750K .......... .......... .......... .......... .......... 91% 51.9M 0s 2024-02-21T07:44:10.403 INFO:tasks.workunit.client.0.smithi069.stderr:123800K .......... .......... .......... .......... .......... 91% 26.4M 0s 2024-02-21T07:44:10.405 INFO:tasks.workunit.client.0.smithi069.stderr:123850K .......... .......... .......... .......... .......... 91% 24.9M 0s 2024-02-21T07:44:10.407 INFO:tasks.workunit.client.0.smithi069.stderr:123900K .......... .......... .......... .......... .......... 91% 26.5M 0s 2024-02-21T07:44:10.409 INFO:tasks.workunit.client.0.smithi069.stderr:123950K .......... .......... .......... .......... .......... 91% 22.3M 0s 2024-02-21T07:44:10.410 INFO:tasks.workunit.client.0.smithi069.stderr:124000K .......... .......... .......... .......... .......... 91% 65.0M 0s 2024-02-21T07:44:10.411 INFO:tasks.workunit.client.0.smithi069.stderr:124050K .......... .......... .......... .......... .......... 91% 28.1M 0s 2024-02-21T07:44:10.413 INFO:tasks.workunit.client.0.smithi069.stderr:124100K .......... .......... .......... .......... .......... 91% 26.2M 0s 2024-02-21T07:44:10.416 INFO:tasks.workunit.client.0.smithi069.stderr:124150K .......... .......... .......... .......... .......... 91% 23.9M 0s 2024-02-21T07:44:10.416 INFO:tasks.workunit.client.0.smithi069.stderr:124200K .......... .......... .......... .......... .......... 91% 66.0M 0s 2024-02-21T07:44:10.418 INFO:tasks.workunit.client.0.smithi069.stderr:124250K .......... .......... .......... .......... .......... 91% 25.4M 0s 2024-02-21T07:44:10.420 INFO:tasks.workunit.client.0.smithi069.stderr:124300K .......... .......... .......... .......... .......... 91% 24.5M 0s 2024-02-21T07:44:10.422 INFO:tasks.workunit.client.0.smithi069.stderr:124350K .......... .......... .......... .......... .......... 91% 24.0M 0s 2024-02-21T07:44:10.424 INFO:tasks.workunit.client.0.smithi069.stderr:124400K .......... .......... .......... .......... .......... 91% 24.0M 0s 2024-02-21T07:44:10.425 INFO:tasks.workunit.client.0.smithi069.stderr:124450K .......... .......... .......... .......... .......... 91% 58.3M 0s 2024-02-21T07:44:10.426 INFO:tasks.workunit.client.0.smithi069.stderr:124500K .......... .......... .......... .......... .......... 91% 29.8M 0s 2024-02-21T07:44:10.429 INFO:tasks.workunit.client.0.smithi069.stderr:124550K .......... .......... .......... .......... .......... 91% 25.4M 0s 2024-02-21T07:44:10.435 INFO:tasks.workunit.client.0.smithi069.stderr:124600K .......... .......... .......... .......... .......... 91% 9.45M 0s 2024-02-21T07:44:10.435 INFO:tasks.workunit.client.0.smithi069.stderr:124650K .......... .......... .......... .......... .......... 91% 54.9M 0s 2024-02-21T07:44:10.435 INFO:tasks.workunit.client.0.smithi069.stderr:124700K .......... .......... .......... .......... .......... 91% 73.3M 0s 2024-02-21T07:44:10.485 INFO:tasks.workunit.client.0.smithi069.stderr:124750K .......... .......... .......... .......... .......... 91% 997K 0s 2024-02-21T07:44:10.486 INFO:tasks.workunit.client.0.smithi069.stderr:124800K .......... .......... .......... .......... .......... 91% 55.6M 0s 2024-02-21T07:44:10.493 INFO:tasks.workunit.client.0.smithi069.stderr:124850K .......... .......... .......... .......... .......... 92% 64.4M 0s 2024-02-21T07:44:10.493 INFO:tasks.workunit.client.0.smithi069.stderr:124900K .......... .......... .......... .......... .......... 92% 56.3M 0s 2024-02-21T07:44:10.493 INFO:tasks.workunit.client.0.smithi069.stderr:124950K .......... .......... .......... .......... .......... 92% 59.1M 0s 2024-02-21T07:44:10.493 INFO:tasks.workunit.client.0.smithi069.stderr:125000K .......... .......... .......... .......... .......... 92% 73.2M 0s 2024-02-21T07:44:10.493 INFO:tasks.workunit.client.0.smithi069.stderr:125050K .......... .......... .......... .......... .......... 92% 63.5M 0s 2024-02-21T07:44:10.494 INFO:tasks.workunit.client.0.smithi069.stderr:125100K .......... .......... .......... .......... .......... 92% 74.0M 0s 2024-02-21T07:44:10.494 INFO:tasks.workunit.client.0.smithi069.stderr:125150K .......... .......... .......... .......... .......... 92% 61.0M 0s 2024-02-21T07:44:10.494 INFO:tasks.workunit.client.0.smithi069.stderr:125200K .......... .......... .......... .......... .......... 92% 62.0M 0s 2024-02-21T07:44:10.497 INFO:tasks.workunit.client.0.smithi069.stderr:125250K .......... .......... .......... .......... .......... 92% 26.0M 0s 2024-02-21T07:44:10.497 INFO:tasks.workunit.client.0.smithi069.stderr:125300K .......... .......... .......... .......... .......... 92% 27.9M 0s 2024-02-21T07:44:10.497 INFO:tasks.workunit.client.0.smithi069.stderr:125350K .......... .......... .......... .......... .......... 92% 50.0M 0s 2024-02-21T07:44:10.499 INFO:tasks.workunit.client.0.smithi069.stderr:125400K .......... .......... .......... .......... .......... 92% 23.3M 0s 2024-02-21T07:44:10.501 INFO:tasks.workunit.client.0.smithi069.stderr:125450K .......... .......... .......... .......... .......... 92% 25.9M 0s 2024-02-21T07:44:10.503 INFO:tasks.workunit.client.0.smithi069.stderr:125500K .......... .......... .......... .......... .......... 92% 24.4M 0s 2024-02-21T07:44:10.505 INFO:tasks.workunit.client.0.smithi069.stderr:125550K .......... .......... .......... .......... .......... 92% 29.8M 0s 2024-02-21T07:44:10.505 INFO:tasks.workunit.client.0.smithi069.stderr:125600K .......... .......... .......... .......... .......... 92% 60.5M 0s 2024-02-21T07:44:10.507 INFO:tasks.workunit.client.0.smithi069.stderr:125650K .......... .......... .......... .......... .......... 92% 25.1M 0s 2024-02-21T07:44:10.509 INFO:tasks.workunit.client.0.smithi069.stderr:125700K .......... .......... .......... .......... .......... 92% 24.4M 0s 2024-02-21T07:44:10.511 INFO:tasks.workunit.client.0.smithi069.stderr:125750K .......... .......... .......... .......... .......... 92% 25.8M 0s 2024-02-21T07:44:10.511 INFO:tasks.workunit.client.0.smithi069.stderr:125800K .......... .......... .......... .......... .......... 92% 70.6M 0s 2024-02-21T07:44:10.514 INFO:tasks.workunit.client.0.smithi069.stderr:125850K .......... .......... .......... .......... .......... 92% 21.7M 0s 2024-02-21T07:44:10.516 INFO:tasks.workunit.client.0.smithi069.stderr:125900K .......... .......... .......... .......... .......... 92% 30.1M 0s 2024-02-21T07:44:10.518 INFO:tasks.workunit.client.0.smithi069.stderr:125950K .......... .......... .......... .......... .......... 92% 25.4M 0s 2024-02-21T07:44:10.520 INFO:tasks.workunit.client.0.smithi069.stderr:126000K .......... .......... .......... .......... .......... 92% 19.5M 0s 2024-02-21T07:44:10.520 INFO:tasks.workunit.client.0.smithi069.stderr:126050K .......... .......... .......... .......... .......... 92% 63.8M 0s 2024-02-21T07:44:10.522 INFO:tasks.workunit.client.0.smithi069.stderr:126100K .......... .......... .......... .......... .......... 92% 36.8M 0s 2024-02-21T07:44:10.524 INFO:tasks.workunit.client.0.smithi069.stderr:126150K .......... .......... .......... .......... .......... 92% 24.0M 0s 2024-02-21T07:44:10.526 INFO:tasks.workunit.client.0.smithi069.stderr:126200K .......... .......... .......... .......... .......... 92% 22.5M 0s 2024-02-21T07:44:10.528 INFO:tasks.workunit.client.0.smithi069.stderr:126250K .......... .......... .......... .......... .......... 93% 42.9M 0s 2024-02-21T07:44:10.528 INFO:tasks.workunit.client.0.smithi069.stderr:126300K .......... .......... .......... .......... .......... 93% 43.4M 0s 2024-02-21T07:44:10.531 INFO:tasks.workunit.client.0.smithi069.stderr:126350K .......... .......... .......... .......... .......... 93% 20.7M 0s 2024-02-21T07:44:10.533 INFO:tasks.workunit.client.0.smithi069.stderr:126400K .......... .......... .......... .......... .......... 93% 25.9M 0s 2024-02-21T07:44:10.535 INFO:tasks.workunit.client.0.smithi069.stderr:126450K .......... .......... .......... .......... .......... 93% 29.0M 0s 2024-02-21T07:44:10.535 INFO:tasks.workunit.client.0.smithi069.stderr:126500K .......... .......... .......... .......... .......... 93% 53.2M 0s 2024-02-21T07:44:10.537 INFO:tasks.workunit.client.0.smithi069.stderr:126550K .......... .......... .......... .......... .......... 93% 23.8M 0s 2024-02-21T07:44:10.539 INFO:tasks.workunit.client.0.smithi069.stderr:126600K .......... .......... .......... .......... .......... 93% 26.0M 0s 2024-02-21T07:44:10.542 INFO:tasks.workunit.client.0.smithi069.stderr:126650K .......... .......... .......... .......... .......... 93% 26.4M 0s 2024-02-21T07:44:10.544 INFO:tasks.workunit.client.0.smithi069.stderr:126700K .......... .......... .......... .......... .......... 93% 27.4M 0s 2024-02-21T07:44:10.544 INFO:tasks.workunit.client.0.smithi069.stderr:126750K .......... .......... .......... .......... .......... 93% 48.3M 0s 2024-02-21T07:44:10.545 INFO:tasks.workunit.client.0.smithi069.stderr:126800K .......... .......... .......... .......... .......... 93% 29.7M 0s 2024-02-21T07:44:10.548 INFO:tasks.workunit.client.0.smithi069.stderr:126850K .......... .......... .......... .......... .......... 93% 24.2M 0s 2024-02-21T07:44:10.550 INFO:tasks.workunit.client.0.smithi069.stderr:126900K .......... .......... .......... .......... .......... 93% 25.1M 0s 2024-02-21T07:44:10.550 INFO:tasks.workunit.client.0.smithi069.stderr:126950K .......... .......... .......... .......... .......... 93% 68.9M 0s 2024-02-21T07:44:10.552 INFO:tasks.workunit.client.0.smithi069.stderr:127000K .......... .......... .......... .......... .......... 93% 26.7M 0s 2024-02-21T07:44:10.554 INFO:tasks.workunit.client.0.smithi069.stderr:127050K .......... .......... .......... .......... .......... 93% 24.2M 0s 2024-02-21T07:44:10.556 INFO:tasks.workunit.client.0.smithi069.stderr:127100K .......... .......... .......... .......... .......... 93% 27.1M 0s 2024-02-21T07:44:10.559 INFO:tasks.workunit.client.0.smithi069.stderr:127150K .......... .......... .......... .......... .......... 93% 23.2M 0s 2024-02-21T07:44:10.559 INFO:tasks.workunit.client.0.smithi069.stderr:127200K .......... .......... .......... .......... .......... 93% 61.7M 0s 2024-02-21T07:44:10.561 INFO:tasks.workunit.client.0.smithi069.stderr:127250K .......... .......... .......... .......... .......... 93% 23.4M 0s 2024-02-21T07:44:10.563 INFO:tasks.workunit.client.0.smithi069.stderr:127300K .......... .......... .......... .......... .......... 93% 24.9M 0s 2024-02-21T07:44:10.565 INFO:tasks.workunit.client.0.smithi069.stderr:127350K .......... .......... .......... .......... .......... 93% 26.5M 0s 2024-02-21T07:44:10.565 INFO:tasks.workunit.client.0.smithi069.stderr:127400K .......... .......... .......... .......... .......... 93% 64.5M 0s 2024-02-21T07:44:10.567 INFO:tasks.workunit.client.0.smithi069.stderr:127450K .......... .......... .......... .......... .......... 93% 25.9M 0s 2024-02-21T07:44:10.569 INFO:tasks.workunit.client.0.smithi069.stderr:127500K .......... .......... .......... .......... .......... 93% 26.5M 0s 2024-02-21T07:44:10.572 INFO:tasks.workunit.client.0.smithi069.stderr:127550K .......... .......... .......... .......... .......... 93% 21.7M 0s 2024-02-21T07:44:10.572 INFO:tasks.workunit.client.0.smithi069.stderr:127600K .......... .......... .......... .......... .......... 94% 55.8M 0s 2024-02-21T07:44:10.574 INFO:tasks.workunit.client.0.smithi069.stderr:127650K .......... .......... .......... .......... .......... 94% 30.4M 0s 2024-02-21T07:44:10.576 INFO:tasks.workunit.client.0.smithi069.stderr:127700K .......... .......... .......... .......... .......... 94% 28.7M 0s 2024-02-21T07:44:10.578 INFO:tasks.workunit.client.0.smithi069.stderr:127750K .......... .......... .......... .......... .......... 94% 29.9M 0s 2024-02-21T07:44:10.578 INFO:tasks.workunit.client.0.smithi069.stderr:127800K .......... .......... .......... .......... .......... 94% 44.4M 0s 2024-02-21T07:44:10.580 INFO:tasks.workunit.client.0.smithi069.stderr:127850K .......... .......... .......... .......... .......... 94% 26.6M 0s 2024-02-21T07:44:10.582 INFO:tasks.workunit.client.0.smithi069.stderr:127900K .......... .......... .......... .......... .......... 94% 28.4M 0s 2024-02-21T07:44:10.584 INFO:tasks.workunit.client.0.smithi069.stderr:127950K .......... .......... .......... .......... .......... 94% 27.0M 0s 2024-02-21T07:44:10.585 INFO:tasks.workunit.client.0.smithi069.stderr:128000K .......... .......... .......... .......... .......... 94% 36.9M 0s 2024-02-21T07:44:10.587 INFO:tasks.workunit.client.0.smithi069.stderr:128050K .......... .......... .......... .......... .......... 94% 24.6M 0s 2024-02-21T07:44:10.590 INFO:tasks.workunit.client.0.smithi069.stderr:128100K .......... .......... .......... .......... .......... 94% 22.6M 0s 2024-02-21T07:44:10.590 INFO:tasks.workunit.client.0.smithi069.stderr:128150K .......... .......... .......... .......... .......... 94% 60.0M 0s 2024-02-21T07:44:10.592 INFO:tasks.workunit.client.0.smithi069.stderr:128200K .......... .......... .......... .......... .......... 94% 24.5M 0s 2024-02-21T07:44:10.594 INFO:tasks.workunit.client.0.smithi069.stderr:128250K .......... .......... .......... .......... .......... 94% 28.5M 0s 2024-02-21T07:44:10.596 INFO:tasks.workunit.client.0.smithi069.stderr:128300K .......... .......... .......... .......... .......... 94% 21.4M 0s 2024-02-21T07:44:10.598 INFO:tasks.workunit.client.0.smithi069.stderr:128350K .......... .......... .......... .......... .......... 94% 27.8M 0s 2024-02-21T07:44:10.598 INFO:tasks.workunit.client.0.smithi069.stderr:128400K .......... .......... .......... .......... .......... 94% 66.5M 0s 2024-02-21T07:44:10.600 INFO:tasks.workunit.client.0.smithi069.stderr:128450K .......... .......... .......... .......... .......... 94% 26.2M 0s 2024-02-21T07:44:10.607 INFO:tasks.workunit.client.0.smithi069.stderr:128500K .......... .......... .......... .......... .......... 94% 12.1M 0s 2024-02-21T07:44:10.607 INFO:tasks.workunit.client.0.smithi069.stderr:128550K .......... .......... .......... .......... .......... 94% 54.1M 0s 2024-02-21T07:44:10.607 INFO:tasks.workunit.client.0.smithi069.stderr:128600K .......... .......... .......... .......... .......... 94% 61.0M 0s 2024-02-21T07:44:10.607 INFO:tasks.workunit.client.0.smithi069.stderr:128650K .......... .......... .......... .......... .......... 94% 55.7M 0s 2024-02-21T07:44:10.611 INFO:tasks.workunit.client.0.smithi069.stderr:128700K .......... .......... .......... .......... .......... 94% 13.9M 0s 2024-02-21T07:44:10.612 INFO:tasks.workunit.client.0.smithi069.stderr:128750K .......... .......... .......... .......... .......... 94% 26.7M 0s 2024-02-21T07:44:10.614 INFO:tasks.workunit.client.0.smithi069.stderr:128800K .......... .......... .......... .......... .......... 94% 32.8M 0s 2024-02-21T07:44:10.615 INFO:tasks.workunit.client.0.smithi069.stderr:128850K .......... .......... .......... .......... .......... 94% 33.2M 0s 2024-02-21T07:44:10.617 INFO:tasks.workunit.client.0.smithi069.stderr:128900K .......... .......... .......... .......... .......... 94% 31.3M 0s 2024-02-21T07:44:10.619 INFO:tasks.workunit.client.0.smithi069.stderr:128950K .......... .......... .......... .......... .......... 95% 42.0M 0s 2024-02-21T07:44:10.619 INFO:tasks.workunit.client.0.smithi069.stderr:129000K .......... .......... .......... .......... .......... 95% 50.7M 0s 2024-02-21T07:44:10.620 INFO:tasks.workunit.client.0.smithi069.stderr:129050K .......... .......... .......... .......... .......... 95% 31.5M 0s 2024-02-21T07:44:10.622 INFO:tasks.workunit.client.0.smithi069.stderr:129100K .......... .......... .......... .......... .......... 95% 32.0M 0s 2024-02-21T07:44:10.625 INFO:tasks.workunit.client.0.smithi069.stderr:129150K .......... .......... .......... .......... .......... 95% 20.9M 0s 2024-02-21T07:44:10.626 INFO:tasks.workunit.client.0.smithi069.stderr:129200K .......... .......... .......... .......... .......... 95% 35.3M 0s 2024-02-21T07:44:10.627 INFO:tasks.workunit.client.0.smithi069.stderr:129250K .......... .......... .......... .......... .......... 95% 28.8M 0s 2024-02-21T07:44:10.629 INFO:tasks.workunit.client.0.smithi069.stderr:129300K .......... .......... .......... .......... .......... 95% 33.4M 0s 2024-02-21T07:44:10.630 INFO:tasks.workunit.client.0.smithi069.stderr:129350K .......... .......... .......... .......... .......... 95% 33.6M 0s 2024-02-21T07:44:10.632 INFO:tasks.workunit.client.0.smithi069.stderr:129400K .......... .......... .......... .......... .......... 95% 23.8M 0s 2024-02-21T07:44:10.633 INFO:tasks.workunit.client.0.smithi069.stderr:129450K .......... .......... .......... .......... .......... 95% 50.5M 0s 2024-02-21T07:44:10.636 INFO:tasks.workunit.client.0.smithi069.stderr:129500K .......... .......... .......... .......... .......... 95% 19.7M 0s 2024-02-21T07:44:10.637 INFO:tasks.workunit.client.0.smithi069.stderr:129550K .......... .......... .......... .......... .......... 95% 36.5M 0s 2024-02-21T07:44:10.639 INFO:tasks.workunit.client.0.smithi069.stderr:129600K .......... .......... .......... .......... .......... 95% 27.4M 0s 2024-02-21T07:44:10.640 INFO:tasks.workunit.client.0.smithi069.stderr:129650K .......... .......... .......... .......... .......... 95% 33.9M 0s 2024-02-21T07:44:10.641 INFO:tasks.workunit.client.0.smithi069.stderr:129700K .......... .......... .......... .......... .......... 95% 35.7M 0s 2024-02-21T07:44:10.644 INFO:tasks.workunit.client.0.smithi069.stderr:129750K .......... .......... .......... .......... .......... 95% 19.8M 0s 2024-02-21T07:44:10.646 INFO:tasks.workunit.client.0.smithi069.stderr:129800K .......... .......... .......... .......... .......... 95% 31.8M 0s 2024-02-21T07:44:10.647 INFO:tasks.workunit.client.0.smithi069.stderr:129850K .......... .......... .......... .......... .......... 95% 29.5M 0s 2024-02-21T07:44:10.649 INFO:tasks.workunit.client.0.smithi069.stderr:129900K .......... .......... .......... .......... .......... 95% 32.1M 0s 2024-02-21T07:44:10.650 INFO:tasks.workunit.client.0.smithi069.stderr:129950K .......... .......... .......... .......... .......... 95% 32.3M 0s 2024-02-21T07:44:10.652 INFO:tasks.workunit.client.0.smithi069.stderr:130000K .......... .......... .......... .......... .......... 95% 30.5M 0s 2024-02-21T07:44:10.654 INFO:tasks.workunit.client.0.smithi069.stderr:130050K .......... .......... .......... .......... .......... 95% 25.9M 0s 2024-02-21T07:44:10.655 INFO:tasks.workunit.client.0.smithi069.stderr:130100K .......... .......... .......... .......... .......... 95% 31.0M 0s 2024-02-21T07:44:10.665 INFO:tasks.workunit.client.0.smithi069.stderr:130150K .......... .......... .......... .......... .......... 95% 28.2M 0s 2024-02-21T07:44:10.665 INFO:tasks.workunit.client.0.smithi069.stderr:130200K .......... .......... .......... .......... .......... 95% 27.0M 0s 2024-02-21T07:44:10.665 INFO:tasks.workunit.client.0.smithi069.stderr:130250K .......... .......... .......... .......... .......... 95% 27.8M 0s 2024-02-21T07:44:10.665 INFO:tasks.workunit.client.0.smithi069.stderr:130300K .......... .......... .......... .......... .......... 96% 29.2M 0s 2024-02-21T07:44:10.665 INFO:tasks.workunit.client.0.smithi069.stderr:130350K .......... .......... .......... .......... .......... 96% 29.6M 0s 2024-02-21T07:44:10.668 INFO:tasks.workunit.client.0.smithi069.stderr:130400K .......... .......... .......... .......... .......... 96% 25.5M 0s 2024-02-21T07:44:10.668 INFO:tasks.workunit.client.0.smithi069.stderr:130450K .......... .......... .......... .......... .......... 96% 30.6M 0s 2024-02-21T07:44:10.668 INFO:tasks.workunit.client.0.smithi069.stderr:130500K .......... .......... .......... .......... .......... 96% 37.4M 0s 2024-02-21T07:44:10.671 INFO:tasks.workunit.client.0.smithi069.stderr:130550K .......... .......... .......... .......... .......... 96% 27.0M 0s 2024-02-21T07:44:10.675 INFO:tasks.workunit.client.0.smithi069.stderr:130600K .......... .......... .......... .......... .......... 96% 30.1M 0s 2024-02-21T07:44:10.676 INFO:tasks.workunit.client.0.smithi069.stderr:130650K .......... .......... .......... .......... .......... 96% 26.5M 0s 2024-02-21T07:44:10.676 INFO:tasks.workunit.client.0.smithi069.stderr:130700K .......... .......... .......... .......... .......... 96% 38.3M 0s 2024-02-21T07:44:10.678 INFO:tasks.workunit.client.0.smithi069.stderr:130750K .......... .......... .......... .......... .......... 96% 26.6M 0s 2024-02-21T07:44:10.680 INFO:tasks.workunit.client.0.smithi069.stderr:130800K .......... .......... .......... .......... .......... 96% 23.1M 0s 2024-02-21T07:44:10.682 INFO:tasks.workunit.client.0.smithi069.stderr:130850K .......... .......... .......... .......... .......... 96% 29.7M 0s 2024-02-21T07:44:10.683 INFO:tasks.workunit.client.0.smithi069.stderr:130900K .......... .......... .......... .......... .......... 96% 28.7M 0s 2024-02-21T07:44:10.686 INFO:tasks.workunit.client.0.smithi069.stderr:130950K .......... .......... .......... .......... .......... 96% 30.7M 0s 2024-02-21T07:44:10.686 INFO:tasks.workunit.client.0.smithi069.stderr:131000K .......... .......... .......... .......... .......... 96% 41.3M 0s 2024-02-21T07:44:10.687 INFO:tasks.workunit.client.0.smithi069.stderr:131050K .......... .......... .......... .......... .......... 96% 27.8M 0s 2024-02-21T07:44:10.689 INFO:tasks.workunit.client.0.smithi069.stderr:131100K .......... .......... .......... .......... .......... 96% 26.1M 0s 2024-02-21T07:44:10.691 INFO:tasks.workunit.client.0.smithi069.stderr:131150K .......... .......... .......... .......... .......... 96% 27.9M 0s 2024-02-21T07:44:10.693 INFO:tasks.workunit.client.0.smithi069.stderr:131200K .......... .......... .......... .......... .......... 96% 26.0M 0s 2024-02-21T07:44:10.695 INFO:tasks.workunit.client.0.smithi069.stderr:131250K .......... .......... .......... .......... .......... 96% 73.3M 0s 2024-02-21T07:44:10.695 INFO:tasks.workunit.client.0.smithi069.stderr:131300K .......... .......... .......... .......... .......... 96% 23.9M 0s 2024-02-21T07:44:10.700 INFO:tasks.workunit.client.0.smithi069.stderr:131350K .......... .......... .......... .......... .......... 96% 17.4M 0s 2024-02-21T07:44:10.701 INFO:tasks.workunit.client.0.smithi069.stderr:131400K .......... .......... .......... .......... .......... 96% 18.9M 0s 2024-02-21T07:44:10.705 INFO:tasks.workunit.client.0.smithi069.stderr:131450K .......... .......... .......... .......... .......... 96% 12.8M 0s 2024-02-21T07:44:10.708 INFO:tasks.workunit.client.0.smithi069.stderr:131500K .......... .......... .......... .......... .......... 96% 15.1M 0s 2024-02-21T07:44:10.711 INFO:tasks.workunit.client.0.smithi069.stderr:131550K .......... .......... .......... .......... .......... 96% 15.5M 0s 2024-02-21T07:44:10.717 INFO:tasks.workunit.client.0.smithi069.stderr:131600K .......... .......... .......... .......... .......... 96% 28.6M 0s 2024-02-21T07:44:10.718 INFO:tasks.workunit.client.0.smithi069.stderr:131650K .......... .......... .......... .......... .......... 97% 32.8M 0s 2024-02-21T07:44:10.718 INFO:tasks.workunit.client.0.smithi069.stderr:131700K .......... .......... .......... .......... .......... 97% 53.9M 0s 2024-02-21T07:44:10.718 INFO:tasks.workunit.client.0.smithi069.stderr:131750K .......... .......... .......... .......... .......... 97% 74.5M 0s 2024-02-21T07:44:10.718 INFO:tasks.workunit.client.0.smithi069.stderr:131800K .......... .......... .......... .......... .......... 97% 54.2M 0s 2024-02-21T07:44:10.720 INFO:tasks.workunit.client.0.smithi069.stderr:131850K .......... .......... .......... .......... .......... 97% 13.5M 0s 2024-02-21T07:44:10.721 INFO:tasks.workunit.client.0.smithi069.stderr:131900K .......... .......... .......... .......... .......... 97% 96.9M 0s 2024-02-21T07:44:10.722 INFO:tasks.workunit.client.0.smithi069.stderr:131950K .......... .......... .......... .......... .......... 97% 115M 0s 2024-02-21T07:44:10.722 INFO:tasks.workunit.client.0.smithi069.stderr:132000K .......... .......... .......... .......... .......... 97% 114M 0s 2024-02-21T07:44:10.723 INFO:tasks.workunit.client.0.smithi069.stderr:132050K .......... .......... .......... .......... .......... 97% 88.7M 0s 2024-02-21T07:44:10.723 INFO:tasks.workunit.client.0.smithi069.stderr:132100K .......... .......... .......... .......... .......... 97% 114M 0s 2024-02-21T07:44:10.724 INFO:tasks.workunit.client.0.smithi069.stderr:132150K .......... .......... .......... .......... .......... 97% 31.7M 0s 2024-02-21T07:44:10.725 INFO:tasks.workunit.client.0.smithi069.stderr:132200K .......... .......... .......... .......... .......... 97% 42.5M 0s 2024-02-21T07:44:10.727 INFO:tasks.workunit.client.0.smithi069.stderr:132250K .......... .......... .......... .......... .......... 97% 25.9M 0s 2024-02-21T07:44:10.729 INFO:tasks.workunit.client.0.smithi069.stderr:132300K .......... .......... .......... .......... .......... 97% 30.5M 0s 2024-02-21T07:44:10.731 INFO:tasks.workunit.client.0.smithi069.stderr:132350K .......... .......... .......... .......... .......... 97% 23.5M 0s 2024-02-21T07:44:10.732 INFO:tasks.workunit.client.0.smithi069.stderr:132400K .......... .......... .......... .......... .......... 97% 32.4M 0s 2024-02-21T07:44:10.734 INFO:tasks.workunit.client.0.smithi069.stderr:132450K .......... .......... .......... .......... .......... 97% 28.2M 0s 2024-02-21T07:44:10.736 INFO:tasks.workunit.client.0.smithi069.stderr:132500K .......... .......... .......... .......... .......... 97% 31.3M 0s 2024-02-21T07:44:10.741 INFO:tasks.workunit.client.0.smithi069.stderr:132550K .......... .......... .......... .......... .......... 97% 11.2M 0s 2024-02-21T07:44:10.741 INFO:tasks.workunit.client.0.smithi069.stderr:132600K .......... .......... .......... .......... .......... 97% 80.3M 0s 2024-02-21T07:44:10.742 INFO:tasks.workunit.client.0.smithi069.stderr:132650K .......... .......... .......... .......... .......... 97% 36.2M 0s 2024-02-21T07:44:10.743 INFO:tasks.workunit.client.0.smithi069.stderr:132700K .......... .......... .......... .......... .......... 97% 72.3M 0s 2024-02-21T07:44:10.744 INFO:tasks.workunit.client.0.smithi069.stderr:132750K .......... .......... .......... .......... .......... 97% 40.0M 0s 2024-02-21T07:44:10.746 INFO:tasks.workunit.client.0.smithi069.stderr:132800K .......... .......... .......... .......... .......... 97% 22.5M 0s 2024-02-21T07:44:10.751 INFO:tasks.workunit.client.0.smithi069.stderr:132850K .......... .......... .......... .......... .......... 97% 15.6M 0s 2024-02-21T07:44:10.751 INFO:tasks.workunit.client.0.smithi069.stderr:132900K .......... .......... .......... .......... .......... 97% 97.9M 0s 2024-02-21T07:44:10.751 INFO:tasks.workunit.client.0.smithi069.stderr:132950K .......... .......... .......... .......... .......... 97% 37.0M 0s 2024-02-21T07:44:10.752 INFO:tasks.workunit.client.0.smithi069.stderr:133000K .......... .......... .......... .......... .......... 98% 27.0M 0s 2024-02-21T07:44:10.755 INFO:tasks.workunit.client.0.smithi069.stderr:133050K .......... .......... .......... .......... .......... 98% 27.3M 0s 2024-02-21T07:44:10.756 INFO:tasks.workunit.client.0.smithi069.stderr:133100K .......... .......... .......... .......... .......... 98% 33.1M 0s 2024-02-21T07:44:10.758 INFO:tasks.workunit.client.0.smithi069.stderr:133150K .......... .......... .......... .......... .......... 98% 28.2M 0s 2024-02-21T07:44:10.759 INFO:tasks.workunit.client.0.smithi069.stderr:133200K .......... .......... .......... .......... .......... 98% 35.8M 0s 2024-02-21T07:44:10.763 INFO:tasks.workunit.client.0.smithi069.stderr:133250K .......... .......... .......... .......... .......... 98% 17.3M 0s 2024-02-21T07:44:10.763 INFO:tasks.workunit.client.0.smithi069.stderr:133300K .......... .......... .......... .......... .......... 98% 42.9M 0s 2024-02-21T07:44:10.765 INFO:tasks.workunit.client.0.smithi069.stderr:133350K .......... .......... .......... .......... .......... 98% 37.8M 0s 2024-02-21T07:44:10.766 INFO:tasks.workunit.client.0.smithi069.stderr:133400K .......... .......... .......... .......... .......... 98% 26.5M 0s 2024-02-21T07:44:10.768 INFO:tasks.workunit.client.0.smithi069.stderr:133450K .......... .......... .......... .......... .......... 98% 34.7M 0s 2024-02-21T07:44:10.769 INFO:tasks.workunit.client.0.smithi069.stderr:133500K .......... .......... .......... .......... .......... 98% 29.6M 0s 2024-02-21T07:44:10.771 INFO:tasks.workunit.client.0.smithi069.stderr:133550K .......... .......... .......... .......... .......... 98% 32.6M 0s 2024-02-21T07:44:10.772 INFO:tasks.workunit.client.0.smithi069.stderr:133600K .......... .......... .......... .......... .......... 98% 30.0M 0s 2024-02-21T07:44:10.775 INFO:tasks.workunit.client.0.smithi069.stderr:133650K .......... .......... .......... .......... .......... 98% 21.8M 0s 2024-02-21T07:44:10.777 INFO:tasks.workunit.client.0.smithi069.stderr:133700K .......... .......... .......... .......... .......... 98% 25.8M 0s 2024-02-21T07:44:10.778 INFO:tasks.workunit.client.0.smithi069.stderr:133750K .......... .......... .......... .......... .......... 98% 32.4M 0s 2024-02-21T07:44:10.779 INFO:tasks.workunit.client.0.smithi069.stderr:133800K .......... .......... .......... .......... .......... 98% 44.0M 0s 2024-02-21T07:44:10.788 INFO:tasks.workunit.client.0.smithi069.stderr:133850K .......... .......... .......... .......... .......... 98% 19.0M 0s 2024-02-21T07:44:10.788 INFO:tasks.workunit.client.0.smithi069.stderr:133900K .......... .......... .......... .......... .......... 98% 27.1M 0s 2024-02-21T07:44:10.788 INFO:tasks.workunit.client.0.smithi069.stderr:133950K .......... .......... .......... .......... .......... 98% 65.1M 0s 2024-02-21T07:44:10.788 INFO:tasks.workunit.client.0.smithi069.stderr:134000K .......... .......... .......... .......... .......... 98% 21.1M 0s 2024-02-21T07:44:10.788 INFO:tasks.workunit.client.0.smithi069.stderr:134050K .......... .......... .......... .......... .......... 98% 64.1M 0s 2024-02-21T07:44:10.789 INFO:tasks.workunit.client.0.smithi069.stderr:134100K .......... .......... .......... .......... .......... 98% 23.2M 0s 2024-02-21T07:44:10.791 INFO:tasks.workunit.client.0.smithi069.stderr:134150K .......... .......... .......... .......... .......... 98% 38.7M 0s 2024-02-21T07:44:10.792 INFO:tasks.workunit.client.0.smithi069.stderr:134200K .......... .......... .......... .......... .......... 98% 26.1M 0s 2024-02-21T07:44:10.794 INFO:tasks.workunit.client.0.smithi069.stderr:134250K .......... .......... .......... .......... .......... 98% 27.5M 0s 2024-02-21T07:44:10.796 INFO:tasks.workunit.client.0.smithi069.stderr:134300K .......... .......... .......... .......... .......... 98% 34.8M 0s 2024-02-21T07:44:10.798 INFO:tasks.workunit.client.0.smithi069.stderr:134350K .......... .......... .......... .......... .......... 99% 23.2M 0s 2024-02-21T07:44:10.800 INFO:tasks.workunit.client.0.smithi069.stderr:134400K .......... .......... .......... .......... .......... 99% 36.8M 0s 2024-02-21T07:44:10.802 INFO:tasks.workunit.client.0.smithi069.stderr:134450K .......... .......... .......... .......... .......... 99% 22.0M 0s 2024-02-21T07:44:10.803 INFO:tasks.workunit.client.0.smithi069.stderr:134500K .......... .......... .......... .......... .......... 99% 27.8M 0s 2024-02-21T07:44:10.805 INFO:tasks.workunit.client.0.smithi069.stderr:134550K .......... .......... .......... .......... .......... 99% 33.9M 0s 2024-02-21T07:44:10.806 INFO:tasks.workunit.client.0.smithi069.stderr:134600K .......... .......... .......... .......... .......... 99% 30.9M 0s 2024-02-21T07:44:10.808 INFO:tasks.workunit.client.0.smithi069.stderr:134650K .......... .......... .......... .......... .......... 99% 32.0M 0s 2024-02-21T07:44:10.809 INFO:tasks.workunit.client.0.smithi069.stderr:134700K .......... .......... .......... .......... .......... 99% 34.7M 0s 2024-02-21T07:44:10.811 INFO:tasks.workunit.client.0.smithi069.stderr:134750K .......... .......... .......... .......... .......... 99% 22.6M 0s 2024-02-21T07:44:10.812 INFO:tasks.workunit.client.0.smithi069.stderr:134800K .......... .......... .......... .......... .......... 99% 33.7M 0s 2024-02-21T07:44:10.814 INFO:tasks.workunit.client.0.smithi069.stderr:134850K .......... .......... .......... .......... .......... 99% 26.6M 0s 2024-02-21T07:44:10.816 INFO:tasks.workunit.client.0.smithi069.stderr:134900K .......... .......... .......... .......... .......... 99% 27.4M 0s 2024-02-21T07:44:10.818 INFO:tasks.workunit.client.0.smithi069.stderr:134950K .......... .......... .......... .......... .......... 99% 42.6M 0s 2024-02-21T07:44:10.822 INFO:tasks.workunit.client.0.smithi069.stderr:135000K .......... .......... .......... .......... .......... 99% 19.8M 0s 2024-02-21T07:44:10.822 INFO:tasks.workunit.client.0.smithi069.stderr:135050K .......... .......... .......... .......... .......... 99% 61.3M 0s 2024-02-21T07:44:10.823 INFO:tasks.workunit.client.0.smithi069.stderr:135100K .......... .......... .......... .......... .......... 99% 25.8M 0s 2024-02-21T07:44:10.825 INFO:tasks.workunit.client.0.smithi069.stderr:135150K .......... .......... .......... .......... .......... 99% 22.6M 0s 2024-02-21T07:44:10.827 INFO:tasks.workunit.client.0.smithi069.stderr:135200K .......... .......... .......... .......... .......... 99% 35.0M 0s 2024-02-21T07:44:10.830 INFO:tasks.workunit.client.0.smithi069.stderr:135250K .......... .......... .......... .......... .......... 99% 25.0M 0s 2024-02-21T07:44:10.830 INFO:tasks.workunit.client.0.smithi069.stderr:135300K .......... .......... .......... .......... .......... 99% 46.2M 0s 2024-02-21T07:44:10.831 INFO:tasks.workunit.client.0.smithi069.stderr:135350K .......... .......... .......... .......... .......... 99% 25.4M 0s 2024-02-21T07:44:10.833 INFO:tasks.workunit.client.0.smithi069.stderr:135400K .......... .......... .......... .......... .......... 99% 23.3M 0s 2024-02-21T07:44:10.836 INFO:tasks.workunit.client.0.smithi069.stderr:135450K .......... .......... .......... .......... .......... 99% 34.6M 0s 2024-02-21T07:44:10.837 INFO:tasks.workunit.client.0.smithi069.stderr:135500K .......... .......... .......... .......... .......... 99% 23.4M 0s 2024-02-21T07:44:10.840 INFO:tasks.workunit.client.0.smithi069.stderr:135550K .......... .......... .......... .......... .......... 99% 64.3M 0s 2024-02-21T07:44:10.840 INFO:tasks.workunit.client.0.smithi069.stderr:135600K .......... .......... .......... .......... .......... 99% 24.3M 0s 2024-02-21T07:44:10.842 INFO:tasks.workunit.client.0.smithi069.stderr:135650K .......... .......... .......... .......... .......... 99% 24.3M 0s 2024-02-21T07:44:10.843 INFO:tasks.workunit.client.0.smithi069.stderr:135700K .......... .......... .......... .......... .......... 99% 42.4M 0s 2024-02-21T07:44:10.843 INFO:tasks.workunit.client.0.smithi069.stderr:135750K .. 100% 82.4M=5.6s 2024-02-21T07:44:10.843 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-02-21T07:44:10.844 INFO:tasks.workunit.client.0.smithi069.stderr:2024-02-21 07:44:10 (23.6 MB/s) - ‘linux.tar.xz’ saved [139010916/139010916] 2024-02-21T07:44:10.844 INFO:tasks.workunit.client.0.smithi069.stderr: 2024-02-21T07:44:10.844 INFO:tasks.workunit.client.0.smithi069.stderr:+ mkdir t 2024-02-21T07:44:10.848 INFO:tasks.workunit.client.0.smithi069.stderr:+ cd t 2024-02-21T07:44:10.848 INFO:tasks.workunit.client.0.smithi069.stderr:+ tar xJf ../linux.tar.xz 2024-02-21T07:44:12.654 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:12.662 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:12.665 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.820+0000 7fc5a2800640 1 Processor -- start 2024-02-21T07:44:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.820+0000 7fc5a2800640 1 -- start start 2024-02-21T07:44:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.821+0000 7fc5a2800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc59c187c10 0x7fc59c1880a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.821+0000 7fc5a2800640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c189af0 con 0x7fc59c185650 2024-02-21T07:44:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.821+0000 7fc5a2800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c17c440 con 0x7fc59c185a30 2024-02-21T07:44:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.821+0000 7fc5a2800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0f9070 con 0x7fc59c187c10 2024-02-21T07:44:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.822+0000 7fc593e00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc59c185a30 0x7fc59c185ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:33394/0 (socket says 172.21.15.69:33394) 2024-02-21T07:44:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.822+0000 7fc59b400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fc59c185650 0x7fc59c1893e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:42588/0 (socket says 172.21.15.69:42588) 2024-02-21T07:44:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.822+0000 7fc59be00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc59c187c10 0x7fc59c1880a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.822+0000 7fc593e00640 1 -- 172.21.15.69:0/3832034224 learned_addr learned my addr 172.21.15.69:0/3832034224 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.822+0000 7fc59aa00640 1 -- 172.21.15.69:0/3832034224 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095120089 0 0) 0x7fc58c001110 con 0x7fc59c185650 2024-02-21T07:44:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.822+0000 7fc59aa00640 1 -- 172.21.15.69:0/3832034224 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc580003520 con 0x7fc59c185650 2024-02-21T07:44:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.822+0000 7fc59aa00640 1 -- 172.21.15.69:0/3832034224 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622226736 0 0) 0x7fc59c17c440 con 0x7fc59c185a30 2024-02-21T07:44:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.822+0000 7fc59be00640 1 -- 172.21.15.69:0/3832034224 >> v1:172.21.15.184:6789/0 conn(0x7fc59c185a30 legacy=0x7fc59c185ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.822+0000 7fc59be00640 1 -- 172.21.15.69:0/3832034224 >> v1:172.21.15.174:6789/0 conn(0x7fc59c185650 legacy=0x7fc59c1893e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.822+0000 7fc59be00640 1 -- 172.21.15.69:0/3832034224 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c186b70 con 0x7fc59c187c10 2024-02-21T07:44:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.823+0000 7fc59be00640 1 --2- 172.21.15.69:0/3832034224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc59c187c10 0x7fc59c1880a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc594009d90 tx=0x7fc59402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6543dcf7ffb277ce server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.824+0000 7fc59aa00640 1 -- 172.21.15.69:0/3832034224 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59402cd00 con 0x7fc59c187c10 2024-02-21T07:44:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.824+0000 7fc59aa00640 1 -- 172.21.15.69:0/3832034224 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59402ce60 con 0x7fc59c187c10 2024-02-21T07:44:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.824+0000 7fc59aa00640 1 -- 172.21.15.69:0/3832034224 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594034660 con 0x7fc59c187c10 2024-02-21T07:44:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.824+0000 7fc5a2800640 1 -- 172.21.15.69:0/3832034224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc59c187c10 msgr2=0x7fc59c1880a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.824+0000 7fc5a2800640 1 --2- 172.21.15.69:0/3832034224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc59c187c10 0x7fc59c1880a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc594009d90 tx=0x7fc59402bf50 comp rx=0 tx=0).stop 2024-02-21T07:44:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.824+0000 7fc5a2800640 1 -- 172.21.15.69:0/3832034224 shutdown_connections 2024-02-21T07:44:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.824+0000 7fc5a2800640 1 --2- 172.21.15.69:0/3832034224 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc59c187c10 0x7fc59c1880a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.824+0000 7fc5a2800640 1 -- 172.21.15.69:0/3832034224 >> 172.21.15.69:0/3832034224 conn(0x7fc59c0ce1e0 msgr2=0x7fc59c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.825+0000 7fc5a2800640 1 -- 172.21.15.69:0/3832034224 shutdown_connections 2024-02-21T07:44:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.825+0000 7fc5a2800640 1 -- 172.21.15.69:0/3832034224 wait complete. 2024-02-21T07:44:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.827+0000 7fc5a2800640 1 Processor -- start 2024-02-21T07:44:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.827+0000 7fc5a2800640 1 -- start start 2024-02-21T07:44:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc5a2800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc59c185650 0x7fc59c164210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc5a2800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59c185a30 0x7fc59c0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc5a2800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc59c187c10 0x7fc59c21e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc5a2800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0cded0 con 0x7fc59c185650 2024-02-21T07:44:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc5a2800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0cd350 con 0x7fc59c187c10 2024-02-21T07:44:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc5a2800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0cd630 con 0x7fc59c185a30 2024-02-21T07:44:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc59b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc59c185650 0x7fc59c164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc59b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc59c185650 0x7fc59c164210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57530/0 (socket says 172.21.15.69:57530) 2024-02-21T07:44:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc59b400640 1 -- 172.21.15.69:0/4100490367 learned_addr learned my addr 172.21.15.69:0/4100490367 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc59be00640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc59c187c10 0x7fc59c21e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.828+0000 7fc593e00640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59c185a30 0x7fc59c0cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc59be00640 1 -- 172.21.15.69:0/4100490367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59c185a30 msgr2=0x7fc59c0cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc59be00640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59c185a30 0x7fc59c0cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc59be00640 1 -- 172.21.15.69:0/4100490367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc59c185650 msgr2=0x7fc59c164210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc59be00640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc59c185650 0x7fc59c164210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc59be00640 1 -- 172.21.15.69:0/4100490367 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594009a70 con 0x7fc59c187c10 2024-02-21T07:44:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc593e00640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59c185a30 0x7fc59c0cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc59be00640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc59c187c10 0x7fc59c21e660 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc594033000 tx=0x7fc594004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc593400640 1 -- 172.21.15.69:0/4100490367 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594003b90 con 0x7fc59c187c10 2024-02-21T07:44:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc593400640 1 -- 172.21.15.69:0/4100490367 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc594003d10 con 0x7fc59c187c10 2024-02-21T07:44:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc593400640 1 -- 172.21.15.69:0/4100490367 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594004260 con 0x7fc59c187c10 2024-02-21T07:44:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.829+0000 7fc5a2800640 1 -- 172.21.15.69:0/4100490367 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c0cd910 con 0x7fc59c187c10 2024-02-21T07:44:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.830+0000 7fc5a2800640 1 -- 172.21.15.69:0/4100490367 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c21f740 con 0x7fc59c187c10 2024-02-21T07:44:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.833+0000 7fc593400640 1 -- 172.21.15.69:0/4100490367 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc59403b040 con 0x7fc59c187c10 2024-02-21T07:44:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.833+0000 7fc5a55b6740 1 Processor -- start 2024-02-21T07:44:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.834+0000 7fc5a55b6740 1 -- start start 2024-02-21T07:44:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.834+0000 7fc593400640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc57809f160 0x7fc5780a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.834+0000 7fc593400640 1 -- 172.21.15.69:0/4100490367 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5940ebe90 con 0x7fc59c187c10 2024-02-21T07:44:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.834+0000 7fc593e00640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc57809f160 0x7fc5780a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23f2070 0x55e5c23b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c23b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23b6f90 0x55e5c23f2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc593e00640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc57809f160 0x7fc5780a1620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc59c073790 tx=0x7fc584007d80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c2372620 con 0x55e5c24264d0 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c23248c0 con 0x55e5c23f2070 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c2321df0 con 0x55e5c23b6f90 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc59b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23f2070 0x55e5c23b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc593e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c23b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc59b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23f2070 0x55e5c23b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:46224/0 (socket says 172.21.15.69:46224) 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc59b400640 1 -- 172.21.15.69:0/3993893423 learned_addr learned my addr 172.21.15.69:0/3993893423 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.835+0000 7fc59be00640 1 --2- 172.21.15.69:0/3993893423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23b6f90 0x55e5c23f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.836+0000 7fc59b400640 1 -- 172.21.15.69:0/3993893423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23b6f90 msgr2=0x55e5c23f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.836+0000 7fc59b400640 1 --2- 172.21.15.69:0/3993893423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23b6f90 0x55e5c23f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.836+0000 7fc59b400640 1 -- 172.21.15.69:0/3993893423 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 msgr2=0x55e5c23b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.836+0000 7fc59b400640 1 --2- 172.21.15.69:0/3993893423 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c23b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.836+0000 7fc59b400640 1 -- 172.21.15.69:0/3993893423 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5c229eb00 con 0x55e5c23f2070 2024-02-21T07:44:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.836+0000 7fc59b400640 1 --2- 172.21.15.69:0/3993893423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23f2070 0x55e5c23b1440 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc58c007500 tx=0x7fc58c004bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bc499c34183eb8f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.836+0000 7fc58be00640 1 -- 172.21.15.69:0/3993893423 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c007150 con 0x55e5c23f2070 2024-02-21T07:44:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.836+0000 7fc58be00640 1 -- 172.21.15.69:0/3993893423 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c001b30 con 0x55e5c23f2070 2024-02-21T07:44:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.836+0000 7fc58be00640 1 -- 172.21.15.69:0/3993893423 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c012350 con 0x55e5c23f2070 2024-02-21T07:44:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.837+0000 7fc5a55b6740 1 -- 172.21.15.69:0/3993893423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23f2070 msgr2=0x55e5c23b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.837+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/3993893423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23f2070 0x55e5c23b1440 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc58c007500 tx=0x7fc58c004bb0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.837+0000 7fc5a55b6740 1 -- 172.21.15.69:0/3993893423 shutdown_connections 2024-02-21T07:44:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.837+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/3993893423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23b6f90 0x55e5c23f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.837+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/3993893423 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c23b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.837+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/3993893423 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23f2070 0x55e5c23b1440 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.837+0000 7fc5a55b6740 1 -- 172.21.15.69:0/3993893423 >> 172.21.15.69:0/3993893423 conn(0x55e5c237e4b0 msgr2=0x55e5c23b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.837+0000 7fc5a55b6740 1 -- 172.21.15.69:0/3993893423 shutdown_connections 2024-02-21T07:44:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.837+0000 7fc5a55b6740 1 -- 172.21.15.69:0/3993893423 wait complete. 2024-02-21T07:44:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.838+0000 7fc5a55b6740 1 -- start start 2024-02-21T07:44:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.838+0000 7fc5a55b6740 1 Processor -- start 2024-02-21T07:44:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.839+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 0x55e5c23e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.839+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 0x55e5c2427bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.839+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c23e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.839+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c231d5d0 con 0x55e5c24264d0 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.839+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c22c2b50 con 0x55e5c23b6f90 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.839+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c22c27f0 con 0x55e5c23f2070 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.839+0000 7fc5a55b6740 10 client.0 _ll_register_callbacks cb 0x55e5c22d6550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc59b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 0x55e5c23e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc59be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c23e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc59b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 0x55e5c23e2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:46226/0 (socket says 172.21.15.69:46226) 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc59b400640 1 -- 172.21.15.69:0/1355653306 learned_addr learned my addr 172.21.15.69:0/1355653306 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc593e00640 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 0x55e5c2427bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc59b400640 1 -- 172.21.15.69:0/1355653306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 msgr2=0x55e5c2427bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc59b400640 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 0x55e5c2427bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc59b400640 1 -- 172.21.15.69:0/1355653306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 msgr2=0x55e5c23e38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc59b400640 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c23e38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc59b400640 1 -- 172.21.15.69:0/1355653306 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc580003520 con 0x55e5c23b6f90 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc59b400640 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 0x55e5c23e2ca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc58c017040 tx=0x7fc58c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b662c5e9459b18 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.840+0000 7fc588c00640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.841+0000 7fc588c00640 1 -- 172.21.15.69:0/1355653306 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c013800 con 0x55e5c23b6f90 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.841+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1355653306 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5c22efcd0 con 0x55e5c23b6f90 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.841+0000 7fc588c00640 1 -- 172.21.15.69:0/1355653306 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc58c013960 con 0x55e5c23b6f90 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.841+0000 7fc588c00640 1 -- 172.21.15.69:0/1355653306 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc58c013b20 con 0x55e5c23b6f90 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.841+0000 7fc5a55b6740 10 client.5605 fetch_fsmap learned FSMap version 19 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.841+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1355653306 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55e5c231bc50 con 0x55e5c23b6f90 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.841+0000 7fc588c00640 1 -- 172.21.15.69:0/1355653306 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c02d020 con 0x55e5c23b6f90 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.842+0000 7fc588c00640 1 -- 172.21.15.69:0/1355653306 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc58c01b070 con 0x55e5c23b6f90 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.842+0000 7fc5a55b6740 10 client.5605 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:44:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.842+0000 7fc5a55b6740 10 client.5605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.842+0000 7fc5a55b6740 20 client.5605 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.842+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55e5c23f6e10 0x55e5c23f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.842+0000 7fc5a55b6740 4 client.5605 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.842+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1355653306 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5c2313ce0 con 0x55e5c23f6e10 2024-02-21T07:44:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.842+0000 7fc593e00640 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55e5c23f6e10 0x55e5c23f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.842+0000 7fc593e00640 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55e5c23f6e10 0x55e5c23f71f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b897598e4e96993a server_cookie=9f510e8c07e28914 in_seq=0 out_seq=0 2024-02-21T07:44:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.842+0000 7fc588c00640 10 client.5605 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc588c00640 1 -- 172.21.15.69:0/1355653306 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e5c2313ce0 con 0x55e5c23f6e10 2024-02-21T07:44:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc588c00640 10 client.5605 handle_command_reply: tid=0 2024-02-21T07:44:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc5a55b6740 1 client.5605 shutdown 2024-02-21T07:44:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1355653306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 msgr2=0x55e5c23e2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 0x55e5c23e2ca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc58c017040 tx=0x7fc58c000bc0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1355653306 shutdown_connections 2024-02-21T07:44:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55e5c23f6e10 0x55e5c23f71f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c23e38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 0x55e5c2427bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/1355653306 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 0x55e5c23e2ca0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc588c00640 0 client.5605 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.843+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1355653306 >> 172.21.15.69:0/1355653306 conn(0x55e5c237e4b0 msgr2=0x55e5c2426950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.844+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1355653306 shutdown_connections 2024-02-21T07:44:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.844+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1355653306 wait complete. 2024-02-21T07:44:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.844+0000 7fc5a55b6740 20 client.5605 trim_cache size 0 max 16384 2024-02-21T07:44:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.858+0000 7fc5a55b6740 1 Processor -- start 2024-02-21T07:44:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.859+0000 7fc5a55b6740 1 -- start start 2024-02-21T07:44:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23b6f90 0x55e5c23bc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c23f2070 0x55e5c23acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c24264d0 0x55e5c23dbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c2065e60 con 0x55e5c23f2070 2024-02-21T07:44:12.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c23f6150 con 0x55e5c24264d0 2024-02-21T07:44:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c24283c0 con 0x55e5c23b6f90 2024-02-21T07:44:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc593e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c23f2070 0x55e5c23acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc59b400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23b6f90 0x55e5c23bc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc59be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c24264d0 0x55e5c23dbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc593e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c23f2070 0x55e5c23acbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57540/0 (socket says 172.21.15.69:57540) 2024-02-21T07:44:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc593e00640 1 -- 172.21.15.69:0/1189021609 learned_addr learned my addr 172.21.15.69:0/1189021609 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc59be00640 1 -- 172.21.15.69:0/1189021609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23b6f90 msgr2=0x55e5c23bc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc59be00640 1 --2- 172.21.15.69:0/1189021609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23b6f90 0x55e5c23bc890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc59be00640 1 -- 172.21.15.69:0/1189021609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c23f2070 msgr2=0x55e5c23acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc59be00640 1 --2- 172.21.15.69:0/1189021609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c23f2070 0x55e5c23acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc59be00640 1 -- 172.21.15.69:0/1189021609 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5c24243f0 con 0x55e5c24264d0 2024-02-21T07:44:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.860+0000 7fc593e00640 1 --2- 172.21.15.69:0/1189021609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c23f2070 0x55e5c23acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc59be00640 1 --2- 172.21.15.69:0/1189021609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c24264d0 0x55e5c23dbf00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc5940e97c0 tx=0x7fc5940a4040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbfad82fb326e27b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc58b400640 1 -- 172.21.15.69:0/1189021609 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594009450 con 0x55e5c24264d0 2024-02-21T07:44:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc58b400640 1 -- 172.21.15.69:0/1189021609 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5940ba020 con 0x55e5c24264d0 2024-02-21T07:44:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc58b400640 1 -- 172.21.15.69:0/1189021609 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5940b9920 con 0x55e5c24264d0 2024-02-21T07:44:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1189021609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c24264d0 msgr2=0x55e5c23dbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/1189021609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c24264d0 0x55e5c23dbf00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc5940e97c0 tx=0x7fc5940a4040 comp rx=0 tx=0).stop 2024-02-21T07:44:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1189021609 shutdown_connections 2024-02-21T07:44:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/1189021609 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c24264d0 0x55e5c23dbf00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/1189021609 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c23f2070 0x55e5c23acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/1189021609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23b6f90 0x55e5c23bc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.861+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1189021609 >> 172.21.15.69:0/1189021609 conn(0x55e5c237e4b0 msgr2=0x55e5c23f2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.862+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1189021609 shutdown_connections 2024-02-21T07:44:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.862+0000 7fc5a55b6740 1 -- 172.21.15.69:0/1189021609 wait complete. 2024-02-21T07:44:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.862+0000 7fc5a55b6740 1 -- start start 2024-02-21T07:44:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.863+0000 7fc5a55b6740 1 Processor -- start 2024-02-21T07:44:12.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 0x55e5c2426940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 0x55e5c23b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc5a55b6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c2482b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c2489450 con 0x55e5c24264d0 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c23dbee0 con 0x55e5c23b6f90 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc5a55b6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5c23dc340 con 0x55e5c23f2070 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc5a55b6740 10 client.0 _ll_register_callbacks cb 0x7fc58c0070a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc59be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c2482b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc59be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c2482b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57550/0 (socket says 172.21.15.69:57550) 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc59be00640 1 -- 172.21.15.69:0/2978188973 learned_addr learned my addr 172.21.15.69:0/2978188973 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc59b400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 0x55e5c2426940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.864+0000 7fc593e00640 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 0x55e5c23b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc59be00640 1 -- 172.21.15.69:0/2978188973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 msgr2=0x55e5c23b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc59be00640 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 0x55e5c23b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc59be00640 1 -- 172.21.15.69:0/2978188973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 msgr2=0x55e5c2426940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc59be00640 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 0x55e5c2426940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:12.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc59be00640 1 -- 172.21.15.69:0/2978188973 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58400f040 con 0x55e5c24264d0 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc593e00640 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 0x55e5c23b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc59be00640 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c2482b00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc594003ff0 tx=0x7fc59404a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a83d68620e5406b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc588c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc588c00640 1 -- 172.21.15.69:0/2978188973 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5940c1e30 con 0x55e5c24264d0 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc588c00640 1 -- 172.21.15.69:0/2978188973 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5940bda70 con 0x55e5c24264d0 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc5a55b6740 1 -- 172.21.15.69:0/2978188973 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5c2342d30 con 0x55e5c24264d0 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc588c00640 1 -- 172.21.15.69:0/2978188973 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc594009450 con 0x55e5c24264d0 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc5a55b6740 10 client.5424 fetch_fsmap learned FSMap version 19 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc5a55b6740 1 -- 172.21.15.69:0/2978188973 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x7fc59c21f740 con 0x55e5c24264d0 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.865+0000 7fc588c00640 1 -- 172.21.15.69:0/2978188973 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5940e9020 con 0x55e5c24264d0 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.866+0000 7fc588c00640 1 -- 172.21.15.69:0/2978188973 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc59404f020 con 0x55e5c24264d0 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.866+0000 7fc5a55b6740 10 client.5424 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.866+0000 7fc5a55b6740 10 client.5424 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:12.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.866+0000 7fc5a55b6740 20 client.5424 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.866+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55e5c23b09a0 0x55e5c2483040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.866+0000 7fc5a55b6740 4 client.5424 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:44:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.866+0000 7fc5a55b6740 1 -- 172.21.15.69:0/2978188973 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e5c201d600 con 0x55e5c23b09a0 2024-02-21T07:44:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.866+0000 7fc59b400640 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55e5c23b09a0 0x55e5c2483040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.866+0000 7fc59b400640 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55e5c23b09a0 0x55e5c2483040 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27c0d8352c624a65 server_cookie=a2cf7ffdbe7c6bf8 in_seq=0 out_seq=0 2024-02-21T07:44:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:12.866+0000 7fc588c00640 10 client.5424 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.136+0000 7fc588c00640 1 -- 172.21.15.69:0/2978188973 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e5c201d600 con 0x55e5c23b09a0 2024-02-21T07:44:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc588c00640 10 client.5424 handle_command_reply: tid=0 2024-02-21T07:44:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 client.5424 shutdown 2024-02-21T07:44:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 -- 172.21.15.69:0/2978188973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 msgr2=0x55e5c2482b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c2482b00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc594003ff0 tx=0x7fc59404a040 comp rx=0 tx=0).stop 2024-02-21T07:44:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 -- 172.21.15.69:0/2978188973 shutdown_connections 2024-02-21T07:44:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55e5c23b09a0 0x55e5c2483040 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:13.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e5c24264d0 0x55e5c2482b00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55e5c23f2070 0x55e5c23b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 --2- 172.21.15.69:0/2978188973 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55e5c23b6f90 0x55e5c2426940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc588c00640 0 client.5424 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 -- 172.21.15.69:0/2978188973 >> 172.21.15.69:0/2978188973 conn(0x55e5c237e4b0 msgr2=0x55e5c23e4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 -- 172.21.15.69:0/2978188973 shutdown_connections 2024-02-21T07:44:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 1 -- 172.21.15.69:0/2978188973 wait complete. 2024-02-21T07:44:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.137+0000 7fc5a55b6740 20 client.5424 trim_cache size 0 max 16384 2024-02-21T07:44:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-02-21T07:44:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-02-21T07:44:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-02-21T07:44:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-02-21T07:44:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 -- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc57809f160 msgr2=0x7fc5780a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc57809f160 0x7fc5780a1620 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc59c073790 tx=0x7fc584007d80 comp rx=0 tx=0).stop 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 -- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc59c187c10 msgr2=0x7fc59c21e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc59c187c10 0x7fc59c21e660 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc594033000 tx=0x7fc594004a40 comp rx=0 tx=0).stop 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 -- 172.21.15.69:0/4100490367 shutdown_connections 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc57809f160 0x7fc5780a1620 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc59c187c10 0x7fc59c21e660 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc59c185a30 0x7fc59c0cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 --2- 172.21.15.69:0/4100490367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc59c185650 0x7fc59c164210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 -- 172.21.15.69:0/4100490367 >> 172.21.15.69:0/4100490367 conn(0x7fc59c0ce1e0 msgr2=0x7fc59c1893e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 -- 172.21.15.69:0/4100490367 shutdown_connections 2024-02-21T07:44:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:13.138+0000 7fc5a2800640 1 -- 172.21.15.69:0/4100490367 wait complete. 2024-02-21T07:44:14.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:44:14.330 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:44:14.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.544+0000 7fcad6800640 1 Processor -- start 2024-02-21T07:44:14.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.544+0000 7fcad6800640 1 -- start start 2024-02-21T07:44:14.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.546+0000 7fcad6800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fcad017d120 0x7fcad0186e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.546+0000 7fcad6800640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad0072c10 con 0x7fcad01873d0 2024-02-21T07:44:14.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.546+0000 7fcad6800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad0072090 con 0x7fcad0070180 2024-02-21T07:44:14.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.546+0000 7fcad6800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad0072370 con 0x7fcad017d120 2024-02-21T07:44:14.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.546+0000 7fcad4a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fcad01873d0 0x7fcad006fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38222/0 (socket says 172.21.15.69:38222) 2024-02-21T07:44:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.546+0000 7fcad4a00640 1 -- 172.21.15.69:0/1195137986 learned_addr learned my addr 172.21.15.69:0/1195137986 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.546+0000 7fcad5400640 1 --2- 172.21.15.69:0/1195137986 >> v2:172.21.15.174:3300/0 conn(0x7fcad017d120 0x7fcad0186e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.547+0000 7fcacfe00640 1 -- 172.21.15.69:0/1195137986 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983226738 0 0) 0x7fcad0072090 con 0x7fcad0070180 2024-02-21T07:44:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.547+0000 7fcacfe00640 1 -- 172.21.15.69:0/1195137986 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab8003520 con 0x7fcad0070180 2024-02-21T07:44:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.547+0000 7fcacfe00640 1 -- 172.21.15.69:0/1195137986 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 627787986 0 0) 0x7fcad0072c10 con 0x7fcad01873d0 2024-02-21T07:44:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.547+0000 7fcad5400640 1 -- 172.21.15.69:0/1195137986 >> v1:172.21.15.184:6789/0 conn(0x7fcad0070180 legacy=0x7fcad0071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.547+0000 7fcad5400640 1 -- 172.21.15.69:0/1195137986 >> v1:172.21.15.69:6789/0 conn(0x7fcad01873d0 legacy=0x7fcad006fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.552 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.547+0000 7fcad5400640 1 -- 172.21.15.69:0/1195137986 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0072650 con 0x7fcad017d120 2024-02-21T07:44:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.548+0000 7fcad5400640 1 --2- 172.21.15.69:0/1195137986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad017d120 0x7fcad0186e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097a0 tx=0x7fcac402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43778ec32e9e592b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.548+0000 7fcacfe00640 1 -- 172.21.15.69:0/1195137986 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac402e070 con 0x7fcad017d120 2024-02-21T07:44:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.548+0000 7fcacfe00640 1 -- 172.21.15.69:0/1195137986 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac40315a0 con 0x7fcad017d120 2024-02-21T07:44:14.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.548+0000 7fcacfe00640 1 -- 172.21.15.69:0/1195137986 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4031930 con 0x7fcad017d120 2024-02-21T07:44:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.549+0000 7fcad6800640 1 -- 172.21.15.69:0/1195137986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad017d120 msgr2=0x7fcad0186e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.549+0000 7fcad6800640 1 --2- 172.21.15.69:0/1195137986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad017d120 0x7fcad0186e90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcac40097a0 tx=0x7fcac402b840 comp rx=0 tx=0).stop 2024-02-21T07:44:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.549+0000 7fcad6800640 1 -- 172.21.15.69:0/1195137986 shutdown_connections 2024-02-21T07:44:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.549+0000 7fcad6800640 1 --2- 172.21.15.69:0/1195137986 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad017d120 0x7fcad0186e90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.549+0000 7fcad6800640 1 -- 172.21.15.69:0/1195137986 >> 172.21.15.69:0/1195137986 conn(0x7fcad00cf360 msgr2=0x7fcad00cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:14.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.549+0000 7fcad6800640 1 -- 172.21.15.69:0/1195137986 shutdown_connections 2024-02-21T07:44:14.555 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.549+0000 7fcad6800640 1 -- 172.21.15.69:0/1195137986 wait complete. 2024-02-21T07:44:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.551+0000 7fcad6800640 1 Processor -- start 2024-02-21T07:44:14.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.551+0000 7fcad6800640 1 -- start start 2024-02-21T07:44:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.552+0000 7fcad6800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0070180 0x7fcad0177100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.552+0000 7fcad6800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad017d120 0x7fcad0172340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.552+0000 7fcad6800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcad01873d0 0x7fcad017c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad6800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad017ab70 con 0x7fcad01873d0 2024-02-21T07:44:14.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad6800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0172880 con 0x7fcad017d120 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad6800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0177720 con 0x7fcad0070180 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad5400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0070180 0x7fcad0177100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad5e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcad01873d0 0x7fcad017c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad5400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0070180 0x7fcad0177100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40424/0 (socket says 172.21.15.69:40424) 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad5400640 1 -- 172.21.15.69:0/479850480 learned_addr learned my addr 172.21.15.69:0/479850480 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad4a00640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad017d120 0x7fcad0172340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad5400640 1 -- 172.21.15.69:0/479850480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad017d120 msgr2=0x7fcad0172340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad5400640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad017d120 0x7fcad0172340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad5400640 1 -- 172.21.15.69:0/479850480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcad01873d0 msgr2=0x7fcad017c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad5400640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcad01873d0 0x7fcad017c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.553+0000 7fcad5400640 1 -- 172.21.15.69:0/479850480 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4009400 con 0x7fcad0070180 2024-02-21T07:44:14.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.554+0000 7fcad5400640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0070180 0x7fcad0177100 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcac4034040 tx=0x7fcac40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:14.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.554+0000 7fcacd600640 1 -- 172.21.15.69:0/479850480 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4032630 con 0x7fcad0070180 2024-02-21T07:44:14.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.554+0000 7fcacd600640 1 -- 172.21.15.69:0/479850480 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4032790 con 0x7fcad0070180 2024-02-21T07:44:14.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.554+0000 7fcacd600640 1 -- 172.21.15.69:0/479850480 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4032b20 con 0x7fcad0070180 2024-02-21T07:44:14.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.554+0000 7fcad6800640 1 -- 172.21.15.69:0/479850480 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad0177a00 con 0x7fcad0070180 2024-02-21T07:44:14.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.554+0000 7fcad6800640 1 -- 172.21.15.69:0/479850480 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad0177fc0 con 0x7fcad0070180 2024-02-21T07:44:14.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.557+0000 7fcacd600640 1 -- 172.21.15.69:0/479850480 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fcac4043070 con 0x7fcad0070180 2024-02-21T07:44:14.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.559+0000 7fcacd600640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcab009f160 0x7fcab00a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.559+0000 7fcacd600640 1 -- 172.21.15.69:0/479850480 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fcac40eb4d0 con 0x7fcad0070180 2024-02-21T07:44:14.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.559+0000 7fcad4a00640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcab009f160 0x7fcab00a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.560+0000 7fcad4a00640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcab009f160 0x7fcab00a1620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcabc007f70 tx=0x7fcabc007f00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:14.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.561+0000 7fcadaa72740 1 Processor -- start 2024-02-21T07:44:14.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.561+0000 7fcadaa72740 1 -- start start 2024-02-21T07:44:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d11020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677d11560 0x561677cdb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677c9e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcadaa72740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677c0e150 con 0x561677cdb5a0 2024-02-21T07:44:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcadaa72740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677c0b680 con 0x561677cdbec0 2024-02-21T07:44:14.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcadaa72740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677c06e60 con 0x561677d11560 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcad5400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d11020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcad5400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d11020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57556/0 (socket says 172.21.15.69:57556) 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcad4a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677d11560 0x561677cdb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcad5400640 1 -- 172.21.15.69:0/1385362789 learned_addr learned my addr 172.21.15.69:0/1385362789 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.563+0000 7fcad5e00640 1 --2- 172.21.15.69:0/1385362789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677c9e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.564+0000 7fcad5400640 1 -- 172.21.15.69:0/1385362789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677d11560 msgr2=0x561677cdb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.564+0000 7fcad5400640 1 --2- 172.21.15.69:0/1385362789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677d11560 0x561677cdb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.564+0000 7fcad5400640 1 -- 172.21.15.69:0/1385362789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 msgr2=0x561677c9e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.564+0000 7fcad5400640 1 --2- 172.21.15.69:0/1385362789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677c9e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.564+0000 7fcad5400640 1 -- 172.21.15.69:0/1385362789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561677bc0060 con 0x561677cdb5a0 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.564+0000 7fcad5400640 1 --2- 172.21.15.69:0/1385362789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d11020 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcac40b52d0 tx=0x7fcac40b7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8f6a930301bef2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.564+0000 7fcac1c00640 1 -- 172.21.15.69:0/1385362789 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40ccea0 con 0x561677cdb5a0 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.564+0000 7fcac1c00640 1 -- 172.21.15.69:0/1385362789 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac40c15f0 con 0x561677cdb5a0 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.564+0000 7fcac1c00640 1 -- 172.21.15.69:0/1385362789 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac4032c80 con 0x561677cdb5a0 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.565+0000 7fcadaa72740 1 -- 172.21.15.69:0/1385362789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 msgr2=0x561677d11020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.565+0000 7fcadaa72740 1 --2- 172.21.15.69:0/1385362789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d11020 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcac40b52d0 tx=0x7fcac40b7040 comp rx=0 tx=0).stop 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.566+0000 7fcadaa72740 1 -- 172.21.15.69:0/1385362789 shutdown_connections 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.566+0000 7fcadaa72740 1 --2- 172.21.15.69:0/1385362789 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677c9e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.566+0000 7fcadaa72740 1 --2- 172.21.15.69:0/1385362789 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677d11560 0x561677cdb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.566+0000 7fcadaa72740 1 --2- 172.21.15.69:0/1385362789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d11020 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.566+0000 7fcadaa72740 1 -- 172.21.15.69:0/1385362789 >> 172.21.15.69:0/1385362789 conn(0x561677c665a0 msgr2=0x561677ca2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:14.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.566+0000 7fcadaa72740 1 -- 172.21.15.69:0/1385362789 shutdown_connections 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.566+0000 7fcadaa72740 1 -- 172.21.15.69:0/1385362789 wait complete. 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.567+0000 7fcadaa72740 1 -- start start 2024-02-21T07:44:14.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.567+0000 7fcadaa72740 1 Processor -- start 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 0x561677cd5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677d22d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677d11560 0x561677c986d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcadaa72740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677babec0 con 0x561677d11560 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcadaa72740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677babb60 con 0x561677cdbec0 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcadaa72740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616779751c0 con 0x561677cdb5a0 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcadaa72740 10 client.0 _ll_register_callbacks cb 0x561677bbf960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcad5400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 0x561677cd5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcad5400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 0x561677cd5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40442/0 (socket says 172.21.15.69:40442) 2024-02-21T07:44:14.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcad5400640 1 -- 172.21.15.69:0/2636457721 learned_addr learned my addr 172.21.15.69:0/2636457721 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcad4a00640 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677d22d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcad5e00640 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677d11560 0x561677c986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcad5400640 1 -- 172.21.15.69:0/2636457721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 msgr2=0x561677d22d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcad5400640 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677d22d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcad5400640 1 -- 172.21.15.69:0/2636457721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677d11560 msgr2=0x561677c986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcad5400640 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677d11560 0x561677c986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.570+0000 7fcad5400640 1 -- 172.21.15.69:0/2636457721 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad0177fc0 con 0x561677cdb5a0 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.571+0000 7fcad5400640 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 0x561677cd5130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcac40b52d0 tx=0x7fcac40b6f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f53e39bfbd701c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.571+0000 7fcab6000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.571+0000 7fcab6000640 1 -- 172.21.15.69:0/2636457721 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40b8550 con 0x561677cdb5a0 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.571+0000 7fcab6000640 1 -- 172.21.15.69:0/2636457721 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fcac40b4bc0 con 0x561677cdb5a0 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.571+0000 7fcadaa72740 1 -- 172.21.15.69:0/2636457721 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616779067e0 con 0x561677cdb5a0 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.571+0000 7fcab6000640 1 -- 172.21.15.69:0/2636457721 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcac40b86b0 con 0x561677cdb5a0 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.571+0000 7fcadaa72740 10 client.5576 fetch_fsmap learned FSMap version 19 2024-02-21T07:44:14.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.571+0000 7fcadaa72740 1 -- 172.21.15.69:0/2636457721 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x561677c054e0 con 0x561677cdb5a0 2024-02-21T07:44:14.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.571+0000 7fcab6000640 1 -- 172.21.15.69:0/2636457721 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac409c080 con 0x561677cdb5a0 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.572+0000 7fcab6000640 1 -- 172.21.15.69:0/2636457721 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcac40b4d80 con 0x561677cdb5a0 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.572+0000 7fcadaa72740 10 client.5576 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.572+0000 7fcadaa72740 10 client.5576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.572+0000 7fcadaa72740 20 client.5576 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.572+0000 7fcadaa72740 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561677c990e0 0x561677d23f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.572+0000 7fcadaa72740 4 client.5576 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.572+0000 7fcadaa72740 1 -- 172.21.15.69:0/2636457721 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561677943720 con 0x561677c990e0 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.572+0000 7fcad4a00640 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561677c990e0 0x561677d23f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.573+0000 7fcad4a00640 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561677c990e0 0x561677d23f10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afe63b1228ca0ad2 server_cookie=7ee70c19e9fc97ee in_seq=0 out_seq=0 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.573+0000 7fcab6000640 10 client.5576 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:14.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.574+0000 7fcab6000640 1 -- 172.21.15.69:0/2636457721 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561677943720 con 0x561677c990e0 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.574+0000 7fcab6000640 10 client.5576 handle_command_reply: tid=0 2024-02-21T07:44:14.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.574+0000 7fcadaa72740 1 client.5576 shutdown 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 1 -- 172.21.15.69:0/2636457721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 msgr2=0x561677cd5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 0x561677cd5130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcac40b52d0 tx=0x7fcac40b6f10 comp rx=0 tx=0).stop 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 1 -- 172.21.15.69:0/2636457721 shutdown_connections 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561677c990e0 0x561677d23f10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcab6000640 0 client.5576 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677d11560 0x561677c986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677d22d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 1 --2- 172.21.15.69:0/2636457721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 0x561677cd5130 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 1 -- 172.21.15.69:0/2636457721 >> 172.21.15.69:0/2636457721 conn(0x561677c665a0 msgr2=0x561677ca2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 1 -- 172.21.15.69:0/2636457721 shutdown_connections 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 1 -- 172.21.15.69:0/2636457721 wait complete. 2024-02-21T07:44:14.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.575+0000 7fcadaa72740 20 client.5576 trim_cache size 0 max 16384 2024-02-21T07:44:14.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.592+0000 7fcadaa72740 1 Processor -- start 2024-02-21T07:44:14.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.592+0000 7fcadaa72740 1 -- start start 2024-02-21T07:44:14.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.593+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677c990e0 0x561677ce47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.593+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d10fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.593+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677c9dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.593+0000 7fcadaa72740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677ce7230 con 0x561677cdb5a0 2024-02-21T07:44:14.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.593+0000 7fcadaa72740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677ce7840 con 0x561677cdbec0 2024-02-21T07:44:14.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.593+0000 7fcadaa72740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677caa320 con 0x561677c990e0 2024-02-21T07:44:14.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.594+0000 7fcad4a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d10fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.594+0000 7fcad5400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677c990e0 0x561677ce47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.594+0000 7fcad4a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d10fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57580/0 (socket says 172.21.15.69:57580) 2024-02-21T07:44:14.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.594+0000 7fcad4a00640 1 -- 172.21.15.69:0/100669320 learned_addr learned my addr 172.21.15.69:0/100669320 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:14.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.594+0000 7fcad5e00640 1 --2- 172.21.15.69:0/100669320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677c9dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.594+0000 7fcad5400640 1 -- 172.21.15.69:0/100669320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 msgr2=0x561677c9dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:14.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.594+0000 7fcad5400640 1 --2- 172.21.15.69:0/100669320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677c9dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.594+0000 7fcad5400640 1 -- 172.21.15.69:0/100669320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 msgr2=0x561677d10fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:14.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.594+0000 7fcad5400640 1 --2- 172.21.15.69:0/100669320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d10fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.594+0000 7fcad5400640 1 -- 172.21.15.69:0/100669320 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561677ba1950 con 0x561677c990e0 2024-02-21T07:44:14.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.595+0000 7fcad5400640 1 --2- 172.21.15.69:0/100669320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677c990e0 0x561677ce47b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcac40b50b0 tx=0x7fcac40d3000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=726d609b8c0f3d11 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:14.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.595+0000 7fcac1200640 1 -- 172.21.15.69:0/100669320 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40b8f00 con 0x561677c990e0 2024-02-21T07:44:14.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.595+0000 7fcac1200640 1 -- 172.21.15.69:0/100669320 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5616779067e0 con 0x561677c990e0 2024-02-21T07:44:14.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.595+0000 7fcac1200640 1 -- 172.21.15.69:0/100669320 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40b4dc0 con 0x561677c990e0 2024-02-21T07:44:14.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.596+0000 7fcadaa72740 1 -- 172.21.15.69:0/100669320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677c990e0 msgr2=0x561677ce47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.596+0000 7fcadaa72740 1 --2- 172.21.15.69:0/100669320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677c990e0 0x561677ce47b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcac40b50b0 tx=0x7fcac40d3000 comp rx=0 tx=0).stop 2024-02-21T07:44:14.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.596+0000 7fcadaa72740 1 -- 172.21.15.69:0/100669320 shutdown_connections 2024-02-21T07:44:14.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.596+0000 7fcadaa72740 1 --2- 172.21.15.69:0/100669320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677c9dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.596+0000 7fcadaa72740 1 --2- 172.21.15.69:0/100669320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677cdb5a0 0x561677d10fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.596+0000 7fcadaa72740 1 --2- 172.21.15.69:0/100669320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677c990e0 0x561677ce47b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.596+0000 7fcadaa72740 1 -- 172.21.15.69:0/100669320 >> 172.21.15.69:0/100669320 conn(0x561677c665a0 msgr2=0x561677c9f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:14.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.596+0000 7fcadaa72740 1 -- 172.21.15.69:0/100669320 shutdown_connections 2024-02-21T07:44:14.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.596+0000 7fcadaa72740 1 -- 172.21.15.69:0/100669320 wait complete. 2024-02-21T07:44:14.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.597+0000 7fcadaa72740 1 -- start start 2024-02-21T07:44:14.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.598+0000 7fcadaa72740 1 Processor -- start 2024-02-21T07:44:14.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677c990e0 0x561677ce2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 0x561677d7a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcad5400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677c990e0 0x561677ce2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcadaa72740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677d258a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcadaa72740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677c9feb0 con 0x561677c990e0 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcad5400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677c990e0 0x561677ce2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57582/0 (socket says 172.21.15.69:57582) 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcadaa72740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677d24b50 con 0x561677cdbec0 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcad5400640 1 -- 172.21.15.69:0/945156893 learned_addr learned my addr 172.21.15.69:0/945156893 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcadaa72740 1 -- 172.21.15.69:0/945156893 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561677d7ad50 con 0x561677cdb5a0 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcadaa72740 10 client.0 _ll_register_callbacks cb 0x7fcabc007340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.600+0000 7fcad4a00640 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 0x561677d7a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcad5e00640 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677d258a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcad5400640 1 -- 172.21.15.69:0/945156893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 msgr2=0x561677d7a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcad5400640 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 0x561677d7a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcad5400640 1 -- 172.21.15.69:0/945156893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 msgr2=0x561677d258a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcad5400640 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677d258a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcad5400640 1 -- 172.21.15.69:0/945156893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561677c054e0 con 0x561677c990e0 2024-02-21T07:44:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcad5400640 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677c990e0 0x561677ce2510 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcac40b50b0 tx=0x7fcac40b5240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a294d750a93722ba server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcab6000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcab6000640 1 -- 172.21.15.69:0/945156893 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40b8f00 con 0x561677c990e0 2024-02-21T07:44:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcab6000640 1 -- 172.21.15.69:0/945156893 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fcac409d030 con 0x561677c990e0 2024-02-21T07:44:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.601+0000 7fcadaa72740 1 -- 172.21.15.69:0/945156893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561677d2b1e0 con 0x561677c990e0 2024-02-21T07:44:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcab6000640 1 -- 172.21.15.69:0/945156893 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcac40b8cd0 con 0x561677c990e0 2024-02-21T07:44:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcadaa72740 10 client.5442 fetch_fsmap learned FSMap version 19 2024-02-21T07:44:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcadaa72740 1 -- 172.21.15.69:0/945156893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x561677bc7430 con 0x561677c990e0 2024-02-21T07:44:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcab6000640 1 -- 172.21.15.69:0/945156893 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561677d2b1e0 con 0x561677c990e0 2024-02-21T07:44:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcab6000640 1 -- 172.21.15.69:0/945156893 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcac40b8350 con 0x561677c990e0 2024-02-21T07:44:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcadaa72740 10 client.5442 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:44:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcadaa72740 10 client.5442 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcadaa72740 20 client.5442 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcadaa72740 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561677d11560 0x561677d261d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcadaa72740 4 client.5442 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:44:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.602+0000 7fcadaa72740 1 -- 172.21.15.69:0/945156893 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7fcac40c15f0 con 0x561677d11560 2024-02-21T07:44:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.603+0000 7fcad4a00640 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561677d11560 0x561677d261d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.604+0000 7fcab6000640 10 client.5442 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.604+0000 7fcad4a00640 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561677d11560 0x561677d261d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f796078f57598fa server_cookie=63f4cef32aad225 in_seq=0 out_seq=0 2024-02-21T07:44:14.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.604+0000 7fcab6000640 1 -- 172.21.15.69:0/945156893 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7fcac40c15f0 con 0x561677d11560 2024-02-21T07:44:14.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcab6000640 10 client.5442 handle_command_reply: tid=0 2024-02-21T07:44:14.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 client.5442 shutdown 2024-02-21T07:44:14.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 -- 172.21.15.69:0/945156893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677c990e0 msgr2=0x561677ce2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677c990e0 0x561677ce2510 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcac40b50b0 tx=0x7fcac40b5240 comp rx=0 tx=0).stop 2024-02-21T07:44:14.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 -- 172.21.15.69:0/945156893 shutdown_connections 2024-02-21T07:44:14.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561677d11560 0x561677d261d0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561677cdbec0 0x561677d258a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561677cdb5a0 0x561677d7a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 --2- 172.21.15.69:0/945156893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561677c990e0 0x561677ce2510 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 -- 172.21.15.69:0/945156893 >> 172.21.15.69:0/945156893 conn(0x561677c665a0 msgr2=0x561677d0a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:14.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcab6000640 0 client.5442 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:14.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 -- 172.21.15.69:0/945156893 shutdown_connections 2024-02-21T07:44:14.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 1 -- 172.21.15.69:0/945156893 wait complete. 2024-02-21T07:44:14.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.605+0000 7fcadaa72740 20 client.5442 trim_cache size 0 max 16384 2024-02-21T07:44:14.612 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:44:14.612 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-02-21T07:44:14.612 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-02-21T07:44:14.612 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 -- 172.21.15.69:0/479850480 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcab009f160 msgr2=0x7fcab00a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcab009f160 0x7fcab00a1620 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcabc007f70 tx=0x7fcabc007f00 comp rx=0 tx=0).stop 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 -- 172.21.15.69:0/479850480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0070180 msgr2=0x7fcad0177100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0070180 0x7fcad0177100 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcac4034040 tx=0x7fcac40046c0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 -- 172.21.15.69:0/479850480 shutdown_connections 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fcab009f160 0x7fcab00a1620 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcad01873d0 0x7fcad017c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fcad017d120 0x7fcad0172340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 --2- 172.21.15.69:0/479850480 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcad0070180 0x7fcad0177100 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 -- 172.21.15.69:0/479850480 >> 172.21.15.69:0/479850480 conn(0x7fcad00cf360 msgr2=0x7fcad008cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:14.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 -- 172.21.15.69:0/479850480 shutdown_connections 2024-02-21T07:44:14.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.606+0000 7fcad6800640 1 -- 172.21.15.69:0/479850480 wait complete. 2024-02-21T07:44:14.629 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:44:14.630 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:44:14.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.823+0000 7fc04b200640 1 Processor -- start 2024-02-21T07:44:14.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.823+0000 7fc04b200640 1 -- start start 2024-02-21T07:44:14.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc04b200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc04c0fd740 0x7fc04c0fe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc04b200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fc04c0fe590 0x7fc04c0fe9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc04b200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04c1897f0 con 0x7fc04c15dad0 2024-02-21T07:44:14.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc04b200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c0fdbd0 con 0x7fc04c0fd740 2024-02-21T07:44:14.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc04b200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04c0fc3c0 con 0x7fc04c0fe590 2024-02-21T07:44:14.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc049e00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc04c15dad0 0x7fc04c189d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38238/0 (socket says 172.21.15.69:38238) 2024-02-21T07:44:14.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc049e00640 1 -- 172.21.15.69:0/2879055709 learned_addr learned my addr 172.21.15.69:0/2879055709 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:14.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc04a800640 1 --2- 172.21.15.69:0/2879055709 >> v2:172.21.15.184:3300/0 conn(0x7fc04c0fe590 0x7fc04c0fe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc049400640 1 --2- 172.21.15.69:0/2879055709 >> v2:172.21.15.174:3300/0 conn(0x7fc04c0fd740 0x7fc04c0fe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc048a00640 1 -- 172.21.15.69:0/2879055709 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436363583 0 0) 0x7fc04c1897f0 con 0x7fc04c15dad0 2024-02-21T07:44:14.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.825+0000 7fc048a00640 1 -- 172.21.15.69:0/2879055709 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc030003520 con 0x7fc04c15dad0 2024-02-21T07:44:14.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.826+0000 7fc04a800640 1 -- 172.21.15.69:0/2879055709 >> v2:172.21.15.174:3300/0 conn(0x7fc04c0fd740 msgr2=0x7fc04c0fe050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:14.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.826+0000 7fc04a800640 1 --2- 172.21.15.69:0/2879055709 >> v2:172.21.15.174:3300/0 conn(0x7fc04c0fd740 0x7fc04c0fe050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.826+0000 7fc04a800640 1 -- 172.21.15.69:0/2879055709 >> v1:172.21.15.69:6789/0 conn(0x7fc04c15dad0 legacy=0x7fc04c189d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.826+0000 7fc04a800640 1 -- 172.21.15.69:0/2879055709 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c0fc6a0 con 0x7fc04c0fe590 2024-02-21T07:44:14.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.827+0000 7fc04a800640 1 --2- 172.21.15.69:0/2879055709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04c0fe590 0x7fc04c0fe9a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0fad90 tx=0x7fc04402bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb451b6b9f055091 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:14.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.827+0000 7fc048a00640 1 -- 172.21.15.69:0/2879055709 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04402cb60 con 0x7fc04c0fe590 2024-02-21T07:44:14.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.827+0000 7fc048a00640 1 -- 172.21.15.69:0/2879055709 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04402ccc0 con 0x7fc04c0fe590 2024-02-21T07:44:14.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.827+0000 7fc048a00640 1 -- 172.21.15.69:0/2879055709 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044034660 con 0x7fc04c0fe590 2024-02-21T07:44:14.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.828+0000 7fc04b200640 1 -- 172.21.15.69:0/2879055709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04c0fe590 msgr2=0x7fc04c0fe9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.828+0000 7fc04b200640 1 --2- 172.21.15.69:0/2879055709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04c0fe590 0x7fc04c0fe9a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0fad90 tx=0x7fc04402bdb0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.828+0000 7fc04b200640 1 -- 172.21.15.69:0/2879055709 shutdown_connections 2024-02-21T07:44:14.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.828+0000 7fc04b200640 1 --2- 172.21.15.69:0/2879055709 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04c0fe590 0x7fc04c0fe9a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.828+0000 7fc04b200640 1 --2- 172.21.15.69:0/2879055709 >> v2:172.21.15.174:3300/0 conn(0x7fc04c0fd740 0x7fc04c0fe050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.828+0000 7fc04b200640 1 -- 172.21.15.69:0/2879055709 >> 172.21.15.69:0/2879055709 conn(0x7fc04c0d2c90 msgr2=0x7fc04c0d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:14.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.828+0000 7fc04b200640 1 -- 172.21.15.69:0/2879055709 shutdown_connections 2024-02-21T07:44:14.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.828+0000 7fc04b200640 1 -- 172.21.15.69:0/2879055709 wait complete. 2024-02-21T07:44:14.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.830+0000 7fc04b200640 1 Processor -- start 2024-02-21T07:44:14.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.830+0000 7fc04b200640 1 -- start start 2024-02-21T07:44:14.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc04b200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc04c0fd740 0x7fc04c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc04b200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc04c0fe590 0x7fc04c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc04b200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04c15dad0 0x7fc04c15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc04b200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c156420 con 0x7fc04c0fe590 2024-02-21T07:44:14.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc04b200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c156700 con 0x7fc04c0fd740 2024-02-21T07:44:14.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc04b200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04c1569e0 con 0x7fc04c15dad0 2024-02-21T07:44:14.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc049400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc04c0fe590 0x7fc04c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc049400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc04c0fe590 0x7fc04c1545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57584/0 (socket says 172.21.15.69:57584) 2024-02-21T07:44:14.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc049400640 1 -- 172.21.15.69:0/225881308 learned_addr learned my addr 172.21.15.69:0/225881308 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:14.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc04a800640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04c15dad0 0x7fc04c15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc049e00640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc04c0fd740 0x7fc04c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc049400640 1 -- 172.21.15.69:0/225881308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04c15dad0 msgr2=0x7fc04c15b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc049400640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04c15dad0 0x7fc04c15b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc049400640 1 -- 172.21.15.69:0/225881308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc04c0fd740 msgr2=0x7fc04c1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:14.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc049400640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc04c0fd740 0x7fc04c1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:14.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.832+0000 7fc049400640 1 -- 172.21.15.69:0/225881308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044009a70 con 0x7fc04c0fe590 2024-02-21T07:44:14.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.833+0000 7fc049400640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc04c0fe590 0x7fc04c1545c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc03800e870 tx=0x7fc03800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:14.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.833+0000 7fc042000640 1 -- 172.21.15.69:0/225881308 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380094f0 con 0x7fc04c0fe590 2024-02-21T07:44:14.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.833+0000 7fc042000640 1 -- 172.21.15.69:0/225881308 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800c940 con 0x7fc04c0fe590 2024-02-21T07:44:14.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.833+0000 7fc042000640 1 -- 172.21.15.69:0/225881308 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03800ccf0 con 0x7fc04c0fe590 2024-02-21T07:44:14.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.833+0000 7fc04b200640 1 -- 172.21.15.69:0/225881308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c156cc0 con 0x7fc04c0fe590 2024-02-21T07:44:14.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.833+0000 7fc04b200640 1 -- 172.21.15.69:0/225881308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04c157280 con 0x7fc04c0fe590 2024-02-21T07:44:14.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.834+0000 7fc04b200640 1 -- 172.21.15.69:0/225881308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04c06cba0 con 0x7fc04c0fe590 2024-02-21T07:44:14.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.837+0000 7fc042000640 1 -- 172.21.15.69:0/225881308 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fc038013470 con 0x7fc04c0fe590 2024-02-21T07:44:14.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.839+0000 7fc042000640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc02c09f130 0x7fc02c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:14.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.839+0000 7fc042000640 1 -- 172.21.15.69:0/225881308 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc0380c9c00 con 0x7fc04c0fe590 2024-02-21T07:44:14.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.839+0000 7fc049e00640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc02c09f130 0x7fc02c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:14.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.840+0000 7fc049e00640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc02c09f130 0x7fc02c0a15f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc03c005880 tx=0x7fc03c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:14.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:14.843+0000 7fc042000640 1 -- 172.21.15.69:0/225881308 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc0380939e0 con 0x7fc04c0fe590 2024-02-21T07:44:15.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.173+0000 7fc04b200640 1 -- 172.21.15.69:0/225881308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc04c069c10 con 0x7fc04c0fe590 2024-02-21T07:44:15.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.175+0000 7fc042000640 1 -- 172.21.15.69:0/225881308 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+11372 (secure 0 0 0) 0x7fc0380970a0 con 0x7fc04c0fe590 2024-02-21T07:44:15.181 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:44:15.181 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:42:56.243830+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:44:15.181 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 19 2024-02-21T07:44:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.177+0000 7fc04b200640 1 -- 172.21.15.69:0/225881308 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc02c09f130 msgr2=0x7fc02c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc02c09f130 0x7fc02c0a15f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc03c005880 tx=0x7fc03c009040 comp rx=0 tx=0).stop 2024-02-21T07:44:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 -- 172.21.15.69:0/225881308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc04c0fe590 msgr2=0x7fc04c1545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc04c0fe590 0x7fc04c1545c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc03800e870 tx=0x7fc03800ed30 comp rx=0 tx=0).stop 2024-02-21T07:44:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 -- 172.21.15.69:0/225881308 shutdown_connections 2024-02-21T07:44:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc02c09f130 0x7fc02c0a15f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc04c15dad0 0x7fc04c15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc04c0fe590 0x7fc04c1545c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 --2- 172.21.15.69:0/225881308 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc04c0fd740 0x7fc04c1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 -- 172.21.15.69:0/225881308 >> 172.21.15.69:0/225881308 conn(0x7fc04c0d2c90 msgr2=0x7fc04c1630f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 -- 172.21.15.69:0/225881308 shutdown_connections 2024-02-21T07:44:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.178+0000 7fc04b200640 1 -- 172.21.15.69:0/225881308 wait complete. 2024-02-21T07:44:15.203 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:44:15.203 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-02-21T07:44:15.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.390+0000 7f067b200640 1 Processor -- start 2024-02-21T07:44:15.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.390+0000 7f067b200640 1 -- start start 2024-02-21T07:44:15.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.392+0000 7f067b200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f067c17f2a0 0x7f067c0fe160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.392+0000 7f067b200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f067c0fe6a0 0x7f067c18ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.392+0000 7f067b200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067c18a800 con 0x7f067c18b1d0 2024-02-21T07:44:15.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.392+0000 7f067b200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067c0ff160 con 0x7f067c17f2a0 2024-02-21T07:44:15.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.392+0000 7f067b200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067c0fde70 con 0x7f067c0fe6a0 2024-02-21T07:44:15.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.392+0000 7f0679e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f067c17f2a0 0x7f067c0fe160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.393+0000 7f0679e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f067c17f2a0 0x7f067c0fe160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57594/0 (socket says 172.21.15.69:57594) 2024-02-21T07:44:15.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.393+0000 7f067a800640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f067c18b1d0 0x7f067c0ce9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:42604/0 (socket says 172.21.15.69:42604) 2024-02-21T07:44:15.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.393+0000 7f0679e00640 1 -- 172.21.15.69:0/3245301786 learned_addr learned my addr 172.21.15.69:0/3245301786 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.393+0000 7f0679400640 1 --2- 172.21.15.69:0/3245301786 >> v2:172.21.15.184:3300/0 conn(0x7f067c0fe6a0 0x7f067c18ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.393+0000 7f0679e00640 1 -- 172.21.15.69:0/3245301786 >> v2:172.21.15.184:3300/0 conn(0x7f067c0fe6a0 msgr2=0x7f067c18ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.393+0000 7f0679e00640 1 --2- 172.21.15.69:0/3245301786 >> v2:172.21.15.184:3300/0 conn(0x7f067c0fe6a0 0x7f067c18ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.393+0000 7f0679e00640 1 -- 172.21.15.69:0/3245301786 >> v1:172.21.15.174:6789/0 conn(0x7f067c18b1d0 legacy=0x7f067c0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.393+0000 7f0679e00640 1 -- 172.21.15.69:0/3245301786 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c189f10 con 0x7f067c17f2a0 2024-02-21T07:44:15.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.394+0000 7f0679e00640 1 --2- 172.21.15.69:0/3245301786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c17f2a0 0x7f067c0fe160 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f067c06cbe0 tx=0x7f066c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afabfcabca1c603 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.395+0000 7f0678a00640 1 -- 172.21.15.69:0/3245301786 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c004230 con 0x7f067c17f2a0 2024-02-21T07:44:15.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.395+0000 7f0678a00640 1 -- 172.21.15.69:0/3245301786 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c02e050 con 0x7f067c17f2a0 2024-02-21T07:44:15.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.395+0000 7f0678a00640 1 -- 172.21.15.69:0/3245301786 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c003610 con 0x7f067c17f2a0 2024-02-21T07:44:15.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.395+0000 7f067b200640 1 -- 172.21.15.69:0/3245301786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c17f2a0 msgr2=0x7f067c0fe160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.395+0000 7f067b200640 1 --2- 172.21.15.69:0/3245301786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c17f2a0 0x7f067c0fe160 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f067c06cbe0 tx=0x7f066c02b7e0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.396+0000 7f067b200640 1 -- 172.21.15.69:0/3245301786 shutdown_connections 2024-02-21T07:44:15.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.396+0000 7f067b200640 1 --2- 172.21.15.69:0/3245301786 >> v2:172.21.15.184:3300/0 conn(0x7f067c0fe6a0 0x7f067c18ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.396+0000 7f067b200640 1 --2- 172.21.15.69:0/3245301786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c17f2a0 0x7f067c0fe160 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.396+0000 7f067b200640 1 -- 172.21.15.69:0/3245301786 >> 172.21.15.69:0/3245301786 conn(0x7f067c0d2b00 msgr2=0x7f067c0d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.396+0000 7f067b200640 1 -- 172.21.15.69:0/3245301786 shutdown_connections 2024-02-21T07:44:15.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.396+0000 7f067b200640 1 -- 172.21.15.69:0/3245301786 wait complete. 2024-02-21T07:44:15.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.398+0000 7f067b200640 1 Processor -- start 2024-02-21T07:44:15.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.398+0000 7f067b200640 1 -- start start 2024-02-21T07:44:15.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.399+0000 7f067b200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c0fe6a0 0x7f067c16e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.399+0000 7f067b200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f067c17f2a0 0x7f067c16ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.399+0000 7f067b200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c18b1d0 0x7f067c220d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.399+0000 7f067b200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c220900 con 0x7f067c0fe6a0 2024-02-21T07:44:15.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.399+0000 7f067b200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c189750 con 0x7f067c17f2a0 2024-02-21T07:44:15.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.399+0000 7f067b200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c189190 con 0x7f067c18b1d0 2024-02-21T07:44:15.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.400+0000 7f0679e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c0fe6a0 0x7f067c16e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.400+0000 7f0679e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c0fe6a0 0x7f067c16e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57600/0 (socket says 172.21.15.69:57600) 2024-02-21T07:44:15.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.400+0000 7f0679e00640 1 -- 172.21.15.69:0/256487137 learned_addr learned my addr 172.21.15.69:0/256487137 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.400+0000 7f0679400640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f067c17f2a0 0x7f067c16ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.400+0000 7f067a800640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c18b1d0 0x7f067c220d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.400+0000 7f0679e00640 1 -- 172.21.15.69:0/256487137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c18b1d0 msgr2=0x7f067c220d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.400+0000 7f0679e00640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c18b1d0 0x7f067c220d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.400+0000 7f0679e00640 1 -- 172.21.15.69:0/256487137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f067c17f2a0 msgr2=0x7f067c16ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.400+0000 7f0679e00640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f067c17f2a0 0x7f067c16ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.400+0000 7f0679e00640 1 -- 172.21.15.69:0/256487137 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c0094d0 con 0x7f067c0fe6a0 2024-02-21T07:44:15.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.401+0000 7f0679e00640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c0fe6a0 0x7f067c16e540 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f066c0090b0 tx=0x7f066c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.401+0000 7f0672000640 1 -- 172.21.15.69:0/256487137 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c003e50 con 0x7f067c0fe6a0 2024-02-21T07:44:15.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.401+0000 7f0672000640 1 -- 172.21.15.69:0/256487137 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c030510 con 0x7f067c0fe6a0 2024-02-21T07:44:15.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.401+0000 7f0672000640 1 -- 172.21.15.69:0/256487137 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c030880 con 0x7f067c0fe6a0 2024-02-21T07:44:15.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.401+0000 7f067b200640 1 -- 172.21.15.69:0/256487137 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067c189470 con 0x7f067c0fe6a0 2024-02-21T07:44:15.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.401+0000 7f067b200640 1 -- 172.21.15.69:0/256487137 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c220590 con 0x7f067c0fe6a0 2024-02-21T07:44:15.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.406+0000 7f0672000640 1 -- 172.21.15.69:0/256487137 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f066c039040 con 0x7f067c0fe6a0 2024-02-21T07:44:15.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.407+0000 7f06837b1740 1 Processor -- start 2024-02-21T07:44:15.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.407+0000 7f06837b1740 1 -- start start 2024-02-21T07:44:15.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.407+0000 7f0672000640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f065c09f130 0x7f065c0a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f0672000640 1 -- 172.21.15.69:0/256487137 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f066c0eb3d0 con 0x7f067c0fe6a0 2024-02-21T07:44:15.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f06837b1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025070 0x5601b3025450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f06837b1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b3060200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f06837b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3060740 0x5601b30614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f06837b1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b2f58210 con 0x5601b3025070 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f06837b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b2f55740 con 0x5601b3060740 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f06837b1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b2f50f20 con 0x5601b3025990 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f067a800640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f065c09f130 0x7f065c0a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f0679e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025070 0x5601b3025450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f0679e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025070 0x5601b3025450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57614/0 (socket says 172.21.15.69:57614) 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f0679e00640 1 -- 172.21.15.69:0/916754563 learned_addr learned my addr 172.21.15.69:0/916754563 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.408+0000 7f0679400640 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b3060200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f067a800640 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3060740 0x5601b30614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f0679400640 1 -- 172.21.15.69:0/916754563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3060740 msgr2=0x5601b30614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f0679400640 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3060740 0x5601b30614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f0679400640 1 -- 172.21.15.69:0/916754563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025070 msgr2=0x5601b3025450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f0679400640 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025070 0x5601b3025450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f0679400640 1 -- 172.21.15.69:0/916754563 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601b2f12df0 con 0x5601b3025990 2024-02-21T07:44:15.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f067a800640 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3060740 0x5601b30614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:44:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f0679e00640 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025070 0x5601b3025450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f067a800640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f065c09f130 0x7f065c0a15f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0674004fd0 tx=0x7f06740020a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f0679400640 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b3060200 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0668009ac0 tx=0x7f0668009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b81afbdd06c6b62 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.409+0000 7f0666600640 1 -- 172.21.15.69:0/916754563 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668011cf0 con 0x5601b3025990 2024-02-21T07:44:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.410+0000 7f0666600640 1 -- 172.21.15.69:0/916754563 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0668011e50 con 0x5601b3025990 2024-02-21T07:44:15.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.410+0000 7f0666600640 1 -- 172.21.15.69:0/916754563 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668004230 con 0x5601b3025990 2024-02-21T07:44:15.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.410+0000 7f06837b1740 1 -- 172.21.15.69:0/916754563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 msgr2=0x5601b3060200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.410+0000 7f06837b1740 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b3060200 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0668009ac0 tx=0x7f0668009f80 comp rx=0 tx=0).stop 2024-02-21T07:44:15.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.410+0000 7f06837b1740 1 -- 172.21.15.69:0/916754563 shutdown_connections 2024-02-21T07:44:15.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.410+0000 7f06837b1740 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3060740 0x5601b30614d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.410+0000 7f06837b1740 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b3060200 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.410+0000 7f06837b1740 1 --2- 172.21.15.69:0/916754563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025070 0x5601b3025450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.410+0000 7f06837b1740 1 -- 172.21.15.69:0/916754563 >> 172.21.15.69:0/916754563 conn(0x5601b2fe7640 msgr2=0x5601b2fe86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.411+0000 7f06837b1740 1 -- 172.21.15.69:0/916754563 shutdown_connections 2024-02-21T07:44:15.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.411+0000 7f06837b1740 1 -- 172.21.15.69:0/916754563 wait complete. 2024-02-21T07:44:15.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.412+0000 7f06837b1740 1 -- start start 2024-02-21T07:44:15.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.412+0000 7f06837b1740 1 Processor -- start 2024-02-21T07:44:15.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.413+0000 7f06837b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025990 0x5601b300f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.413+0000 7f06837b1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3060740 0x5601b305db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.413+0000 7f06837b1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025e90 0x5601b3028740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.413+0000 7f06837b1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b2ef6150 con 0x5601b3025e90 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.413+0000 7f06837b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b2ef5df0 con 0x5601b3025990 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.413+0000 7f06837b1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b2cbf1c0 con 0x5601b3060740 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f06837b1740 10 client.0 _ll_register_callbacks cb 0x5601b2f452b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f0679400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3060740 0x5601b305db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f0679400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3060740 0x5601b305db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40508/0 (socket says 172.21.15.69:40508) 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f0679400640 1 -- 172.21.15.69:0/819787296 learned_addr learned my addr 172.21.15.69:0/819787296 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f067a800640 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025e90 0x5601b3028740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f0679e00640 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025990 0x5601b300f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f0679400640 1 -- 172.21.15.69:0/819787296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025990 msgr2=0x5601b300f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f0679400640 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025990 0x5601b300f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f0679400640 1 -- 172.21.15.69:0/819787296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025e90 msgr2=0x5601b3028740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f0679400640 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025e90 0x5601b3028740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.414+0000 7f0679400640 1 -- 172.21.15.69:0/819787296 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0668009720 con 0x5601b3060740 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.415+0000 7f0679e00640 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025990 0x5601b300f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.415+0000 7f0679400640 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3060740 0x5601b305db70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0668004660 tx=0x7f0668004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eb8ffbbec5877b1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.415+0000 7f065aa00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.415+0000 7f065aa00640 1 -- 172.21.15.69:0/819787296 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668025070 con 0x5601b3060740 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.415+0000 7f065aa00640 1 -- 172.21.15.69:0/819787296 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0668003820 con 0x5601b3060740 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.416+0000 7f06837b1740 1 -- 172.21.15.69:0/819787296 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601b2c507e0 con 0x5601b3060740 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.416+0000 7f065aa00640 1 -- 172.21.15.69:0/819787296 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0668011cf0 con 0x5601b3060740 2024-02-21T07:44:15.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.416+0000 7f06837b1740 10 client.5600 fetch_fsmap learned FSMap version 19 2024-02-21T07:44:15.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.416+0000 7f06837b1740 1 -- 172.21.15.69:0/819787296 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x5601b2f4f5a0 con 0x5601b3060740 2024-02-21T07:44:15.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.416+0000 7f065aa00640 1 -- 172.21.15.69:0/819787296 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5601b2c507e0 con 0x5601b3060740 2024-02-21T07:44:15.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.416+0000 7f065aa00640 1 -- 172.21.15.69:0/819787296 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f06680039e0 con 0x5601b3060740 2024-02-21T07:44:15.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.417+0000 7f06837b1740 10 client.5600 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:44:15.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.417+0000 7f06837b1740 10 client.5600 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.b 2024-02-21T07:44:15.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.417+0000 7f06837b1740 20 client.5600 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:15.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.417+0000 7f06837b1740 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x5601b2fe8b50 0x5601b2fe2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.417+0000 7f06837b1740 4 client.5600 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:15.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.417+0000 7f06837b1740 1 -- 172.21.15.69:0/819787296 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601b2c8d720 con 0x5601b2fe8b50 2024-02-21T07:44:15.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.417+0000 7f0679e00640 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x5601b2fe8b50 0x5601b2fe2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.418+0000 7f0679e00640 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x5601b2fe8b50 0x5601b2fe2e30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=15a0834f6397fb51 server_cookie=311e3267a6863e19 in_seq=0 out_seq=0 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.418+0000 7f065aa00640 10 client.5600 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.418+0000 7f065aa00640 1 -- 172.21.15.69:0/819787296 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5601b2c8d720 con 0x5601b2fe8b50 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.418+0000 7f065aa00640 10 client.5600 handle_command_reply: tid=0 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.418+0000 7f06837b1740 1 client.5600 shutdown 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 1 -- 172.21.15.69:0/819787296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3060740 msgr2=0x5601b305db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3060740 0x5601b305db70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0668004660 tx=0x7f0668004730 comp rx=0 tx=0).stop 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 1 -- 172.21.15.69:0/819787296 shutdown_connections 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x5601b2fe8b50 0x5601b2fe2e30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3025e90 0x5601b3028740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3060740 0x5601b305db70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 1 --2- 172.21.15.69:0/819787296 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025990 0x5601b300f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 1 -- 172.21.15.69:0/819787296 >> 172.21.15.69:0/819787296 conn(0x5601b3025070 msgr2=0x5601b2fe90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f065aa00640 0 client.5600 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:44:15.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 1 -- 172.21.15.69:0/819787296 shutdown_connections 2024-02-21T07:44:15.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 1 -- 172.21.15.69:0/819787296 wait complete. 2024-02-21T07:44:15.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.419+0000 7f06837b1740 20 client.5600 trim_cache size 0 max 16384 2024-02-21T07:44:15.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.434+0000 7f06837b1740 1 Processor -- start 2024-02-21T07:44:15.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.434+0000 7f06837b1740 1 -- start start 2024-02-21T07:44:15.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f06837b1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b300fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f06837b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 0x5601b2fe91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f06837b1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 0x5601b30b7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f06837b1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b3025810 con 0x5601b3060740 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f06837b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b3017680 con 0x5601b3025e90 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f06837b1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b3031280 con 0x5601b3025990 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f067a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 0x5601b30b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f067a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 0x5601b30b7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57618/0 (socket says 172.21.15.69:57618) 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f067a800640 1 -- 172.21.15.69:0/364792523 learned_addr learned my addr 172.21.15.69:0/364792523 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f0679e00640 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b300fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f0679400640 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 0x5601b2fe91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f0679400640 1 -- 172.21.15.69:0/364792523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 msgr2=0x5601b300fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.436+0000 7f0679400640 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b300fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.437+0000 7f0679400640 1 -- 172.21.15.69:0/364792523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 msgr2=0x5601b30b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.437+0000 7f0679400640 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 0x5601b30b7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.437+0000 7f0679400640 1 -- 172.21.15.69:0/364792523 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601b2eebab0 con 0x5601b3025e90 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.437+0000 7f0679e00640 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b300fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.437+0000 7f067a800640 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 0x5601b30b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.437+0000 7f0679400640 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 0x5601b2fe91c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0668004690 tx=0x7f0668025000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2af295758c9b03d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.437+0000 7f0665c00640 1 -- 172.21.15.69:0/364792523 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668011cf0 con 0x5601b3025e90 2024-02-21T07:44:15.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.437+0000 7f0665c00640 1 -- 172.21.15.69:0/364792523 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0668011750 con 0x5601b3025e90 2024-02-21T07:44:15.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.437+0000 7f0665c00640 1 -- 172.21.15.69:0/364792523 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0668003a60 con 0x5601b3025e90 2024-02-21T07:44:15.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.438+0000 7f06837b1740 1 -- 172.21.15.69:0/364792523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 msgr2=0x5601b2fe91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.438+0000 7f06837b1740 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 0x5601b2fe91c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0668004690 tx=0x7f0668025000 comp rx=0 tx=0).stop 2024-02-21T07:44:15.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.438+0000 7f06837b1740 1 -- 172.21.15.69:0/364792523 shutdown_connections 2024-02-21T07:44:15.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.438+0000 7f06837b1740 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 0x5601b30b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.438+0000 7f06837b1740 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 0x5601b2fe91c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.438+0000 7f06837b1740 1 --2- 172.21.15.69:0/364792523 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b300fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.438+0000 7f06837b1740 1 -- 172.21.15.69:0/364792523 >> 172.21.15.69:0/364792523 conn(0x5601b3025070 msgr2=0x5601b305db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.438+0000 7f06837b1740 1 -- 172.21.15.69:0/364792523 shutdown_connections 2024-02-21T07:44:15.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.438+0000 7f06837b1740 1 -- 172.21.15.69:0/364792523 wait complete. 2024-02-21T07:44:15.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.439+0000 7f06837b1740 1 -- start start 2024-02-21T07:44:15.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.439+0000 7f06837b1740 1 Processor -- start 2024-02-21T07:44:15.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.440+0000 7f06837b1740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b305cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.440+0000 7f06837b1740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 0x5601b3026c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.440+0000 7f06837b1740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 0x5601b3030fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.440+0000 7f06837b1740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b30271b0 con 0x5601b3060740 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.440+0000 7f06837b1740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b305c050 con 0x5601b3025e90 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.440+0000 7f06837b1740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601b30314e0 con 0x5601b3025990 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f06837b1740 10 client.0 _ll_register_callbacks cb 0x7f0668009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f0679e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b305cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f067a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 0x5601b3030fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f0679e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b305cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40528/0 (socket says 172.21.15.69:40528) 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f0679e00640 1 -- 172.21.15.69:0/1959407178 learned_addr learned my addr 172.21.15.69:0/1959407178 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f0679400640 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 0x5601b3026c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f0679e00640 1 -- 172.21.15.69:0/1959407178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 msgr2=0x5601b3026c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f0679e00640 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 0x5601b3026c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f0679e00640 1 -- 172.21.15.69:0/1959407178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 msgr2=0x5601b3030fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f0679e00640 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 0x5601b3030fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.441+0000 7f0679e00640 1 -- 172.21.15.69:0/1959407178 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c189470 con 0x5601b3025990 2024-02-21T07:44:15.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f0679e00640 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b305cc30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f066c0b57e0 tx=0x7f066c0b8ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c670bb1d0c59496c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f065aa00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f065aa00640 1 -- 172.21.15.69:0/1959407178 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c0d6270 con 0x5601b3025990 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f065aa00640 1 -- 172.21.15.69:0/1959407178 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f066c0d63d0 con 0x5601b3025990 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f06837b1740 1 -- 172.21.15.69:0/1959407178 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0668011e50 con 0x5601b3025990 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f065aa00640 1 -- 172.21.15.69:0/1959407178 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f066c0d0bd0 con 0x5601b3025990 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f06837b1740 10 client.5606 fetch_fsmap learned FSMap version 19 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f06837b1740 1 -- 172.21.15.69:0/1959407178 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x7f067401f040 con 0x5601b3025990 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f065aa00640 1 -- 172.21.15.69:0/1959407178 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0668011e50 con 0x5601b3025990 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f065aa00640 1 -- 172.21.15.69:0/1959407178 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f066c0c10c0 con 0x5601b3025990 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f06837b1740 10 client.5606 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.442+0000 7f06837b1740 10 client.5606 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.b 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.443+0000 7f06837b1740 20 client.5606 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.443+0000 7f06837b1740 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x5601b30b7970 0x5601b3008900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.443+0000 7f06837b1740 4 client.5606 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:44:15.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.443+0000 7f06837b1740 1 -- 172.21.15.69:0/1959407178 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5601b2cdc890 con 0x5601b30b7970 2024-02-21T07:44:15.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.443+0000 7f0679400640 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x5601b30b7970 0x5601b3008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.443+0000 7f0679400640 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x5601b30b7970 0x5601b3008900 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a0fa0b087beefa9f server_cookie=a4791e298575f2b in_seq=0 out_seq=0 2024-02-21T07:44:15.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.443+0000 7f065aa00640 10 client.5606 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:44:15.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f065aa00640 1 -- 172.21.15.69:0/1959407178 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5601b2cdc890 con 0x5601b30b7970 2024-02-21T07:44:15.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f065aa00640 10 client.5606 handle_command_reply: tid=0 2024-02-21T07:44:15.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 client.5606 shutdown 2024-02-21T07:44:15.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 -- 172.21.15.69:0/1959407178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 msgr2=0x5601b305cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b305cc30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f066c0b57e0 tx=0x7f066c0b8ad0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 -- 172.21.15.69:0/1959407178 shutdown_connections 2024-02-21T07:44:15.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x5601b30b7970 0x5601b3008900 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5601b3060740 0x5601b3030fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5601b3025e90 0x5601b3026c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 --2- 172.21.15.69:0/1959407178 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5601b3025990 0x5601b305cc30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 -- 172.21.15.69:0/1959407178 >> 172.21.15.69:0/1959407178 conn(0x5601b3025070 msgr2=0x5601b305dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f065aa00640 0 client.5606 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:44:15.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 -- 172.21.15.69:0/1959407178 shutdown_connections 2024-02-21T07:44:15.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.444+0000 7f06837b1740 1 -- 172.21.15.69:0/1959407178 wait complete. 2024-02-21T07:44:15.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f06837b1740 20 client.5606 trim_cache size 0 max 16384 2024-02-21T07:44:15.453 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f067b200640 1 -- 172.21.15.69:0/256487137 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f065c09f130 msgr2=0x7f065c0a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f067b200640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f065c09f130 0x7f065c0a15f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0674004fd0 tx=0x7f06740020a0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f067b200640 1 -- 172.21.15.69:0/256487137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c0fe6a0 msgr2=0x7f067c16e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f067b200640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c0fe6a0 0x7f067c16e540 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f066c0090b0 tx=0x7f066c0046c0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f067b200640 1 -- 172.21.15.69:0/256487137 shutdown_connections 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f067b200640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f065c09f130 0x7f065c0a15f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f067b200640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f067c18b1d0 0x7f067c220d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f067b200640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f067c17f2a0 0x7f067c16ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f067b200640 1 --2- 172.21.15.69:0/256487137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f067c0fe6a0 0x7f067c16e540 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.445+0000 7f067b200640 1 -- 172.21.15.69:0/256487137 >> 172.21.15.69:0/256487137 conn(0x7f067c0d2b00 msgr2=0x7f067c17bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.446+0000 7f067b200640 1 -- 172.21.15.69:0/256487137 shutdown_connections 2024-02-21T07:44:15.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.446+0000 7f067b200640 1 -- 172.21.15.69:0/256487137 wait complete. 2024-02-21T07:44:15.470 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:44:15.470 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-02-21T07:44:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.657+0000 7fa2a0000640 1 Processor -- start 2024-02-21T07:44:15.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.657+0000 7fa2a0000640 1 -- start start 2024-02-21T07:44:15.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.659+0000 7fa2a0000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa298183ea0 0x7fa2981846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.659+0000 7fa2a0000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fa298184c20 0x7fa2980ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.659+0000 7fa2a0000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2981850b0 con 0x7fa2980eeb80 2024-02-21T07:44:15.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.659+0000 7fa2a0000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa298186010 con 0x7fa298183ea0 2024-02-21T07:44:15.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.659+0000 7fa2a0000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa298185390 con 0x7fa298184c20 2024-02-21T07:44:15.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.660+0000 7fa29d600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa298183ea0 0x7fa2981846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.660+0000 7fa29e000640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa2980eeb80 0x7fa298186bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38246/0 (socket says 172.21.15.69:38246) 2024-02-21T07:44:15.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.660+0000 7fa29d600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa298183ea0 0x7fa2981846e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57638/0 (socket says 172.21.15.69:57638) 2024-02-21T07:44:15.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.660+0000 7fa29e000640 1 -- 172.21.15.69:0/1492572254 learned_addr learned my addr 172.21.15.69:0/1492572254 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:15.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.660+0000 7fa29cc00640 1 --2- 172.21.15.69:0/1492572254 >> v2:172.21.15.184:3300/0 conn(0x7fa298184c20 0x7fa2980ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.660+0000 7fa29cc00640 1 -- 172.21.15.69:0/1492572254 >> v2:172.21.15.69:3300/0 conn(0x7fa298183ea0 msgr2=0x7fa2981846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.660+0000 7fa29cc00640 1 --2- 172.21.15.69:0/1492572254 >> v2:172.21.15.69:3300/0 conn(0x7fa298183ea0 0x7fa2981846e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.660+0000 7fa29cc00640 1 -- 172.21.15.69:0/1492572254 >> v1:172.21.15.69:6789/0 conn(0x7fa2980eeb80 legacy=0x7fa298186bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.660+0000 7fa29cc00640 1 -- 172.21.15.69:0/1492572254 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa298185670 con 0x7fa298184c20 2024-02-21T07:44:15.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.660+0000 7fa29d600640 1 --2- 172.21.15.69:0/1492572254 >> v2:172.21.15.69:3300/0 conn(0x7fa298183ea0 0x7fa2981846e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.661+0000 7fa29cc00640 1 --2- 172.21.15.69:0/1492572254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa298184c20 0x7fa2980ee640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa2980faf60 tx=0x7fa28402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff664bbfac58fd9d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.662+0000 7fa297e00640 1 -- 172.21.15.69:0/1492572254 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28402e070 con 0x7fa298184c20 2024-02-21T07:44:15.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.662+0000 7fa297e00640 1 -- 172.21.15.69:0/1492572254 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2840315a0 con 0x7fa298184c20 2024-02-21T07:44:15.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.662+0000 7fa297e00640 1 -- 172.21.15.69:0/1492572254 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284031930 con 0x7fa298184c20 2024-02-21T07:44:15.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.662+0000 7fa2a0000640 1 -- 172.21.15.69:0/1492572254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa298184c20 msgr2=0x7fa2980ee640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.662+0000 7fa2a0000640 1 --2- 172.21.15.69:0/1492572254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa298184c20 0x7fa2980ee640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa2980faf60 tx=0x7fa28402b840 comp rx=0 tx=0).stop 2024-02-21T07:44:15.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.662+0000 7fa2a0000640 1 -- 172.21.15.69:0/1492572254 shutdown_connections 2024-02-21T07:44:15.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.663+0000 7fa2a0000640 1 --2- 172.21.15.69:0/1492572254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa298184c20 0x7fa2980ee640 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.663+0000 7fa2a0000640 1 --2- 172.21.15.69:0/1492572254 >> v2:172.21.15.69:3300/0 conn(0x7fa298183ea0 0x7fa2981846e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.663+0000 7fa2a0000640 1 -- 172.21.15.69:0/1492572254 >> 172.21.15.69:0/1492572254 conn(0x7fa2980ce3d0 msgr2=0x7fa2980ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.663+0000 7fa2a0000640 1 -- 172.21.15.69:0/1492572254 shutdown_connections 2024-02-21T07:44:15.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.663+0000 7fa2a0000640 1 -- 172.21.15.69:0/1492572254 wait complete. 2024-02-21T07:44:15.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.665+0000 7fa2a0000640 1 Processor -- start 2024-02-21T07:44:15.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.665+0000 7fa2a0000640 1 -- start start 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.666+0000 7fa2a0000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2980eeb80 0x7fa2980c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.666+0000 7fa2a0000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa298183ea0 0x7fa2980cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.666+0000 7fa2a0000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2980ccfb0 0x7fa29816aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.666+0000 7fa2a0000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980c9680 con 0x7fa2980ccfb0 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.666+0000 7fa2a0000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980c9960 con 0x7fa298183ea0 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.666+0000 7fa2a0000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2980c9c40 con 0x7fa2980eeb80 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.666+0000 7fa29e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2980ccfb0 0x7fa29816aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.666+0000 7fa29d600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2980eeb80 0x7fa2980c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.666+0000 7fa29e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2980ccfb0 0x7fa29816aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57648/0 (socket says 172.21.15.69:57648) 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.667+0000 7fa29e000640 1 -- 172.21.15.69:0/177358683 learned_addr learned my addr 172.21.15.69:0/177358683 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.667+0000 7fa29cc00640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa298183ea0 0x7fa2980cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.667+0000 7fa29d600640 1 -- 172.21.15.69:0/177358683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa298183ea0 msgr2=0x7fa2980cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.667+0000 7fa29d600640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa298183ea0 0x7fa2980cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.667+0000 7fa29d600640 1 -- 172.21.15.69:0/177358683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2980ccfb0 msgr2=0x7fa29816aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.667+0000 7fa29d600640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2980ccfb0 0x7fa29816aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.667+0000 7fa29d600640 1 -- 172.21.15.69:0/177358683 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c009400 con 0x7fa2980eeb80 2024-02-21T07:44:15.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.667+0000 7fa29e000640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2980ccfb0 0x7fa29816aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.667+0000 7fa29d600640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2980eeb80 0x7fa2980c8de0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e870 tx=0x7fa28c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.668+0000 7fa295600640 1 -- 172.21.15.69:0/177358683 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00c940 con 0x7fa2980eeb80 2024-02-21T07:44:15.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.668+0000 7fa295600640 1 -- 172.21.15.69:0/177358683 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00caa0 con 0x7fa2980eeb80 2024-02-21T07:44:15.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.668+0000 7fa295600640 1 -- 172.21.15.69:0/177358683 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00ce30 con 0x7fa2980eeb80 2024-02-21T07:44:15.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.668+0000 7fa2a0000640 1 -- 172.21.15.69:0/177358683 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa284009400 con 0x7fa2980eeb80 2024-02-21T07:44:15.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.668+0000 7fa2a0000640 1 -- 172.21.15.69:0/177358683 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2980ca200 con 0x7fa2980eeb80 2024-02-21T07:44:15.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.671+0000 7fa295600640 1 -- 172.21.15.69:0/177358683 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fa28c013470 con 0x7fa2980eeb80 2024-02-21T07:44:15.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.672+0000 7fa2a2d94740 1 Processor -- start 2024-02-21T07:44:15.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.673+0000 7fa2a2d94740 1 -- start start 2024-02-21T07:44:15.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.673+0000 7fa295600640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa27809f230 0x7fa2780a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.673+0000 7fa295600640 1 -- 172.21.15.69:0/177358683 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa28c0c9ba0 con 0x7fa2980eeb80 2024-02-21T07:44:15.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.673+0000 7fa29e000640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa27809f230 0x7fa2780a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc55ec0 0x56227bc562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc91050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc92320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bb89210 con 0x56227bc567e0 2024-02-21T07:44:15.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bb86740 con 0x56227bc91590 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bb81f20 con 0x56227bc55ec0 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa29e000640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa27809f230 0x7fa2780a16f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa290005c00 tx=0x7fa290009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa29cc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc91050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa29e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc92320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa29cc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc91050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57652/0 (socket says 172.21.15.69:57652) 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa29e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc92320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:46362/0 (socket says 172.21.15.69:46362) 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa29cc00640 1 -- 172.21.15.69:0/3337546441 learned_addr learned my addr 172.21.15.69:0/3337546441 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.674+0000 7fa29d600640 1 --2- 172.21.15.69:0/3337546441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc55ec0 0x56227bc562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.675+0000 7fa29e000640 1 -- 172.21.15.69:0/3337546441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc55ec0 msgr2=0x56227bc562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.675+0000 7fa29e000640 1 --2- 172.21.15.69:0/3337546441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc55ec0 0x56227bc562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.675+0000 7fa29e000640 1 -- 172.21.15.69:0/3337546441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 msgr2=0x56227bc91050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.675+0000 7fa29e000640 1 --2- 172.21.15.69:0/3337546441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc91050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.675+0000 7fa29e000640 1 -- 172.21.15.69:0/3337546441 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56227bb43df0 con 0x56227bc91590 2024-02-21T07:44:15.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.675+0000 7fa29cc00640 1 --2- 172.21.15.69:0/3337546441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc91050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.675+0000 7fa29e000640 1 --2- 172.21.15.69:0/3337546441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc92320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa290014550 tx=0x7fa290012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bd2c73c66e3f85e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.675+0000 7fa289c00640 1 -- 172.21.15.69:0/3337546441 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900135c0 con 0x56227bc91590 2024-02-21T07:44:15.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.676+0000 7fa289c00640 1 -- 172.21.15.69:0/3337546441 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290013720 con 0x56227bc91590 2024-02-21T07:44:15.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.676+0000 7fa289c00640 1 -- 172.21.15.69:0/3337546441 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290013a90 con 0x56227bc91590 2024-02-21T07:44:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.676+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3337546441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 msgr2=0x56227bc92320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.676+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3337546441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc92320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa290014550 tx=0x7fa290012000 comp rx=0 tx=0).stop 2024-02-21T07:44:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.676+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3337546441 shutdown_connections 2024-02-21T07:44:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.676+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3337546441 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc92320 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.676+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3337546441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc91050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.676+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3337546441 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc55ec0 0x56227bc562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.676+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3337546441 >> 172.21.15.69:0/3337546441 conn(0x56227bc18490 msgr2=0x56227bc19510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.676+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3337546441 shutdown_connections 2024-02-21T07:44:15.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.677+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3337546441 wait complete. 2024-02-21T07:44:15.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.677+0000 7fa2a2d94740 1 -- start start 2024-02-21T07:44:15.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.678+0000 7fa2a2d94740 1 Processor -- start 2024-02-21T07:44:15.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc567e0 0x56227bc9e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc91590 0x56227bc4cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc7f020 0x56227bc15b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bb27150 con 0x56227bc91590 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bb26df0 con 0x56227bc7f020 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227b8f01c0 con 0x56227bc567e0 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa2a2d94740 10 client.0 _ll_register_callbacks cb 0x56227bb762b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa29d600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc567e0 0x56227bc9e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa29cc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc91590 0x56227bc4cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa29e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc7f020 0x56227bc15b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa29cc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc91590 0x56227bc4cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57658/0 (socket says 172.21.15.69:57658) 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa29d600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc567e0 0x56227bc9e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40568/0 (socket says 172.21.15.69:40568) 2024-02-21T07:44:15.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.679+0000 7fa29cc00640 1 -- 172.21.15.69:0/1247758682 learned_addr learned my addr 172.21.15.69:0/1247758682 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa29d600640 1 -- 172.21.15.69:0/1247758682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc7f020 msgr2=0x56227bc15b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa29d600640 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc7f020 0x56227bc15b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa29d600640 1 -- 172.21.15.69:0/1247758682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc91590 msgr2=0x56227bc4cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa29d600640 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc91590 0x56227bc4cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa29d600640 1 -- 172.21.15.69:0/1247758682 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2981850b0 con 0x56227bc567e0 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa29e000640 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc7f020 0x56227bc15b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa29d600640 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc567e0 0x56227bc9e8a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0c74d0 tx=0x7fa28c09b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=263ae990b28d1fc8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa27e000640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa27e000640 1 -- 172.21.15.69:0/1247758682 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0c7700 con 0x56227bc567e0 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa2a2d94740 1 -- 172.21.15.69:0/1247758682 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56227b8817e0 con 0x56227bc567e0 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.680+0000 7fa27e000640 1 -- 172.21.15.69:0/1247758682 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa28c0af170 con 0x56227bc567e0 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa27e000640 1 -- 172.21.15.69:0/1247758682 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa28c096bc0 con 0x56227bc567e0 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa2a2d94740 10 client.5618 fetch_fsmap learned FSMap version 19 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa2a2d94740 1 -- 172.21.15.69:0/1247758682 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x56227bb805a0 con 0x56227bc567e0 2024-02-21T07:44:15.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa27e000640 1 -- 172.21.15.69:0/1247758682 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56227b8817e0 con 0x56227bc567e0 2024-02-21T07:44:15.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa27e000640 1 -- 172.21.15.69:0/1247758682 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa28c011070 con 0x56227bc567e0 2024-02-21T07:44:15.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa2a2d94740 10 client.5618 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:44:15.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa2a2d94740 10 client.5618 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.d 2024-02-21T07:44:15.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa2a2d94740 20 client.5618 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:15.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x56227bc16040 0x56227bc15090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa2a2d94740 4 client.5618 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:15.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.681+0000 7fa2a2d94740 1 -- 172.21.15.69:0/1247758682 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56227b8be720 con 0x56227bc16040 2024-02-21T07:44:15.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.682+0000 7fa29cc00640 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x56227bc16040 0x56227bc15090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.682+0000 7fa29cc00640 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x56227bc16040 0x56227bc15090 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6a0c151e564e29b1 server_cookie=78716dd55bffc401 in_seq=0 out_seq=0 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.682+0000 7fa27e000640 10 client.5618 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.683+0000 7fa27e000640 1 -- 172.21.15.69:0/1247758682 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56227b8be720 con 0x56227bc16040 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.683+0000 7fa27e000640 10 client.5618 handle_command_reply: tid=0 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.683+0000 7fa2a2d94740 1 client.5618 shutdown 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.683+0000 7fa2a2d94740 1 -- 172.21.15.69:0/1247758682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc567e0 msgr2=0x56227bc9e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.683+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc567e0 0x56227bc9e8a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0c74d0 tx=0x7fa28c09b810 comp rx=0 tx=0).stop 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.683+0000 7fa2a2d94740 1 -- 172.21.15.69:0/1247758682 shutdown_connections 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.683+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x56227bc16040 0x56227bc15090 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.683+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc7f020 0x56227bc15b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.684+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc91590 0x56227bc4cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.684+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/1247758682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc567e0 0x56227bc9e8a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.684+0000 7fa27e000640 0 client.5618 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:44:15.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.684+0000 7fa2a2d94740 1 -- 172.21.15.69:0/1247758682 >> 172.21.15.69:0/1247758682 conn(0x56227bc55ec0 msgr2=0x56227bc19f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.684+0000 7fa2a2d94740 1 -- 172.21.15.69:0/1247758682 shutdown_connections 2024-02-21T07:44:15.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.684+0000 7fa2a2d94740 1 -- 172.21.15.69:0/1247758682 wait complete. 2024-02-21T07:44:15.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.684+0000 7fa2a2d94740 20 client.5618 trim_cache size 0 max 16384 2024-02-21T07:44:15.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.698+0000 7fa2a2d94740 1 Processor -- start 2024-02-21T07:44:15.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.698+0000 7fa2a2d94740 1 -- start start 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.699+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bcaa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.699+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc47bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.699+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bce9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.699+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bcaa710 con 0x56227bc567e0 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.699+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bc48130 con 0x56227bc91590 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.699+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bc17570 con 0x56227bc7f020 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29d600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bcaa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29cc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc47bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29cc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc47bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40580/0 (socket says 172.21.15.69:40580) 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29cc00640 1 -- 172.21.15.69:0/3532659460 learned_addr learned my addr 172.21.15.69:0/3532659460 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29d600640 1 --2- 172.21.15.69:0/3532659460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bcaa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57672/0 (socket says 172.21.15.69:57672) 2024-02-21T07:44:15.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29e000640 1 --2- 172.21.15.69:0/3532659460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bce9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29cc00640 1 -- 172.21.15.69:0/3532659460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 msgr2=0x56227bce9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29cc00640 1 --2- 172.21.15.69:0/3532659460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bce9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29cc00640 1 -- 172.21.15.69:0/3532659460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 msgr2=0x56227bcaa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29cc00640 1 --2- 172.21.15.69:0/3532659460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bcaa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29cc00640 1 -- 172.21.15.69:0/3532659460 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2982233e0 con 0x56227bc7f020 2024-02-21T07:44:15.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29e000640 1 --2- 172.21.15.69:0/3532659460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bce9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:15.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.700+0000 7fa29cc00640 1 --2- 172.21.15.69:0/3532659460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc47bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56227bc15770 tx=0x7fa284008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=876980d2216d0925 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.701+0000 7fa289200640 1 -- 172.21.15.69:0/3532659460 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284004230 con 0x56227bc7f020 2024-02-21T07:44:15.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.701+0000 7fa289200640 1 -- 172.21.15.69:0/3532659460 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2840043b0 con 0x56227bc7f020 2024-02-21T07:44:15.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.701+0000 7fa289200640 1 -- 172.21.15.69:0/3532659460 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa284004520 con 0x56227bc7f020 2024-02-21T07:44:15.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.701+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3532659460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 msgr2=0x56227bc47bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.701+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3532659460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc47bf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56227bc15770 tx=0x7fa284008030 comp rx=0 tx=0).stop 2024-02-21T07:44:15.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.702+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3532659460 shutdown_connections 2024-02-21T07:44:15.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.702+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3532659460 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bce9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.702+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3532659460 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc47bf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.702+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3532659460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bcaa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.702+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3532659460 >> 172.21.15.69:0/3532659460 conn(0x56227bc55ec0 msgr2=0x56227bc10300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.702+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3532659460 shutdown_connections 2024-02-21T07:44:15.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.702+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3532659460 wait complete. 2024-02-21T07:44:15.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.703+0000 7fa2a2d94740 1 -- start start 2024-02-21T07:44:15.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.703+0000 7fa2a2d94740 1 Processor -- start 2024-02-21T07:44:15.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.704+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc17b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.704+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc91030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.704+0000 7fa2a2d94740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc86320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.704+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bc61850 con 0x56227bc567e0 2024-02-21T07:44:15.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.704+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bc196e0 con 0x56227bc91590 2024-02-21T07:44:15.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.704+0000 7fa2a2d94740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227bc8f0a0 con 0x56227bc7f020 2024-02-21T07:44:15.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.704+0000 7fa2a2d94740 10 client.0 _ll_register_callbacks cb 0x7fa290017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:15.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29d600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc17b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc86320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc86320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:46390/0 (socket says 172.21.15.69:46390) 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29d600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc17b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57678/0 (socket says 172.21.15.69:57678) 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29e000640 1 -- 172.21.15.69:0/3487220972 learned_addr learned my addr 172.21.15.69:0/3487220972 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29cc00640 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc91030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29e000640 1 -- 172.21.15.69:0/3487220972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 msgr2=0x56227bc91030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29e000640 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc91030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29e000640 1 -- 172.21.15.69:0/3487220972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 msgr2=0x56227bc17b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29e000640 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc17b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29e000640 1 -- 172.21.15.69:0/3487220972 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa284031c80 con 0x56227bc91590 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29cc00640 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc91030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.705+0000 7fa29d600640 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc17b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.706+0000 7fa29e000640 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc86320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa2900012e0 tx=0x7fa290005b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6588f48a6eee066 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.706+0000 7fa27e000640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.706+0000 7fa27e000640 1 -- 172.21.15.69:0/3487220972 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900135c0 con 0x56227bc91590 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.706+0000 7fa27e000640 1 -- 172.21.15.69:0/3487220972 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa29001c040 con 0x56227bc91590 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.706+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3487220972 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa290013720 con 0x56227bc91590 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.706+0000 7fa27e000640 1 -- 172.21.15.69:0/3487220972 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa29000d270 con 0x56227bc91590 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.706+0000 7fa2a2d94740 10 client.5665 fetch_fsmap learned FSMap version 19 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.706+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3487220972 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x56227bb1cab0 con 0x56227bc91590 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.707+0000 7fa27e000640 1 -- 172.21.15.69:0/3487220972 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa290013720 con 0x56227bc91590 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.707+0000 7fa27e000640 1 -- 172.21.15.69:0/3487220972 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 19) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa290012070 con 0x56227bc91590 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.707+0000 7fa2a2d94740 10 client.5665 fetch_fsmap finished waiting for FSMap version 19 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.707+0000 7fa2a2d94740 10 client.5665 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.d 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.707+0000 7fa2a2d94740 20 client.5665 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.707+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x56227bc5bac0 0x56227bce5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.707+0000 7fa2a2d94740 4 client.5665 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:44:15.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.707+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3487220972 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56227b90d890 con 0x56227bc5bac0 2024-02-21T07:44:15.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.707+0000 7fa29d600640 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x56227bc5bac0 0x56227bce5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa29d600640 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x56227bc5bac0 0x56227bce5bf0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eac5592559adb84b server_cookie=a5a23a1ee4a51f67 in_seq=0 out_seq=0 2024-02-21T07:44:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa27e000640 10 client.5665 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:44:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa27e000640 1 -- 172.21.15.69:0/3487220972 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56227b90d890 con 0x56227bc5bac0 2024-02-21T07:44:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa27e000640 10 client.5665 handle_command_reply: tid=0 2024-02-21T07:44:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa2a2d94740 1 client.5665 shutdown 2024-02-21T07:44:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3487220972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 msgr2=0x56227bc86320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc86320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa2900012e0 tx=0x7fa290005b70 comp rx=0 tx=0).stop 2024-02-21T07:44:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3487220972 shutdown_connections 2024-02-21T07:44:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x56227bc5bac0 0x56227bce5bf0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56227bc91590 0x56227bc86320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56227bc7f020 0x56227bc91030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa2a2d94740 1 --2- 172.21.15.69:0/3487220972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56227bc567e0 0x56227bc17b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.708+0000 7fa27e000640 0 client.5665 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:44:15.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.709+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3487220972 >> 172.21.15.69:0/3487220972 conn(0x56227bc55ec0 msgr2=0x56227bc10510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.709+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3487220972 shutdown_connections 2024-02-21T07:44:15.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.709+0000 7fa2a2d94740 1 -- 172.21.15.69:0/3487220972 wait complete. 2024-02-21T07:44:15.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.709+0000 7fa2a2d94740 20 client.5665 trim_cache size 0 max 16384 2024-02-21T07:44:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:44:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 -- 172.21.15.69:0/177358683 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa27809f230 msgr2=0x7fa2780a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa27809f230 0x7fa2780a16f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa290005c00 tx=0x7fa290009040 comp rx=0 tx=0).stop 2024-02-21T07:44:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 -- 172.21.15.69:0/177358683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2980eeb80 msgr2=0x7fa2980c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2980eeb80 0x7fa2980c8de0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e870 tx=0x7fa28c00ed30 comp rx=0 tx=0).stop 2024-02-21T07:44:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 -- 172.21.15.69:0/177358683 shutdown_connections 2024-02-21T07:44:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa27809f230 0x7fa2780a16f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2980ccfb0 0x7fa29816aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa298183ea0 0x7fa2980cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 --2- 172.21.15.69:0/177358683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa2980eeb80 0x7fa2980c8de0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 -- 172.21.15.69:0/177358683 >> 172.21.15.69:0/177358683 conn(0x7fa2980ce3d0 msgr2=0x7fa2980f96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 -- 172.21.15.69:0/177358683 shutdown_connections 2024-02-21T07:44:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.710+0000 7fa2a0000640 1 -- 172.21.15.69:0/177358683 wait complete. 2024-02-21T07:44:15.737 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:44:15.737 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:44:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.953+0000 7f44a5e00640 1 Processor -- start 2024-02-21T07:44:15.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.953+0000 7f44a5e00640 1 -- start start 2024-02-21T07:44:15.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.955+0000 7f44a5e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f44a0183ea0 0x7f44a01846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.956+0000 7f44a5e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f44a0184c20 0x7f44a00ee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.956+0000 7f44a5e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a01850b0 con 0x7f44a00eeb80 2024-02-21T07:44:15.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.956+0000 7f44a5e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a0186010 con 0x7f44a0183ea0 2024-02-21T07:44:15.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.956+0000 7f44a5e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a0185390 con 0x7f44a0184c20 2024-02-21T07:44:15.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.956+0000 7f449f400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f44a00eeb80 0x7f44a0186bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38260/0 (socket says 172.21.15.69:38260) 2024-02-21T07:44:15.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.956+0000 7f449f400640 1 -- 172.21.15.69:0/3879507987 learned_addr learned my addr 172.21.15.69:0/3879507987 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:15.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.956+0000 7f449ea00640 1 --2- 172.21.15.69:0/3879507987 >> v2:172.21.15.174:3300/0 conn(0x7f44a0183ea0 0x7f44a01846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.956+0000 7f449e000640 1 --2- 172.21.15.69:0/3879507987 >> v2:172.21.15.184:3300/0 conn(0x7f44a0184c20 0x7f44a00ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.957+0000 7f449d600640 1 -- 172.21.15.69:0/3879507987 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914095613 0 0) 0x7f44a01850b0 con 0x7f44a00eeb80 2024-02-21T07:44:15.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.957+0000 7f449d600640 1 -- 172.21.15.69:0/3879507987 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4484003520 con 0x7f44a00eeb80 2024-02-21T07:44:15.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.957+0000 7f449ea00640 1 -- 172.21.15.69:0/3879507987 >> v2:172.21.15.184:3300/0 conn(0x7f44a0184c20 msgr2=0x7f44a00ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.957+0000 7f449ea00640 1 --2- 172.21.15.69:0/3879507987 >> v2:172.21.15.184:3300/0 conn(0x7f44a0184c20 0x7f44a00ee640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.957+0000 7f449ea00640 1 -- 172.21.15.69:0/3879507987 >> v1:172.21.15.69:6789/0 conn(0x7f44a00eeb80 legacy=0x7f44a0186bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.957+0000 7f449ea00640 1 -- 172.21.15.69:0/3879507987 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a0185670 con 0x7f44a0183ea0 2024-02-21T07:44:15.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.957+0000 7f449e000640 1 --2- 172.21.15.69:0/3879507987 >> v2:172.21.15.184:3300/0 conn(0x7f44a0184c20 0x7f44a00ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.958+0000 7f449ea00640 1 --2- 172.21.15.69:0/3879507987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 0x7f44a01846e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f44a00faf60 tx=0x7f449002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a60353df30e412f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.958+0000 7f449d600640 1 -- 172.21.15.69:0/3879507987 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449002e070 con 0x7f44a0183ea0 2024-02-21T07:44:15.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.958+0000 7f449d600640 1 -- 172.21.15.69:0/3879507987 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44900315a0 con 0x7f44a0183ea0 2024-02-21T07:44:15.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.958+0000 7f449d600640 1 -- 172.21.15.69:0/3879507987 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490031930 con 0x7f44a0183ea0 2024-02-21T07:44:15.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.959+0000 7f44a5e00640 1 -- 172.21.15.69:0/3879507987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 msgr2=0x7f44a01846e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.959+0000 7f44a5e00640 1 --2- 172.21.15.69:0/3879507987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 0x7f44a01846e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f44a00faf60 tx=0x7f449002b840 comp rx=0 tx=0).stop 2024-02-21T07:44:15.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.959+0000 7f44a5e00640 1 -- 172.21.15.69:0/3879507987 shutdown_connections 2024-02-21T07:44:15.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.959+0000 7f44a5e00640 1 --2- 172.21.15.69:0/3879507987 >> v2:172.21.15.184:3300/0 conn(0x7f44a0184c20 0x7f44a00ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.959+0000 7f44a5e00640 1 --2- 172.21.15.69:0/3879507987 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 0x7f44a01846e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.959+0000 7f44a5e00640 1 -- 172.21.15.69:0/3879507987 >> 172.21.15.69:0/3879507987 conn(0x7f44a00ce3d0 msgr2=0x7f44a00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.959+0000 7f44a5e00640 1 -- 172.21.15.69:0/3879507987 shutdown_connections 2024-02-21T07:44:15.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.959+0000 7f44a5e00640 1 -- 172.21.15.69:0/3879507987 wait complete. 2024-02-21T07:44:15.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.962+0000 7f44a5e00640 1 Processor -- start 2024-02-21T07:44:15.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.962+0000 7f44a5e00640 1 -- start start 2024-02-21T07:44:15.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.963+0000 7f44a5e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44a00eeb80 0x7f44a0189420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.963+0000 7f44a5e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 0x7f44a016e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.963+0000 7f44a5e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44a00f2640 0x7f44a016eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.963+0000 7f44a5e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00f3b20 con 0x7f44a00eeb80 2024-02-21T07:44:15.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.963+0000 7f44a5e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00f2bc0 con 0x7f44a0183ea0 2024-02-21T07:44:15.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.963+0000 7f44a5e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00f2ea0 con 0x7f44a00f2640 2024-02-21T07:44:15.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44a00eeb80 0x7f44a0189420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 0x7f44a016e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449e000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 0x7f44a016e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:46410/0 (socket says 172.21.15.69:46410) 2024-02-21T07:44:15.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449e000640 1 -- 172.21.15.69:0/2975670647 learned_addr learned my addr 172.21.15.69:0/2975670647 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44a00f2640 0x7f44a016eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449e000640 1 -- 172.21.15.69:0/2975670647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44a00f2640 msgr2=0x7f44a016eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449e000640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44a00f2640 0x7f44a016eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449e000640 1 -- 172.21.15.69:0/2975670647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44a00eeb80 msgr2=0x7f44a0189420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449e000640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44a00eeb80 0x7f44a0189420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449e000640 1 -- 172.21.15.69:0/2975670647 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c009400 con 0x7f44a0183ea0 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.964+0000 7f449ea00640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44a00eeb80 0x7f44a0189420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.965+0000 7f449e000640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 0x7f44a016e560 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f448c00ebe0 tx=0x7f448c00c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.965+0000 7f4497400640 1 -- 172.21.15.69:0/2975670647 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c009760 con 0x7f44a0183ea0 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.965+0000 7f4497400640 1 -- 172.21.15.69:0/2975670647 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c00cc30 con 0x7f44a0183ea0 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.965+0000 7f4497400640 1 -- 172.21.15.69:0/2975670647 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00eee0 con 0x7f44a0183ea0 2024-02-21T07:44:15.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.965+0000 7f44a5e00640 1 -- 172.21.15.69:0/2975670647 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4490009400 con 0x7f44a0183ea0 2024-02-21T07:44:15.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.965+0000 7f44a5e00640 1 -- 172.21.15.69:0/2975670647 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a00f3460 con 0x7f44a0183ea0 2024-02-21T07:44:15.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.970+0000 7f4497400640 1 -- 172.21.15.69:0/2975670647 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7f448c013470 con 0x7f44a0183ea0 2024-02-21T07:44:15.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.971+0000 7f44a8b8e740 1 Processor -- start 2024-02-21T07:44:15.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.971+0000 7f44a8b8e740 1 -- start start 2024-02-21T07:44:15.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.971+0000 7f4497400640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f448009f130 0x7f44800a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.972+0000 7f4497400640 1 -- 172.21.15.69:0/2975670647 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f448c0c9eb0 con 0x7f44a0183ea0 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.972+0000 7f449f400640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f448009f130 0x7f44800a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.972+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eaec0 0x55a5707eb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.972+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a570826050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.972+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 0x55a570827320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.972+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a57071e210 con 0x55a570826590 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.972+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a57071b740 con 0x55a5707eaec0 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.972+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a570716f20 con 0x55a5707eb7e0 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eaec0 0x55a5707eb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eaec0 0x55a5707eb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:46424/0 (socket says 172.21.15.69:46424) 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449ea00640 1 -- 172.21.15.69:0/1391906361 learned_addr learned my addr 172.21.15.69:0/1391906361 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449e000640 1 --2- 172.21.15.69:0/1391906361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a570826050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449f400640 1 --2- 172.21.15.69:0/1391906361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 0x55a570827320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449ea00640 1 -- 172.21.15.69:0/1391906361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 msgr2=0x55a570826050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449ea00640 1 --2- 172.21.15.69:0/1391906361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a570826050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449ea00640 1 -- 172.21.15.69:0/1391906361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 msgr2=0x55a570827320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449ea00640 1 --2- 172.21.15.69:0/1391906361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 0x55a570827320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449ea00640 1 -- 172.21.15.69:0/1391906361 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5706d8df0 con 0x55a5707eaec0 2024-02-21T07:44:15.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449f400640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f448009f130 0x7f44800a15f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4498001560 tx=0x7f449800e530 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.973+0000 7f449ea00640 1 --2- 172.21.15.69:0/1391906361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eaec0 0x55a5707eb2a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f449002b880 tx=0x7f4490008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62844560a9be1cb1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.974+0000 7f448b400640 1 -- 172.21.15.69:0/1391906361 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490031ad0 con 0x55a5707eaec0 2024-02-21T07:44:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.974+0000 7f448b400640 1 -- 172.21.15.69:0/1391906361 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490031c30 con 0x55a5707eaec0 2024-02-21T07:44:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.974+0000 7f448b400640 1 -- 172.21.15.69:0/1391906361 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490046480 con 0x55a5707eaec0 2024-02-21T07:44:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.975+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1391906361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eaec0 msgr2=0x55a5707eb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.975+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/1391906361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eaec0 0x55a5707eb2a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f449002b880 tx=0x7f4490008030 comp rx=0 tx=0).stop 2024-02-21T07:44:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.975+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1391906361 shutdown_connections 2024-02-21T07:44:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.975+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/1391906361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 0x55a570827320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.975+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/1391906361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a570826050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.975+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/1391906361 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eaec0 0x55a5707eb2a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.975+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1391906361 >> 172.21.15.69:0/1391906361 conn(0x55a5707ad490 msgr2=0x55a5707ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.975+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1391906361 shutdown_connections 2024-02-21T07:44:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.975+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1391906361 wait complete. 2024-02-21T07:44:15.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.976+0000 7f44a8b8e740 1 -- start start 2024-02-21T07:44:15.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.976+0000 7f44a8b8e740 1 Processor -- start 2024-02-21T07:44:15.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a570826590 0x55a5707f2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 0x55a5707de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5706bc150 con 0x55a57082f420 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5706bbdf0 con 0x55a570826590 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5704851c0 con 0x55a5707eb7e0 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f44a8b8e740 10 client.0 _ll_register_callbacks cb 0x55a57070b2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f449f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 0x55a5707de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f449ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f449f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 0x55a5707de8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57708/0 (socket says 172.21.15.69:57708) 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f449ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707a9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40626/0 (socket says 172.21.15.69:40626) 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f449f400640 1 -- 172.21.15.69:0/1697041917 learned_addr learned my addr 172.21.15.69:0/1697041917 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f449e000640 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a570826590 0x55a5707f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f449ea00640 1 -- 172.21.15.69:0/1697041917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a570826590 msgr2=0x55a5707f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f449ea00640 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a570826590 0x55a5707f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f449ea00640 1 -- 172.21.15.69:0/1697041917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 msgr2=0x55a5707de8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:15.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.978+0000 7f449ea00640 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 0x55a5707de8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.979+0000 7f449ea00640 1 -- 172.21.15.69:0/1697041917 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a0185670 con 0x55a5707eb7e0 2024-02-21T07:44:15.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.979+0000 7f449ea00640 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707a9ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4490045000 tx=0x7f4490004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc1d7a26760ad75f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:15.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.979+0000 7f447fe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.979+0000 7f447fe00640 1 -- 172.21.15.69:0/1697041917 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490055070 con 0x55a5707eb7e0 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.979+0000 7f447fe00640 1 -- 172.21.15.69:0/1697041917 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4490040070 con 0x55a5707eb7e0 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.979+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1697041917 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5704167e0 con 0x55a5707eb7e0 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.980+0000 7f447fe00640 1 -- 172.21.15.69:0/1697041917 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4490004040 con 0x55a5707eb7e0 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.980+0000 7f44a8b8e740 10 client.5636 fetch_fsmap learned FSMap version 20 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.980+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1697041917 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55a5707155a0 con 0x55a5707eb7e0 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.980+0000 7f447fe00640 1 -- 172.21.15.69:0/1697041917 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5704167e0 con 0x55a5707eb7e0 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.980+0000 7f447fe00640 1 -- 172.21.15.69:0/1697041917 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 20) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4490058020 con 0x55a5707eb7e0 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.980+0000 7f44a8b8e740 10 client.5636 fetch_fsmap finished waiting for FSMap version 20 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.980+0000 7f44a8b8e740 10 client.5636 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.g 2024-02-21T07:44:15.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.980+0000 7f44a8b8e740 20 client.5636 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:15.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.981+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a5707a9240 0x55a570823ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:15.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.981+0000 7f44a8b8e740 4 client.5636 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:15.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.981+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1697041917 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a570453720 con 0x55a5707a9240 2024-02-21T07:44:15.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.981+0000 7f449e000640 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a5707a9240 0x55a570823ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:15.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.982+0000 7f449e000640 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a5707a9240 0x55a570823ab0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fa9abff220f866cb server_cookie=3985b3f00bbe28d in_seq=0 out_seq=0 2024-02-21T07:44:15.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.982+0000 7f447fe00640 10 client.5636 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:44:15.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f447fe00640 1 -- 172.21.15.69:0/1697041917 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a570453720 con 0x55a5707a9240 2024-02-21T07:44:15.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f447fe00640 10 client.5636 handle_command_reply: tid=0 2024-02-21T07:44:15.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f44a8b8e740 1 client.5636 shutdown 2024-02-21T07:44:15.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1697041917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 msgr2=0x55a5707a9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707a9ca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4490045000 tx=0x7f4490004730 comp rx=0 tx=0).stop 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1697041917 shutdown_connections 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a5707a9240 0x55a570823ab0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 0x55a5707de8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a570826590 0x55a5707f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f447fe00640 0 client.5636 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/1697041917 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707a9ca0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.983+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1697041917 >> 172.21.15.69:0/1697041917 conn(0x55a5707eaec0 msgr2=0x55a5707aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.984+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1697041917 shutdown_connections 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.984+0000 7f44a8b8e740 1 -- 172.21.15.69:0/1697041917 wait complete. 2024-02-21T07:44:15.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:15.984+0000 7f44a8b8e740 20 client.5636 trim_cache size 0 max 16384 2024-02-21T07:44:16.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.004+0000 7f44a8b8e740 1 Processor -- start 2024-02-21T07:44:16.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.004+0000 7f44a8b8e740 1 -- start start 2024-02-21T07:44:16.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eb7e0 0x55a5707ac570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a570826590 0x55a5707a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 0x55a570825f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a570830320 con 0x55a57082f420 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5707de760 con 0x55a5707eb7e0 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5708300b0 con 0x55a570826590 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f449e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a570826590 0x55a5707a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f449f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 0x55a570825f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f449e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a570826590 0x55a5707a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40642/0 (socket says 172.21.15.69:40642) 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f449e000640 1 -- 172.21.15.69:0/2542673427 learned_addr learned my addr 172.21.15.69:0/2542673427 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.006+0000 7f449ea00640 1 --2- 172.21.15.69:0/2542673427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eb7e0 0x55a5707ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.007+0000 7f449e000640 1 -- 172.21.15.69:0/2542673427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eb7e0 msgr2=0x55a5707ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.007+0000 7f449e000640 1 --2- 172.21.15.69:0/2542673427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eb7e0 0x55a5707ac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.007+0000 7f449e000640 1 -- 172.21.15.69:0/2542673427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 msgr2=0x55a570825f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.007+0000 7f449e000640 1 --2- 172.21.15.69:0/2542673427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 0x55a570825f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.007+0000 7f449e000640 1 -- 172.21.15.69:0/2542673427 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5706b1ab0 con 0x55a570826590 2024-02-21T07:44:16.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.007+0000 7f449ea00640 1 --2- 172.21.15.69:0/2542673427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eb7e0 0x55a5707ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:16.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.007+0000 7f449e000640 1 --2- 172.21.15.69:0/2542673427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a570826590 0x55a5707a5620 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f448c00ca20 tx=0x7f448c0c9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=270e6f55ad259a93 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.007+0000 7f448aa00640 1 -- 172.21.15.69:0/2542673427 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c0b3070 con 0x55a570826590 2024-02-21T07:44:16.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.007+0000 7f448aa00640 1 -- 172.21.15.69:0/2542673427 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c0a0140 con 0x55a570826590 2024-02-21T07:44:16.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.007+0000 7f448aa00640 1 -- 172.21.15.69:0/2542673427 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c095ca0 con 0x55a570826590 2024-02-21T07:44:16.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.008+0000 7f44a8b8e740 1 -- 172.21.15.69:0/2542673427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a570826590 msgr2=0x55a5707a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.008+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/2542673427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a570826590 0x55a5707a5620 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f448c00ca20 tx=0x7f448c0c9040 comp rx=0 tx=0).stop 2024-02-21T07:44:16.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.008+0000 7f44a8b8e740 1 -- 172.21.15.69:0/2542673427 shutdown_connections 2024-02-21T07:44:16.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.008+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/2542673427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a57082f420 0x55a570825f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.009+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/2542673427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a570826590 0x55a5707a5620 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.009+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/2542673427 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a5707eb7e0 0x55a5707ac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.009+0000 7f44a8b8e740 1 -- 172.21.15.69:0/2542673427 >> 172.21.15.69:0/2542673427 conn(0x55a5707eaec0 msgr2=0x55a570826970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.009+0000 7f44a8b8e740 1 -- 172.21.15.69:0/2542673427 shutdown_connections 2024-02-21T07:44:16.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.009+0000 7f44a8b8e740 1 -- 172.21.15.69:0/2542673427 wait complete. 2024-02-21T07:44:16.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.010+0000 7f44a8b8e740 1 -- start start 2024-02-21T07:44:16.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.010+0000 7f44a8b8e740 1 Processor -- start 2024-02-21T07:44:16.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707e0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 0x55a57088e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f44a8b8e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a57082f420 0x55a57087d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a57088abc0 con 0x55a570826590 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a57088e000 con 0x55a57082f420 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f44a8b8e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a57088e9d0 con 0x55a5707eb7e0 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f44a8b8e740 10 client.0 _ll_register_callbacks cb 0x7f448c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f449ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707e0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f449ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707e0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40646/0 (socket says 172.21.15.69:40646) 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f449ea00640 1 -- 172.21.15.69:0/3818802177 learned_addr learned my addr 172.21.15.69:0/3818802177 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f449f400640 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a57082f420 0x55a57087d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.011+0000 7f449e000640 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 0x55a57088e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f449ea00640 1 -- 172.21.15.69:0/3818802177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a57082f420 msgr2=0x55a57087d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f449ea00640 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a57082f420 0x55a57087d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f449ea00640 1 -- 172.21.15.69:0/3818802177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 msgr2=0x55a57088e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f449ea00640 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 0x55a57088e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f449ea00640 1 -- 172.21.15.69:0/3818802177 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5707155a0 con 0x55a5707eb7e0 2024-02-21T07:44:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f449e000640 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 0x55a57088e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f449ea00640 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707e0460 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f449002bd90 tx=0x7f449003d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d02bd8a11c8a678f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f447fe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f447fe00640 1 -- 172.21.15.69:0/3818802177 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490055030 con 0x55a5707eb7e0 2024-02-21T07:44:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f447fe00640 1 -- 172.21.15.69:0/3818802177 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4490056070 con 0x55a5707eb7e0 2024-02-21T07:44:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.012+0000 7f44a8b8e740 1 -- 172.21.15.69:0/3818802177 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5707f67b0 con 0x55a5707eb7e0 2024-02-21T07:44:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.013+0000 7f447fe00640 1 -- 172.21.15.69:0/3818802177 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4490031710 con 0x55a5707eb7e0 2024-02-21T07:44:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.013+0000 7f44a8b8e740 10 client.5642 fetch_fsmap learned FSMap version 20 2024-02-21T07:44:16.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.013+0000 7f44a8b8e740 1 -- 172.21.15.69:0/3818802177 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x7f44a00f3460 con 0x55a5707eb7e0 2024-02-21T07:44:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.013+0000 7f447fe00640 1 -- 172.21.15.69:0/3818802177 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5707f67b0 con 0x55a5707eb7e0 2024-02-21T07:44:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.013+0000 7f447fe00640 1 -- 172.21.15.69:0/3818802177 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 20) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4490058040 con 0x55a5707eb7e0 2024-02-21T07:44:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.013+0000 7f44a8b8e740 10 client.5642 fetch_fsmap finished waiting for FSMap version 20 2024-02-21T07:44:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.013+0000 7f44a8b8e740 10 client.5642 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.g 2024-02-21T07:44:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.013+0000 7f44a8b8e740 20 client.5642 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.014+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a5707d47b0 0x55a570879070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.014+0000 7f44a8b8e740 4 client.5642 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:44:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.014+0000 7f44a8b8e740 1 -- 172.21.15.69:0/3818802177 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f4490031c30 con 0x55a5707d47b0 2024-02-21T07:44:16.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.014+0000 7f449e000640 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a5707d47b0 0x55a570879070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.016+0000 7f449e000640 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a5707d47b0 0x55a570879070 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3262dd3327c5c0b9 server_cookie=f68fefe8ed636366 in_seq=0 out_seq=0 2024-02-21T07:44:16.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.016+0000 7f447fe00640 10 client.5642 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:44:16.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.016+0000 7f447fe00640 1 -- 172.21.15.69:0/3818802177 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f4490031c30 con 0x55a5707d47b0 2024-02-21T07:44:16.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.016+0000 7f447fe00640 10 client.5642 handle_command_reply: tid=0 2024-02-21T07:44:16.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.017+0000 7f44a8b8e740 1 client.5642 shutdown 2024-02-21T07:44:16.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.017+0000 7f44a8b8e740 1 -- 172.21.15.69:0/3818802177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 msgr2=0x55a5707e0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.017+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707e0460 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f449002bd90 tx=0x7f449003d040 comp rx=0 tx=0).stop 2024-02-21T07:44:16.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.018+0000 7f44a8b8e740 1 -- 172.21.15.69:0/3818802177 shutdown_connections 2024-02-21T07:44:16.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.018+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a5707d47b0 0x55a570879070 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.018+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a57082f420 0x55a57087d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.018+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a570826590 0x55a57088e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.018+0000 7f44a8b8e740 1 --2- 172.21.15.69:0/3818802177 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a5707eb7e0 0x55a5707e0460 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.018+0000 7f44a8b8e740 1 -- 172.21.15.69:0/3818802177 >> 172.21.15.69:0/3818802177 conn(0x55a5707eaec0 msgr2=0x55a5707a9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.018+0000 7f447fe00640 0 client.5642 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:44:16.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.018+0000 7f44a8b8e740 1 -- 172.21.15.69:0/3818802177 shutdown_connections 2024-02-21T07:44:16.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.018+0000 7f44a8b8e740 1 -- 172.21.15.69:0/3818802177 wait complete. 2024-02-21T07:44:16.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.018+0000 7f44a8b8e740 20 client.5642 trim_cache size 0 max 16384 2024-02-21T07:44:16.025 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:44:16.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 -- 172.21.15.69:0/2975670647 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f448009f130 msgr2=0x7f44800a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f448009f130 0x7f44800a15f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4498001560 tx=0x7f449800e530 comp rx=0 tx=0).stop 2024-02-21T07:44:16.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 -- 172.21.15.69:0/2975670647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 msgr2=0x7f44a016e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 0x7f44a016e560 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f448c00ebe0 tx=0x7f448c00c520 comp rx=0 tx=0).stop 2024-02-21T07:44:16.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 -- 172.21.15.69:0/2975670647 shutdown_connections 2024-02-21T07:44:16.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f448009f130 0x7f44800a15f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44a00f2640 0x7f44a016eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f44a0183ea0 0x7f44a016e560 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 --2- 172.21.15.69:0/2975670647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44a00eeb80 0x7f44a0189420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 -- 172.21.15.69:0/2975670647 >> 172.21.15.69:0/2975670647 conn(0x7f44a00ce3d0 msgr2=0x7f44a0184280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 -- 172.21.15.69:0/2975670647 shutdown_connections 2024-02-21T07:44:16.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.020+0000 7f44a5e00640 1 -- 172.21.15.69:0/2975670647 wait complete. 2024-02-21T07:44:16.045 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:44:16.045 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:44:16.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.271+0000 7fac0de00640 1 Processor -- start 2024-02-21T07:44:16.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.274+0000 7fac0de00640 1 -- start start 2024-02-21T07:44:16.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.280+0000 7fac0de00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fac08190ca0 0x7fac0806da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.280+0000 7fac0de00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fac080f4d50 0x7fac080f5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.281+0000 7fac0de00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac080cf510 con 0x7fac0818a4e0 2024-02-21T07:44:16.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.281+0000 7fac0d400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fac080f4d50 0x7fac080f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.281+0000 7fac0d400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fac080f4d50 0x7fac080f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40654/0 (socket says 172.21.15.69:40654) 2024-02-21T07:44:16.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.281+0000 7fac0d400640 1 -- 172.21.15.69:0/1568289658 learned_addr learned my addr 172.21.15.69:0/1568289658 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.281+0000 7fac0de00640 1 -- 172.21.15.69:0/1568289658 --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0806df80 con 0x7fac08190ca0 2024-02-21T07:44:16.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.281+0000 7fac0de00640 1 -- 172.21.15.69:0/1568289658 --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0818a8c0 con 0x7fac080f4d50 2024-02-21T07:44:16.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.282+0000 7fac0d400640 1 -- 172.21.15.69:0/1568289658 >> v2:172.21.15.69:3300/0 conn(0x7fac08190ca0 msgr2=0x7fac0806da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.282+0000 7fac0d400640 1 --2- 172.21.15.69:0/1568289658 >> v2:172.21.15.69:3300/0 conn(0x7fac08190ca0 0x7fac0806da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.283+0000 7fac0d400640 1 -- 172.21.15.69:0/1568289658 >> v1:172.21.15.69:6789/0 conn(0x7fac0818a4e0 legacy=0x7fac080f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.283+0000 7fac0d400640 1 -- 172.21.15.69:0/1568289658 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0818ac50 con 0x7fac080f4d50 2024-02-21T07:44:16.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.288+0000 7fac0d400640 1 --2- 172.21.15.69:0/1568289658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac080f4d50 0x7fac080f5180 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac080f0d20 tx=0x7fabf402b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=255f5c2b19bb4f10 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.289+0000 7fac07400640 1 -- 172.21.15.69:0/1568289658 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4030870 con 0x7fac080f4d50 2024-02-21T07:44:16.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.290+0000 7fac07400640 1 -- 172.21.15.69:0/1568289658 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf40309d0 con 0x7fac080f4d50 2024-02-21T07:44:16.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.290+0000 7fac07400640 1 -- 172.21.15.69:0/1568289658 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4030d60 con 0x7fac080f4d50 2024-02-21T07:44:16.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.291+0000 7fac0de00640 1 -- 172.21.15.69:0/1568289658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac080f4d50 msgr2=0x7fac080f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.291+0000 7fac0de00640 1 --2- 172.21.15.69:0/1568289658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac080f4d50 0x7fac080f5180 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fac080f0d20 tx=0x7fabf402b9b0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.292+0000 7fac0de00640 1 -- 172.21.15.69:0/1568289658 shutdown_connections 2024-02-21T07:44:16.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.292+0000 7fac0de00640 1 --2- 172.21.15.69:0/1568289658 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac080f4d50 0x7fac080f5180 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.292+0000 7fac0de00640 1 --2- 172.21.15.69:0/1568289658 >> v2:172.21.15.69:3300/0 conn(0x7fac08190ca0 0x7fac0806da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.292+0000 7fac0de00640 1 -- 172.21.15.69:0/1568289658 >> 172.21.15.69:0/1568289658 conn(0x7fac080ce190 msgr2=0x7fac080ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.293+0000 7fac0de00640 1 -- 172.21.15.69:0/1568289658 shutdown_connections 2024-02-21T07:44:16.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.295+0000 7fac0de00640 1 -- 172.21.15.69:0/1568289658 wait complete. 2024-02-21T07:44:16.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.304+0000 7fac0de00640 1 Processor -- start 2024-02-21T07:44:16.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.304+0000 7fac0de00640 1 -- start start 2024-02-21T07:44:16.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.310+0000 7fac0de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac080f4d50 0x7fac0816cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.310+0000 7fac0de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0818a4e0 0x7fac08226770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.310+0000 7fac0de00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac08190ca0 0x7fac08226cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.310+0000 7fac0de00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0818ec70 con 0x7fac080f4d50 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.310+0000 7fac0de00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac082271f0 con 0x7fac08190ca0 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.310+0000 7fac0de00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0818e6b0 con 0x7fac0818a4e0 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.313+0000 7fac07e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0818a4e0 0x7fac08226770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.313+0000 7fac07e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0818a4e0 0x7fac08226770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40670/0 (socket says 172.21.15.69:40670) 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.313+0000 7fac07e00640 1 -- 172.21.15.69:0/1181549507 learned_addr learned my addr 172.21.15.69:0/1181549507 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.313+0000 7fac0ca00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac080f4d50 0x7fac0816cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.313+0000 7fac07e00640 1 -- 172.21.15.69:0/1181549507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac08190ca0 msgr2=0x7fac08226cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.313+0000 7fac07e00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac08190ca0 0x7fac08226cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.313+0000 7fac07e00640 1 -- 172.21.15.69:0/1181549507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac080f4d50 msgr2=0x7fac0816cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.313+0000 7fac07e00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac080f4d50 0x7fac0816cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.313+0000 7fac07e00640 1 -- 172.21.15.69:0/1181549507 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf40094d0 con 0x7fac0818a4e0 2024-02-21T07:44:16.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.314+0000 7fac07e00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0818a4e0 0x7fac08226770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fabf800b410 tx=0x7fabf800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.314+0000 7fac04c00640 1 -- 172.21.15.69:0/1181549507 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8022640 con 0x7fac0818a4e0 2024-02-21T07:44:16.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.314+0000 7fac04c00640 1 -- 172.21.15.69:0/1181549507 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf80227c0 con 0x7fac0818a4e0 2024-02-21T07:44:16.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.314+0000 7fac04c00640 1 -- 172.21.15.69:0/1181549507 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8022b70 con 0x7fac0818a4e0 2024-02-21T07:44:16.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.315+0000 7fac0de00640 1 -- 172.21.15.69:0/1181549507 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0818e990 con 0x7fac0818a4e0 2024-02-21T07:44:16.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.315+0000 7fac0de00640 1 -- 172.21.15.69:0/1181549507 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac08224640 con 0x7fac0818a4e0 2024-02-21T07:44:16.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.322+0000 7fac12061740 1 Processor -- start 2024-02-21T07:44:16.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.323+0000 7fac12061740 1 -- start start 2024-02-21T07:44:16.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.324+0000 7fac04c00640 1 -- 172.21.15.69:0/1181549507 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fabf8022cd0 con 0x7fac0818a4e0 2024-02-21T07:44:16.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.325+0000 7fac04c00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fabe809f130 0x7fabe80a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.325+0000 7fac04c00640 1 -- 172.21.15.69:0/1181549507 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fabf80dac20 con 0x7fac0818a4e0 2024-02-21T07:44:16.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.326+0000 7fac0d400640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fabe809f130 0x7fabe80a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.326+0000 7fac12061740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a997070 0x55f37a997450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.327+0000 7fac12061740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a997990 0x55f37a9d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.327+0000 7fac12061740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a9d2740 0x55f37a9d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.327+0000 7fac12061740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a8ca210 con 0x55f37a9d2740 2024-02-21T07:44:16.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.327+0000 7fac12061740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a8c7740 con 0x55f37a997990 2024-02-21T07:44:16.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.327+0000 7fac12061740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a8c2f20 con 0x55f37a997070 2024-02-21T07:44:16.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.327+0000 7fac0ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a997070 0x55f37a997450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.327+0000 7fac0ca00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a997070 0x55f37a997450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40682/0 (socket says 172.21.15.69:40682) 2024-02-21T07:44:16.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.327+0000 7fac0ca00640 1 -- 172.21.15.69:0/1075474454 learned_addr learned my addr 172.21.15.69:0/1075474454 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.327+0000 7fac07e00640 1 --2- 172.21.15.69:0/1075474454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a997990 0x55f37a9d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.328+0000 7fac0d400640 1 --2- 172.21.15.69:0/1075474454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a9d2740 0x55f37a9d34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.328+0000 7fac0ca00640 1 -- 172.21.15.69:0/1075474454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a997990 msgr2=0x55f37a9d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.328+0000 7fac0ca00640 1 --2- 172.21.15.69:0/1075474454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a997990 0x55f37a9d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.328+0000 7fac0ca00640 1 -- 172.21.15.69:0/1075474454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a9d2740 msgr2=0x55f37a9d34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.328+0000 7fac0ca00640 1 --2- 172.21.15.69:0/1075474454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a9d2740 0x55f37a9d34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.328+0000 7fac0ca00640 1 -- 172.21.15.69:0/1075474454 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f37a884df0 con 0x55f37a997070 2024-02-21T07:44:16.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.329+0000 7fac0ca00640 1 --2- 172.21.15.69:0/1075474454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a997070 0x55f37a997450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fac00001d70 tx=0x7fac0000e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ac8e8c8ed337869 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.329+0000 7fabfd200640 1 -- 172.21.15.69:0/1075474454 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00003b80 con 0x55f37a997070 2024-02-21T07:44:16.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.329+0000 7fabfd200640 1 -- 172.21.15.69:0/1075474454 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac00003ce0 con 0x55f37a997070 2024-02-21T07:44:16.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.329+0000 7fabfd200640 1 -- 172.21.15.69:0/1075474454 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0000eba0 con 0x55f37a997070 2024-02-21T07:44:16.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.331+0000 7fac0d400640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fabe809f130 0x7fabe80a15f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fabf4036000 tx=0x7fabf4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.331+0000 7fac12061740 1 -- 172.21.15.69:0/1075474454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a997070 msgr2=0x55f37a997450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.332+0000 7fac12061740 1 --2- 172.21.15.69:0/1075474454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a997070 0x55f37a997450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fac00001d70 tx=0x7fac0000e160 comp rx=0 tx=0).stop 2024-02-21T07:44:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.332+0000 7fac12061740 1 -- 172.21.15.69:0/1075474454 shutdown_connections 2024-02-21T07:44:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.332+0000 7fac12061740 1 --2- 172.21.15.69:0/1075474454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a9d2740 0x55f37a9d34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.332+0000 7fac12061740 1 --2- 172.21.15.69:0/1075474454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a997990 0x55f37a9d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.332+0000 7fac12061740 1 --2- 172.21.15.69:0/1075474454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a997070 0x55f37a997450 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.332+0000 7fac12061740 1 -- 172.21.15.69:0/1075474454 >> 172.21.15.69:0/1075474454 conn(0x55f37a959640 msgr2=0x55f37a95a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.334+0000 7fac12061740 1 -- 172.21.15.69:0/1075474454 shutdown_connections 2024-02-21T07:44:16.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.334+0000 7fac12061740 1 -- 172.21.15.69:0/1075474454 wait complete. 2024-02-21T07:44:16.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.335+0000 7fac12061740 1 -- start start 2024-02-21T07:44:16.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.336+0000 7fac12061740 1 Processor -- start 2024-02-21T07:44:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.341+0000 7fac12061740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a95aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.341+0000 7fac12061740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a9db960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.341+0000 7fac12061740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a98b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.341+0000 7fac12061740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a868150 con 0x55f37a997990 2024-02-21T07:44:16.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.341+0000 7fac12061740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a867df0 con 0x55f37a9d2740 2024-02-21T07:44:16.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.341+0000 7fac12061740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a6311c0 con 0x55f37a9c5420 2024-02-21T07:44:16.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.341+0000 7fac12061740 10 client.0 _ll_register_callbacks cb 0x55f37a8b72b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.342+0000 7fac0ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a95aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.342+0000 7fac0ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a95aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57782/0 (socket says 172.21.15.69:57782) 2024-02-21T07:44:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.342+0000 7fac0ca00640 1 -- 172.21.15.69:0/939027377 learned_addr learned my addr 172.21.15.69:0/939027377 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.343+0000 7fac0ca00640 1 -- 172.21.15.69:0/939027377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 msgr2=0x55f37a98b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.343+0000 7fac0ca00640 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a98b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.343+0000 7fac0ca00640 1 -- 172.21.15.69:0/939027377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 msgr2=0x55f37a9db960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.343+0000 7fac0ca00640 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a9db960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.343+0000 7fac0ca00640 1 -- 172.21.15.69:0/939027377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0000f040 con 0x55f37a997990 2024-02-21T07:44:16.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.344+0000 7fac0ca00640 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a95aad0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac0000ede0 tx=0x7fac00001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e1ea148e18dec5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.344+0000 7fabf1600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:16.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.345+0000 7fabf1600640 1 -- 172.21.15.69:0/939027377 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00003b80 con 0x55f37a997990 2024-02-21T07:44:16.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.345+0000 7fabf1600640 1 -- 172.21.15.69:0/939027377 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fac000052d0 con 0x55f37a997990 2024-02-21T07:44:16.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.346+0000 7fac12061740 1 -- 172.21.15.69:0/939027377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f37a5c27e0 con 0x55f37a997990 2024-02-21T07:44:16.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.346+0000 7fabf1600640 1 -- 172.21.15.69:0/939027377 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac00001620 con 0x55f37a997990 2024-02-21T07:44:16.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.347+0000 7fac12061740 10 client.5517 fetch_fsmap learned FSMap version 20 2024-02-21T07:44:16.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.347+0000 7fac12061740 1 -- 172.21.15.69:0/939027377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55f37a8c15a0 con 0x55f37a997990 2024-02-21T07:44:16.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.348+0000 7fabf1600640 1 -- 172.21.15.69:0/939027377 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f37a5c27e0 con 0x55f37a997990 2024-02-21T07:44:16.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.348+0000 7fabf1600640 1 -- 172.21.15.69:0/939027377 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 20) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fac00006b50 con 0x55f37a997990 2024-02-21T07:44:16.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.349+0000 7fac12061740 10 client.5517 fetch_fsmap finished waiting for FSMap version 20 2024-02-21T07:44:16.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.349+0000 7fac12061740 10 client.5517 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:44:16.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.349+0000 7fac12061740 20 client.5517 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:16.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.349+0000 7fac12061740 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f37a9c58a0 0x55f37a9d0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.349+0000 7fac12061740 4 client.5517 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:16.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.349+0000 7fac12061740 1 -- 172.21.15.69:0/939027377 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f37a5ff720 con 0x55f37a9c58a0 2024-02-21T07:44:16.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.350+0000 7fac07e00640 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f37a9c58a0 0x55f37a9d0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.351+0000 7fabf1600640 10 client.5517 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:44:16.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.352+0000 7fac07e00640 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f37a9c58a0 0x55f37a9d0170 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d5af864296744266 server_cookie=28ee972c6c5425a6 in_seq=0 out_seq=0 2024-02-21T07:44:16.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.353+0000 7fabf1600640 1 -- 172.21.15.69:0/939027377 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f37a5ff720 con 0x55f37a9c58a0 2024-02-21T07:44:16.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.353+0000 7fabf1600640 10 client.5517 handle_command_reply: tid=0 2024-02-21T07:44:16.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.354+0000 7fac12061740 1 client.5517 shutdown 2024-02-21T07:44:16.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.354+0000 7fac12061740 1 -- 172.21.15.69:0/939027377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 msgr2=0x55f37a95aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.354+0000 7fac12061740 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a95aad0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fac0000ede0 tx=0x7fac00001250 comp rx=0 tx=0).stop 2024-02-21T07:44:16.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.355+0000 7fac12061740 1 -- 172.21.15.69:0/939027377 shutdown_connections 2024-02-21T07:44:16.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.355+0000 7fac12061740 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f37a9c58a0 0x55f37a9d0170 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.355+0000 7fac12061740 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a98b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.355+0000 7fac12061740 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a9db960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.355+0000 7fac12061740 1 --2- 172.21.15.69:0/939027377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a95aad0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.355+0000 7fac12061740 1 -- 172.21.15.69:0/939027377 >> 172.21.15.69:0/939027377 conn(0x55f37a997070 msgr2=0x55f37a9c03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.355+0000 7fabf1600640 0 client.5517 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:44:16.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.356+0000 7fac12061740 1 -- 172.21.15.69:0/939027377 shutdown_connections 2024-02-21T07:44:16.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.356+0000 7fac12061740 1 -- 172.21.15.69:0/939027377 wait complete. 2024-02-21T07:44:16.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.357+0000 7fac12061740 20 client.5517 trim_cache size 0 max 16384 2024-02-21T07:44:16.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.405+0000 7fac12061740 1 Processor -- start 2024-02-21T07:44:16.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.406+0000 7fac12061740 1 -- start start 2024-02-21T07:44:16.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.410+0000 7fac12061740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a9552d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.411+0000 7fac12061740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a984fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.411+0000 7fac12061740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a95b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.411+0000 7fac12061740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a958b00 con 0x55f37a997990 2024-02-21T07:44:16.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.411+0000 7fac12061740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a9d23f0 con 0x55f37a9d2740 2024-02-21T07:44:16.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.411+0000 7fac12061740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a9977d0 con 0x55f37a9c5420 2024-02-21T07:44:16.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.412+0000 7fac0ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a9552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.412+0000 7fac0ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a9552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57786/0 (socket says 172.21.15.69:57786) 2024-02-21T07:44:16.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.412+0000 7fac0ca00640 1 -- 172.21.15.69:0/4134276999 learned_addr learned my addr 172.21.15.69:0/4134276999 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.413+0000 7fac0d400640 1 --2- 172.21.15.69:0/4134276999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a95b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.414+0000 7fac0ca00640 1 -- 172.21.15.69:0/4134276999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 msgr2=0x55f37a984fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:44:16.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.415+0000 7fac0ca00640 1 --2- 172.21.15.69:0/4134276999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a984fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.415+0000 7fac0ca00640 1 -- 172.21.15.69:0/4134276999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 msgr2=0x55f37a95b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.415+0000 7fac0ca00640 1 --2- 172.21.15.69:0/4134276999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a95b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.415+0000 7fac0ca00640 1 -- 172.21.15.69:0/4134276999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f37a85dab0 con 0x55f37a997990 2024-02-21T07:44:16.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.416+0000 7fac0ca00640 1 --2- 172.21.15.69:0/4134276999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a9552d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fac00001700 tx=0x7fac0001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bd0d74448a9755 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.416+0000 7fabf3e00640 1 -- 172.21.15.69:0/4134276999 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00001bb0 con 0x55f37a997990 2024-02-21T07:44:16.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.416+0000 7fabf3e00640 1 -- 172.21.15.69:0/4134276999 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0000ee10 con 0x55f37a997990 2024-02-21T07:44:16.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.416+0000 7fabf3e00640 1 -- 172.21.15.69:0/4134276999 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00001bb0 con 0x55f37a997990 2024-02-21T07:44:16.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.417+0000 7fac12061740 1 -- 172.21.15.69:0/4134276999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 msgr2=0x55f37a9552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.417+0000 7fac12061740 1 --2- 172.21.15.69:0/4134276999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a9552d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fac00001700 tx=0x7fac0001f000 comp rx=0 tx=0).stop 2024-02-21T07:44:16.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.419+0000 7fac12061740 1 -- 172.21.15.69:0/4134276999 shutdown_connections 2024-02-21T07:44:16.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.419+0000 7fac12061740 1 --2- 172.21.15.69:0/4134276999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a95b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.419+0000 7fac12061740 1 --2- 172.21.15.69:0/4134276999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a984fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.419+0000 7fac12061740 1 --2- 172.21.15.69:0/4134276999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37a9552d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.419+0000 7fac12061740 1 -- 172.21.15.69:0/4134276999 >> 172.21.15.69:0/4134276999 conn(0x55f37a997070 msgr2=0x55f37a98ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.419+0000 7fac12061740 1 -- 172.21.15.69:0/4134276999 shutdown_connections 2024-02-21T07:44:16.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.419+0000 7fac12061740 1 -- 172.21.15.69:0/4134276999 wait complete. 2024-02-21T07:44:16.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.421+0000 7fac12061740 1 -- start start 2024-02-21T07:44:16.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.421+0000 7fac12061740 1 Processor -- start 2024-02-21T07:44:16.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.423+0000 7fac12061740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37aa39350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.423+0000 7fac12061740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a984c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.423+0000 7fac12061740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a99c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.423+0000 7fac12061740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37aa39c20 con 0x55f37a997990 2024-02-21T07:44:16.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.423+0000 7fac12061740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a9852d0 con 0x55f37a9d2740 2024-02-21T07:44:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.423+0000 7fac12061740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37a98e4a0 con 0x55f37a9c5420 2024-02-21T07:44:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.423+0000 7fac12061740 10 client.0 _ll_register_callbacks cb 0x7fac00001780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:16.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.424+0000 7fac0ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37aa39350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.424+0000 7fac0ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37aa39350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57802/0 (socket says 172.21.15.69:57802) 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.424+0000 7fac0ca00640 1 -- 172.21.15.69:0/3352762120 learned_addr learned my addr 172.21.15.69:0/3352762120 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.425+0000 7fac0d400640 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a99c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.425+0000 7fac07e00640 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a984c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.426+0000 7fac0ca00640 1 -- 172.21.15.69:0/3352762120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 msgr2=0x55f37a984c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.426+0000 7fac0ca00640 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a984c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.426+0000 7fac0ca00640 1 -- 172.21.15.69:0/3352762120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 msgr2=0x55f37a99c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.426+0000 7fac0ca00640 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a99c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.426+0000 7fac0ca00640 1 -- 172.21.15.69:0/3352762120 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f37a8c15a0 con 0x55f37a997990 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.427+0000 7fac07e00640 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a984c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.427+0000 7fac0d400640 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a99c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:16.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.427+0000 7fac0ca00640 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37aa39350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fac0002a040 tx=0x7fac00009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e7f5dbdfe00d65 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.427+0000 7fabf1600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:16.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.428+0000 7fabf1600640 1 -- 172.21.15.69:0/3352762120 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00005270 con 0x55f37a997990 2024-02-21T07:44:16.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.428+0000 7fabf1600640 1 -- 172.21.15.69:0/3352762120 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fac00014480 con 0x55f37a997990 2024-02-21T07:44:16.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.428+0000 7fac12061740 1 -- 172.21.15.69:0/3352762120 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fac00003ce0 con 0x55f37a997990 2024-02-21T07:44:16.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.429+0000 7fabf1600640 1 -- 172.21.15.69:0/3352762120 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac000053d0 con 0x55f37a997990 2024-02-21T07:44:16.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.430+0000 7fac12061740 10 client.5523 fetch_fsmap learned FSMap version 20 2024-02-21T07:44:16.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.430+0000 7fac12061740 1 -- 172.21.15.69:0/3352762120 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55f37a883650 con 0x55f37a997990 2024-02-21T07:44:16.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.431+0000 7fabf1600640 1 -- 172.21.15.69:0/3352762120 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac00003ce0 con 0x55f37a997990 2024-02-21T07:44:16.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.431+0000 7fabf1600640 1 -- 172.21.15.69:0/3352762120 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 20) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fac00014640 con 0x55f37a997990 2024-02-21T07:44:16.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.431+0000 7fac12061740 10 client.5523 fetch_fsmap finished waiting for FSMap version 20 2024-02-21T07:44:16.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.431+0000 7fac12061740 10 client.5523 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:44:16.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.431+0000 7fac12061740 20 client.5523 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:16.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.431+0000 7fac12061740 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f37a9deee0 0x55f37a95a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.431+0000 7fac12061740 4 client.5523 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:44:16.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.431+0000 7fac12061740 1 -- 172.21.15.69:0/3352762120 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f37a64e890 con 0x55f37a9deee0 2024-02-21T07:44:16.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.432+0000 7fac07e00640 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f37a9deee0 0x55f37a95a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.432+0000 7fabf1600640 10 client.5523 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:44:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.433+0000 7fac07e00640 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f37a9deee0 0x55f37a95a780 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ff0a1aebe4d6721 server_cookie=4044e553d5454d28 in_seq=0 out_seq=0 2024-02-21T07:44:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.433+0000 7fabf1600640 1 -- 172.21.15.69:0/3352762120 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f37a64e890 con 0x55f37a9deee0 2024-02-21T07:44:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.433+0000 7fabf1600640 10 client.5523 handle_command_reply: tid=0 2024-02-21T07:44:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.433+0000 7fac12061740 1 client.5523 shutdown 2024-02-21T07:44:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.434+0000 7fac12061740 1 -- 172.21.15.69:0/3352762120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 msgr2=0x55f37aa39350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.434+0000 7fac12061740 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37aa39350 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fac0002a040 tx=0x7fac00009040 comp rx=0 tx=0).stop 2024-02-21T07:44:16.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.434+0000 7fac12061740 1 -- 172.21.15.69:0/3352762120 shutdown_connections 2024-02-21T07:44:16.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.434+0000 7fac12061740 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55f37a9d2740 0x55f37a99c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.434+0000 7fac12061740 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55f37a9deee0 0x55f37a95a780 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.435+0000 7fac12061740 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55f37a9c5420 0x55f37a984c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.435+0000 7fac12061740 1 --2- 172.21.15.69:0/3352762120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f37a997990 0x55f37aa39350 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.435+0000 7fac12061740 1 -- 172.21.15.69:0/3352762120 >> 172.21.15.69:0/3352762120 conn(0x55f37a997070 msgr2=0x55f37a9d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.435+0000 7fabf1600640 0 client.5523 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:44:16.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.435+0000 7fac12061740 1 -- 172.21.15.69:0/3352762120 shutdown_connections 2024-02-21T07:44:16.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.435+0000 7fac12061740 1 -- 172.21.15.69:0/3352762120 wait complete. 2024-02-21T07:44:16.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.435+0000 7fac12061740 20 client.5523 trim_cache size 0 max 16384 2024-02-21T07:44:16.442 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:44:16.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.436+0000 7fac0de00640 1 -- 172.21.15.69:0/1181549507 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fabe809f130 msgr2=0x7fabe80a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.436+0000 7fac0de00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fabe809f130 0x7fabe80a15f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fabf4036000 tx=0x7fabf4030000 comp rx=0 tx=0).stop 2024-02-21T07:44:16.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.436+0000 7fac0de00640 1 -- 172.21.15.69:0/1181549507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0818a4e0 msgr2=0x7fac08226770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.436+0000 7fac0de00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0818a4e0 0x7fac08226770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fabf800b410 tx=0x7fabf800b8d0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.437+0000 7fac0de00640 1 -- 172.21.15.69:0/1181549507 shutdown_connections 2024-02-21T07:44:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.437+0000 7fac0de00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fabe809f130 0x7fabe80a15f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.437+0000 7fac0de00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fac08190ca0 0x7fac08226cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.437+0000 7fac0de00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac0818a4e0 0x7fac08226770 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.437+0000 7fac0de00640 1 --2- 172.21.15.69:0/1181549507 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac080f4d50 0x7fac0816cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.437+0000 7fac0de00640 1 -- 172.21.15.69:0/1181549507 >> 172.21.15.69:0/1181549507 conn(0x7fac080ce190 msgr2=0x7fac0806d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.437+0000 7fac0de00640 1 -- 172.21.15.69:0/1181549507 shutdown_connections 2024-02-21T07:44:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.437+0000 7fac0de00640 1 -- 172.21.15.69:0/1181549507 wait complete. 2024-02-21T07:44:16.483 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:44:16.483 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:44:16.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.733+0000 7fde95800640 1 Processor -- start 2024-02-21T07:44:16.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.733+0000 7fde95800640 1 -- start start 2024-02-21T07:44:16.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.735+0000 7fde95800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fde9017f550 0x7fde900f9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.735+0000 7fde95800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fde900fa7c0 0x7fde9018b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.735+0000 7fde95800640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9018bc10 con 0x7fde900fa350 2024-02-21T07:44:16.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.735+0000 7fde95800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde900ff310 con 0x7fde9017f550 2024-02-21T07:44:16.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.735+0000 7fde95800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde90189f40 con 0x7fde900fa7c0 2024-02-21T07:44:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.735+0000 7fde8e000640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fde900fa350 0x7fde9018afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38280/0 (socket says 172.21.15.69:38280) 2024-02-21T07:44:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.736+0000 7fde8e000640 1 -- 172.21.15.69:0/2751777100 learned_addr learned my addr 172.21.15.69:0/2751777100 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.736+0000 7fde8ea00640 1 --2- 172.21.15.69:0/2751777100 >> v2:172.21.15.174:3300/0 conn(0x7fde9017f550 0x7fde900f9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.736+0000 7fde8f400640 1 --2- 172.21.15.69:0/2751777100 >> v2:172.21.15.184:3300/0 conn(0x7fde900fa7c0 0x7fde9018b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.736+0000 7fde8d600640 1 -- 172.21.15.69:0/2751777100 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148700199 0 0) 0x7fde9018bc10 con 0x7fde900fa350 2024-02-21T07:44:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.736+0000 7fde8ea00640 1 -- 172.21.15.69:0/2751777100 >> v2:172.21.15.184:3300/0 conn(0x7fde900fa7c0 msgr2=0x7fde9018b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.736+0000 7fde8ea00640 1 --2- 172.21.15.69:0/2751777100 >> v2:172.21.15.184:3300/0 conn(0x7fde900fa7c0 0x7fde9018b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.736+0000 7fde8ea00640 1 -- 172.21.15.69:0/2751777100 >> v1:172.21.15.69:6789/0 conn(0x7fde900fa350 legacy=0x7fde9018afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.736+0000 7fde8ea00640 1 -- 172.21.15.69:0/2751777100 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9017f930 con 0x7fde9017f550 2024-02-21T07:44:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.737+0000 7fde8ea00640 1 --2- 172.21.15.69:0/2751777100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde9017f550 0x7fde900f9e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fde900d0a30 tx=0x7fde8002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a8325bb8639a09c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.737+0000 7fde8d600640 1 -- 172.21.15.69:0/2751777100 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8002e070 con 0x7fde9017f550 2024-02-21T07:44:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.737+0000 7fde8d600640 1 -- 172.21.15.69:0/2751777100 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde800315a0 con 0x7fde9017f550 2024-02-21T07:44:16.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.737+0000 7fde8d600640 1 -- 172.21.15.69:0/2751777100 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80031930 con 0x7fde9017f550 2024-02-21T07:44:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.738+0000 7fde95800640 1 -- 172.21.15.69:0/2751777100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde9017f550 msgr2=0x7fde900f9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.738+0000 7fde95800640 1 --2- 172.21.15.69:0/2751777100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde9017f550 0x7fde900f9e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fde900d0a30 tx=0x7fde8002b840 comp rx=0 tx=0).stop 2024-02-21T07:44:16.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.738+0000 7fde95800640 1 -- 172.21.15.69:0/2751777100 shutdown_connections 2024-02-21T07:44:16.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.738+0000 7fde95800640 1 --2- 172.21.15.69:0/2751777100 >> v2:172.21.15.184:3300/0 conn(0x7fde900fa7c0 0x7fde9018b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.738+0000 7fde95800640 1 --2- 172.21.15.69:0/2751777100 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde9017f550 0x7fde900f9e10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.738+0000 7fde95800640 1 -- 172.21.15.69:0/2751777100 >> 172.21.15.69:0/2751777100 conn(0x7fde900668e0 msgr2=0x7fde90066cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.738+0000 7fde95800640 1 -- 172.21.15.69:0/2751777100 shutdown_connections 2024-02-21T07:44:16.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.738+0000 7fde95800640 1 -- 172.21.15.69:0/2751777100 wait complete. 2024-02-21T07:44:16.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.740+0000 7fde95800640 1 Processor -- start 2024-02-21T07:44:16.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.740+0000 7fde95800640 1 -- start start 2024-02-21T07:44:16.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.741+0000 7fde95800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde900fa350 0x7fde9016b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.741+0000 7fde95800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde9017f550 0x7fde900fc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde95800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9016bc50 0x7fde900fcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde95800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9021c7f0 con 0x7fde900fa350 2024-02-21T07:44:16.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde95800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9021cad0 con 0x7fde9017f550 2024-02-21T07:44:16.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde95800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9021cdb0 con 0x7fde9016bc50 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde900fa350 0x7fde9016b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde900fa350 0x7fde9016b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57804/0 (socket says 172.21.15.69:57804) 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8ea00640 1 -- 172.21.15.69:0/2501236519 learned_addr learned my addr 172.21.15.69:0/2501236519 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8f400640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9016bc50 0x7fde900fcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8e000640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde9017f550 0x7fde900fc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8f400640 1 -- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde9017f550 msgr2=0x7fde900fc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8f400640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde9017f550 0x7fde900fc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8f400640 1 -- 172.21.15.69:0/2501236519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde900fa350 msgr2=0x7fde9016b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8f400640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde900fa350 0x7fde9016b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8f400640 1 -- 172.21.15.69:0/2501236519 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde80009400 con 0x7fde9016bc50 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8e000640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde9017f550 0x7fde900fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.742+0000 7fde8ea00640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde900fa350 0x7fde9016b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:16.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.743+0000 7fde8f400640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9016bc50 0x7fde900fcad0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fde8800eb70 tx=0x7fde8800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.743+0000 7fde86a00640 1 -- 172.21.15.69:0/2501236519 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8800cd20 con 0x7fde9016bc50 2024-02-21T07:44:16.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.743+0000 7fde86a00640 1 -- 172.21.15.69:0/2501236519 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8800f040 con 0x7fde9016bc50 2024-02-21T07:44:16.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.743+0000 7fde95800640 1 -- 172.21.15.69:0/2501236519 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde9021d090 con 0x7fde9016bc50 2024-02-21T07:44:16.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.743+0000 7fde86a00640 1 -- 172.21.15.69:0/2501236519 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde880146c0 con 0x7fde9016bc50 2024-02-21T07:44:16.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.743+0000 7fde95800640 1 -- 172.21.15.69:0/2501236519 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9021d650 con 0x7fde9016bc50 2024-02-21T07:44:16.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.747+0000 7fde86a00640 1 -- 172.21.15.69:0/2501236519 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 6) v1 ==== 134419+0+0 (secure 0 0 0) 0x7fde88014820 con 0x7fde9016bc50 2024-02-21T07:44:16.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.747+0000 7fde9862a740 1 Processor -- start 2024-02-21T07:44:16.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.747+0000 7fde9862a740 1 -- start start 2024-02-21T07:44:16.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.748+0000 7fde9862a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82baccec0 0x55b82bacd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.748+0000 7fde9862a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 0x55b82bb08050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.748+0000 7fde9862a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bb08590 0x55b82bb09320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.748+0000 7fde9862a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82ba00210 con 0x55b82baccec0 2024-02-21T07:44:16.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.748+0000 7fde9862a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82b9fd740 con 0x55b82bacd7e0 2024-02-21T07:44:16.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.748+0000 7fde9862a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82b9f8f20 con 0x55b82bb08590 2024-02-21T07:44:16.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82baccec0 0x55b82bacd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82baccec0 0x55b82bacd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57820/0 (socket says 172.21.15.69:57820) 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8e000640 1 -- 172.21.15.69:0/2481857439 learned_addr learned my addr 172.21.15.69:0/2481857439 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde86a00640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7009f130 0x7fde700a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8ea00640 1 --2- 172.21.15.69:0/2481857439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 0x55b82bb08050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8e000640 1 --2- 172.21.15.69:0/2481857439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bb08590 0x55b82bb09320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8e000640 1 -- 172.21.15.69:0/2481857439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bb08590 msgr2=0x55b82bb09320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8e000640 1 --2- 172.21.15.69:0/2481857439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bb08590 0x55b82bb09320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8e000640 1 -- 172.21.15.69:0/2481857439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 msgr2=0x55b82bb08050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8e000640 1 --2- 172.21.15.69:0/2481857439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 0x55b82bb08050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8e000640 1 -- 172.21.15.69:0/2481857439 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b82b9badf0 con 0x55b82baccec0 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde86a00640 1 -- 172.21.15.69:0/2501236519 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fde880ca930 con 0x7fde9016bc50 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8f400640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7009f130 0x7fde700a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.749+0000 7fde8e000640 1 --2- 172.21.15.69:0/2481857439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82baccec0 0x55b82bacd2a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0077f0 tx=0x7fde7c007250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e27cf2d168792d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.750+0000 7fde7b400640 1 -- 172.21.15.69:0/2481857439 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0146f0 con 0x55b82baccec0 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.750+0000 7fde7b400640 1 -- 172.21.15.69:0/2481857439 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c014850 con 0x55b82baccec0 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.750+0000 7fde7b400640 1 -- 172.21.15.69:0/2481857439 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c014bc0 con 0x55b82baccec0 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.751+0000 7fde9862a740 1 -- 172.21.15.69:0/2481857439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82baccec0 msgr2=0x55b82bacd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.751+0000 7fde9862a740 1 --2- 172.21.15.69:0/2481857439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82baccec0 0x55b82bacd2a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0077f0 tx=0x7fde7c007250 comp rx=0 tx=0).stop 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.751+0000 7fde8f400640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7009f130 0x7fde700a15f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fde880c81b0 tx=0x7fde8800ef90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.751+0000 7fde9862a740 1 -- 172.21.15.69:0/2481857439 shutdown_connections 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.751+0000 7fde9862a740 1 --2- 172.21.15.69:0/2481857439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bb08590 0x55b82bb09320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.751+0000 7fde9862a740 1 --2- 172.21.15.69:0/2481857439 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 0x55b82bb08050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.751+0000 7fde9862a740 1 --2- 172.21.15.69:0/2481857439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82baccec0 0x55b82bacd2a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.751+0000 7fde9862a740 1 -- 172.21.15.69:0/2481857439 >> 172.21.15.69:0/2481857439 conn(0x55b82ba8f490 msgr2=0x55b82ba90510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.751+0000 7fde9862a740 1 -- 172.21.15.69:0/2481857439 shutdown_connections 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.751+0000 7fde9862a740 1 -- 172.21.15.69:0/2481857439 wait complete. 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.752+0000 7fde9862a740 1 -- start start 2024-02-21T07:44:16.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.752+0000 7fde9862a740 1 Processor -- start 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde9862a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacd7e0 0x55b82bafaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde9862a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bb08590 0x55b82babb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde9862a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacc680 0x55b82bacaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde9862a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82b99e150 con 0x55b82bacc680 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde9862a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82b99ddf0 con 0x55b82bb08590 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde9862a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82b7671c0 con 0x55b82bacd7e0 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde9862a740 10 client.0 _ll_register_callbacks cb 0x55b82b9ed2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde8e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacd7e0 0x55b82bafaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde8e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacd7e0 0x55b82bafaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40748/0 (socket says 172.21.15.69:40748) 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde8e000640 1 -- 172.21.15.69:0/1177889995 learned_addr learned my addr 172.21.15.69:0/1177889995 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.753+0000 7fde8e000640 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacc680 0x55b82bacaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde8ea00640 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bb08590 0x55b82babb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde8e000640 1 -- 172.21.15.69:0/1177889995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bb08590 msgr2=0x55b82babb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde8e000640 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bb08590 0x55b82babb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde8e000640 1 -- 172.21.15.69:0/1177889995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacc680 msgr2=0x55b82bacaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde8e000640 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacc680 0x55b82bacaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde8e000640 1 -- 172.21.15.69:0/1177889995 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c0047e0 con 0x55b82bacd7e0 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde8e000640 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacd7e0 0x55b82bafaeb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fde7c004f70 tx=0x7fde7c00f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d5931a8e056c09 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde6fe00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde6fe00640 1 -- 172.21.15.69:0/1177889995 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c0146f0 con 0x55b82bacd7e0 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde9862a740 1 -- 172.21.15.69:0/1177889995 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b82b6f87e0 con 0x55b82bacd7e0 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.754+0000 7fde6fe00640 1 -- 172.21.15.69:0/1177889995 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fde7c019470 con 0x55b82bacd7e0 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde6fe00640 1 -- 172.21.15.69:0/1177889995 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde7c007210 con 0x55b82bacd7e0 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde9862a740 10 client.5666 fetch_fsmap learned FSMap version 20 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde9862a740 1 -- 172.21.15.69:0/1177889995 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55b82b9f75a0 con 0x55b82bacd7e0 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde6fe00640 1 -- 172.21.15.69:0/1177889995 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b82b6f87e0 con 0x55b82bacd7e0 2024-02-21T07:44:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde6fe00640 1 -- 172.21.15.69:0/1177889995 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 20) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fde7c019630 con 0x55b82bacd7e0 2024-02-21T07:44:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde9862a740 10 client.5666 fetch_fsmap finished waiting for FSMap version 20 2024-02-21T07:44:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde9862a740 10 client.5666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde9862a740 20 client.5666 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde9862a740 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b82bb05bb0 0x55b82bb05fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde9862a740 4 client.5666 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.755+0000 7fde9862a740 1 -- 172.21.15.69:0/1177889995 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b82b735720 con 0x55b82bb05bb0 2024-02-21T07:44:16.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.756+0000 7fde8ea00640 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b82bb05bb0 0x55b82bb05fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.756+0000 7fde8ea00640 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b82bb05bb0 0x55b82bb05fc0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee0e9850482cff18 server_cookie=7ef47ce84e98df2d in_seq=0 out_seq=0 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.756+0000 7fde6fe00640 10 client.5666 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde6fe00640 1 -- 172.21.15.69:0/1177889995 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b82b735720 con 0x55b82bb05bb0 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde6fe00640 10 client.5666 handle_command_reply: tid=0 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 client.5666 shutdown 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 -- 172.21.15.69:0/1177889995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacd7e0 msgr2=0x55b82bafaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacd7e0 0x55b82bafaeb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fde7c004f70 tx=0x7fde7c00f000 comp rx=0 tx=0).stop 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 -- 172.21.15.69:0/1177889995 shutdown_connections 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b82bb05bb0 0x55b82bb05fc0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacc680 0x55b82bacaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bb08590 0x55b82babb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 --2- 172.21.15.69:0/1177889995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacd7e0 0x55b82bafaeb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde6fe00640 0 client.5666 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 -- 172.21.15.69:0/1177889995 >> 172.21.15.69:0/1177889995 conn(0x55b82baccec0 msgr2=0x55b82ba90f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 -- 172.21.15.69:0/1177889995 shutdown_connections 2024-02-21T07:44:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.757+0000 7fde9862a740 1 -- 172.21.15.69:0/1177889995 wait complete. 2024-02-21T07:44:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.758+0000 7fde9862a740 20 client.5666 trim_cache size 0 max 16384 2024-02-21T07:44:16.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.770+0000 7fde9862a740 1 Processor -- start 2024-02-21T07:44:16.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.770+0000 7fde9862a740 1 -- start start 2024-02-21T07:44:16.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.771+0000 7fde9862a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacc680 0x55b82bb07f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.771+0000 7fde9862a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 0x55b82bac35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.771+0000 7fde9862a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bb08590 0x55b82ba87300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.771+0000 7fde9862a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82bac3b10 con 0x55b82bb08590 2024-02-21T07:44:16.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.771+0000 7fde9862a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82bafb210 con 0x55b82bacd7e0 2024-02-21T07:44:16.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.771+0000 7fde9862a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82ba908e0 con 0x55b82bacc680 2024-02-21T07:44:16.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 0x55b82bac35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 0x55b82bac35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:46534/0 (socket says 172.21.15.69:46534) 2024-02-21T07:44:16.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8ea00640 1 -- 172.21.15.69:0/1917797006 learned_addr learned my addr 172.21.15.69:0/1917797006 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8e000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacc680 0x55b82bb07f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8e000640 1 --2- 172.21.15.69:0/1917797006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bb08590 0x55b82ba87300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8ea00640 1 -- 172.21.15.69:0/1917797006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacc680 msgr2=0x55b82bb07f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8ea00640 1 --2- 172.21.15.69:0/1917797006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacc680 0x55b82bb07f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8ea00640 1 -- 172.21.15.69:0/1917797006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bb08590 msgr2=0x55b82ba87300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8ea00640 1 --2- 172.21.15.69:0/1917797006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bb08590 0x55b82ba87300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8ea00640 1 -- 172.21.15.69:0/1917797006 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b82b993ab0 con 0x55b82bacd7e0 2024-02-21T07:44:16.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.772+0000 7fde8ea00640 1 --2- 172.21.15.69:0/1917797006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 0x55b82bac35d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fde8002be50 tx=0x7fde80030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574430149e51c389 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.773+0000 7fde7aa00640 1 -- 172.21.15.69:0/1917797006 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80031e40 con 0x55b82bacd7e0 2024-02-21T07:44:16.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.773+0000 7fde7aa00640 1 -- 172.21.15.69:0/1917797006 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde80004040 con 0x55b82bacd7e0 2024-02-21T07:44:16.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.773+0000 7fde7aa00640 1 -- 172.21.15.69:0/1917797006 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde800043d0 con 0x55b82bacd7e0 2024-02-21T07:44:16.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.773+0000 7fde9862a740 1 -- 172.21.15.69:0/1917797006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 msgr2=0x55b82bac35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.773+0000 7fde9862a740 1 --2- 172.21.15.69:0/1917797006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 0x55b82bac35d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fde8002be50 tx=0x7fde80030000 comp rx=0 tx=0).stop 2024-02-21T07:44:16.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.773+0000 7fde9862a740 1 -- 172.21.15.69:0/1917797006 shutdown_connections 2024-02-21T07:44:16.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.773+0000 7fde9862a740 1 --2- 172.21.15.69:0/1917797006 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bb08590 0x55b82ba87300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.773+0000 7fde9862a740 1 --2- 172.21.15.69:0/1917797006 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bacd7e0 0x55b82bac35d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.773+0000 7fde9862a740 1 --2- 172.21.15.69:0/1917797006 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacc680 0x55b82bb07f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.773+0000 7fde9862a740 1 -- 172.21.15.69:0/1917797006 >> 172.21.15.69:0/1917797006 conn(0x55b82baccec0 msgr2=0x55b82ba90f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.774+0000 7fde9862a740 1 -- 172.21.15.69:0/1917797006 shutdown_connections 2024-02-21T07:44:16.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.774+0000 7fde9862a740 1 -- 172.21.15.69:0/1917797006 wait complete. 2024-02-21T07:44:16.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.774+0000 7fde9862a740 1 -- start start 2024-02-21T07:44:16.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.775+0000 7fde9862a740 1 Processor -- start 2024-02-21T07:44:16.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde9862a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacc680 0x55b82ba90f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde9862a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacd7e0 0x55b82bb567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde9862a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bb08590 0x55b82bb6d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde9862a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82ba914d0 con 0x55b82bacd7e0 2024-02-21T07:44:16.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde9862a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82bac5ef0 con 0x55b82bb08590 2024-02-21T07:44:16.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde9862a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82bb56ce0 con 0x55b82bacc680 2024-02-21T07:44:16.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde9862a740 10 client.0 _ll_register_callbacks cb 0x7fde7c007160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:16.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde8ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacd7e0 0x55b82bb567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde8ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacd7e0 0x55b82bb567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57846/0 (socket says 172.21.15.69:57846) 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde8ea00640 1 -- 172.21.15.69:0/2913027436 learned_addr learned my addr 172.21.15.69:0/2913027436 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde8e000640 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacc680 0x55b82ba90f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.776+0000 7fde8e000640 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bb08590 0x55b82bb6d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.777+0000 7fde8ea00640 1 -- 172.21.15.69:0/2913027436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacc680 msgr2=0x55b82ba90f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.777+0000 7fde8ea00640 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacc680 0x55b82ba90f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.777+0000 7fde8ea00640 1 -- 172.21.15.69:0/2913027436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bb08590 msgr2=0x55b82bb6d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.777+0000 7fde8ea00640 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bb08590 0x55b82bb6d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.777+0000 7fde8ea00640 1 -- 172.21.15.69:0/2913027436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9017f930 con 0x55b82bacd7e0 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.777+0000 7fde8ea00640 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacd7e0 0x55b82bb567a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fde8004d000 tx=0x7fde80004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7db516cc013ced3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.777+0000 7fde6fe00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.777+0000 7fde6fe00640 1 -- 172.21.15.69:0/2913027436 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80003610 con 0x55b82bacd7e0 2024-02-21T07:44:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.777+0000 7fde6fe00640 1 -- 172.21.15.69:0/2913027436 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fde80040040 con 0x55b82bacd7e0 2024-02-21T07:44:16.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.777+0000 7fde9862a740 1 -- 172.21.15.69:0/2913027436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde7c014850 con 0x55b82bacd7e0 2024-02-21T07:44:16.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde6fe00640 1 -- 172.21.15.69:0/2913027436 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde80003770 con 0x55b82bacd7e0 2024-02-21T07:44:16.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde9862a740 10 client.5541 fetch_fsmap learned FSMap version 20 2024-02-21T07:44:16.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde9862a740 1 -- 172.21.15.69:0/2913027436 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x55b82b9b9650 con 0x55b82bacd7e0 2024-02-21T07:44:16.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde6fe00640 1 -- 172.21.15.69:0/2913027436 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde80064020 con 0x55b82bacd7e0 2024-02-21T07:44:16.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde6fe00640 1 -- 172.21.15.69:0/2913027436 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 20) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fde800038d0 con 0x55b82bacd7e0 2024-02-21T07:44:16.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde9862a740 10 client.5541 fetch_fsmap finished waiting for FSMap version 20 2024-02-21T07:44:16.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde9862a740 10 client.5541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:16.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde9862a740 20 client.5541 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde9862a740 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b82bb00550 0x55b82bac1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde9862a740 4 client.5541 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.778+0000 7fde9862a740 1 -- 172.21.15.69:0/2913027436 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b82b784890 con 0x55b82bb00550 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.779+0000 7fde8e000640 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b82bb00550 0x55b82bac1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.779+0000 7fde8e000640 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b82bb00550 0x55b82bac1d10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58a7934ce0d25ccb server_cookie=6d1651daf4587272 in_seq=0 out_seq=0 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.779+0000 7fde6fe00640 10 client.5541 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.779+0000 7fde6fe00640 1 -- 172.21.15.69:0/2913027436 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b82b784890 con 0x55b82bb00550 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.779+0000 7fde6fe00640 10 client.5541 handle_command_reply: tid=0 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.779+0000 7fde9862a740 1 client.5541 shutdown 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.779+0000 7fde9862a740 1 -- 172.21.15.69:0/2913027436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacd7e0 msgr2=0x55b82bb567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.779+0000 7fde9862a740 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacd7e0 0x55b82bb567a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fde8004d000 tx=0x7fde80004730 comp rx=0 tx=0).stop 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde9862a740 1 -- 172.21.15.69:0/2913027436 shutdown_connections 2024-02-21T07:44:16.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde9862a740 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55b82bb00550 0x55b82bac1d10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde9862a740 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55b82bb08590 0x55b82bb6d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde9862a740 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b82bacd7e0 0x55b82bb567a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde6fe00640 0 client.5541 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:16.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde9862a740 1 --2- 172.21.15.69:0/2913027436 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55b82bacc680 0x55b82ba90f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde9862a740 1 -- 172.21.15.69:0/2913027436 >> 172.21.15.69:0/2913027436 conn(0x55b82baccec0 msgr2=0x55b82ba87300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde9862a740 1 -- 172.21.15.69:0/2913027436 shutdown_connections 2024-02-21T07:44:16.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde9862a740 1 -- 172.21.15.69:0/2913027436 wait complete. 2024-02-21T07:44:16.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde9862a740 20 client.5541 trim_cache size 0 max 16384 2024-02-21T07:44:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:44:16.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde95800640 1 -- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7009f130 msgr2=0x7fde700a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde95800640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7009f130 0x7fde700a15f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fde880c81b0 tx=0x7fde8800ef90 comp rx=0 tx=0).stop 2024-02-21T07:44:16.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde95800640 1 -- 172.21.15.69:0/2501236519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9016bc50 msgr2=0x7fde900fcad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:16.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.780+0000 7fde95800640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9016bc50 0x7fde900fcad0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fde8800eb70 tx=0x7fde8800c490 comp rx=0 tx=0).stop 2024-02-21T07:44:16.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.781+0000 7fde95800640 1 -- 172.21.15.69:0/2501236519 shutdown_connections 2024-02-21T07:44:16.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.781+0000 7fde95800640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fde7009f130 0x7fde700a15f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.781+0000 7fde95800640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde9016bc50 0x7fde900fcad0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.781+0000 7fde95800640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fde9017f550 0x7fde900fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.781+0000 7fde95800640 1 --2- 172.21.15.69:0/2501236519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde900fa350 0x7fde9016b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:16.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.781+0000 7fde95800640 1 -- 172.21.15.69:0/2501236519 >> 172.21.15.69:0/2501236519 conn(0x7fde900668e0 msgr2=0x7fde90174780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:16.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.781+0000 7fde95800640 1 -- 172.21.15.69:0/2501236519 shutdown_connections 2024-02-21T07:44:16.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:16.781+0000 7fde95800640 1 -- 172.21.15.69:0/2501236519 wait complete. 2024-02-21T07:44:17.803 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:44:17.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:44:17.803 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:44:18.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.018+0000 7f7a17200640 1 Processor -- start 2024-02-21T07:44:18.024 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.018+0000 7f7a17200640 1 -- start start 2024-02-21T07:44:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.021+0000 7f7a17200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7a10182900 0x7f7a1008d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.021+0000 7f7a17200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f7a10182ce0 0x7f7a100d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.021+0000 7f7a17200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a100d0a20 con 0x7f7a100d1720 2024-02-21T07:44:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.021+0000 7f7a17200640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a10187f30 con 0x7f7a10182900 2024-02-21T07:44:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.021+0000 7f7a17200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a10188210 con 0x7f7a10182ce0 2024-02-21T07:44:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.021+0000 7f7a0fe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7a10182900 0x7f7a1008d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.021+0000 7f7a0fe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7a10182900 0x7f7a1008d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57862/0 (socket says 172.21.15.69:57862) 2024-02-21T07:44:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.021+0000 7f7a0fe00640 1 -- 172.21.15.69:0/28099925 learned_addr learned my addr 172.21.15.69:0/28099925 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.021+0000 7f7a15200640 1 --1- 172.21.15.69:0/28099925 >> v1:172.21.15.69:6789/0 conn(0x7f7a100d1720 0x7f7a1018c040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38292/0 (socket says 172.21.15.69:38292) 2024-02-21T07:44:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.021+0000 7f7a07e00640 1 --2- 172.21.15.69:0/28099925 >> v2:172.21.15.184:3300/0 conn(0x7f7a10182ce0 0x7f7a100d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.022+0000 7f7a07e00640 1 -- 172.21.15.69:0/28099925 >> v2:172.21.15.69:3300/0 conn(0x7f7a10182900 msgr2=0x7f7a1008d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.022+0000 7f7a07e00640 1 --2- 172.21.15.69:0/28099925 >> v2:172.21.15.69:3300/0 conn(0x7f7a10182900 0x7f7a1008d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.022+0000 7f7a07e00640 1 -- 172.21.15.69:0/28099925 >> v1:172.21.15.69:6789/0 conn(0x7f7a100d1720 legacy=0x7f7a1018c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.022+0000 7f7a0f400640 1 -- 172.21.15.69:0/28099925 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067763704 0 0) 0x7f7a100d0a20 con 0x7f7a100d1720 2024-02-21T07:44:18.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.022+0000 7f7a07e00640 1 -- 172.21.15.69:0/28099925 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a101884f0 con 0x7f7a10182ce0 2024-02-21T07:44:18.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.024+0000 7f7a07e00640 1 --2- 172.21.15.69:0/28099925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a10182ce0 0x7f7a100d11e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7a100fb230 tx=0x7f79f802b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e0915c854c74c83 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.024+0000 7f7a0f400640 1 -- 172.21.15.69:0/28099925 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8031520 con 0x7f7a10182ce0 2024-02-21T07:44:18.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.024+0000 7f7a0f400640 1 -- 172.21.15.69:0/28099925 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8031680 con 0x7f7a10182ce0 2024-02-21T07:44:18.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.024+0000 7f7a0f400640 1 -- 172.21.15.69:0/28099925 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8031a10 con 0x7f7a10182ce0 2024-02-21T07:44:18.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.025+0000 7f7a17200640 1 -- 172.21.15.69:0/28099925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a10182ce0 msgr2=0x7f7a100d11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.025+0000 7f7a17200640 1 --2- 172.21.15.69:0/28099925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a10182ce0 0x7f7a100d11e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7a100fb230 tx=0x7f79f802b7c0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.025+0000 7f7a17200640 1 -- 172.21.15.69:0/28099925 shutdown_connections 2024-02-21T07:44:18.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.025+0000 7f7a17200640 1 --2- 172.21.15.69:0/28099925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a10182ce0 0x7f7a100d11e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.025+0000 7f7a17200640 1 --2- 172.21.15.69:0/28099925 >> v2:172.21.15.69:3300/0 conn(0x7f7a10182900 0x7f7a1008d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.025+0000 7f7a17200640 1 -- 172.21.15.69:0/28099925 >> 172.21.15.69:0/28099925 conn(0x7f7a100d6580 msgr2=0x7f7a100d6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.025+0000 7f7a17200640 1 -- 172.21.15.69:0/28099925 shutdown_connections 2024-02-21T07:44:18.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.025+0000 7f7a17200640 1 -- 172.21.15.69:0/28099925 wait complete. 2024-02-21T07:44:18.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.027+0000 7f7a17200640 1 Processor -- start 2024-02-21T07:44:18.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.027+0000 7f7a17200640 1 -- start start 2024-02-21T07:44:18.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.029+0000 7f7a17200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a100d1720 0x7f7a101736f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.029+0000 7f7a17200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a10182900 0x7f7a10184b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.029+0000 7f7a17200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a10182ce0 0x7f7a101806c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.029+0000 7f7a17200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10183620 con 0x7f7a10182ce0 2024-02-21T07:44:18.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.030+0000 7f7a17200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10183850 con 0x7f7a10182900 2024-02-21T07:44:18.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.030+0000 7f7a17200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a10183af0 con 0x7f7a100d1720 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.030+0000 7f7a0fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a100d1720 0x7f7a101736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.030+0000 7f7a15200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a10182ce0 0x7f7a101806c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.030+0000 7f7a0fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a100d1720 0x7f7a101736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40766/0 (socket says 172.21.15.69:40766) 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.030+0000 7f7a0fe00640 1 -- 172.21.15.69:0/1047467505 learned_addr learned my addr 172.21.15.69:0/1047467505 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.030+0000 7f7a07e00640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a10182900 0x7f7a10184b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.031+0000 7f7a0fe00640 1 -- 172.21.15.69:0/1047467505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a10182900 msgr2=0x7f7a10184b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.031+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a10182900 0x7f7a10184b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.031+0000 7f7a0fe00640 1 -- 172.21.15.69:0/1047467505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a10182ce0 msgr2=0x7f7a101806c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.031+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a10182ce0 0x7f7a101806c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.031+0000 7f7a0fe00640 1 -- 172.21.15.69:0/1047467505 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f8009400 con 0x7f7a100d1720 2024-02-21T07:44:18.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.031+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a100d1720 0x7f7a101736f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009fd0 tx=0x7f7a0000ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.031+0000 7f7a0cc00640 1 -- 172.21.15.69:0/1047467505 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000c940 con 0x7f7a100d1720 2024-02-21T07:44:18.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.031+0000 7f7a0cc00640 1 -- 172.21.15.69:0/1047467505 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0000caa0 con 0x7f7a100d1720 2024-02-21T07:44:18.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.031+0000 7f7a0cc00640 1 -- 172.21.15.69:0/1047467505 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000ce30 con 0x7f7a100d1720 2024-02-21T07:44:18.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.031+0000 7f7a17200640 1 -- 172.21.15.69:0/1047467505 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a10183dd0 con 0x7f7a100d1720 2024-02-21T07:44:18.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.032+0000 7f7a17200640 1 -- 172.21.15.69:0/1047467505 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a10184390 con 0x7f7a100d1720 2024-02-21T07:44:18.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.035+0000 7f7a0cc00640 1 -- 172.21.15.69:0/1047467505 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f7a00013470 con 0x7f7a100d1720 2024-02-21T07:44:18.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.036+0000 7f7a0cc00640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f79ec09f0a0 0x7f79ec0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.037+0000 7f7a0cc00640 1 -- 172.21.15.69:0/1047467505 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7a000c9ce0 con 0x7f7a100d1720 2024-02-21T07:44:18.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.037+0000 7f7a19f9a740 1 Processor -- start 2024-02-21T07:44:18.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.037+0000 7f7a07e00640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f79ec09f0a0 0x7f79ec0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.037+0000 7f7a19f9a740 1 -- start start 2024-02-21T07:44:18.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.038+0000 7f7a07e00640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f79ec09f0a0 0x7f79ec0a1560 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f79f8035000 tx=0x7f79f8030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.038+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa091c0 0x561aefa095a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.038+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa44350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.038+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa44890 0x561aefa45620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.038+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aef989300 con 0x561aefa44890 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.038+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aef93be50 con 0x561aefa09ae0 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.038+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aef939380 con 0x561aefa091c0 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa44350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a15200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa44890 0x561aefa45620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa44350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:46566/0 (socket says 172.21.15.69:46566) 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a07e00640 1 -- 172.21.15.69:0/1108538080 learned_addr learned my addr 172.21.15.69:0/1108538080 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/1108538080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa091c0 0x561aefa095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a07e00640 1 -- 172.21.15.69:0/1108538080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa091c0 msgr2=0x561aefa095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a07e00640 1 --2- 172.21.15.69:0/1108538080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa091c0 0x561aefa095a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a07e00640 1 -- 172.21.15.69:0/1108538080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa44890 msgr2=0x561aefa45620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a07e00640 1 --2- 172.21.15.69:0/1108538080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa44890 0x561aefa45620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a07e00640 1 -- 172.21.15.69:0/1108538080 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561aef8fdc80 con 0x561aefa09ae0 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.039+0000 7f7a07e00640 1 --2- 172.21.15.69:0/1108538080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa44350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009860 tx=0x7f79f802e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd792416427ec18c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.040+0000 7f7a04c00640 1 -- 172.21.15.69:0/1108538080 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f803db90 con 0x561aefa09ae0 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.040+0000 7f7a04c00640 1 -- 172.21.15.69:0/1108538080 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8041070 con 0x561aefa09ae0 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.040+0000 7f7a04c00640 1 -- 172.21.15.69:0/1108538080 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8048410 con 0x561aefa09ae0 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.041+0000 7f7a19f9a740 1 -- 172.21.15.69:0/1108538080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 msgr2=0x561aefa44350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.041+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/1108538080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa44350 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009860 tx=0x7f79f802e000 comp rx=0 tx=0).stop 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.041+0000 7f7a19f9a740 1 -- 172.21.15.69:0/1108538080 shutdown_connections 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.041+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/1108538080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa44890 0x561aefa45620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.041+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/1108538080 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa44350 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.041+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/1108538080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa091c0 0x561aefa095a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.041+0000 7f7a19f9a740 1 -- 172.21.15.69:0/1108538080 >> 172.21.15.69:0/1108538080 conn(0x561aef9cb790 msgr2=0x561aef9cc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.041+0000 7f7a19f9a740 1 -- 172.21.15.69:0/1108538080 shutdown_connections 2024-02-21T07:44:18.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.041+0000 7f7a19f9a740 1 -- 172.21.15.69:0/1108538080 wait complete. 2024-02-21T07:44:18.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.042+0000 7f7a19f9a740 1 -- start start 2024-02-21T07:44:18.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.042+0000 7f7a19f9a740 1 Processor -- start 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa09ae0 0x561aefa00910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 0x561aef9fc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa38420 0x561aef9fc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aef934b60 con 0x561aefa09ae0 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aef8d9fd0 con 0x561aefa38420 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aef8d9c70 con 0x561aefa44890 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a19f9a740 10 client.0 _ll_register_callbacks cb 0x561aef645c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a0fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa09ae0 0x561aefa00910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a0fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa09ae0 0x561aefa00910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57870/0 (socket says 172.21.15.69:57870) 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 0x561aef9fc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a0fe00640 1 -- 172.21.15.69:0/3275747958 learned_addr learned my addr 172.21.15.69:0/3275747958 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a15200640 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa38420 0x561aef9fc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a0fe00640 1 -- 172.21.15.69:0/3275747958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 msgr2=0x561aef9fc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 0x561aef9fc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a0fe00640 1 -- 172.21.15.69:0/3275747958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa38420 msgr2=0x561aef9fc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa38420 0x561aef9fc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.044+0000 7f7a0fe00640 1 -- 172.21.15.69:0/3275747958 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a101884f0 con 0x561aefa09ae0 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.045+0000 7f7a07e00640 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 0x561aef9fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.045+0000 7f7a15200640 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa38420 0x561aef9fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.045+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa09ae0 0x561aefa00910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7a000094a0 tx=0x7f7a00095d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0e7ca731fc8af5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.045+0000 7f79fd600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.045+0000 7f79fd600640 1 -- 172.21.15.69:0/3275747958 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0009ff60 con 0x561aefa09ae0 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.045+0000 7f79fd600640 1 -- 172.21.15.69:0/3275747958 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7a000af170 con 0x561aefa09ae0 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.045+0000 7f7a19f9a740 1 -- 172.21.15.69:0/3275747958 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561aef634860 con 0x561aefa09ae0 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.045+0000 7f79fd600640 1 -- 172.21.15.69:0/3275747958 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a000af330 con 0x561aefa09ae0 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.045+0000 7f7a19f9a740 10 client.5556 fetch_fsmap learned FSMap version 20 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.045+0000 7f7a19f9a740 1 -- 172.21.15.69:0/3275747958 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x561aef9331e0 con 0x561aefa09ae0 2024-02-21T07:44:18.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.046+0000 7f79fd600640 1 -- 172.21.15.69:0/3275747958 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561aef634860 con 0x561aefa09ae0 2024-02-21T07:44:18.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.046+0000 7f79fd600640 1 -- 172.21.15.69:0/3275747958 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 20) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f7a00011070 con 0x561aefa09ae0 2024-02-21T07:44:18.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.046+0000 7f7a19f9a740 10 client.5556 fetch_fsmap finished waiting for FSMap version 20 2024-02-21T07:44:18.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.046+0000 7f7a19f9a740 10 client.5556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:18.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.046+0000 7f7a19f9a740 20 client.5556 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:18.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.046+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561aefa37580 0x561aefa37990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.046+0000 7f7a19f9a740 4 client.5556 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:18.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.046+0000 7f7a19f9a740 1 -- 172.21.15.69:0/3275747958 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561aef685410 con 0x561aefa37580 2024-02-21T07:44:18.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.046+0000 7f7a07e00640 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561aefa37580 0x561aefa37990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.047+0000 7f7a07e00640 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561aefa37580 0x561aefa37990 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d77e6b1b7b5d75fb server_cookie=5eaffd5d6d877d40 in_seq=0 out_seq=0 2024-02-21T07:44:18.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.047+0000 7f79fd600640 10 client.5556 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:18.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f79fd600640 1 -- 172.21.15.69:0/3275747958 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561aef685410 con 0x561aefa37580 2024-02-21T07:44:18.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f79fd600640 10 client.5556 handle_command_reply: tid=0 2024-02-21T07:44:18.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f7a19f9a740 1 client.5556 shutdown 2024-02-21T07:44:18.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f7a19f9a740 1 -- 172.21.15.69:0/3275747958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa09ae0 msgr2=0x561aefa00910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa09ae0 0x561aefa00910 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7a000094a0 tx=0x7f7a00095d80 comp rx=0 tx=0).stop 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f7a19f9a740 1 -- 172.21.15.69:0/3275747958 shutdown_connections 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561aefa37580 0x561aefa37990 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa38420 0x561aef9fc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 0x561aef9fc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/3275747958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa09ae0 0x561aefa00910 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f79fd600640 0 client.5556 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.048+0000 7f7a19f9a740 1 -- 172.21.15.69:0/3275747958 >> 172.21.15.69:0/3275747958 conn(0x561aefa091c0 msgr2=0x561aefa425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.049+0000 7f7a19f9a740 1 -- 172.21.15.69:0/3275747958 shutdown_connections 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.049+0000 7f7a19f9a740 1 -- 172.21.15.69:0/3275747958 wait complete. 2024-02-21T07:44:18.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.049+0000 7f7a19f9a740 20 client.5556 trim_cache size 0 max 16384 2024-02-21T07:44:18.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.069+0000 7f7a19f9a740 1 Processor -- start 2024-02-21T07:44:18.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.069+0000 7f7a19f9a740 1 -- start start 2024-02-21T07:44:18.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.070+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa006c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.070+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa0ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.070+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 0x561aefa44c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.070+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aef67d0c0 con 0x561aefa38420 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.070+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aef9c7110 con 0x561aefa09ae0 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.070+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aef9cd2a0 con 0x561aefa44890 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.070+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa0ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.070+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa0ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57886/0 (socket says 172.21.15.69:57886) 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.070+0000 7f7a07e00640 1 -- 172.21.15.69:0/2029532929 learned_addr learned my addr 172.21.15.69:0/2029532929 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.070+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.071+0000 7f7a15200640 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 0x561aefa44c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.071+0000 7f7a07e00640 1 -- 172.21.15.69:0/2029532929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 msgr2=0x561aefa44c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.071+0000 7f7a07e00640 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 0x561aefa44c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.071+0000 7f7a07e00640 1 -- 172.21.15.69:0/2029532929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 msgr2=0x561aefa006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.071+0000 7f7a07e00640 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.071+0000 7f7a07e00640 1 -- 172.21.15.69:0/2029532929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561aefa423f0 con 0x561aefa38420 2024-02-21T07:44:18.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.071+0000 7f7a15200640 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 0x561aefa44c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:18.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.071+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:18.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.071+0000 7f7a07e00640 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa0ed90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009890 tx=0x7f79f803f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528f77b547bbd640 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.071+0000 7f79ffe00640 1 -- 172.21.15.69:0/2029532929 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f805d2d0 con 0x561aefa38420 2024-02-21T07:44:18.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f79ffe00640 1 -- 172.21.15.69:0/2029532929 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f805d430 con 0x561aefa38420 2024-02-21T07:44:18.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f79ffe00640 1 -- 172.21.15.69:0/2029532929 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f805d7e0 con 0x561aefa38420 2024-02-21T07:44:18.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2029532929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 msgr2=0x561aefa0ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa0ed90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f79f8009890 tx=0x7f79f803f070 comp rx=0 tx=0).stop 2024-02-21T07:44:18.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2029532929 shutdown_connections 2024-02-21T07:44:18.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa44890 0x561aefa44c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa0ed90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/2029532929 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa09ae0 0x561aefa006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2029532929 >> 172.21.15.69:0/2029532929 conn(0x561aefa091c0 msgr2=0x561aef9c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2029532929 shutdown_connections 2024-02-21T07:44:18.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.072+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2029532929 wait complete. 2024-02-21T07:44:18.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.073+0000 7f7a19f9a740 1 -- start start 2024-02-21T07:44:18.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.074+0000 7f7a19f9a740 1 Processor -- start 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa09ae0 0x561aef9ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa08530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a19f9a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa44890 0x561aefa05ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aefa06640 con 0x561aefa38420 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aefa392e0 con 0x561aefa44890 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a19f9a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561aefa06430 con 0x561aefa09ae0 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a19f9a740 10 client.0 _ll_register_callbacks cb 0x7f7a000090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa08530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a0fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa09ae0 0x561aef9ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a15200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa44890 0x561aefa05ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a15200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa44890 0x561aefa05ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:46590/0 (socket says 172.21.15.69:46590) 2024-02-21T07:44:18.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a07e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa08530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57898/0 (socket says 172.21.15.69:57898) 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a15200640 1 -- 172.21.15.69:0/2076335752 learned_addr learned my addr 172.21.15.69:0/2076335752 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.075+0000 7f7a0fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa09ae0 0x561aef9ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40796/0 (socket says 172.21.15.69:40796) 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f7a0fe00640 1 -- 172.21.15.69:0/2076335752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa44890 msgr2=0x561aefa05ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa44890 0x561aefa05ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f7a0fe00640 1 -- 172.21.15.69:0/2076335752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 msgr2=0x561aefa08530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa08530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f7a0fe00640 1 -- 172.21.15.69:0/2076335752 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561aef9331e0 con 0x561aefa09ae0 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f7a15200640 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa44890 0x561aefa05ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f7a0fe00640 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa09ae0 0x561aef9ca870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7a00097520 tx=0x7f7a000c9070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec99057e320ed53f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f79fd600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f79fd600640 1 -- 172.21.15.69:0/2076335752 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0009ff60 con 0x561aefa09ae0 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f79fd600640 1 -- 172.21.15.69:0/2076335752 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7a000c7330 con 0x561aefa09ae0 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.076+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2076335752 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79f8041070 con 0x561aefa09ae0 2024-02-21T07:44:18.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f79fd600640 1 -- 172.21.15.69:0/2076335752 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a000971d0 con 0x561aefa09ae0 2024-02-21T07:44:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f7a19f9a740 10 client.5690 fetch_fsmap learned FSMap version 20 2024-02-21T07:44:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2076335752 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x561aef8fdc80 con 0x561aefa09ae0 2024-02-21T07:44:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f79fd600640 1 -- 172.21.15.69:0/2076335752 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8041070 con 0x561aefa09ae0 2024-02-21T07:44:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f79fd600640 1 -- 172.21.15.69:0/2076335752 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 20) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f7a00011040 con 0x561aefa09ae0 2024-02-21T07:44:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f7a19f9a740 10 client.5690 fetch_fsmap finished waiting for FSMap version 20 2024-02-21T07:44:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f7a19f9a740 10 client.5690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f7a19f9a740 20 client.5690 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561aefa44250 0x561aefa9c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f7a19f9a740 4 client.5690 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:44:18.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2076335752 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561aef6717b0 con 0x561aefa44250 2024-02-21T07:44:18.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.077+0000 7f7a07e00640 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561aefa44250 0x561aefa9c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.078+0000 7f7a07e00640 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561aefa44250 0x561aefa9c9f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e6898605036d4d5 server_cookie=783a4d71967d3ae0 in_seq=0 out_seq=0 2024-02-21T07:44:18.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.078+0000 7f79fd600640 10 client.5690 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.079+0000 7f79fd600640 1 -- 172.21.15.69:0/2076335752 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561aef6717b0 con 0x561aefa44250 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.079+0000 7f79fd600640 10 client.5690 handle_command_reply: tid=0 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.079+0000 7f7a19f9a740 1 client.5690 shutdown 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.079+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2076335752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa09ae0 msgr2=0x561aef9ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.079+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa09ae0 0x561aef9ca870 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7a00097520 tx=0x7f7a000c9070 comp rx=0 tx=0).stop 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.079+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2076335752 shutdown_connections 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.080+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x561aefa44250 0x561aefa9c9f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.080+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561aefa44890 0x561aefa05ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.080+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561aefa38420 0x561aefa08530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.080+0000 7f7a19f9a740 1 --2- 172.21.15.69:0/2076335752 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561aefa09ae0 0x561aef9ca870 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.080+0000 7f79fd600640 0 client.5690 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.080+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2076335752 >> 172.21.15.69:0/2076335752 conn(0x561aefa091c0 msgr2=0x561aefa0ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.080+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2076335752 shutdown_connections 2024-02-21T07:44:18.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.080+0000 7f7a19f9a740 1 -- 172.21.15.69:0/2076335752 wait complete. 2024-02-21T07:44:18.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.080+0000 7f7a19f9a740 20 client.5690 trim_cache size 0 max 16384 2024-02-21T07:44:18.088 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:44:18.088 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-02-21T07:44:18.088 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "7af39093-3674-4a32-91f7-f4a88bd61d50", 2024-02-21T07:44:18.088 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-02-21T07:44:18.088 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:44:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 -- 172.21.15.69:0/1047467505 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f79ec09f0a0 msgr2=0x7f79ec0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f79ec09f0a0 0x7f79ec0a1560 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f79f8035000 tx=0x7f79f8030000 comp rx=0 tx=0).stop 2024-02-21T07:44:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 -- 172.21.15.69:0/1047467505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a100d1720 msgr2=0x7f7a101736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a100d1720 0x7f7a101736f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009fd0 tx=0x7f7a0000ed40 comp rx=0 tx=0).stop 2024-02-21T07:44:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 -- 172.21.15.69:0/1047467505 shutdown_connections 2024-02-21T07:44:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f79ec09f0a0 0x7f79ec0a1560 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a10182ce0 0x7f7a101806c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7a10182900 0x7f7a10184b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 --2- 172.21.15.69:0/1047467505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a100d1720 0x7f7a101736f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 -- 172.21.15.69:0/1047467505 >> 172.21.15.69:0/1047467505 conn(0x7f7a100d6580 msgr2=0x7f7a100d4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 -- 172.21.15.69:0/1047467505 shutdown_connections 2024-02-21T07:44:18.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.081+0000 7f7a17200640 1 -- 172.21.15.69:0/1047467505 wait complete. 2024-02-21T07:44:18.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:44:18.107 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:44:18.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.322+0000 7f7039600640 1 Processor -- start 2024-02-21T07:44:18.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.322+0000 7f7039600640 1 -- start start 2024-02-21T07:44:18.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.324+0000 7f7039600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7034187fe0 0x7f70340fdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.324+0000 7f7039600640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70341898d0 con 0x7f70340cf400 2024-02-21T07:44:18.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.324+0000 7f7039600640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70340fef90 con 0x7f70341861e0 2024-02-21T07:44:18.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.324+0000 7f7039600640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70341874b0 con 0x7f7034187fe0 2024-02-21T07:44:18.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.325+0000 7f7033400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f70340cf400 0x7f70341878d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:42614/0 (socket says 172.21.15.69:42614) 2024-02-21T07:44:18.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.325+0000 7f7033400640 1 -- 172.21.15.69:0/2731881966 learned_addr learned my addr 172.21.15.69:0/2731881966 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:18.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.325+0000 7f7038c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7034187fe0 0x7f70340fdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.325+0000 7f7032a00640 1 -- 172.21.15.69:0/2731881966 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559117649 0 0) 0x7f70341898d0 con 0x7f70340cf400 2024-02-21T07:44:18.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.325+0000 7f7032a00640 1 -- 172.21.15.69:0/2731881966 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7018003520 con 0x7f70340cf400 2024-02-21T07:44:18.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.325+0000 7f7038c00640 1 -- 172.21.15.69:0/2731881966 >> v1:172.21.15.184:6789/0 conn(0x7f70341861e0 legacy=0x7f70340cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.325+0000 7f7032a00640 1 -- 172.21.15.69:0/2731881966 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655061877 0 0) 0x7f70340fef90 con 0x7f70341861e0 2024-02-21T07:44:18.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.325+0000 7f7038c00640 1 -- 172.21.15.69:0/2731881966 >> v1:172.21.15.174:6789/0 conn(0x7f70340cf400 legacy=0x7f70341878d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.325+0000 7f7038c00640 1 -- 172.21.15.69:0/2731881966 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7034186830 con 0x7f7034187fe0 2024-02-21T07:44:18.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.327+0000 7f7038c00640 1 --2- 172.21.15.69:0/2731881966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7034187fe0 0x7f70340fdf20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f702c009d90 tx=0x7f702c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228a76f156e45b64 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.327+0000 7f7032a00640 1 -- 172.21.15.69:0/2731881966 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c02cbd0 con 0x7f7034187fe0 2024-02-21T07:44:18.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.327+0000 7f7032a00640 1 -- 172.21.15.69:0/2731881966 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c02cd30 con 0x7f7034187fe0 2024-02-21T07:44:18.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.327+0000 7f7032a00640 1 -- 172.21.15.69:0/2731881966 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c02cea0 con 0x7f7034187fe0 2024-02-21T07:44:18.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.328+0000 7f7039600640 1 -- 172.21.15.69:0/2731881966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7034187fe0 msgr2=0x7f70340fdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.328+0000 7f7039600640 1 --2- 172.21.15.69:0/2731881966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7034187fe0 0x7f70340fdf20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f702c009d90 tx=0x7f702c02be20 comp rx=0 tx=0).stop 2024-02-21T07:44:18.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.328+0000 7f7039600640 1 -- 172.21.15.69:0/2731881966 shutdown_connections 2024-02-21T07:44:18.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.328+0000 7f7039600640 1 --2- 172.21.15.69:0/2731881966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7034187fe0 0x7f70340fdf20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.328+0000 7f7039600640 1 -- 172.21.15.69:0/2731881966 >> 172.21.15.69:0/2731881966 conn(0x7f70340d2be0 msgr2=0x7f70340d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.329+0000 7f7039600640 1 -- 172.21.15.69:0/2731881966 shutdown_connections 2024-02-21T07:44:18.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.329+0000 7f7039600640 1 -- 172.21.15.69:0/2731881966 wait complete. 2024-02-21T07:44:18.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.331+0000 7f7039600640 1 Processor -- start 2024-02-21T07:44:18.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.331+0000 7f7039600640 1 -- start start 2024-02-21T07:44:18.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.332+0000 7f7039600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70340cf400 0x7f703421fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.332+0000 7f7039600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70341861e0 0x7f7034221620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.332+0000 7f7039600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7034187fe0 0x7f703421c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.332+0000 7f7039600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70342202a0 con 0x7f70340cf400 2024-02-21T07:44:18.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.332+0000 7f7039600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7034220580 con 0x7f7034187fe0 2024-02-21T07:44:18.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.332+0000 7f7039600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7034220860 con 0x7f70341861e0 2024-02-21T07:44:18.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.333+0000 7f7033e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70340cf400 0x7f703421fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.333+0000 7f7033e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70340cf400 0x7f703421fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57914/0 (socket says 172.21.15.69:57914) 2024-02-21T07:44:18.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.333+0000 7f7033e00640 1 -- 172.21.15.69:0/3879584401 learned_addr learned my addr 172.21.15.69:0/3879584401 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.333+0000 7f7038c00640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7034187fe0 0x7f703421c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.333+0000 7f7033400640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70341861e0 0x7f7034221620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.333+0000 7f7033400640 1 -- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7034187fe0 msgr2=0x7f703421c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.333+0000 7f7033400640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7034187fe0 0x7f703421c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.333+0000 7f7033400640 1 -- 172.21.15.69:0/3879584401 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70340cf400 msgr2=0x7f703421fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.333+0000 7f7033400640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70340cf400 0x7f703421fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.333+0000 7f7033400640 1 -- 172.21.15.69:0/3879584401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c009a70 con 0x7f70341861e0 2024-02-21T07:44:18.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.334+0000 7f7038c00640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7034187fe0 0x7f703421c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:18.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.334+0000 7f7033e00640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70340cf400 0x7f703421fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:18.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.334+0000 7f7033400640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70341861e0 0x7f7034221620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f702000c390 tx=0x7f7020001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.334+0000 7f702be00640 1 -- 172.21.15.69:0/3879584401 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020005ce0 con 0x7f70341861e0 2024-02-21T07:44:18.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.334+0000 7f702be00640 1 -- 172.21.15.69:0/3879584401 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020005e40 con 0x7f70341861e0 2024-02-21T07:44:18.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.334+0000 7f702be00640 1 -- 172.21.15.69:0/3879584401 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70200072d0 con 0x7f70341861e0 2024-02-21T07:44:18.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.334+0000 7f7039600640 1 -- 172.21.15.69:0/3879584401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7034220b40 con 0x7f70341861e0 2024-02-21T07:44:18.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.334+0000 7f7039600640 1 -- 172.21.15.69:0/3879584401 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7034221100 con 0x7f70341861e0 2024-02-21T07:44:18.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.339+0000 7f702be00640 1 -- 172.21.15.69:0/3879584401 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f70200074f0 con 0x7f70341861e0 2024-02-21T07:44:18.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.340+0000 7f703d87a740 1 Processor -- start 2024-02-21T07:44:18.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.340+0000 7f703d87a740 1 -- start start 2024-02-21T07:44:18.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.341+0000 7f702be00640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f701409f0a0 0x7f70140a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.341+0000 7f702be00640 1 -- 172.21.15.69:0/3879584401 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f70200c8f10 con 0x7f70341861e0 2024-02-21T07:44:18.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.341+0000 7f703d87a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 0x5606b0d21420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.341+0000 7f703d87a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0cebd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.342+0000 7f703d87a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 0x5606b0cae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.342+0000 7f703d87a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0c1a150 con 0x5606b0ceb9a0 2024-02-21T07:44:18.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.342+0000 7f7038c00640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f701409f0a0 0x7f70140a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.342+0000 7f703d87a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0c17680 con 0x5606b0d21960 2024-02-21T07:44:18.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.342+0000 7f703d87a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0c12e60 con 0x5606b0cec2c0 2024-02-21T07:44:18.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.342+0000 7f7033e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 0x5606b0d21420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.342+0000 7f7033400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0cebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.342+0000 7f7033e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 0x5606b0d21420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57918/0 (socket says 172.21.15.69:57918) 2024-02-21T07:44:18.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.342+0000 7f7033e00640 1 -- 172.21.15.69:0/2457757083 learned_addr learned my addr 172.21.15.69:0/2457757083 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.342+0000 7f7038c00640 1 --2- 172.21.15.69:0/2457757083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 0x5606b0cae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.343+0000 7f7033e00640 1 -- 172.21.15.69:0/2457757083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 msgr2=0x5606b0cae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.343+0000 7f7033e00640 1 --2- 172.21.15.69:0/2457757083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 0x5606b0cae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.343+0000 7f7033e00640 1 -- 172.21.15.69:0/2457757083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 msgr2=0x5606b0cebd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.343+0000 7f7033e00640 1 --2- 172.21.15.69:0/2457757083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0cebd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.343+0000 7f7038c00640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f701409f0a0 0x7f70140a1560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f702c036000 tx=0x7f702c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.343+0000 7f7033e00640 1 -- 172.21.15.69:0/2457757083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606b0bcc060 con 0x5606b0ceb9a0 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.343+0000 7f7033400640 1 --2- 172.21.15.69:0/2457757083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0cebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.343+0000 7f7033e00640 1 --2- 172.21.15.69:0/2457757083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 0x5606b0d21420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7024001c40 tx=0x7f702400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1dc07dda1b8382 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.344+0000 7f701fe00640 1 -- 172.21.15.69:0/2457757083 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70240017c0 con 0x5606b0ceb9a0 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.344+0000 7f701fe00640 1 -- 172.21.15.69:0/2457757083 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702400fec0 con 0x5606b0ceb9a0 2024-02-21T07:44:18.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.344+0000 7f701fe00640 1 -- 172.21.15.69:0/2457757083 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70240052d0 con 0x5606b0ceb9a0 2024-02-21T07:44:18.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.345+0000 7f703d87a740 1 -- 172.21.15.69:0/2457757083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 msgr2=0x5606b0d21420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.345+0000 7f703d87a740 1 --2- 172.21.15.69:0/2457757083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 0x5606b0d21420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7024001c40 tx=0x7f702400f5a0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.345+0000 7f703d87a740 1 -- 172.21.15.69:0/2457757083 shutdown_connections 2024-02-21T07:44:18.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.345+0000 7f703d87a740 1 --2- 172.21.15.69:0/2457757083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 0x5606b0cae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.345+0000 7f703d87a740 1 --2- 172.21.15.69:0/2457757083 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0cebd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.345+0000 7f703d87a740 1 --2- 172.21.15.69:0/2457757083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 0x5606b0d21420 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.345+0000 7f703d87a740 1 -- 172.21.15.69:0/2457757083 >> 172.21.15.69:0/2457757083 conn(0x5606b0c725a0 msgr2=0x5606b0cb2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.345+0000 7f703d87a740 1 -- 172.21.15.69:0/2457757083 shutdown_connections 2024-02-21T07:44:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.345+0000 7f703d87a740 1 -- 172.21.15.69:0/2457757083 wait complete. 2024-02-21T07:44:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.346+0000 7f703d87a740 1 -- start start 2024-02-21T07:44:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.346+0000 7f703d87a740 1 Processor -- start 2024-02-21T07:44:18.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f703d87a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 0x5606b0ce1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f703d87a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 0x5606b0d1fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f703d87a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0ce46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f703d87a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0bb7ec0 con 0x5606b0ceb9a0 2024-02-21T07:44:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f703d87a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0bb7b60 con 0x5606b0d21960 2024-02-21T07:44:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f703d87a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b09811c0 con 0x5606b0cec2c0 2024-02-21T07:44:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f703d87a740 10 client.0 _ll_register_callbacks cb 0x5606b0bcb960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:18.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f7033400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 0x5606b0d1fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f7033400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 0x5606b0d1fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40830/0 (socket says 172.21.15.69:40830) 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f7033400640 1 -- 172.21.15.69:0/618695989 learned_addr learned my addr 172.21.15.69:0/618695989 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f7038c00640 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0ce46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f7033e00640 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 0x5606b0ce1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f7033400640 1 -- 172.21.15.69:0/618695989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 msgr2=0x5606b0ce46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f7033400640 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0ce46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f7033400640 1 -- 172.21.15.69:0/618695989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 msgr2=0x5606b0ce1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f7033400640 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 0x5606b0ce1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.348+0000 7f7033400640 1 -- 172.21.15.69:0/618695989 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7024001920 con 0x5606b0cec2c0 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.349+0000 7f7033400640 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 0x5606b0d1fbb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7020000f60 tx=0x7f7020096460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdb6a60e4dc94213 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.349+0000 7f701cc00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:18.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.349+0000 7f701cc00640 1 -- 172.21.15.69:0/618695989 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702009aba0 con 0x5606b0cec2c0 2024-02-21T07:44:18.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.349+0000 7f701cc00640 1 -- 172.21.15.69:0/618695989 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f702009f1f0 con 0x5606b0cec2c0 2024-02-21T07:44:18.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.349+0000 7f703d87a740 1 -- 172.21.15.69:0/618695989 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606b094f720 con 0x5606b0cec2c0 2024-02-21T07:44:18.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.349+0000 7f701cc00640 1 -- 172.21.15.69:0/618695989 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70200927c0 con 0x5606b0cec2c0 2024-02-21T07:44:18.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.349+0000 7f703d87a740 10 client.5702 fetch_fsmap learned FSMap version 20 2024-02-21T07:44:18.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.349+0000 7f703d87a740 1 -- 172.21.15.69:0/618695989 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x5606b0c114e0 con 0x5606b0cec2c0 2024-02-21T07:44:18.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.350+0000 7f701cc00640 1 -- 172.21.15.69:0/618695989 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5606b094f720 con 0x5606b0cec2c0 2024-02-21T07:44:18.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.350+0000 7f701cc00640 1 -- 172.21.15.69:0/618695989 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 20) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f70200b5040 con 0x5606b0cec2c0 2024-02-21T07:44:18.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.350+0000 7f703d87a740 10 client.5702 fetch_fsmap finished waiting for FSMap version 20 2024-02-21T07:44:18.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.350+0000 7f703d87a740 10 client.5702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:18.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.350+0000 7f703d87a740 20 client.5702 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:18.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.350+0000 7f703d87a740 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5606b0ce3880 0x5606b0d36bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.350+0000 7f703d87a740 4 client.5702 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:18.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.350+0000 7f703d87a740 1 -- 172.21.15.69:0/618695989 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606b099e890 con 0x5606b0ce3880 2024-02-21T07:44:18.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.350+0000 7f7033e00640 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5606b0ce3880 0x5606b0d36bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.351+0000 7f7033e00640 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5606b0ce3880 0x5606b0d36bf0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3a8abc63eac06f3 server_cookie=c913a5edad99dde5 in_seq=0 out_seq=0 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.351+0000 7f701cc00640 10 client.5702 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.352+0000 7f701cc00640 1 -- 172.21.15.69:0/618695989 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5606b099e890 con 0x5606b0ce3880 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.352+0000 7f701cc00640 10 client.5702 handle_command_reply: tid=0 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.352+0000 7f703d87a740 1 client.5702 shutdown 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.352+0000 7f703d87a740 1 -- 172.21.15.69:0/618695989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 msgr2=0x5606b0d1fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f703d87a740 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 0x5606b0d1fbb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7020000f60 tx=0x7f7020096460 comp rx=0 tx=0).stop 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f703d87a740 1 -- 172.21.15.69:0/618695989 shutdown_connections 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f703d87a740 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5606b0ce3880 0x5606b0d36bf0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f703d87a740 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0ce46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f703d87a740 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0cec2c0 0x5606b0d1fbb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f703d87a740 1 --2- 172.21.15.69:0/618695989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0ceb9a0 0x5606b0ce1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f703d87a740 1 -- 172.21.15.69:0/618695989 >> 172.21.15.69:0/618695989 conn(0x5606b0c725a0 msgr2=0x5606b0cb9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f701cc00640 0 client.5702 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:18.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f703d87a740 1 -- 172.21.15.69:0/618695989 shutdown_connections 2024-02-21T07:44:18.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f703d87a740 1 -- 172.21.15.69:0/618695989 wait complete. 2024-02-21T07:44:18.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.353+0000 7f703d87a740 20 client.5702 trim_cache size 0 max 16384 2024-02-21T07:44:18.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.370+0000 7f703d87a740 1 Processor -- start 2024-02-21T07:44:18.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.370+0000 7f703d87a740 1 -- start start 2024-02-21T07:44:18.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f703d87a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0d19300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f703d87a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 0x5606b0d82500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f703d87a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0ca4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f703d87a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0d21370 con 0x5606b0cec2c0 2024-02-21T07:44:18.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f703d87a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0ca0cc0 con 0x5606b0d21960 2024-02-21T07:44:18.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f703d87a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0cb1c90 con 0x5606b0ceb9a0 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7033400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 0x5606b0d82500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7033e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0d19300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7033400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 0x5606b0d82500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57936/0 (socket says 172.21.15.69:57936) 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7033400640 1 -- 172.21.15.69:0/1187701299 learned_addr learned my addr 172.21.15.69:0/1187701299 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7038c00640 1 --2- 172.21.15.69:0/1187701299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0ca4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7033e00640 1 -- 172.21.15.69:0/1187701299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 msgr2=0x5606b0ca4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7033e00640 1 --2- 172.21.15.69:0/1187701299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0ca4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7033e00640 1 -- 172.21.15.69:0/1187701299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 msgr2=0x5606b0d82500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7033e00640 1 --2- 172.21.15.69:0/1187701299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 0x5606b0d82500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7033e00640 1 -- 172.21.15.69:0/1187701299 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606b0bad950 con 0x5606b0ceb9a0 2024-02-21T07:44:18.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7038c00640 1 --2- 172.21.15.69:0/1187701299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0ca4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:18.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.372+0000 7f7033400640 1 --2- 172.21.15.69:0/1187701299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 0x5606b0d82500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:18.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.373+0000 7f7033e00640 1 --2- 172.21.15.69:0/1187701299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0d19300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7024017000 tx=0x7f7024005000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a33e1507f4dac13 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.373+0000 7f701f400640 1 -- 172.21.15.69:0/1187701299 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70240051f0 con 0x5606b0ceb9a0 2024-02-21T07:44:18.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.373+0000 7f701f400640 1 -- 172.21.15.69:0/1187701299 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7024005450 con 0x5606b0ceb9a0 2024-02-21T07:44:18.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.373+0000 7f701f400640 1 -- 172.21.15.69:0/1187701299 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024026d20 con 0x5606b0ceb9a0 2024-02-21T07:44:18.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.374+0000 7f703d87a740 1 -- 172.21.15.69:0/1187701299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 msgr2=0x5606b0d19300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.374+0000 7f703d87a740 1 --2- 172.21.15.69:0/1187701299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0d19300 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7024017000 tx=0x7f7024005000 comp rx=0 tx=0).stop 2024-02-21T07:44:18.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.374+0000 7f703d87a740 1 -- 172.21.15.69:0/1187701299 shutdown_connections 2024-02-21T07:44:18.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.374+0000 7f703d87a740 1 --2- 172.21.15.69:0/1187701299 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0ca4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.374+0000 7f703d87a740 1 --2- 172.21.15.69:0/1187701299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 0x5606b0d82500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.374+0000 7f703d87a740 1 --2- 172.21.15.69:0/1187701299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0d19300 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.374+0000 7f703d87a740 1 -- 172.21.15.69:0/1187701299 >> 172.21.15.69:0/1187701299 conn(0x5606b0c725a0 msgr2=0x5606b0ce7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.374+0000 7f703d87a740 1 -- 172.21.15.69:0/1187701299 shutdown_connections 2024-02-21T07:44:18.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.374+0000 7f703d87a740 1 -- 172.21.15.69:0/1187701299 wait complete. 2024-02-21T07:44:18.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.375+0000 7f703d87a740 1 -- start start 2024-02-21T07:44:18.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.375+0000 7f703d87a740 1 Processor -- start 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f703d87a740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0ce3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f703d87a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 0x5606b0cd6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f703d87a740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0d7d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f703d87a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0d30eb0 con 0x5606b0cec2c0 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f703d87a740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0ce4340 con 0x5606b0d21960 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f703d87a740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606b0ca49e0 con 0x5606b0ceb9a0 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f703d87a740 10 client.0 _ll_register_callbacks cb 0x7f7020001040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f7033e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0ce3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f7033e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0ce3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:40848/0 (socket says 172.21.15.69:40848) 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f7033e00640 1 -- 172.21.15.69:0/2461663245 learned_addr learned my addr 172.21.15.69:0/2461663245 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f7033400640 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 0x5606b0cd6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.377+0000 7f7038c00640 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0d7d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f7033e00640 1 -- 172.21.15.69:0/2461663245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 msgr2=0x5606b0d7d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f7033e00640 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0d7d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f7033e00640 1 -- 172.21.15.69:0/2461663245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 msgr2=0x5606b0cd6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f7033e00640 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 0x5606b0cd6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f7033e00640 1 -- 172.21.15.69:0/2461663245 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606b0c114e0 con 0x5606b0ceb9a0 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f7038c00640 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0d7d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f7033e00640 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0ce3e00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7024014000 tx=0x7f7024007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=185bac5773b0f26e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f701cc00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f701cc00640 1 -- 172.21.15.69:0/2461663245 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024026d10 con 0x5606b0ceb9a0 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f701cc00640 1 -- 172.21.15.69:0/2461663245 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7024026320 con 0x5606b0ceb9a0 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.378+0000 7f703d87a740 1 -- 172.21.15.69:0/2461663245 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5606b0d31bb0 con 0x5606b0ceb9a0 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.379+0000 7f701cc00640 1 -- 172.21.15.69:0/2461663245 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7024026e70 con 0x5606b0ceb9a0 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.379+0000 7f703d87a740 10 client.5708 fetch_fsmap learned FSMap version 20 2024-02-21T07:44:18.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.379+0000 7f703d87a740 1 -- 172.21.15.69:0/2461663245 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) v3 -- 0x5606b0bcc060 con 0x5606b0ceb9a0 2024-02-21T07:44:18.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.380+0000 7f701cc00640 1 -- 172.21.15.69:0/2461663245 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7024037030 con 0x5606b0ceb9a0 2024-02-21T07:44:18.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.380+0000 7f701cc00640 1 -- 172.21.15.69:0/2461663245 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 20) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f702402e070 con 0x5606b0ceb9a0 2024-02-21T07:44:18.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.380+0000 7f703d87a740 10 client.5708 fetch_fsmap finished waiting for FSMap version 20 2024-02-21T07:44:18.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.380+0000 7f703d87a740 10 client.5708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:18.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.380+0000 7f703d87a740 20 client.5708 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:18.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.380+0000 7f703d87a740 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5606b0cb1810 0x5606b0d2fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:18.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.380+0000 7f703d87a740 4 client.5708 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:44:18.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.380+0000 7f703d87a740 1 -- 172.21.15.69:0/2461663245 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5606b0d1da60 con 0x5606b0cb1810 2024-02-21T07:44:18.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.381+0000 7f7033400640 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5606b0cb1810 0x5606b0d2fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:18.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.381+0000 7f7033400640 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5606b0cb1810 0x5606b0d2fff0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b89fe13a2e7ad4fb server_cookie=25a89a5029cc51 in_seq=0 out_seq=0 2024-02-21T07:44:18.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.381+0000 7f701cc00640 10 client.5708 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:18.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.383+0000 7f701cc00640 1 -- 172.21.15.69:0/2461663245 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5606b0d1da60 con 0x5606b0cb1810 2024-02-21T07:44:18.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.383+0000 7f701cc00640 10 client.5708 handle_command_reply: tid=0 2024-02-21T07:44:18.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.383+0000 7f703d87a740 1 client.5708 shutdown 2024-02-21T07:44:18.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.383+0000 7f703d87a740 1 -- 172.21.15.69:0/2461663245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 msgr2=0x5606b0ce3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.383+0000 7f703d87a740 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0ce3e00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7024014000 tx=0x7f7024007ec0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.384+0000 7f703d87a740 1 -- 172.21.15.69:0/2461663245 shutdown_connections 2024-02-21T07:44:18.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.384+0000 7f703d87a740 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5606b0cb1810 0x5606b0d2fff0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.384+0000 7f703d87a740 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5606b0d21960 0x5606b0d7d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.384+0000 7f703d87a740 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5606b0cec2c0 0x5606b0cd6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.384+0000 7f703d87a740 1 --2- 172.21.15.69:0/2461663245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5606b0ceb9a0 0x5606b0ce3e00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.384+0000 7f703d87a740 1 -- 172.21.15.69:0/2461663245 >> 172.21.15.69:0/2461663245 conn(0x5606b0c725a0 msgr2=0x5606b0cb9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.384+0000 7f701cc00640 0 client.5708 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:18.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.384+0000 7f703d87a740 1 -- 172.21.15.69:0/2461663245 shutdown_connections 2024-02-21T07:44:18.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.384+0000 7f703d87a740 1 -- 172.21.15.69:0/2461663245 wait complete. 2024-02-21T07:44:18.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.384+0000 7f703d87a740 20 client.5708 trim_cache size 0 max 16384 2024-02-21T07:44:18.391 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:44:18.391 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "scrub active (318 inodes in the stack)", 2024-02-21T07:44:18.391 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2024-02-21T07:44:18.391 INFO:teuthology.orchestra.run.smithi069.stdout: "7af39093-3674-4a32-91f7-f4a88bd61d50": { 2024-02-21T07:44:18.391 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2024-02-21T07:44:18.391 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "7af39093-3674-4a32-91f7-f4a88bd61d50", 2024-02-21T07:44:18.391 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2024-02-21T07:44:18.391 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:44:18.392 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:44:18.392 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.385+0000 7f7039600640 1 -- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f701409f0a0 msgr2=0x7f70140a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.385+0000 7f7039600640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f701409f0a0 0x7f70140a1560 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f702c036000 tx=0x7f702c02e000 comp rx=0 tx=0).stop 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.385+0000 7f7039600640 1 -- 172.21.15.69:0/3879584401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70341861e0 msgr2=0x7f7034221620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.385+0000 7f7039600640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70341861e0 0x7f7034221620 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f702000c390 tx=0x7f7020001e70 comp rx=0 tx=0).stop 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.385+0000 7f7039600640 1 -- 172.21.15.69:0/3879584401 shutdown_connections 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.385+0000 7f7039600640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f701409f0a0 0x7f70140a1560 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.385+0000 7f7039600640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f7034187fe0 0x7f703421c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.385+0000 7f7039600640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f70341861e0 0x7f7034221620 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.385+0000 7f7039600640 1 --2- 172.21.15.69:0/3879584401 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70340cf400 0x7f703421fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.385+0000 7f7039600640 1 -- 172.21.15.69:0/3879584401 >> 172.21.15.69:0/3879584401 conn(0x7f70340d2be0 msgr2=0x7f70340d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.386+0000 7f7039600640 1 -- 172.21.15.69:0/3879584401 shutdown_connections 2024-02-21T07:44:18.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:18.386+0000 7f7039600640 1 -- 172.21.15.69:0/3879584401 wait complete. 2024-02-21T07:44:18.411 INFO:tasks.cephfs.filesystem:scrub status for tag:7af39093-3674-4a32-91f7-f4a88bd61d50 - {'path': '/', 'tag': '7af39093-3674-4a32-91f7-f4a88bd61d50', 'options': 'recursive,force'} 2024-02-21T07:44:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.288+0000 7efdf9200640 1 Processor -- start 2024-02-21T07:44:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.288+0000 7efdf9200640 1 -- start start 2024-02-21T07:44:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.290+0000 7efdf9200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efdf4189d80 0x7efdf4186800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.290+0000 7efdf9200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf4186550 con 0x7efdf4186170 2024-02-21T07:44:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.290+0000 7efdf9200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf4189830 con 0x7efdf40f9e70 2024-02-21T07:44:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.290+0000 7efdf9200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf418bc90 con 0x7efdf4189d80 2024-02-21T07:44:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.291+0000 7efdf1400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7efdf4189d80 0x7efdf4186800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.291+0000 7efdf2800640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7efdf40f9e70 0x7efdf40fa2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:42814/0 (socket says 172.21.15.69:42814) 2024-02-21T07:44:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.291+0000 7efdf2800640 1 -- 172.21.15.69:0/2301072533 learned_addr learned my addr 172.21.15.69:0/2301072533 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.291+0000 7efdf1400640 1 -- 172.21.15.69:0/2301072533 >> v1:172.21.15.184:6789/0 conn(0x7efdf40f9e70 legacy=0x7efdf40fa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.291+0000 7efdf1400640 1 -- 172.21.15.69:0/2301072533 >> v1:172.21.15.174:6789/0 conn(0x7efdf4186170 legacy=0x7efdf418b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.291+0000 7efdf0a00640 1 -- 172.21.15.69:0/2301072533 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449686714 0 0) 0x7efdf4189830 con 0x7efdf40f9e70 2024-02-21T07:44:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.291+0000 7efdf1400640 1 -- 172.21.15.69:0/2301072533 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf418a200 con 0x7efdf4189d80 2024-02-21T07:44:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.293+0000 7efdf1400640 1 --2- 172.21.15.69:0/2301072533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf4189d80 0x7efdf4186800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efde00097a0 tx=0x7efde002b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b856658efef4529c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.294+0000 7efdf0a00640 1 -- 172.21.15.69:0/2301072533 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0030710 con 0x7efdf4189d80 2024-02-21T07:44:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.294+0000 7efdf0a00640 1 -- 172.21.15.69:0/2301072533 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde002e050 con 0x7efdf4189d80 2024-02-21T07:44:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.294+0000 7efdf0a00640 1 -- 172.21.15.69:0/2301072533 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0030a90 con 0x7efdf4189d80 2024-02-21T07:44:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.294+0000 7efdf9200640 1 -- 172.21.15.69:0/2301072533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf4189d80 msgr2=0x7efdf4186800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.294+0000 7efdf9200640 1 --2- 172.21.15.69:0/2301072533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf4189d80 0x7efdf4186800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efde00097a0 tx=0x7efde002b680 comp rx=0 tx=0).stop 2024-02-21T07:44:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.295+0000 7efdf9200640 1 -- 172.21.15.69:0/2301072533 shutdown_connections 2024-02-21T07:44:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.295+0000 7efdf9200640 1 --2- 172.21.15.69:0/2301072533 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf4189d80 0x7efdf4186800 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.295+0000 7efdf9200640 1 -- 172.21.15.69:0/2301072533 >> 172.21.15.69:0/2301072533 conn(0x7efdf406ab70 msgr2=0x7efdf406af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.295+0000 7efdf9200640 1 -- 172.21.15.69:0/2301072533 shutdown_connections 2024-02-21T07:44:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.295+0000 7efdf9200640 1 -- 172.21.15.69:0/2301072533 wait complete. 2024-02-21T07:44:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.297+0000 7efdf9200640 1 Processor -- start 2024-02-21T07:44:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.297+0000 7efdf9200640 1 -- start start 2024-02-21T07:44:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf9200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdf40f9e70 0x7efdf4178350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf9200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4186170 0x7efdf417bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf9200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf4189d80 0x7efdf421cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf9200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf421d620 con 0x7efdf40f9e70 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf9200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf421d900 con 0x7efdf4189d80 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf9200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf421dbe0 con 0x7efdf4186170 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf1e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdf40f9e70 0x7efdf4178350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf1e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdf40f9e70 0x7efdf4178350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38866/0 (socket says 172.21.15.69:38866) 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf1e00640 1 -- 172.21.15.69:0/2963415087 learned_addr learned my addr 172.21.15.69:0/2963415087 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf1400640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4186170 0x7efdf417bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.298+0000 7efdf2800640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf4189d80 0x7efdf421cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.299+0000 7efdf1e00640 1 -- 172.21.15.69:0/2963415087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4186170 msgr2=0x7efdf417bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.299+0000 7efdf1e00640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4186170 0x7efdf417bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.299+0000 7efdf1e00640 1 -- 172.21.15.69:0/2963415087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf4189d80 msgr2=0x7efdf421cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.299+0000 7efdf1e00640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf4189d80 0x7efdf421cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.299+0000 7efdf1e00640 1 -- 172.21.15.69:0/2963415087 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0009400 con 0x7efdf40f9e70 2024-02-21T07:44:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.299+0000 7efdf1e00640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdf40f9e70 0x7efdf4178350 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efde400c4e0 tx=0x7efde400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.300+0000 7efdea000640 1 -- 172.21.15.69:0/2963415087 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde4005480 con 0x7efdf40f9e70 2024-02-21T07:44:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.300+0000 7efdea000640 1 -- 172.21.15.69:0/2963415087 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde40035f0 con 0x7efdf40f9e70 2024-02-21T07:44:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.300+0000 7efdea000640 1 -- 172.21.15.69:0/2963415087 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde40039a0 con 0x7efdf40f9e70 2024-02-21T07:44:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.300+0000 7efdf9200640 1 -- 172.21.15.69:0/2963415087 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf421dec0 con 0x7efdf40f9e70 2024-02-21T07:44:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.300+0000 7efdf9200640 1 -- 172.21.15.69:0/2963415087 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf421e480 con 0x7efdf40f9e70 2024-02-21T07:44:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.303+0000 7efdea000640 1 -- 172.21.15.69:0/2963415087 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7efde4003b00 con 0x7efdf40f9e70 2024-02-21T07:44:26.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.304+0000 7efdfbf80740 1 Processor -- start 2024-02-21T07:44:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.304+0000 7efdfbf80740 1 -- start start 2024-02-21T07:44:26.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.305+0000 7efdea000640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdd409f0a0 0x7efdd40a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.305+0000 7efdea000640 1 -- 172.21.15.69:0/2963415087 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efde40c90b0 con 0x7efdf40f9e70 2024-02-21T07:44:26.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.305+0000 7efdf2800640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdd409f0a0 0x7efdd40a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.305+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbefa9a070 0x55cbefa59440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.305+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbeface4d0 0x55cbefa5ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefa9a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdfbf80740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbefa1a620 con 0x55cbefa9a070 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdfbf80740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbef9cc8c0 con 0x55cbefa5ef90 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdfbf80740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbef9c9df0 con 0x55cbeface4d0 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf1400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbeface4d0 0x55cbefa5ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf1e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbefa9a070 0x55cbefa59440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf1400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbeface4d0 0x55cbefa5ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:54170/0 (socket says 172.21.15.69:54170) 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf2800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefa9a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf1400640 1 -- 172.21.15.69:0/3571710037 learned_addr learned my addr 172.21.15.69:0/3571710037 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf1400640 1 -- 172.21.15.69:0/3571710037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 msgr2=0x55cbefa9a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf1400640 1 --2- 172.21.15.69:0/3571710037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefa9a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf1400640 1 -- 172.21.15.69:0/3571710037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbefa9a070 msgr2=0x55cbefa59440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf1400640 1 --2- 172.21.15.69:0/3571710037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbefa9a070 0x55cbefa59440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf2800640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdd409f0a0 0x7efdd40a1560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efdec0012e0 tx=0x7efdec004d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.306+0000 7efdf1400640 1 -- 172.21.15.69:0/3571710037 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbef946b00 con 0x55cbeface4d0 2024-02-21T07:44:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.307+0000 7efdf1400640 1 --2- 172.21.15.69:0/3571710037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbeface4d0 0x55cbefa5ea50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efde00098c0 tx=0x7efde002f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3ef34c0cb26767d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.307+0000 7efddea00640 1 -- 172.21.15.69:0/3571710037 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0030a50 con 0x55cbeface4d0 2024-02-21T07:44:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.307+0000 7efddea00640 1 -- 172.21.15.69:0/3571710037 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde0030bd0 con 0x55cbeface4d0 2024-02-21T07:44:26.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.307+0000 7efddea00640 1 -- 172.21.15.69:0/3571710037 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde003c440 con 0x55cbeface4d0 2024-02-21T07:44:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.308+0000 7efdfbf80740 1 -- 172.21.15.69:0/3571710037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbeface4d0 msgr2=0x55cbefa5ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.308+0000 7efdfbf80740 1 --2- 172.21.15.69:0/3571710037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbeface4d0 0x55cbefa5ea50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efde00098c0 tx=0x7efde002f000 comp rx=0 tx=0).stop 2024-02-21T07:44:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.308+0000 7efdfbf80740 1 -- 172.21.15.69:0/3571710037 shutdown_connections 2024-02-21T07:44:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.308+0000 7efdfbf80740 1 --2- 172.21.15.69:0/3571710037 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefa9a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.308+0000 7efdfbf80740 1 --2- 172.21.15.69:0/3571710037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbeface4d0 0x55cbefa5ea50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.308+0000 7efdfbf80740 1 --2- 172.21.15.69:0/3571710037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbefa9a070 0x55cbefa59440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.308+0000 7efdfbf80740 1 -- 172.21.15.69:0/3571710037 >> 172.21.15.69:0/3571710037 conn(0x55cbefa264b0 msgr2=0x55cbefa5dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.308+0000 7efdfbf80740 1 -- 172.21.15.69:0/3571710037 shutdown_connections 2024-02-21T07:44:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.308+0000 7efdfbf80740 1 -- 172.21.15.69:0/3571710037 wait complete. 2024-02-21T07:44:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.309+0000 7efdfbf80740 1 -- start start 2024-02-21T07:44:26.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.309+0000 7efdfbf80740 1 Processor -- start 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.310+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefac4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 0x55cbefacbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdfbf80740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbef9c55d0 con 0x55cbeface4d0 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdfbf80740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbef96ab50 con 0x55cbefa5ef90 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdfbf80740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbef96a7f0 con 0x55cbefa9a070 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdfbf80740 10 client.0 _ll_register_callbacks cb 0x55cbef97e550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdf2800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdf1e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefac4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdf2800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38880/0 (socket says 172.21.15.69:38880) 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdf2800640 1 -- 172.21.15.69:0/584540254 learned_addr learned my addr 172.21.15.69:0/584540254 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdf1400640 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 0x55cbefacbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdf1e00640 1 -- 172.21.15.69:0/584540254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 msgr2=0x55cbefacbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdf1e00640 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 0x55cbefacbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdf1e00640 1 -- 172.21.15.69:0/584540254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 msgr2=0x55cbefa584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdf1e00640 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.311+0000 7efdf1e00640 1 -- 172.21.15.69:0/584540254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf418a200 con 0x55cbefa5ef90 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.312+0000 7efdf1e00640 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefac4450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efde400cfd0 tx=0x7efde409ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61b0a05b9f1ed966 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.312+0000 7efdd3400640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.312+0000 7efdd3400640 1 -- 172.21.15.69:0/584540254 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde40ae070 con 0x55cbefa5ef90 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.312+0000 7efdd3400640 1 -- 172.21.15.69:0/584540254 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efde4095000 con 0x55cbefa5ef90 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.312+0000 7efdfbf80740 1 -- 172.21.15.69:0/584540254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cbef997cd0 con 0x55cbefa5ef90 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.312+0000 7efdd3400640 1 -- 172.21.15.69:0/584540254 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7efde40aabe0 con 0x55cbefa5ef90 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.312+0000 7efdfbf80740 10 client.5758 fetch_fsmap learned FSMap version 21 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.312+0000 7efdfbf80740 1 -- 172.21.15.69:0/584540254 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55cbef9c3c50 con 0x55cbefa5ef90 2024-02-21T07:44:26.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.312+0000 7efdd3400640 1 -- 172.21.15.69:0/584540254 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde40c4020 con 0x55cbefa5ef90 2024-02-21T07:44:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.313+0000 7efdd3400640 1 -- 172.21.15.69:0/584540254 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 21) v1 ==== 7906+0+0 (secure 0 0 0) 0x7efde4096090 con 0x55cbefa5ef90 2024-02-21T07:44:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.313+0000 7efdfbf80740 10 client.5758 fetch_fsmap finished waiting for FSMap version 21 2024-02-21T07:44:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.313+0000 7efdfbf80740 10 client.5758 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.313+0000 7efdfbf80740 20 client.5758 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.313+0000 7efdfbf80740 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cbefa90470 0x55cbefae1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.313+0000 7efdfbf80740 4 client.5758 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.313+0000 7efdfbf80740 1 -- 172.21.15.69:0/584540254 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cbef9bbce0 con 0x55cbefa90470 2024-02-21T07:44:26.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.313+0000 7efdf1400640 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cbefa90470 0x55cbefae1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.314+0000 7efdf1400640 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cbefa90470 0x55cbefae1950 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a62642359b17641 server_cookie=23c1ad72f1bea438 in_seq=0 out_seq=0 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.314+0000 7efdd3400640 10 client.5758 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.314+0000 7efdd3400640 1 -- 172.21.15.69:0/584540254 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cbef9bbce0 con 0x55cbefa90470 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.314+0000 7efdd3400640 10 client.5758 handle_command_reply: tid=0 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 client.5758 shutdown 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 -- 172.21.15.69:0/584540254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 msgr2=0x55cbefac4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefac4450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efde400cfd0 tx=0x7efde409ace0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 -- 172.21.15.69:0/584540254 shutdown_connections 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cbefa90470 0x55cbefae1950 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 0x55cbefacbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 --2- 172.21.15.69:0/584540254 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefac4450 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 -- 172.21.15.69:0/584540254 >> 172.21.15.69:0/584540254 conn(0x55cbefa264b0 msgr2=0x55cbefa64e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdd3400640 0 client.5758 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 -- 172.21.15.69:0/584540254 shutdown_connections 2024-02-21T07:44:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 1 -- 172.21.15.69:0/584540254 wait complete. 2024-02-21T07:44:26.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.315+0000 7efdfbf80740 20 client.5758 trim_cache size 0 max 16384 2024-02-21T07:44:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.339+0000 7efdfbf80740 1 Processor -- start 2024-02-21T07:44:26.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.339+0000 7efdfbf80740 1 -- start start 2024-02-21T07:44:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.340+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefa94400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.340+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 0x55cbefacdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.340+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa54d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.340+0000 7efdfbf80740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbef70de60 con 0x55cbeface4d0 2024-02-21T07:44:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.340+0000 7efdfbf80740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbefabe070 con 0x55cbefa5ef90 2024-02-21T07:44:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.340+0000 7efdfbf80740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbefa96920 con 0x55cbefa9a070 2024-02-21T07:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf2800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa54d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf1400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 0x55cbefacdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf1e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefa94400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf2800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa54d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38896/0 (socket says 172.21.15.69:38896) 2024-02-21T07:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf2800640 1 -- 172.21.15.69:0/3490856492 learned_addr learned my addr 172.21.15.69:0/3490856492 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf1400640 1 -- 172.21.15.69:0/3490856492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 msgr2=0x55cbefa94400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf1400640 1 --2- 172.21.15.69:0/3490856492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefa94400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf1400640 1 -- 172.21.15.69:0/3490856492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 msgr2=0x55cbefa54d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf1400640 1 --2- 172.21.15.69:0/3490856492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa54d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf1400640 1 -- 172.21.15.69:0/3490856492 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbefa9f820 con 0x55cbefa9a070 2024-02-21T07:44:26.348 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.341+0000 7efdf1400640 1 --2- 172.21.15.69:0/3490856492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 0x55cbefacdba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efde0000c00 tx=0x7efde0009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e15e637e7235f5ba server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.342+0000 7efdde000640 1 -- 172.21.15.69:0/3490856492 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0006a20 con 0x55cbefa9a070 2024-02-21T07:44:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.342+0000 7efdde000640 1 -- 172.21.15.69:0/3490856492 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde00043c0 con 0x55cbefa9a070 2024-02-21T07:44:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.342+0000 7efdde000640 1 -- 172.21.15.69:0/3490856492 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde00563b0 con 0x55cbefa9a070 2024-02-21T07:44:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.343+0000 7efdfbf80740 1 -- 172.21.15.69:0/3490856492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 msgr2=0x55cbefacdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.343+0000 7efdfbf80740 1 --2- 172.21.15.69:0/3490856492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 0x55cbefacdba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efde0000c00 tx=0x7efde0009190 comp rx=0 tx=0).stop 2024-02-21T07:44:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.343+0000 7efdfbf80740 1 -- 172.21.15.69:0/3490856492 shutdown_connections 2024-02-21T07:44:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.343+0000 7efdfbf80740 1 --2- 172.21.15.69:0/3490856492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa54d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.343+0000 7efdfbf80740 1 --2- 172.21.15.69:0/3490856492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa9a070 0x55cbefacdba0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.343+0000 7efdfbf80740 1 --2- 172.21.15.69:0/3490856492 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa5ef90 0x55cbefa94400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.343+0000 7efdfbf80740 1 -- 172.21.15.69:0/3490856492 >> 172.21.15.69:0/3490856492 conn(0x55cbefa264b0 msgr2=0x55cbefac4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.343+0000 7efdfbf80740 1 -- 172.21.15.69:0/3490856492 shutdown_connections 2024-02-21T07:44:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.343+0000 7efdfbf80740 1 -- 172.21.15.69:0/3490856492 wait complete. 2024-02-21T07:44:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.344+0000 7efdfbf80740 1 -- start start 2024-02-21T07:44:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.344+0000 7efdfbf80740 1 Processor -- start 2024-02-21T07:44:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.346+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa5ef90 0x55cbefa959b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.346+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa9a070 0x55cbefa65250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.346+0000 7efdfbf80740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa8e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.346+0000 7efdfbf80740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbefa5dc60 con 0x55cbeface4d0 2024-02-21T07:44:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.346+0000 7efdfbf80740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbefa65790 con 0x55cbefa9a070 2024-02-21T07:44:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.346+0000 7efdfbf80740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbefa5c2f0 con 0x55cbefa5ef90 2024-02-21T07:44:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.346+0000 7efdfbf80740 10 client.0 _ll_register_callbacks cb 0x7efde0009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:26.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf2800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa8e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa5ef90 0x55cbefa959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa5ef90 0x55cbefa959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:54204/0 (socket says 172.21.15.69:54204) 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1e00640 1 -- 172.21.15.69:0/2378268278 learned_addr learned my addr 172.21.15.69:0/2378268278 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1400640 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa9a070 0x55cbefa65250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1e00640 1 -- 172.21.15.69:0/2378268278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa9a070 msgr2=0x55cbefa65250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1e00640 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa9a070 0x55cbefa65250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1e00640 1 -- 172.21.15.69:0/2378268278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 msgr2=0x55cbefa8e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1e00640 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa8e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1e00640 1 -- 172.21.15.69:0/2378268278 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cbef946b00 con 0x55cbefa5ef90 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1400640 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa9a070 0x55cbefa65250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdf1e00640 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa5ef90 0x55cbefa959b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efde400c4b0 tx=0x7efde4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba1e3ff347ac613 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.347+0000 7efdd3400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdd3400640 1 -- 172.21.15.69:0/2378268278 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde40ae040 con 0x55cbefa5ef90 2024-02-21T07:44:26.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdd3400640 1 -- 172.21.15.69:0/2378268278 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efde40c5080 con 0x55cbefa5ef90 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdfbf80740 1 -- 172.21.15.69:0/2378268278 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cbef9ead30 con 0x55cbefa5ef90 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdd3400640 1 -- 172.21.15.69:0/2378268278 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7efde40aabe0 con 0x55cbefa5ef90 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdfbf80740 10 client.5726 fetch_fsmap learned FSMap version 21 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdfbf80740 1 -- 172.21.15.69:0/2378268278 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x55cbef960530 con 0x55cbefa5ef90 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdd3400640 1 -- 172.21.15.69:0/2378268278 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cbef9ead30 con 0x55cbefa5ef90 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdd3400640 1 -- 172.21.15.69:0/2378268278 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 21) v1 ==== 7906+0+0 (secure 0 0 0) 0x7efde40b5b70 con 0x55cbefa5ef90 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdfbf80740 10 client.5726 fetch_fsmap finished waiting for FSMap version 21 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdfbf80740 10 client.5726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdfbf80740 20 client.5726 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdfbf80740 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cbefacae30 0x55cbefa96130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdfbf80740 4 client.5726 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:44:26.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.348+0000 7efdfbf80740 1 -- 172.21.15.69:0/2378268278 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cbef6c5600 con 0x55cbefacae30 2024-02-21T07:44:26.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.349+0000 7efdf1400640 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cbefacae30 0x55cbefa96130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:26.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.349+0000 7efdf1400640 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cbefacae30 0x55cbefa96130 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ae9711dbc5f771e server_cookie=48a68897b80a5369 in_seq=0 out_seq=0 2024-02-21T07:44:26.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:26.349+0000 7efdd3400640 10 client.5726 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.843+0000 7efdd3400640 1 -- 172.21.15.69:0/2378268278 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cbef6c5600 con 0x55cbefacae30 2024-02-21T07:44:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.843+0000 7efdd3400640 10 client.5726 handle_command_reply: tid=0 2024-02-21T07:44:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 client.5726 shutdown 2024-02-21T07:44:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 -- 172.21.15.69:0/2378268278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa5ef90 msgr2=0x55cbefa959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa5ef90 0x55cbefa959b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efde400c4b0 tx=0x7efde4000bc0 comp rx=0 tx=0).stop 2024-02-21T07:44:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 -- 172.21.15.69:0/2378268278 shutdown_connections 2024-02-21T07:44:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cbefacae30 0x55cbefa96130 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbeface4d0 0x55cbefa8e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cbefa9a070 0x55cbefa65250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 --2- 172.21.15.69:0/2378268278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cbefa5ef90 0x55cbefa959b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 -- 172.21.15.69:0/2378268278 >> 172.21.15.69:0/2378268278 conn(0x55cbefa264b0 msgr2=0x55cbefacda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdd3400640 0 client.5726 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 -- 172.21.15.69:0/2378268278 shutdown_connections 2024-02-21T07:44:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.844+0000 7efdfbf80740 1 -- 172.21.15.69:0/2378268278 wait complete. 2024-02-21T07:44:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.845+0000 7efdfbf80740 20 client.5726 trim_cache size 0 max 16384 2024-02-21T07:44:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-02-21T07:44:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-02-21T07:44:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-02-21T07:44:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.845+0000 7efdf9200640 1 -- 172.21.15.69:0/2963415087 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdd409f0a0 msgr2=0x7efdd40a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.845+0000 7efdf9200640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdd409f0a0 0x7efdd40a1560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efdec0012e0 tx=0x7efdec004d40 comp rx=0 tx=0).stop 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.845+0000 7efdf9200640 1 -- 172.21.15.69:0/2963415087 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdf40f9e70 msgr2=0x7efdf4178350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.845+0000 7efdf9200640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdf40f9e70 0x7efdf4178350 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efde400c4e0 tx=0x7efde400c9a0 comp rx=0 tx=0).stop 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.846+0000 7efdf9200640 1 -- 172.21.15.69:0/2963415087 shutdown_connections 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.846+0000 7efdf9200640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efdd409f0a0 0x7efdd40a1560 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.846+0000 7efdf9200640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efdf4189d80 0x7efdf421cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.846+0000 7efdf9200640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efdf4186170 0x7efdf417bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.846+0000 7efdf9200640 1 --2- 172.21.15.69:0/2963415087 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efdf40f9e70 0x7efdf4178350 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.846+0000 7efdf9200640 1 -- 172.21.15.69:0/2963415087 >> 172.21.15.69:0/2963415087 conn(0x7efdf406ab70 msgr2=0x7efdf418b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.846+0000 7efdf9200640 1 -- 172.21.15.69:0/2963415087 shutdown_connections 2024-02-21T07:44:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:29.846+0000 7efdf9200640 1 -- 172.21.15.69:0/2963415087 wait complete. 2024-02-21T07:44:42.791 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:42.799 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:42.802 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:44:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.103+0000 7f4209000640 1 Processor -- start 2024-02-21T07:44:43.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.103+0000 7f4209000640 1 -- start start 2024-02-21T07:44:43.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.106+0000 7f4209000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f42040f7a50 0x7f42040cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.107+0000 7f4203400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f42040f7a50 0x7f42040cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.108+0000 7f4209000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420406c3f0 con 0x7f420418ddf0 2024-02-21T07:44:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.108+0000 7f4209000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420406b220 con 0x7f42040f8540 2024-02-21T07:44:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.108+0000 7f4209000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420406b500 con 0x7f42040f7a50 2024-02-21T07:44:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.108+0000 7f4203e00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f42040f8540 0x7f42040d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:51848/0 (socket says 172.21.15.69:51848) 2024-02-21T07:44:43.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.108+0000 7f4203e00640 1 -- 172.21.15.69:0/1870120210 learned_addr learned my addr 172.21.15.69:0/1870120210 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.109+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145859299 0 0) 0x7f420406c3f0 con 0x7f420418ddf0 2024-02-21T07:44:43.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.110+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e8003520 con 0x7f420418ddf0 2024-02-21T07:44:43.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.110+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2226282783 0 0) 0x7f41e8003520 con 0x7f420418ddf0 2024-02-21T07:44:43.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.110+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 >> v2:172.21.15.184:3300/0 conn(0x7f42040f7a50 msgr2=0x7f42040cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:43.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.110+0000 7f4202000640 1 --2- 172.21.15.69:0/1870120210 >> v2:172.21.15.184:3300/0 conn(0x7f42040f7a50 0x7f42040cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.110+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 >> v1:172.21.15.174:6789/0 conn(0x7f42040f8540 legacy=0x7f42040d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:43.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.110+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420406b7e0 con 0x7f420418ddf0 2024-02-21T07:44:43.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.111+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f41f0001650 con 0x7f420418ddf0 2024-02-21T07:44:43.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.111+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 >> v1:172.21.15.69:6789/0 conn(0x7f420418ddf0 legacy=0x7f42040f7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:43.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.111+0000 7f4202000640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41e8003a10 0x7f41e8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.111+0000 7f4202000640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 0x7f41e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.111+0000 7f4202000640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41e8005380 0x7f41e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.111+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420406b500 con 0x7f41e8005380 2024-02-21T07:44:43.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.111+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e800c220 con 0x7f41e80047c0 2024-02-21T07:44:43.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.111+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e800c3e0 con 0x7f41e8003a10 2024-02-21T07:44:43.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.112+0000 7f4202a00640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 0x7f41e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.121 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.113+0000 7f4203e00640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41e8005380 0x7f41e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.114+0000 7f4202a00640 1 -- 172.21.15.69:0/1870120210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41e8003a10 msgr2=0x7f41e8003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:44:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.114+0000 7f4202a00640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f41e8003a10 0x7f41e8003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.114+0000 7f4202a00640 1 -- 172.21.15.69:0/1870120210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41e8005380 msgr2=0x7f41e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.114+0000 7f4202a00640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41e8005380 0x7f41e800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.114+0000 7f4202a00640 1 -- 172.21.15.69:0/1870120210 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e8003520 con 0x7f41e80047c0 2024-02-21T07:44:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.116+0000 7f4203e00640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f41e8005380 0x7f41e800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:44:43.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.116+0000 7f4203e00640 1 -- 172.21.15.69:0/1870120210 reap_dead start 2024-02-21T07:44:43.123 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.118+0000 7f4202a00640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 0x7f41e8004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41f000c190 tx=0x7f41e80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a159fe25b12e472 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.118+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f002ca70 con 0x7f41e80047c0 2024-02-21T07:44:43.124 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.119+0000 7f4202000640 1 -- 172.21.15.69:0/1870120210 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f002cbd0 con 0x7f41e80047c0 2024-02-21T07:44:43.126 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.120+0000 7f4209000640 1 -- 172.21.15.69:0/1870120210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 msgr2=0x7f41e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.120+0000 7f4209000640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 0x7f41e8004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f41f000c190 tx=0x7f41e80057f0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.121+0000 7f4209000640 1 -- 172.21.15.69:0/1870120210 shutdown_connections 2024-02-21T07:44:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.121+0000 7f4209000640 1 --2- 172.21.15.69:0/1870120210 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 0x7f41e8004c40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.121+0000 7f4209000640 1 -- 172.21.15.69:0/1870120210 >> 172.21.15.69:0/1870120210 conn(0x7f42040f65d0 msgr2=0x7f42040f69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:43.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.122+0000 7f4209000640 1 -- 172.21.15.69:0/1870120210 shutdown_connections 2024-02-21T07:44:43.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.122+0000 7f4209000640 1 -- 172.21.15.69:0/1870120210 wait complete. 2024-02-21T07:44:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.131+0000 7f4209000640 1 Processor -- start 2024-02-21T07:44:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.132+0000 7f4209000640 1 -- start start 2024-02-21T07:44:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.136+0000 7f4209000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 0x7f42041664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.136+0000 7f4209000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4204166a20 0x7f4204223820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.137+0000 7f4209000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4204223d60 0x7f420418b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.137+0000 7f4203400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 0x7f42041664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.137+0000 7f4203400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 0x7f42041664e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:32924/0 (socket says 172.21.15.69:32924) 2024-02-21T07:44:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.138+0000 7f4203e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4204223d60 0x7f420418b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.138+0000 7f4203e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4204223d60 0x7f420418b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49542/0 (socket says 172.21.15.69:49542) 2024-02-21T07:44:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.138+0000 7f4203400640 1 -- 172.21.15.69:0/1189012809 learned_addr learned my addr 172.21.15.69:0/1189012809 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.139+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420418f4b0 con 0x7f4204223d60 2024-02-21T07:44:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.139+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420418f790 con 0x7f41e80047c0 2024-02-21T07:44:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.139+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420418a810 con 0x7f4204166a20 2024-02-21T07:44:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.141+0000 7f4203e00640 1 -- 172.21.15.69:0/1189012809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4204166a20 msgr2=0x7f4204223820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:44:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.141+0000 7f4203e00640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4204166a20 0x7f4204223820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.141+0000 7f4203e00640 1 -- 172.21.15.69:0/1189012809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 msgr2=0x7f42041664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.141+0000 7f4203e00640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 0x7f42041664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.141+0000 7f4203e00640 1 -- 172.21.15.69:0/1189012809 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420418aaf0 con 0x7f4204223d60 2024-02-21T07:44:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.143+0000 7f4203e00640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4204223d60 0x7f420418b5d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f420408ddb0 tx=0x7f41fc00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.144+0000 7f41fb400640 1 -- 172.21.15.69:0/1189012809 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00b680 con 0x7f4204223d60 2024-02-21T07:44:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.144+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420418add0 con 0x7f4204223d60 2024-02-21T07:44:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.144+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420418bb10 con 0x7f4204223d60 2024-02-21T07:44:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.145+0000 7f41fb400640 1 -- 172.21.15.69:0/1189012809 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc00b7e0 con 0x7f4204223d60 2024-02-21T07:44:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.145+0000 7f41fb400640 1 -- 172.21.15.69:0/1189012809 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00b680 con 0x7f4204223d60 2024-02-21T07:44:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.160+0000 7f41fb400640 1 -- 172.21.15.69:0/1189012809 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f41fc00b950 con 0x7f4204223d60 2024-02-21T07:44:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.166+0000 7f41fb400640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41e409f180 0x7f41e40a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.167+0000 7f420d1f6740 1 Processor -- start 2024-02-21T07:44:43.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.168+0000 7f41fb400640 1 -- 172.21.15.69:0/1189012809 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f41fc0c96f0 con 0x7f4204223d60 2024-02-21T07:44:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.169+0000 7f4203400640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41e409f180 0x7f41e40a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.169+0000 7f420d1f6740 1 -- start start 2024-02-21T07:44:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.171+0000 7f4203400640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41e409f180 0x7f41e40a1640 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f41f4006fd0 tx=0x7f41f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.179+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.179+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x55589732bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.180+0000 7f4203400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.180+0000 7f4203400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49630/0 (socket says 172.21.15.69:49630) 2024-02-21T07:44:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.181+0000 7f4203400640 1 -- 172.21.15.69:0/1208754201 learned_addr learned my addr 172.21.15.69:0/1208754201 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.181+0000 7f4202a00640 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x55589732bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.183+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x555897367660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.184+0000 7f420d1f6740 1 -- 172.21.15.69:0/1208754201 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558972e7620 con 0x55589739b6e0 2024-02-21T07:44:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.185+0000 7f420d1f6740 1 -- 172.21.15.69:0/1208754201 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558972998c0 con 0x55589732c1a0 2024-02-21T07:44:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.185+0000 7f420d1f6740 1 -- 172.21.15.69:0/1208754201 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x555897296df0 con 0x555897367280 2024-02-21T07:44:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.185+0000 7f4203e00640 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x555897367660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.188+0000 7f4203400640 1 -- 172.21.15.69:0/1208754201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 msgr2=0x555897367660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:43.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.188+0000 7f4203400640 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x555897367660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.188+0000 7f4203400640 1 -- 172.21.15.69:0/1208754201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 msgr2=0x55589732bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:43.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.188+0000 7f4203400640 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x55589732bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.188+0000 7f4203400640 1 -- 172.21.15.69:0/1208754201 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555897213b00 con 0x555897367280 2024-02-21T07:44:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.190+0000 7f4203e00640 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x555897367660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.191+0000 7f4202a00640 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x55589732bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.192+0000 7f4203400640 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326650 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f41f4010bf0 tx=0x7f41f4013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=782e4f76f00ea0eb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.192+0000 7f41efe00640 1 -- 172.21.15.69:0/1208754201 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4016e50 con 0x555897367280 2024-02-21T07:44:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.192+0000 7f41efe00640 1 -- 172.21.15.69:0/1208754201 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f401a070 con 0x555897367280 2024-02-21T07:44:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.192+0000 7f41efe00640 1 -- 172.21.15.69:0/1208754201 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4021640 con 0x555897367280 2024-02-21T07:44:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.194+0000 7f420d1f6740 1 -- 172.21.15.69:0/1208754201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 msgr2=0x555897326650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.194+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326650 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f41f4010bf0 tx=0x7f41f4013000 comp rx=0 tx=0).stop 2024-02-21T07:44:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.195+0000 7f420d1f6740 1 -- 172.21.15.69:0/1208754201 shutdown_connections 2024-02-21T07:44:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.196+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x555897367660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.196+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x55589732bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.196+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1208754201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326650 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.196+0000 7f420d1f6740 1 -- 172.21.15.69:0/1208754201 >> 172.21.15.69:0/1208754201 conn(0x5558972f34b0 msgr2=0x55589732aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.196+0000 7f420d1f6740 1 -- 172.21.15.69:0/1208754201 shutdown_connections 2024-02-21T07:44:43.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.196+0000 7f420d1f6740 1 -- 172.21.15.69:0/1208754201 wait complete. 2024-02-21T07:44:43.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.199+0000 7f420d1f6740 1 -- start start 2024-02-21T07:44:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.201+0000 7f420d1f6740 1 Processor -- start 2024-02-21T07:44:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.204+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x5558973a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.204+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555897367280 0x555897391450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.204+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55589739b6e0 0x5558973ad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.204+0000 7f420d1f6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558972925d0 con 0x555897367280 2024-02-21T07:44:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.204+0000 7f420d1f6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x555897237b50 con 0x55589732c1a0 2024-02-21T07:44:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.204+0000 7f420d1f6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558972377f0 con 0x55589739b6e0 2024-02-21T07:44:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.204+0000 7f420d1f6740 10 client.0 _ll_register_callbacks cb 0x55589724b550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:43.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.205+0000 7f4203e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55589739b6e0 0x5558973ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.205+0000 7f4203e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55589739b6e0 0x5558973ad900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49642/0 (socket says 172.21.15.69:49642) 2024-02-21T07:44:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.205+0000 7f4203e00640 1 -- 172.21.15.69:0/1504864330 learned_addr learned my addr 172.21.15.69:0/1504864330 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.205+0000 7f4202a00640 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555897367280 0x555897391450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.206+0000 7f4203e00640 1 -- 172.21.15.69:0/1504864330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 msgr2=0x5558973a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.206+0000 7f4203e00640 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x5558973a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.211 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.206+0000 7f4203e00640 1 -- 172.21.15.69:0/1504864330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555897367280 msgr2=0x555897391450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.207+0000 7f4203e00640 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555897367280 0x555897391450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.207+0000 7f4203e00640 1 -- 172.21.15.69:0/1504864330 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f400e040 con 0x55589739b6e0 2024-02-21T07:44:43.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.208+0000 7f4202a00640 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555897367280 0x555897391450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:43.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.210+0000 7f4203e00640 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55589739b6e0 0x5558973ad900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f41fc096ed0 tx=0x7f41fc0953d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6be0d6b33cdea7f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:43.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.210+0000 7f41ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.211+0000 7f41ecc00640 1 -- 172.21.15.69:0/1504864330 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00be00 con 0x55589739b6e0 2024-02-21T07:44:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.211+0000 7f41ecc00640 1 -- 172.21.15.69:0/1504864330 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f41fc09b320 con 0x55589739b6e0 2024-02-21T07:44:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.212+0000 7f420d1f6740 1 -- 172.21.15.69:0/1504864330 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555897264cd0 con 0x55589739b6e0 2024-02-21T07:44:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.213+0000 7f41ecc00640 1 -- 172.21.15.69:0/1504864330 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41fc09f970 con 0x55589739b6e0 2024-02-21T07:44:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.213+0000 7f420d1f6740 10 client.5735 fetch_fsmap learned FSMap version 21 2024-02-21T07:44:43.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.213+0000 7f420d1f6740 1 -- 172.21.15.69:0/1504864330 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x555897290c50 con 0x55589739b6e0 2024-02-21T07:44:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.215+0000 7f41ecc00640 1 -- 172.21.15.69:0/1504864330 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555897264cd0 con 0x55589739b6e0 2024-02-21T07:44:43.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.215+0000 7f41ecc00640 1 -- 172.21.15.69:0/1504864330 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 21) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f41fc068200 con 0x55589739b6e0 2024-02-21T07:44:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.217+0000 7f420d1f6740 10 client.5735 fetch_fsmap finished waiting for FSMap version 21 2024-02-21T07:44:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.217+0000 7f420d1f6740 10 client.5735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.217+0000 7f420d1f6740 20 client.5735 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.217+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5558973aca60 0x5558973ace70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.217+0000 7f420d1f6740 4 client.5735 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:43.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.217+0000 7f420d1f6740 1 -- 172.21.15.69:0/1504864330 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555897288ce0 con 0x5558973aca60 2024-02-21T07:44:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.228+0000 7f4203400640 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5558973aca60 0x5558973ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.233+0000 7f4203400640 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5558973aca60 0x5558973ace70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e9cfe6faf964406 server_cookie=e59092bc56e45bf4 in_seq=0 out_seq=0 2024-02-21T07:44:43.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.233+0000 7f41ecc00640 10 client.5735 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.250+0000 7f41ecc00640 1 -- 172.21.15.69:0/1504864330 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555897288ce0 con 0x5558973aca60 2024-02-21T07:44:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.250+0000 7f41ecc00640 10 client.5735 handle_command_reply: tid=0 2024-02-21T07:44:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.250+0000 7f420d1f6740 1 client.5735 shutdown 2024-02-21T07:44:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.251+0000 7f420d1f6740 1 -- 172.21.15.69:0/1504864330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55589739b6e0 msgr2=0x5558973ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.251+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55589739b6e0 0x5558973ad900 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f41fc096ed0 tx=0x7f41fc0953d0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.251+0000 7f420d1f6740 1 -- 172.21.15.69:0/1504864330 shutdown_connections 2024-02-21T07:44:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.251+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5558973aca60 0x5558973ace70 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.251+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55589739b6e0 0x5558973ad900 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.251+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555897367280 0x555897391450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.251+0000 7f41ecc00640 0 client.5735 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.251+0000 7f420d1f6740 1 --2- 172.21.15.69:0/1504864330 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x5558973a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.251+0000 7f420d1f6740 1 -- 172.21.15.69:0/1504864330 >> 172.21.15.69:0/1504864330 conn(0x5558972f34b0 msgr2=0x55589739bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.253+0000 7f420d1f6740 1 -- 172.21.15.69:0/1504864330 shutdown_connections 2024-02-21T07:44:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.253+0000 7f420d1f6740 1 -- 172.21.15.69:0/1504864330 wait complete. 2024-02-21T07:44:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.254+0000 7f420d1f6740 20 client.5735 trim_cache size 0 max 16384 2024-02-21T07:44:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.299+0000 7f420d1f6740 1 Processor -- start 2024-02-21T07:44:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.301+0000 7f420d1f6740 1 -- start start 2024-02-21T07:44:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.305+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x5558973a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.305+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x5558973fea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.306+0000 7f4203400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x5558973a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.305+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x55589736bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.306+0000 7f420d1f6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555896fdae60 con 0x55589739b6e0 2024-02-21T07:44:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.306+0000 7f420d1f6740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55589732a2b0 con 0x55589732c1a0 2024-02-21T07:44:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.306+0000 7f420d1f6740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558973a9df0 con 0x555897367280 2024-02-21T07:44:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.307+0000 7f4203400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x5558973a9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:32940/0 (socket says 172.21.15.69:32940) 2024-02-21T07:44:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.307+0000 7f4203400640 1 -- 172.21.15.69:0/753741636 learned_addr learned my addr 172.21.15.69:0/753741636 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.308+0000 7f4202a00640 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x5558973fea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.308+0000 7f4203e00640 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x55589736bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.308+0000 7f4203400640 1 -- 172.21.15.69:0/753741636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 msgr2=0x5558973fea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.309+0000 7f4203400640 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x5558973fea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.309+0000 7f4203400640 1 -- 172.21.15.69:0/753741636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 msgr2=0x55589736bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.309+0000 7f4203400640 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x55589736bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.309+0000 7f4203400640 1 -- 172.21.15.69:0/753741636 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55589722d530 con 0x55589732c1a0 2024-02-21T07:44:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.309+0000 7f4202a00640 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x5558973fea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.309+0000 7f4203e00640 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x55589736bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:44:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.309+0000 7f4203400640 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x5558973a9fd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41f4010620 tx=0x7f41f4015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ceb3e509ce48a44 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.311+0000 7f41ef400640 1 -- 172.21.15.69:0/753741636 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4030040 con 0x55589732c1a0 2024-02-21T07:44:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.312+0000 7f41ef400640 1 -- 172.21.15.69:0/753741636 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f401a040 con 0x55589732c1a0 2024-02-21T07:44:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.312+0000 7f41ef400640 1 -- 172.21.15.69:0/753741636 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4033e00 con 0x55589732c1a0 2024-02-21T07:44:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.313+0000 7f420d1f6740 1 -- 172.21.15.69:0/753741636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 msgr2=0x5558973a9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.313+0000 7f420d1f6740 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x5558973a9fd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41f4010620 tx=0x7f41f4015000 comp rx=0 tx=0).stop 2024-02-21T07:44:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.314+0000 7f420d1f6740 1 -- 172.21.15.69:0/753741636 shutdown_connections 2024-02-21T07:44:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.314+0000 7f420d1f6740 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x55589736bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.314+0000 7f420d1f6740 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x5558973fea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.314+0000 7f420d1f6740 1 --2- 172.21.15.69:0/753741636 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x5558973a9fd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.314+0000 7f420d1f6740 1 -- 172.21.15.69:0/753741636 >> 172.21.15.69:0/753741636 conn(0x5558972f34b0 msgr2=0x555897361400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.314+0000 7f420d1f6740 1 -- 172.21.15.69:0/753741636 shutdown_connections 2024-02-21T07:44:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.314+0000 7f420d1f6740 1 -- 172.21.15.69:0/753741636 wait complete. 2024-02-21T07:44:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.316+0000 7f420d1f6740 1 -- start start 2024-02-21T07:44:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.316+0000 7f420d1f6740 1 Processor -- start 2024-02-21T07:44:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.320+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x555897399b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.320+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.321+0000 7f420d1f6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x5558974095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.321+0000 7f4203400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x555897399b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.321+0000 7f4203400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x555897399b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:32946/0 (socket says 172.21.15.69:32946) 2024-02-21T07:44:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.321+0000 7f4202a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.321+0000 7f4202a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49658/0 (socket says 172.21.15.69:49658) 2024-02-21T07:44:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.322+0000 7f4203400640 1 -- 172.21.15.69:0/355490652 learned_addr learned my addr 172.21.15.69:0/355490652 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.322+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x555897409d20 con 0x55589739b6e0 2024-02-21T07:44:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.322+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558973b2640 con 0x55589732c1a0 2024-02-21T07:44:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.322+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558973b2aa0 con 0x555897367280 2024-02-21T07:44:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.323+0000 7f4203e00640 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x5558974095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.324+0000 7f4202a00640 1 -- 172.21.15.69:0/355490652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 msgr2=0x555897399b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.324+0000 7f4202a00640 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x555897399b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.324+0000 7f4202a00640 1 -- 172.21.15.69:0/355490652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 msgr2=0x5558974095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.324+0000 7f4202a00640 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x5558974095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:43.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.325+0000 7f4202a00640 1 -- 172.21.15.69:0/355490652 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555897213b00 con 0x555897367280 2024-02-21T07:44:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.325+0000 7f4202a00640 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326d80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f41f0033000 tx=0x7f41f002e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3515d77785cf6c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.326+0000 7f420d1f6740 10 client.0 _ll_register_callbacks cb 0x7f41f40077c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.326+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558972b7d30 con 0x555897367280 2024-02-21T07:44:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.326+0000 7f41ecc00640 10 client.5741 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.327+0000 7f41ecc00640 1 -- 172.21.15.69:0/355490652 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0043070 con 0x555897367280 2024-02-21T07:44:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.327+0000 7f41ecc00640 1 -- 172.21.15.69:0/355490652 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f41f0001870 con 0x555897367280 2024-02-21T07:44:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.327+0000 7f41ecc00640 1 -- 172.21.15.69:0/355490652 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41f0034870 con 0x555897367280 2024-02-21T07:44:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.327+0000 7f420d1f6740 10 client.5741 fetch_fsmap learned FSMap version 21 2024-02-21T07:44:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.327+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({fsmap=21}) v3 -- 0x5558972532c0 con 0x555897367280 2024-02-21T07:44:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.328+0000 7f41ecc00640 1 -- 172.21.15.69:0/355490652 <== mon.2 v2:172.21.15.184:3300/0 4 ==== fsmap(e 21) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f41f00349d0 con 0x555897367280 2024-02-21T07:44:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.329+0000 7f420d1f6740 10 client.5741 fetch_fsmap finished waiting for FSMap version 21 2024-02-21T07:44:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.329+0000 7f420d1f6740 10 client.5741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.329+0000 7f420d1f6740 20 client.5741 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.329+0000 7f420d1f6740 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5558973fdc80 0x5558973ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.329+0000 7f420d1f6740 4 client.5741 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:44:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.329+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555896f92600 con 0x5558973fdc80 2024-02-21T07:44:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.330+0000 7f4203400640 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5558973fdc80 0x5558973ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.332+0000 7f4203400640 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5558973fdc80 0x5558973ad9b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=419ced1744b0978c server_cookie=1feec0c867aab5dd in_seq=0 out_seq=0 2024-02-21T07:44:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:43.333+0000 7f41ecc00640 10 client.5741 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:48.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:44:48.412 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:44:48.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.821+0000 7fce73200640 1 Processor -- start 2024-02-21T07:44:48.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.821+0000 7fce73200640 1 -- start start 2024-02-21T07:44:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.824+0000 7fce73200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fce6c04f190 0x7fce6c04f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.824+0000 7fce73200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6c10b210 con 0x7fce6c107ca0 2024-02-21T07:44:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.824+0000 7fce73200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6c1081a0 con 0x7fce6c0550c0 2024-02-21T07:44:48.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.824+0000 7fce73200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c050840 con 0x7fce6c04f190 2024-02-21T07:44:48.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.826+0000 7fce72800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fce6c04f190 0x7fce6c04f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:48.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.826+0000 7fce72800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fce6c04f190 0x7fce6c04f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:49672/0 (socket says 172.21.15.69:49672) 2024-02-21T07:44:48.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.826+0000 7fce72800640 1 -- 172.21.15.69:0/4039041547 learned_addr learned my addr 172.21.15.69:0/4039041547 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.827+0000 7fce70a00640 1 -- 172.21.15.69:0/4039041547 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341535291 0 0) 0x7fce6c1081a0 con 0x7fce6c0550c0 2024-02-21T07:44:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.827+0000 7fce70a00640 1 -- 172.21.15.69:0/4039041547 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce58003520 con 0x7fce6c0550c0 2024-02-21T07:44:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.827+0000 7fce72800640 1 -- 172.21.15.69:0/4039041547 >> v1:172.21.15.174:6789/0 conn(0x7fce6c0550c0 legacy=0x7fce6c055500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.827+0000 7fce72800640 1 -- 172.21.15.69:0/4039041547 >> v1:172.21.15.69:6789/0 conn(0x7fce6c107ca0 legacy=0x7fce6c07dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.827+0000 7fce72800640 1 -- 172.21.15.69:0/4039041547 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c050560 con 0x7fce6c04f190 2024-02-21T07:44:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.835+0000 7fce72800640 1 --2- 172.21.15.69:0/4039041547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c04f190 0x7fce6c04f600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fce7407b910 tx=0x7fce740ab510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e82747e53532b7c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.836+0000 7fce70a00640 1 -- 172.21.15.69:0/4039041547 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740b07d0 con 0x7fce6c04f190 2024-02-21T07:44:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.836+0000 7fce70a00640 1 -- 172.21.15.69:0/4039041547 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce740ae050 con 0x7fce6c04f190 2024-02-21T07:44:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.836+0000 7fce70a00640 1 -- 172.21.15.69:0/4039041547 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce740b0c30 con 0x7fce6c04f190 2024-02-21T07:44:48.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.839+0000 7fce73200640 1 -- 172.21.15.69:0/4039041547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c04f190 msgr2=0x7fce6c04f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:48.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.840+0000 7fce73200640 1 --2- 172.21.15.69:0/4039041547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c04f190 0x7fce6c04f600 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fce7407b910 tx=0x7fce740ab510 comp rx=0 tx=0).stop 2024-02-21T07:44:48.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.841+0000 7fce73200640 1 -- 172.21.15.69:0/4039041547 shutdown_connections 2024-02-21T07:44:48.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.841+0000 7fce73200640 1 --2- 172.21.15.69:0/4039041547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c04f190 0x7fce6c04f600 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.841+0000 7fce73200640 1 -- 172.21.15.69:0/4039041547 >> 172.21.15.69:0/4039041547 conn(0x7fce6c052de0 msgr2=0x7fce6c0531f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:48.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.842+0000 7fce73200640 1 -- 172.21.15.69:0/4039041547 shutdown_connections 2024-02-21T07:44:48.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.842+0000 7fce73200640 1 -- 172.21.15.69:0/4039041547 wait complete. 2024-02-21T07:44:48.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.850+0000 7fce73200640 1 Processor -- start 2024-02-21T07:44:48.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.851+0000 7fce73200640 1 -- start start 2024-02-21T07:44:48.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.854+0000 7fce73200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce6c04f190 0x7fce6c103260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.854+0000 7fce73200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce6c0550c0 0x7fce6c1a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.854+0000 7fce73200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c107ca0 0x7fce6c1a8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.854+0000 7fce73200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c102dd0 con 0x7fce6c04f190 2024-02-21T07:44:48.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.855+0000 7fce72800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c107ca0 0x7fce6c1a8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:48.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.855+0000 7fce72800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c107ca0 0x7fce6c1a8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:52982/0 (socket says 172.21.15.69:52982) 2024-02-21T07:44:48.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.855+0000 7fce72800640 1 -- 172.21.15.69:0/2460974623 learned_addr learned my addr 172.21.15.69:0/2460974623 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:48.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.855+0000 7fce73200640 1 -- 172.21.15.69:0/2460974623 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c101f20 con 0x7fce6c0550c0 2024-02-21T07:44:48.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.855+0000 7fce73200640 1 -- 172.21.15.69:0/2460974623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c1021c0 con 0x7fce6c107ca0 2024-02-21T07:44:48.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.856+0000 7fce72800640 1 -- 172.21.15.69:0/2460974623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce6c0550c0 msgr2=0x7fce6c1a5880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:44:48.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.856+0000 7fce72800640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce6c0550c0 0x7fce6c1a5880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.856+0000 7fce72800640 1 -- 172.21.15.69:0/2460974623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce6c04f190 msgr2=0x7fce6c103260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:48.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.856+0000 7fce72800640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce6c04f190 0x7fce6c103260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.856+0000 7fce72800640 1 -- 172.21.15.69:0/2460974623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c1024a0 con 0x7fce6c107ca0 2024-02-21T07:44:48.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.857+0000 7fce72800640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c107ca0 0x7fce6c1a8160 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fce74073740 tx=0x7fce740af000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:48.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.857+0000 7fce6a000640 1 -- 172.21.15.69:0/2460974623 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74091040 con 0x7fce6c107ca0 2024-02-21T07:44:48.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.857+0000 7fce73200640 1 -- 172.21.15.69:0/2460974623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6c102780 con 0x7fce6c107ca0 2024-02-21T07:44:48.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.858+0000 7fce73200640 1 -- 172.21.15.69:0/2460974623 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c1a5dc0 con 0x7fce6c107ca0 2024-02-21T07:44:48.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.862+0000 7fce6a000640 1 -- 172.21.15.69:0/2460974623 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce740b2830 con 0x7fce6c107ca0 2024-02-21T07:44:48.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.862+0000 7fce6a000640 1 -- 172.21.15.69:0/2460974623 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74091040 con 0x7fce6c107ca0 2024-02-21T07:44:48.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.867+0000 7fce7b5de740 1 Processor -- start 2024-02-21T07:44:48.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.868+0000 7fce6a000640 1 -- 172.21.15.69:0/2460974623 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fce740b29e0 con 0x7fce6c107ca0 2024-02-21T07:44:48.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.868+0000 7fce7b5de740 1 -- start start 2024-02-21T07:44:48.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.877+0000 7fce6a000640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fce5409f080 0x7fce540a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.878+0000 7fce6a000640 1 -- 172.21.15.69:0/2460974623 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fce74167380 con 0x7fce6c107ca0 2024-02-21T07:44:48.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.878+0000 7fce71400640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fce5409f080 0x7fce540a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:48.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.878+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 0x562e0152ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.878+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 0x562e014f5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.878+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 0x562e014b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.878+0000 7fce7b5de740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e0142c150 con 0x562e0152b160 2024-02-21T07:44:48.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.878+0000 7fce7b5de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e01429680 con 0x562e014f5ac0 2024-02-21T07:44:48.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.878+0000 7fce7b5de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e01424e60 con 0x562e014f51a0 2024-02-21T07:44:48.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.879+0000 7fce72800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 0x562e014b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:48.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.879+0000 7fce72800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 0x562e014b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:37810/0 (socket says 172.21.15.69:37810) 2024-02-21T07:44:48.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.879+0000 7fce72800640 1 -- 172.21.15.69:0/2367445199 learned_addr learned my addr 172.21.15.69:0/2367445199 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:48.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.880+0000 7fce71e00640 1 --2- 172.21.15.69:0/2367445199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 0x562e0152ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:48.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.881+0000 7fce71e00640 1 -- 172.21.15.69:0/2367445199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 msgr2=0x562e014b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:48.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.881+0000 7fce71e00640 1 --2- 172.21.15.69:0/2367445199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 0x562e014b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.881+0000 7fce71e00640 1 -- 172.21.15.69:0/2367445199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 msgr2=0x562e014f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:48.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.881+0000 7fce71e00640 1 --2- 172.21.15.69:0/2367445199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 0x562e014f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.882+0000 7fce71e00640 1 -- 172.21.15.69:0/2367445199 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e013de060 con 0x562e014f51a0 2024-02-21T07:44:48.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.882+0000 7fce71e00640 1 --2- 172.21.15.69:0/2367445199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 0x562e0152ac20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fce600096b0 tx=0x7fce60009ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f273f3c56b607a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:48.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.884+0000 7fce71400640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fce5409f080 0x7fce540a1540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fce6c07a850 tx=0x7fce64007d70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:48.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.887+0000 7fce5e600640 1 -- 172.21.15.69:0/2367445199 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60011830 con 0x562e014f51a0 2024-02-21T07:44:48.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.887+0000 7fce5e600640 1 -- 172.21.15.69:0/2367445199 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce60011990 con 0x562e014f51a0 2024-02-21T07:44:48.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.887+0000 7fce5e600640 1 -- 172.21.15.69:0/2367445199 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60011d40 con 0x562e014f51a0 2024-02-21T07:44:48.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.890+0000 7fce7b5de740 1 -- 172.21.15.69:0/2367445199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 msgr2=0x562e0152ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:48.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.890+0000 7fce7b5de740 1 --2- 172.21.15.69:0/2367445199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 0x562e0152ac20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fce600096b0 tx=0x7fce60009ab0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.899+0000 7fce7b5de740 1 -- 172.21.15.69:0/2367445199 shutdown_connections 2024-02-21T07:44:48.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.899+0000 7fce7b5de740 1 --2- 172.21.15.69:0/2367445199 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 0x562e014b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.899+0000 7fce7b5de740 1 --2- 172.21.15.69:0/2367445199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 0x562e014f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.899+0000 7fce7b5de740 1 --2- 172.21.15.69:0/2367445199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 0x562e0152ac20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.899+0000 7fce7b5de740 1 -- 172.21.15.69:0/2367445199 >> 172.21.15.69:0/2367445199 conn(0x562e014845a0 msgr2=0x562e014bc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:48.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.899+0000 7fce7b5de740 1 -- 172.21.15.69:0/2367445199 shutdown_connections 2024-02-21T07:44:48.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.900+0000 7fce7b5de740 1 -- 172.21.15.69:0/2367445199 wait complete. 2024-02-21T07:44:48.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.901+0000 7fce7b5de740 1 -- start start 2024-02-21T07:44:48.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.901+0000 7fce7b5de740 1 Processor -- start 2024-02-21T07:44:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.907+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 0x562e014ead70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.907+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f5ac0 0x562e014ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.907+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e0152b160 0x562e01551380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.909+0000 7fce71400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f5ac0 0x562e014ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:48.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.910+0000 7fce71400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f5ac0 0x562e014ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39544/0 (socket says 172.21.15.69:39544) 2024-02-21T07:44:48.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.913+0000 7fce7b5de740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e013c9ec0 con 0x562e014f5ac0 2024-02-21T07:44:48.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.913+0000 7fce7b5de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e013c9b60 con 0x562e0152b160 2024-02-21T07:44:48.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.913+0000 7fce7b5de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e011931c0 con 0x562e014f51a0 2024-02-21T07:44:48.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.913+0000 7fce7b5de740 10 client.0 _ll_register_callbacks cb 0x562e013dd960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:48.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.916+0000 7fce71400640 1 -- 172.21.15.69:0/3942452757 learned_addr learned my addr 172.21.15.69:0/3942452757 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:48.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.917+0000 7fce72800640 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e0152b160 0x562e01551380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:48.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.917+0000 7fce71e00640 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 0x562e014ead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:48.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.917+0000 7fce71400640 1 -- 172.21.15.69:0/3942452757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 msgr2=0x562e014ead70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:48.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.917+0000 7fce71400640 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 0x562e014ead70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.917+0000 7fce71400640 1 -- 172.21.15.69:0/3942452757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e0152b160 msgr2=0x562e01551380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:48.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.917+0000 7fce71400640 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e0152b160 0x562e01551380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:48.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.917+0000 7fce71400640 1 -- 172.21.15.69:0/3942452757 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce600092b0 con 0x562e014f5ac0 2024-02-21T07:44:48.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.918+0000 7fce71e00640 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 0x562e014ead70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:48.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.918+0000 7fce52a00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:48.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.918+0000 7fce71400640 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f5ac0 0x562e014ff1e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce6400ec40 tx=0x7fce64000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ecb88a16ddba2c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:48.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.919+0000 7fce52a00640 1 -- 172.21.15.69:0/3942452757 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640052d0 con 0x562e014f5ac0 2024-02-21T07:44:48.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.920+0000 7fce7b5de740 1 -- 172.21.15.69:0/3942452757 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e011247e0 con 0x562e014f5ac0 2024-02-21T07:44:48.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.920+0000 7fce52a00640 1 -- 172.21.15.69:0/3942452757 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fce64005430 con 0x562e014f5ac0 2024-02-21T07:44:48.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.921+0000 7fce52a00640 1 -- 172.21.15.69:0/3942452757 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce640052d0 con 0x562e014f5ac0 2024-02-21T07:44:48.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.921+0000 7fce7b5de740 10 client.5613 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:48.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.921+0000 7fce7b5de740 1 -- 172.21.15.69:0/3942452757 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x562e014234e0 con 0x562e014f5ac0 2024-02-21T07:44:48.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.923+0000 7fce52a00640 1 -- 172.21.15.69:0/3942452757 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562e011247e0 con 0x562e014f5ac0 2024-02-21T07:44:48.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.924+0000 7fce52a00640 1 -- 172.21.15.69:0/3942452757 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fce640035f0 con 0x562e014f5ac0 2024-02-21T07:44:48.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.924+0000 7fce7b5de740 10 client.5613 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:48.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.925+0000 7fce7b5de740 10 client.5613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:48.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.925+0000 7fce7b5de740 20 client.5613 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:48.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.925+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562e014bcf50 0x562e014b8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:48.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.926+0000 7fce7b5de740 4 client.5613 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:48.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.926+0000 7fce7b5de740 1 -- 172.21.15.69:0/3942452757 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e01161720 con 0x562e014bcf50 2024-02-21T07:44:48.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.926+0000 7fce71e00640 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562e014bcf50 0x562e014b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:48.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.928+0000 7fce71e00640 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562e014bcf50 0x562e014b8040 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd6dc2412c2b050 server_cookie=274611a5b54975ec in_seq=0 out_seq=0 2024-02-21T07:44:48.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:48.928+0000 7fce52a00640 10 client.5613 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.641+0000 7f41ecc00640 1 -- 172.21.15.69:0/355490652 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555896f92600 con 0x5558973fdc80 2024-02-21T07:44:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.641+0000 7f41ecc00640 10 client.5741 handle_command_reply: tid=0 2024-02-21T07:44:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.641+0000 7f420d1f6740 1 client.5741 shutdown 2024-02-21T07:44:49.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.641+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 msgr2=0x555897326d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.641+0000 7f420d1f6740 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326d80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f41f0033000 tx=0x7f41f002e000 comp rx=0 tx=0).stop 2024-02-21T07:44:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.642+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 shutdown_connections 2024-02-21T07:44:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.642+0000 7f420d1f6740 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5558973fdc80 0x5558973ad9b0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.642+0000 7f420d1f6740 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55589739b6e0 0x5558974095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.642+0000 7f420d1f6740 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x555897367280 0x555897326d80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.642+0000 7f420d1f6740 1 --2- 172.21.15.69:0/355490652 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55589732c1a0 0x555897399b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.642+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 >> 172.21.15.69:0/355490652 conn(0x5558972f34b0 msgr2=0x555897361400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:49.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.642+0000 7f41ecc00640 0 client.5741 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:49.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.642+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 shutdown_connections 2024-02-21T07:44:49.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.642+0000 7f420d1f6740 1 -- 172.21.15.69:0/355490652 wait complete. 2024-02-21T07:44:49.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.642+0000 7fce52a00640 1 -- 172.21.15.69:0/3942452757 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562e01161720 con 0x562e014bcf50 2024-02-21T07:44:49.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.642+0000 7fce52a00640 10 client.5613 handle_command_reply: tid=0 2024-02-21T07:44:49.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.642+0000 7f420d1f6740 20 client.5741 trim_cache size 0 max 16384 2024-02-21T07:44:49.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.642+0000 7fce7b5de740 1 client.5613 shutdown 2024-02-21T07:44:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-02-21T07:44:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-02-21T07:44:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-02-21T07:44:49.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-02-21T07:44:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.642+0000 7fce7b5de740 1 -- 172.21.15.69:0/3942452757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f5ac0 msgr2=0x562e014ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.642+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f5ac0 0x562e014ff1e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fce6400ec40 tx=0x7fce64000ed0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.642+0000 7fce7b5de740 1 -- 172.21.15.69:0/3942452757 shutdown_connections 2024-02-21T07:44:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.642+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562e014bcf50 0x562e014b8040 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.642+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e0152b160 0x562e01551380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.643+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f5ac0 0x562e014ff1e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.643+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3942452757 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f51a0 0x562e014ead70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.643+0000 7fce7b5de740 1 -- 172.21.15.69:0/3942452757 >> 172.21.15.69:0/3942452757 conn(0x562e014845a0 msgr2=0x562e0152aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:49.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.643+0000 7fce52a00640 0 client.5613 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:49.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.643+0000 7fce7b5de740 1 -- 172.21.15.69:0/3942452757 shutdown_connections 2024-02-21T07:44:49.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.643+0000 7fce7b5de740 1 -- 172.21.15.69:0/3942452757 wait complete. 2024-02-21T07:44:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41e409f180 msgr2=0x7f41e40a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41e409f180 0x7f41e40a1640 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f41f4006fd0 tx=0x7f41f4008040 comp rx=0 tx=0).stop 2024-02-21T07:44:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4204223d60 msgr2=0x7f420418b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4204223d60 0x7f420418b5d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f420408ddb0 tx=0x7f41fc00df70 comp rx=0 tx=0).stop 2024-02-21T07:44:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 shutdown_connections 2024-02-21T07:44:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f41e409f180 0x7f41e40a1640 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4204223d60 0x7f420418b5d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4204166a20 0x7f4204223820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 --2- 172.21.15.69:0/1189012809 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f41e80047c0 0x7f42041664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 >> 172.21.15.69:0/1189012809 conn(0x7f42040f65d0 msgr2=0x7f42040f69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:49.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.643+0000 7fce7b5de740 20 client.5613 trim_cache size 0 max 16384 2024-02-21T07:44:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 shutdown_connections 2024-02-21T07:44:49.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:44:49.643+0000 7f4209000640 1 -- 172.21.15.69:0/1189012809 wait complete. 2024-02-21T07:44:49.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.659+0000 7fce7b5de740 1 Processor -- start 2024-02-21T07:44:49.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.659+0000 7fce7b5de740 1 -- start start 2024-02-21T07:44:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.660+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f51a0 0x562e0152ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.660+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f5ac0 0x562e01529470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.660+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 0x562e014ead30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.660+0000 7fce7b5de740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e014eb270 con 0x562e0152b160 2024-02-21T07:44:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.660+0000 7fce7b5de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e014e4740 con 0x562e014f51a0 2024-02-21T07:44:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.660+0000 7fce7b5de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e01550d00 con 0x562e014f5ac0 2024-02-21T07:44:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.660+0000 7fce72800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 0x562e014ead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce71400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f5ac0 0x562e01529470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce72800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 0x562e014ead30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39550/0 (socket says 172.21.15.69:39550) 2024-02-21T07:44:49.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce71e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f51a0 0x562e0152ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce72800640 1 -- 172.21.15.69:0/291260666 learned_addr learned my addr 172.21.15.69:0/291260666 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:49.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce71e00640 1 -- 172.21.15.69:0/291260666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f5ac0 msgr2=0x562e01529470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:49.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce71e00640 1 --2- 172.21.15.69:0/291260666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f5ac0 0x562e01529470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce71e00640 1 -- 172.21.15.69:0/291260666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 msgr2=0x562e014ead30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:49.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce71e00640 1 --2- 172.21.15.69:0/291260666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 0x562e014ead30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce71e00640 1 -- 172.21.15.69:0/291260666 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e013bf950 con 0x562e014f51a0 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce71400640 1 --2- 172.21.15.69:0/291260666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f5ac0 0x562e01529470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce72800640 1 --2- 172.21.15.69:0/291260666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 0x562e014ead30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce71e00640 1 --2- 172.21.15.69:0/291260666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f51a0 0x562e0152ed40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fce60009680 tx=0x7fce60008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba18228424e5ec server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce5dc00640 1 -- 172.21.15.69:0/291260666 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60011d00 con 0x562e014f51a0 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.661+0000 7fce5dc00640 1 -- 172.21.15.69:0/291260666 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce60011e80 con 0x562e014f51a0 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.662+0000 7fce5dc00640 1 -- 172.21.15.69:0/291260666 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60004260 con 0x562e014f51a0 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.662+0000 7fce7b5de740 1 -- 172.21.15.69:0/291260666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f51a0 msgr2=0x562e0152ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.662+0000 7fce7b5de740 1 --2- 172.21.15.69:0/291260666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f51a0 0x562e0152ed40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fce60009680 tx=0x7fce60008030 comp rx=0 tx=0).stop 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.662+0000 7fce7b5de740 1 -- 172.21.15.69:0/291260666 shutdown_connections 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.662+0000 7fce7b5de740 1 --2- 172.21.15.69:0/291260666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e0152b160 0x562e014ead30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.662+0000 7fce7b5de740 1 --2- 172.21.15.69:0/291260666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e014f5ac0 0x562e01529470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.662+0000 7fce7b5de740 1 --2- 172.21.15.69:0/291260666 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f51a0 0x562e0152ed40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.662+0000 7fce7b5de740 1 -- 172.21.15.69:0/291260666 >> 172.21.15.69:0/291260666 conn(0x562e014845a0 msgr2=0x562e0152aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:49.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.662+0000 7fce7b5de740 1 -- 172.21.15.69:0/291260666 shutdown_connections 2024-02-21T07:44:49.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.662+0000 7fce7b5de740 1 -- 172.21.15.69:0/291260666 wait complete. 2024-02-21T07:44:49.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.663+0000 7fce7b5de740 1 -- start start 2024-02-21T07:44:49.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.663+0000 7fce7b5de740 1 Processor -- start 2024-02-21T07:44:49.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.664+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f51a0 0x562e014bc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.664+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 0x562e015a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce7b5de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e0152b160 0x562e015a8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce7b5de740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e015a8450 con 0x562e014f51a0 2024-02-21T07:44:49.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce7b5de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e01521230 con 0x562e014f5ac0 2024-02-21T07:44:49.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce7b5de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e015a5bf0 con 0x562e0152b160 2024-02-21T07:44:49.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce7b5de740 10 client.0 _ll_register_callbacks cb 0x7fce6400e910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f51a0 0x562e014bc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f51a0 0x562e014bc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39556/0 (socket says 172.21.15.69:39556) 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71e00640 1 -- 172.21.15.69:0/3479062320 learned_addr learned my addr 172.21.15.69:0/3479062320 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce72800640 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e0152b160 0x562e015a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71400640 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 0x562e015a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71e00640 1 -- 172.21.15.69:0/3479062320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e0152b160 msgr2=0x562e015a8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71e00640 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e0152b160 0x562e015a8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71e00640 1 -- 172.21.15.69:0/3479062320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 msgr2=0x562e015a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71e00640 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 0x562e015a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71e00640 1 -- 172.21.15.69:0/3479062320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e014234e0 con 0x562e014f51a0 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71400640 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 0x562e015a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce71e00640 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f51a0 0x562e014bc4c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce60014040 tx=0x7fce60004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5b83fe25012df3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.665+0000 7fce52a00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce52a00640 1 -- 172.21.15.69:0/3479062320 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60004220 con 0x562e014f51a0 2024-02-21T07:44:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce52a00640 1 -- 172.21.15.69:0/3479062320 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fce6001f040 con 0x562e014f51a0 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce7b5de740 1 -- 172.21.15.69:0/3479062320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e011b0890 con 0x562e014f51a0 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce52a00640 1 -- 172.21.15.69:0/3479062320 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce60004380 con 0x562e014f51a0 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce7b5de740 10 client.5619 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce7b5de740 1 -- 172.21.15.69:0/3479062320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7fce6c1a5dc0 con 0x562e014f51a0 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce52a00640 1 -- 172.21.15.69:0/3479062320 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562e011b0890 con 0x562e014f51a0 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce52a00640 1 -- 172.21.15.69:0/3479062320 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fce600035f0 con 0x562e014f51a0 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce7b5de740 10 client.5619 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce7b5de740 10 client.5619 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce7b5de740 20 client.5619 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562e014e4180 0x562e015ab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce7b5de740 4 client.5619 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.666+0000 7fce7b5de740 1 -- 172.21.15.69:0/3479062320 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562e010d0700 con 0x562e014e4180 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.667+0000 7fce71400640 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562e014e4180 0x562e015ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.667+0000 7fce52a00640 10 client.5619 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.667+0000 7fce71400640 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562e014e4180 0x562e015ab480 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19dd14ea9b9ca91d server_cookie=82b8596a1f0d6845 in_seq=0 out_seq=0 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.667+0000 7fce52a00640 1 -- 172.21.15.69:0/3479062320 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562e010d0700 con 0x562e014e4180 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.667+0000 7fce52a00640 10 client.5619 handle_command_reply: tid=0 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.667+0000 7fce7b5de740 1 client.5619 shutdown 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.667+0000 7fce7b5de740 1 -- 172.21.15.69:0/3479062320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f51a0 msgr2=0x562e014bc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.667+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f51a0 0x562e014bc4c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fce60014040 tx=0x7fce60004720 comp rx=0 tx=0).stop 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce7b5de740 1 -- 172.21.15.69:0/3479062320 shutdown_connections 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562e014e4180 0x562e015ab480 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562e0152b160 0x562e015a8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562e014f5ac0 0x562e015a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce7b5de740 1 --2- 172.21.15.69:0/3479062320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562e014f51a0 0x562e014bc4c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce7b5de740 1 -- 172.21.15.69:0/3479062320 >> 172.21.15.69:0/3479062320 conn(0x562e014845a0 msgr2=0x562e014b9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce52a00640 0 client.5619 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce7b5de740 1 -- 172.21.15.69:0/3479062320 shutdown_connections 2024-02-21T07:44:49.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce7b5de740 1 -- 172.21.15.69:0/3479062320 wait complete. 2024-02-21T07:44:49.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce7b5de740 20 client.5619 trim_cache size 0 max 16384 2024-02-21T07:44:49.678 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:44:49.678 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-02-21T07:44:49.678 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-02-21T07:44:49.678 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:44:49.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce73200640 1 -- 172.21.15.69:0/2460974623 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fce5409f080 msgr2=0x7fce540a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce73200640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fce5409f080 0x7fce540a1540 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fce6c07a850 tx=0x7fce64007d70 comp rx=0 tx=0).stop 2024-02-21T07:44:49.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce73200640 1 -- 172.21.15.69:0/2460974623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c107ca0 msgr2=0x7fce6c1a8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce73200640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c107ca0 0x7fce6c1a8160 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fce74073740 tx=0x7fce740af000 comp rx=0 tx=0).stop 2024-02-21T07:44:49.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce73200640 1 -- 172.21.15.69:0/2460974623 shutdown_connections 2024-02-21T07:44:49.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce73200640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fce5409f080 0x7fce540a1540 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce73200640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fce6c107ca0 0x7fce6c1a8160 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce73200640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fce6c0550c0 0x7fce6c1a5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.668+0000 7fce73200640 1 --2- 172.21.15.69:0/2460974623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fce6c04f190 0x7fce6c103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.669+0000 7fce73200640 1 -- 172.21.15.69:0/2460974623 >> 172.21.15.69:0/2460974623 conn(0x7fce6c052de0 msgr2=0x7fce6c0056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:49.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.669+0000 7fce73200640 1 -- 172.21.15.69:0/2460974623 shutdown_connections 2024-02-21T07:44:49.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.669+0000 7fce73200640 1 -- 172.21.15.69:0/2460974623 wait complete. 2024-02-21T07:44:49.689 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:44:49.689 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:44:49.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.874+0000 7ff291600640 1 Processor -- start 2024-02-21T07:44:49.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.874+0000 7ff291600640 1 -- start start 2024-02-21T07:44:49.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.876+0000 7ff291600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff28c183d30 0x7ff28c185b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.876+0000 7ff291600640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7ff28c186060 0x7ff28c0cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.876+0000 7ff291600640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c0f5640 con 0x7ff28c183000 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.876+0000 7ff291600640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c1833e0 con 0x7ff28c183d30 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.876+0000 7ff291600640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c0f62a0 con 0x7ff28c186060 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.876+0000 7ff28aa00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ff28c183000 0x7ff28c183620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:51096/0 (socket says 172.21.15.69:51096) 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.876+0000 7ff28aa00640 1 -- 172.21.15.69:0/276903805 learned_addr learned my addr 172.21.15.69:0/276903805 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.876+0000 7ff28b400640 1 --2- 172.21.15.69:0/276903805 >> v2:172.21.15.184:3300/0 conn(0x7ff28c186060 0x7ff28c0cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.877+0000 7ff28a000640 1 --2- 172.21.15.69:0/276903805 >> v2:172.21.15.69:3300/0 conn(0x7ff28c183d30 0x7ff28c185b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.877+0000 7ff289600640 1 -- 172.21.15.69:0/276903805 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474347900 0 0) 0x7ff28c0f5640 con 0x7ff28c183000 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.877+0000 7ff289600640 1 -- 172.21.15.69:0/276903805 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff270003520 con 0x7ff28c183000 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.877+0000 7ff28b400640 1 -- 172.21.15.69:0/276903805 >> v2:172.21.15.69:3300/0 conn(0x7ff28c183d30 msgr2=0x7ff28c185b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.877+0000 7ff28b400640 1 --2- 172.21.15.69:0/276903805 >> v2:172.21.15.69:3300/0 conn(0x7ff28c183d30 0x7ff28c185b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.877+0000 7ff28b400640 1 -- 172.21.15.69:0/276903805 >> v1:172.21.15.184:6789/0 conn(0x7ff28c183000 legacy=0x7ff28c183620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.877+0000 7ff28b400640 1 -- 172.21.15.69:0/276903805 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c06dcd0 con 0x7ff28c186060 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.878+0000 7ff28b400640 1 --2- 172.21.15.69:0/276903805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c186060 0x7ff28c0cf790 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0d2a90 tx=0x7ff28402bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fefe9c41ff99320 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.878+0000 7ff289600640 1 -- 172.21.15.69:0/276903805 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28402cb60 con 0x7ff28c186060 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.878+0000 7ff289600640 1 -- 172.21.15.69:0/276903805 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28402ccc0 con 0x7ff28c186060 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.878+0000 7ff289600640 1 -- 172.21.15.69:0/276903805 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284034660 con 0x7ff28c186060 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.879+0000 7ff291600640 1 -- 172.21.15.69:0/276903805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c186060 msgr2=0x7ff28c0cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.879+0000 7ff291600640 1 --2- 172.21.15.69:0/276903805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c186060 0x7ff28c0cf790 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0d2a90 tx=0x7ff28402bdb0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.879+0000 7ff291600640 1 -- 172.21.15.69:0/276903805 shutdown_connections 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.879+0000 7ff291600640 1 --2- 172.21.15.69:0/276903805 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c186060 0x7ff28c0cf790 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.879+0000 7ff291600640 1 --2- 172.21.15.69:0/276903805 >> v2:172.21.15.69:3300/0 conn(0x7ff28c183d30 0x7ff28c185b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.879+0000 7ff291600640 1 -- 172.21.15.69:0/276903805 >> 172.21.15.69:0/276903805 conn(0x7ff28c0f69c0 msgr2=0x7ff28c0f6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:49.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.879+0000 7ff291600640 1 -- 172.21.15.69:0/276903805 shutdown_connections 2024-02-21T07:44:49.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.879+0000 7ff291600640 1 -- 172.21.15.69:0/276903805 wait complete. 2024-02-21T07:44:49.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.881+0000 7ff291600640 1 Processor -- start 2024-02-21T07:44:49.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.881+0000 7ff291600640 1 -- start start 2024-02-21T07:44:49.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.882+0000 7ff291600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c183000 0x7ff28c220000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.882+0000 7ff291600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28c183d30 0x7ff28c06ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.882+0000 7ff291600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff28c186060 0x7ff28c175810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.882+0000 7ff291600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c180ce0 con 0x7ff28c183d30 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.882+0000 7ff291600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c1806b0 con 0x7ff28c186060 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.882+0000 7ff291600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c06b180 con 0x7ff28c183000 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.882+0000 7ff28a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28c183d30 0x7ff28c06ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff28a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28c183d30 0x7ff28c06ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39570/0 (socket says 172.21.15.69:39570) 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff28a000640 1 -- 172.21.15.69:0/329066518 learned_addr learned my addr 172.21.15.69:0/329066518 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff28aa00640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c183000 0x7ff28c220000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff28b400640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff28c186060 0x7ff28c175810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff28a000640 1 -- 172.21.15.69:0/329066518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c183000 msgr2=0x7ff28c220000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff28a000640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c183000 0x7ff28c220000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff28a000640 1 -- 172.21.15.69:0/329066518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff28c186060 msgr2=0x7ff28c175810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff28a000640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff28c186060 0x7ff28c175810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff28a000640 1 -- 172.21.15.69:0/329066518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff284009a70 con 0x7ff28c183d30 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff28a000640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28c183d30 0x7ff28c06ab20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff27800e870 tx=0x7ff27800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff282a00640 1 -- 172.21.15.69:0/329066518 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780094f0 con 0x7ff28c183d30 2024-02-21T07:44:49.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff282a00640 1 -- 172.21.15.69:0/329066518 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800c940 con 0x7ff28c183d30 2024-02-21T07:44:49.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff291600640 1 -- 172.21.15.69:0/329066518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c06b460 con 0x7ff28c183d30 2024-02-21T07:44:49.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.883+0000 7ff282a00640 1 -- 172.21.15.69:0/329066518 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800ccf0 con 0x7ff28c183d30 2024-02-21T07:44:49.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.884+0000 7ff291600640 1 -- 172.21.15.69:0/329066518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c06ba20 con 0x7ff28c183d30 2024-02-21T07:44:49.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.885+0000 7ff291600640 1 -- 172.21.15.69:0/329066518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c180e20 con 0x7ff28c183d30 2024-02-21T07:44:49.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.887+0000 7ff282a00640 1 -- 172.21.15.69:0/329066518 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7ff278013470 con 0x7ff28c183d30 2024-02-21T07:44:49.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.888+0000 7ff282a00640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff26c09f0a0 0x7ff26c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:49.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.888+0000 7ff282a00640 1 -- 172.21.15.69:0/329066518 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7ff2780c9b70 con 0x7ff28c183d30 2024-02-21T07:44:49.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.888+0000 7ff28aa00640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff26c09f0a0 0x7ff26c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:49.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.889+0000 7ff28aa00640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff26c09f0a0 0x7ff26c0a1560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0011e0 tx=0x7ff27c007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:49.892+0000 7ff282a00640 1 -- 172.21.15.69:0/329066518 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff2780939a0 con 0x7ff28c183d30 2024-02-21T07:44:50.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.108+0000 7ff291600640 1 -- 172.21.15.69:0/329066518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff28c069d50 con 0x7ff28c183d30 2024-02-21T07:44:50.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.109+0000 7ff282a00640 1 -- 172.21.15.69:0/329066518 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+11380 (secure 0 0 0) 0x7ff278097060 con 0x7ff28c183d30 2024-02-21T07:44:50.116 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:44:50.116 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:44:45.674311+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":11,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:44:50.116 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 22 2024-02-21T07:44:50.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 -- 172.21.15.69:0/329066518 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff26c09f0a0 msgr2=0x7ff26c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff26c09f0a0 0x7ff26c0a1560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff27c0011e0 tx=0x7ff27c007d30 comp rx=0 tx=0).stop 2024-02-21T07:44:50.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 -- 172.21.15.69:0/329066518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28c183d30 msgr2=0x7ff28c06ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28c183d30 0x7ff28c06ab20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff27800e870 tx=0x7ff27800ed30 comp rx=0 tx=0).stop 2024-02-21T07:44:50.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 -- 172.21.15.69:0/329066518 shutdown_connections 2024-02-21T07:44:50.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7ff26c09f0a0 0x7ff26c0a1560 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7ff28c186060 0x7ff28c175810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28c183d30 0x7ff28c06ab20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 --2- 172.21.15.69:0/329066518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff28c183000 0x7ff28c220000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 -- 172.21.15.69:0/329066518 >> 172.21.15.69:0/329066518 conn(0x7ff28c0f69c0 msgr2=0x7ff28c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 -- 172.21.15.69:0/329066518 shutdown_connections 2024-02-21T07:44:50.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.112+0000 7ff291600640 1 -- 172.21.15.69:0/329066518 wait complete. 2024-02-21T07:44:50.135 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:44:50.135 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-02-21T07:44:50.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.337+0000 7f2ec1600640 1 Processor -- start 2024-02-21T07:44:50.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.337+0000 7f2ec1600640 1 -- start start 2024-02-21T07:44:50.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ec1600640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ebc182720 0x7f2ebc0f4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ec1600640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2ebc1875c0 0x7f2ebc1607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ec1600640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ebc0f5420 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ec1600640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc1867b0 con 0x7f2ebc1875c0 2024-02-21T07:44:50.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ec1600640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ebc1897f0 con 0x7f2ebc182720 2024-02-21T07:44:50.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ebbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ebc182720 0x7f2ebc0f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ec0c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2ebc1875c0 0x7f2ebc1607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ebbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2ebc182720 0x7f2ebc0f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:37842/0 (socket says 172.21.15.69:37842) 2024-02-21T07:44:50.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ebbe00640 1 -- 172.21.15.69:0/3304895012 learned_addr learned my addr 172.21.15.69:0/3304895012 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ec0c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2ebc1875c0 0x7f2ebc1607b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39580/0 (socket says 172.21.15.69:39580) 2024-02-21T07:44:50.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.339+0000 7f2ebb400640 1 --1- 172.21.15.69:0/3304895012 >> v1:172.21.15.184:6789/0 conn(0x7f2ebc0f4b80 0x7f2ebc186eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:51108/0 (socket says 172.21.15.69:51108) 2024-02-21T07:44:50.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.340+0000 7f2ebaa00640 1 -- 172.21.15.69:0/3304895012 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650096803 0 0) 0x7f2ebc0f5420 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.340+0000 7f2ebaa00640 1 -- 172.21.15.69:0/3304895012 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ea0003520 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.340+0000 7f2ebbe00640 1 -- 172.21.15.69:0/3304895012 >> v2:172.21.15.69:3300/0 conn(0x7f2ebc1875c0 msgr2=0x7f2ebc1607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.340+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/3304895012 >> v2:172.21.15.69:3300/0 conn(0x7f2ebc1875c0 0x7f2ebc1607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.340+0000 7f2ebbe00640 1 -- 172.21.15.69:0/3304895012 >> v1:172.21.15.184:6789/0 conn(0x7f2ebc0f4b80 legacy=0x7f2ebc186eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.340+0000 7f2ebbe00640 1 -- 172.21.15.69:0/3304895012 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc0f5700 con 0x7f2ebc182720 2024-02-21T07:44:50.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.340+0000 7f2ec0c00640 1 --2- 172.21.15.69:0/3304895012 >> v2:172.21.15.69:3300/0 conn(0x7f2ebc1875c0 0x7f2ebc1607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:50.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.342+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/3304895012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ebc182720 0x7f2ebc0f4640 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0fad50 tx=0x7f2eac02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f54f2e2ced882dc5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.342+0000 7f2ebaa00640 1 -- 172.21.15.69:0/3304895012 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac030860 con 0x7f2ebc182720 2024-02-21T07:44:50.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.342+0000 7f2ebaa00640 1 -- 172.21.15.69:0/3304895012 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0309c0 con 0x7f2ebc182720 2024-02-21T07:44:50.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.342+0000 7f2ebaa00640 1 -- 172.21.15.69:0/3304895012 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac030d50 con 0x7f2ebc182720 2024-02-21T07:44:50.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.342+0000 7f2ec1600640 1 -- 172.21.15.69:0/3304895012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ebc182720 msgr2=0x7f2ebc0f4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.342+0000 7f2ec1600640 1 --2- 172.21.15.69:0/3304895012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ebc182720 0x7f2ebc0f4640 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0fad50 tx=0x7f2eac02b9a0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.343+0000 7f2ec1600640 1 -- 172.21.15.69:0/3304895012 shutdown_connections 2024-02-21T07:44:50.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.343+0000 7f2ec1600640 1 --2- 172.21.15.69:0/3304895012 >> v2:172.21.15.69:3300/0 conn(0x7f2ebc1875c0 0x7f2ebc1607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.343+0000 7f2ec1600640 1 --2- 172.21.15.69:0/3304895012 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ebc182720 0x7f2ebc0f4640 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.343+0000 7f2ec1600640 1 -- 172.21.15.69:0/3304895012 >> 172.21.15.69:0/3304895012 conn(0x7f2ebc0ce190 msgr2=0x7f2ebc0ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.343+0000 7f2ec1600640 1 -- 172.21.15.69:0/3304895012 shutdown_connections 2024-02-21T07:44:50.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.343+0000 7f2ec1600640 1 -- 172.21.15.69:0/3304895012 wait complete. 2024-02-21T07:44:50.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.345+0000 7f2ec1600640 1 Processor -- start 2024-02-21T07:44:50.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.345+0000 7f2ec1600640 1 -- start start 2024-02-21T07:44:50.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ec1600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0f4b80 0x7f2ebc17c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ec1600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ebc182720 0x7f2ebc1781d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ec1600640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ebc1875c0 0x7f2ebc21caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ec1600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc2215b0 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ec1600640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc220d10 con 0x7f2ebc1875c0 2024-02-21T07:44:50.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ec1600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc220ff0 con 0x7f2ebc182720 2024-02-21T07:44:50.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ebbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0f4b80 0x7f2ebc17c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ebbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0f4b80 0x7f2ebc17c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39594/0 (socket says 172.21.15.69:39594) 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ebbe00640 1 -- 172.21.15.69:0/2257777679 learned_addr learned my addr 172.21.15.69:0/2257777679 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ec0c00640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ebc1875c0 0x7f2ebc21caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.346+0000 7f2ebb400640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ebc182720 0x7f2ebc1781d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.347+0000 7f2ebbe00640 1 -- 172.21.15.69:0/2257777679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ebc182720 msgr2=0x7f2ebc1781d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.347+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ebc182720 0x7f2ebc1781d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.347+0000 7f2ebbe00640 1 -- 172.21.15.69:0/2257777679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ebc1875c0 msgr2=0x7f2ebc21caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.347+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ebc1875c0 0x7f2ebc21caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.347+0000 7f2ebbe00640 1 -- 172.21.15.69:0/2257777679 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb4009a70 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.347+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0f4b80 0x7f2ebc17c6f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2eac02b9e0 tx=0x7f2eac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.347+0000 7f2eb3e00640 1 -- 172.21.15.69:0/2257777679 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac039c90 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.347+0000 7f2eb3e00640 1 -- 172.21.15.69:0/2257777679 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac039df0 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.347+0000 7f2ec1600640 1 -- 172.21.15.69:0/2257777679 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac0094d0 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.347+0000 7f2eb3e00640 1 -- 172.21.15.69:0/2257777679 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac043640 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.348+0000 7f2ec1600640 1 -- 172.21.15.69:0/2257777679 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc21c2f0 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.350+0000 7f2eb3e00640 1 -- 172.21.15.69:0/2257777679 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2eac0437a0 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.351+0000 7f2eb3e00640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2e9809f0a0 0x7f2e980a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.352+0000 7f2eb3e00640 1 -- 172.21.15.69:0/2257777679 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2eac03e070 con 0x7f2ebc0f4b80 2024-02-21T07:44:50.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.352+0000 7f2ec59bb740 1 Processor -- start 2024-02-21T07:44:50.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.352+0000 7f2ec59bb740 1 -- start start 2024-02-21T07:44:50.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.352+0000 7f2ebb400640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2e9809f0a0 0x7f2e980a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.352+0000 7f2ebb400640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2e9809f0a0 0x7f2e980a1560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc181930 tx=0x7f2ea4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932070 0x565525932450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 0x56552596d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552596d740 0x56552596e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x565525865210 con 0x56552596d740 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x565525862740 con 0x565525932990 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56552585df20 con 0x565525932070 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ebb400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 0x56552596d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ec0c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552596d740 0x56552596e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ec0c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552596d740 0x56552596e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39598/0 (socket says 172.21.15.69:39598) 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ec0c00640 1 -- 172.21.15.69:0/1768256454 learned_addr learned my addr 172.21.15.69:0/1768256454 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ebb400640 1 --2- 172.21.15.69:0/1768256454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 0x56552596d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:37868/0 (socket says 172.21.15.69:37868) 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.353+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/1768256454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932070 0x565525932450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.354+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1768256454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 msgr2=0x56552596d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.354+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/1768256454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 0x56552596d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.354+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1768256454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552596d740 msgr2=0x56552596e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.354+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/1768256454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552596d740 0x56552596e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.354+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1768256454 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56552581fdf0 con 0x565525932070 2024-02-21T07:44:50.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.354+0000 7f2ec0c00640 1 --2- 172.21.15.69:0/1768256454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552596d740 0x56552596e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:50.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.354+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/1768256454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932070 0x565525932450 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ea5c0 tx=0x7f2eac0d7f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4c71ea2a63ec918 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.354+0000 7f2eabe00640 1 -- 172.21.15.69:0/1768256454 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0bae30 con 0x565525932070 2024-02-21T07:44:50.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.354+0000 7f2eabe00640 1 -- 172.21.15.69:0/1768256454 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ba730 con 0x565525932070 2024-02-21T07:44:50.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.354+0000 7f2eabe00640 1 -- 172.21.15.69:0/1768256454 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0be880 con 0x565525932070 2024-02-21T07:44:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.355+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1768256454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932070 msgr2=0x565525932450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.355+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1768256454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932070 0x565525932450 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ea5c0 tx=0x7f2eac0d7f90 comp rx=0 tx=0).stop 2024-02-21T07:44:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.355+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1768256454 shutdown_connections 2024-02-21T07:44:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.355+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1768256454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552596d740 0x56552596e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.355+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1768256454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 0x56552596d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.355+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1768256454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932070 0x565525932450 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.355+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1768256454 >> 172.21.15.69:0/1768256454 conn(0x5655258f4640 msgr2=0x5655258f56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.355+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1768256454 shutdown_connections 2024-02-21T07:44:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.355+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1768256454 wait complete. 2024-02-21T07:44:50.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.356+0000 7f2ec59bb740 1 -- start start 2024-02-21T07:44:50.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.356+0000 7f2ec59bb740 1 Processor -- start 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565525932990 0x5655259793c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56552596d740 0x5655259778e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56552591fe10 0x5655258f2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x565525803150 con 0x565525932990 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x565525802df0 con 0x56552596d740 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655255cc1c0 con 0x56552591fe10 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ec59bb740 10 client.0 _ll_register_callbacks cb 0x5655258522b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ebbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565525932990 0x5655259793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ebbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565525932990 0x5655259793c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39602/0 (socket says 172.21.15.69:39602) 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ebbe00640 1 -- 172.21.15.69:0/2966321281 learned_addr learned my addr 172.21.15.69:0/2966321281 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.357+0000 7f2ebb400640 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56552596d740 0x5655259778e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ec0c00640 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56552591fe10 0x5655258f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ebbe00640 1 -- 172.21.15.69:0/2966321281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56552591fe10 msgr2=0x5655258f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56552591fe10 0x5655258f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ebbe00640 1 -- 172.21.15.69:0/2966321281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56552596d740 msgr2=0x5655259778e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56552596d740 0x5655259778e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ebbe00640 1 -- 172.21.15.69:0/2966321281 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ebc21c2f0 con 0x565525932990 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565525932990 0x5655259793c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ba430 tx=0x7f2eac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a125f81682efec7e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ea8c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ea8c00640 1 -- 172.21.15.69:0/2966321281 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0a52e0 con 0x565525932990 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ea8c00640 1 -- 172.21.15.69:0/2966321281 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2eac0bae30 con 0x565525932990 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ec59bb740 1 -- 172.21.15.69:0/2966321281 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56552555d7e0 con 0x565525932990 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ea8c00640 1 -- 172.21.15.69:0/2966321281 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eac0c2ed0 con 0x565525932990 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ec59bb740 10 client.5637 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.358+0000 7f2ec59bb740 1 -- 172.21.15.69:0/2966321281 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x56552585c5a0 con 0x565525932990 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.359+0000 7f2ea8c00640 1 -- 172.21.15.69:0/2966321281 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56552555d7e0 con 0x565525932990 2024-02-21T07:44:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.359+0000 7f2ea8c00640 1 -- 172.21.15.69:0/2966321281 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f2eac0d2070 con 0x565525932990 2024-02-21T07:44:50.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.359+0000 7f2ec59bb740 10 client.5637 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:50.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.359+0000 7f2ec59bb740 10 client.5637 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.b 2024-02-21T07:44:50.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.359+0000 7f2ec59bb740 20 client.5637 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:50.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.359+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x56552592fd50 0x5655258f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.359+0000 7f2ec59bb740 4 client.5637 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:50.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.359+0000 7f2ec59bb740 1 -- 172.21.15.69:0/2966321281 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56552559a720 con 0x56552592fd50 2024-02-21T07:44:50.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.359+0000 7f2ebb400640 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x56552592fd50 0x5655258f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.360+0000 7f2ebb400640 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x56552592fd50 0x5655258f2ba0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=523d8e8545bb1fc server_cookie=66d95f52769e7717 in_seq=0 out_seq=0 2024-02-21T07:44:50.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.360+0000 7f2ea8c00640 10 client.5637 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:44:50.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ea8c00640 1 -- 172.21.15.69:0/2966321281 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56552559a720 con 0x56552592fd50 2024-02-21T07:44:50.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ea8c00640 10 client.5637 handle_command_reply: tid=0 2024-02-21T07:44:50.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 client.5637 shutdown 2024-02-21T07:44:50.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 -- 172.21.15.69:0/2966321281 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565525932990 msgr2=0x5655259793c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565525932990 0x5655259793c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ba430 tx=0x7f2eac0046c0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 -- 172.21.15.69:0/2966321281 shutdown_connections 2024-02-21T07:44:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x56552592fd50 0x5655258f2ba0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56552591fe10 0x5655258f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56552596d740 0x5655259778e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/2966321281 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x565525932990 0x5655259793c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 -- 172.21.15.69:0/2966321281 >> 172.21.15.69:0/2966321281 conn(0x565525932070 msgr2=0x5655258f60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ea8c00640 0 client.5637 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:44:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 -- 172.21.15.69:0/2966321281 shutdown_connections 2024-02-21T07:44:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 1 -- 172.21.15.69:0/2966321281 wait complete. 2024-02-21T07:44:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.361+0000 7f2ec59bb740 20 client.5637 trim_cache size 0 max 16384 2024-02-21T07:44:50.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.374+0000 7f2ec59bb740 1 Processor -- start 2024-02-21T07:44:50.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.374+0000 7f2ec59bb740 1 -- start start 2024-02-21T07:44:50.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655258efea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932990 0x565525919700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56552596d740 0x5655259c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655258ec680 con 0x56552591fe10 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655258f10f0 con 0x56552596d740 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655258f03e0 con 0x565525932990 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ebbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655258efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ebbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655258efea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39610/0 (socket says 172.21.15.69:39610) 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1568429203 learned_addr learned my addr 172.21.15.69:0/1568429203 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ec0c00640 1 --2- 172.21.15.69:0/1568429203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56552596d740 0x5655259c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.375+0000 7f2ebb400640 1 --2- 172.21.15.69:0/1568429203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932990 0x565525919700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.376+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1568429203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932990 msgr2=0x565525919700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.376+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/1568429203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932990 0x565525919700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.376+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1568429203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56552596d740 msgr2=0x5655259c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.376+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/1568429203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56552596d740 0x5655259c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.376+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1568429203 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5655257f8ab0 con 0x56552591fe10 2024-02-21T07:44:50.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.376+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/1568429203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655258efea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0c29a0 tx=0x7f2eac045070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d8552f3a214bdc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.376+0000 7f2eab400640 1 -- 172.21.15.69:0/1568429203 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0c2ed0 con 0x56552591fe10 2024-02-21T07:44:50.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.376+0000 7f2eab400640 1 -- 172.21.15.69:0/1568429203 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0a52e0 con 0x56552591fe10 2024-02-21T07:44:50.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.376+0000 7f2eab400640 1 -- 172.21.15.69:0/1568429203 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0b9d80 con 0x56552591fe10 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.377+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1568429203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 msgr2=0x5655258efea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.377+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1568429203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655258efea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0c29a0 tx=0x7f2eac045070 comp rx=0 tx=0).stop 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.377+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1568429203 shutdown_connections 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.377+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1568429203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56552596d740 0x5655259c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.377+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1568429203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x565525932990 0x565525919700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.377+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1568429203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655258efea0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.377+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1568429203 >> 172.21.15.69:0/1568429203 conn(0x565525932070 msgr2=0x5655258f60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.377+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1568429203 shutdown_connections 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.377+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1568429203 wait complete. 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.377+0000 7f2ec59bb740 1 -- start start 2024-02-21T07:44:50.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.378+0000 7f2ec59bb740 1 Processor -- start 2024-02-21T07:44:50.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655259d4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 0x56552596c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ec59bb740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56552596d740 0x56552596be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655259d0970 con 0x56552591fe10 2024-02-21T07:44:50.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655259d47d0 con 0x565525932990 2024-02-21T07:44:50.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ec59bb740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655259d4ca0 con 0x56552596d740 2024-02-21T07:44:50.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ec59bb740 10 client.0 _ll_register_callbacks cb 0x7f2eac006cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:50.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ebbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655259d4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ebbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655259d4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39612/0 (socket says 172.21.15.69:39612) 2024-02-21T07:44:50.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1635745883 learned_addr learned my addr 172.21.15.69:0/1635745883 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ec0c00640 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56552596d740 0x56552596be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ebb400640 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 0x56552596c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1635745883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56552596d740 msgr2=0x56552596be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56552596d740 0x56552596be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1635745883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 msgr2=0x56552596c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 0x56552596c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.379+0000 7f2ebbe00640 1 -- 172.21.15.69:0/1635745883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56552585c5a0 con 0x56552591fe10 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ebbe00640 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655259d4290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ea5f0 tx=0x7f2eac0d9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d983ef7be3b31d73 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ea8c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ea8c00640 1 -- 172.21.15.69:0/1635745883 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0ba090 con 0x56552591fe10 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ea8c00640 1 -- 172.21.15.69:0/1635745883 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2eac0e5080 con 0x56552591fe10 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1635745883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2eac0ba730 con 0x56552591fe10 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ea8c00640 1 -- 172.21.15.69:0/1635745883 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eac0bae30 con 0x56552591fe10 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ec59bb740 10 client.5643 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1635745883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x56552581e650 con 0x56552591fe10 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ea8c00640 1 -- 172.21.15.69:0/1635745883 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ba730 con 0x56552591fe10 2024-02-21T07:44:50.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ea8c00640 1 -- 172.21.15.69:0/1635745883 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f2eac0ea020 con 0x56552591fe10 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ec59bb740 10 client.5643 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ec59bb740 10 client.5643 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.b 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.380+0000 7f2ec59bb740 20 client.5643 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.381+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x565525932450 0x5655259c0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.381+0000 7f2ec59bb740 4 client.5643 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.381+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1635745883 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5655255e9890 con 0x565525932450 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.381+0000 7f2ebb400640 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x565525932450 0x5655259c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.381+0000 7f2ebb400640 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x565525932450 0x5655259c0200 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7334d5f056c1a770 server_cookie=8dc8883199ab0fc9 in_seq=0 out_seq=0 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.381+0000 7f2ea8c00640 10 client.5643 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.381+0000 7f2ea8c00640 1 -- 172.21.15.69:0/1635745883 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5655255e9890 con 0x565525932450 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.381+0000 7f2ea8c00640 10 client.5643 handle_command_reply: tid=0 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.381+0000 7f2ec59bb740 1 client.5643 shutdown 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1635745883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 msgr2=0x5655259d4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655259d4290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ea5f0 tx=0x7f2eac0d9040 comp rx=0 tx=0).stop 2024-02-21T07:44:50.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1635745883 shutdown_connections 2024-02-21T07:44:50.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x565525932450 0x5655259c0200 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56552596d740 0x56552596be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x565525932990 0x56552596c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ea8c00640 0 client.5643 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:44:50.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 1 --2- 172.21.15.69:0/1635745883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56552591fe10 0x5655259d4290 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1635745883 >> 172.21.15.69:0/1635745883 conn(0x565525932070 msgr2=0x5655258efe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1635745883 shutdown_connections 2024-02-21T07:44:50.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 1 -- 172.21.15.69:0/1635745883 wait complete. 2024-02-21T07:44:50.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec59bb740 20 client.5643 trim_cache size 0 max 16384 2024-02-21T07:44:50.394 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:44:50.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec1600640 1 -- 172.21.15.69:0/2257777679 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2e9809f0a0 msgr2=0x7f2e980a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec1600640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2e9809f0a0 0x7f2e980a1560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc181930 tx=0x7f2ea4007d30 comp rx=0 tx=0).stop 2024-02-21T07:44:50.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec1600640 1 -- 172.21.15.69:0/2257777679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0f4b80 msgr2=0x7f2ebc17c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.382+0000 7f2ec1600640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0f4b80 0x7f2ebc17c6f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2eac02b9e0 tx=0x7f2eac004730 comp rx=0 tx=0).stop 2024-02-21T07:44:50.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.383+0000 7f2ec1600640 1 -- 172.21.15.69:0/2257777679 shutdown_connections 2024-02-21T07:44:50.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.383+0000 7f2ec1600640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f2e9809f0a0 0x7f2e980a1560 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.383+0000 7f2ec1600640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f2ebc1875c0 0x7f2ebc21caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.383+0000 7f2ec1600640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ebc182720 0x7f2ebc1781d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.383+0000 7f2ec1600640 1 --2- 172.21.15.69:0/2257777679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ebc0f4b80 0x7f2ebc17c6f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.383+0000 7f2ec1600640 1 -- 172.21.15.69:0/2257777679 >> 172.21.15.69:0/2257777679 conn(0x7f2ebc0ce190 msgr2=0x7f2ebc188560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.383+0000 7f2ec1600640 1 -- 172.21.15.69:0/2257777679 shutdown_connections 2024-02-21T07:44:50.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.383+0000 7f2ec1600640 1 -- 172.21.15.69:0/2257777679 wait complete. 2024-02-21T07:44:50.403 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:44:50.403 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-02-21T07:44:50.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.606+0000 7f63db200640 1 Processor -- start 2024-02-21T07:44:50.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.606+0000 7f63db200640 1 -- start start 2024-02-21T07:44:50.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.610+0000 7f63db200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f63dc1861e0 0x7f63dc0cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.610+0000 7f63db200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f63dc0cf230 0x7f63dc1878d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.610+0000 7f63db200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63dc0fef90 con 0x7f63dc187e10 2024-02-21T07:44:50.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.610+0000 7f63db200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc1874b0 con 0x7f63dc1861e0 2024-02-21T07:44:50.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.610+0000 7f63db200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc1865c0 con 0x7f63dc0cf230 2024-02-21T07:44:50.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.610+0000 7f63d9e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f63dc1861e0 0x7f63dc0cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.610+0000 7f63d9e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f63dc1861e0 0x7f63dc0cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:37898/0 (socket says 172.21.15.69:37898) 2024-02-21T07:44:50.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.610+0000 7f63d9e00640 1 -- 172.21.15.69:0/1873865570 learned_addr learned my addr 172.21.15.69:0/1873865570 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.610+0000 7f63d9400640 1 --2- 172.21.15.69:0/1873865570 >> v2:172.21.15.184:3300/0 conn(0x7f63dc0cf230 0x7f63dc1878d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.611+0000 7f63d8a00640 1 -- 172.21.15.69:0/1873865570 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745433453 0 0) 0x7f63dc0fef90 con 0x7f63dc187e10 2024-02-21T07:44:50.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.611+0000 7f63d8a00640 1 -- 172.21.15.69:0/1873865570 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63c0003520 con 0x7f63dc187e10 2024-02-21T07:44:50.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.611+0000 7f63d9400640 1 -- 172.21.15.69:0/1873865570 >> v2:172.21.15.174:3300/0 conn(0x7f63dc1861e0 msgr2=0x7f63dc0cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.611+0000 7f63d9400640 1 --2- 172.21.15.69:0/1873865570 >> v2:172.21.15.174:3300/0 conn(0x7f63dc1861e0 0x7f63dc0cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.611+0000 7f63d9400640 1 -- 172.21.15.69:0/1873865570 >> v1:172.21.15.184:6789/0 conn(0x7f63dc187e10 legacy=0x7f63dc0fdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.611+0000 7f63d9400640 1 -- 172.21.15.69:0/1873865570 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc1898d0 con 0x7f63dc0cf230 2024-02-21T07:44:50.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.611+0000 7f63d9e00640 1 --2- 172.21.15.69:0/1873865570 >> v2:172.21.15.174:3300/0 conn(0x7f63dc1861e0 0x7f63dc0cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:50.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.612+0000 7f63d9400640 1 --2- 172.21.15.69:0/1873865570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc0cf230 0x7f63dc1878d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0fcff0 tx=0x7f63c802b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d416ee010bba0c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.613+0000 7f63d8a00640 1 -- 172.21.15.69:0/1873865570 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8031710 con 0x7f63dc0cf230 2024-02-21T07:44:50.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.613+0000 7f63d8a00640 1 -- 172.21.15.69:0/1873865570 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c802f050 con 0x7f63dc0cf230 2024-02-21T07:44:50.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.613+0000 7f63d8a00640 1 -- 172.21.15.69:0/1873865570 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8031a90 con 0x7f63dc0cf230 2024-02-21T07:44:50.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.614+0000 7f63db200640 1 -- 172.21.15.69:0/1873865570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc0cf230 msgr2=0x7f63dc1878d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.614+0000 7f63db200640 1 --2- 172.21.15.69:0/1873865570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc0cf230 0x7f63dc1878d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f63dc0fcff0 tx=0x7f63c802b7b0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.614+0000 7f63db200640 1 -- 172.21.15.69:0/1873865570 shutdown_connections 2024-02-21T07:44:50.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.614+0000 7f63db200640 1 --2- 172.21.15.69:0/1873865570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc0cf230 0x7f63dc1878d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.614+0000 7f63db200640 1 --2- 172.21.15.69:0/1873865570 >> v2:172.21.15.174:3300/0 conn(0x7f63dc1861e0 0x7f63dc0cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.614+0000 7f63db200640 1 -- 172.21.15.69:0/1873865570 >> 172.21.15.69:0/1873865570 conn(0x7f63dc0d2be0 msgr2=0x7f63dc0d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.614+0000 7f63db200640 1 -- 172.21.15.69:0/1873865570 shutdown_connections 2024-02-21T07:44:50.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.614+0000 7f63db200640 1 -- 172.21.15.69:0/1873865570 wait complete. 2024-02-21T07:44:50.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.617+0000 7f63db200640 1 Processor -- start 2024-02-21T07:44:50.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.617+0000 7f63db200640 1 -- start start 2024-02-21T07:44:50.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63db200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63dc0cf230 0x7f63dc223370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63db200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc1861e0 0x7f63dc17a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63db200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63dc187e10 0x7f63dc17ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63db200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc179420 con 0x7f63dc187e10 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63db200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc179700 con 0x7f63dc0cf230 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63db200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc1799e0 con 0x7f63dc1861e0 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63d9e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63dc0cf230 0x7f63dc223370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63d9e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63dc0cf230 0x7f63dc223370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:37904/0 (socket says 172.21.15.69:37904) 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63da800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63dc187e10 0x7f63dc17ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63d9e00640 1 -- 172.21.15.69:0/1080643027 learned_addr learned my addr 172.21.15.69:0/1080643027 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.619+0000 7f63d9400640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc1861e0 0x7f63dc17a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.620+0000 7f63d9e00640 1 -- 172.21.15.69:0/1080643027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc1861e0 msgr2=0x7f63dc17a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.620+0000 7f63d9e00640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc1861e0 0x7f63dc17a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.620+0000 7f63d9e00640 1 -- 172.21.15.69:0/1080643027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63dc187e10 msgr2=0x7f63dc17ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.620+0000 7f63d9e00640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63dc187e10 0x7f63dc17ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.620+0000 7f63d9e00640 1 -- 172.21.15.69:0/1080643027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc0094d0 con 0x7f63dc0cf230 2024-02-21T07:44:50.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.620+0000 7f63d9e00640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63dc0cf230 0x7f63dc223370 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00e9b0 tx=0x7f63cc00ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.620+0000 7f63d2000640 1 -- 172.21.15.69:0/1080643027 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00c9a0 con 0x7f63dc0cf230 2024-02-21T07:44:50.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.620+0000 7f63d2000640 1 -- 172.21.15.69:0/1080643027 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc00cb00 con 0x7f63dc0cf230 2024-02-21T07:44:50.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.620+0000 7f63d2000640 1 -- 172.21.15.69:0/1080643027 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc00ce70 con 0x7f63dc0cf230 2024-02-21T07:44:50.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.620+0000 7f63db200640 1 -- 172.21.15.69:0/1080643027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c8009400 con 0x7f63dc0cf230 2024-02-21T07:44:50.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.621+0000 7f63db200640 1 -- 172.21.15.69:0/1080643027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc179fa0 con 0x7f63dc0cf230 2024-02-21T07:44:50.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.624+0000 7f63d2000640 1 -- 172.21.15.69:0/1080643027 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f63cc013470 con 0x7f63dc0cf230 2024-02-21T07:44:50.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.625+0000 7f63d2000640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f63bc09f0a0 0x7f63bc0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.625+0000 7f63e3e34740 1 Processor -- start 2024-02-21T07:44:50.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.625+0000 7f63d2000640 1 -- 172.21.15.69:0/1080643027 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f63cc0ca440 con 0x7f63dc0cf230 2024-02-21T07:44:50.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.625+0000 7f63e3e34740 1 -- start start 2024-02-21T07:44:50.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.625+0000 7f63d9400640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f63bc09f0a0 0x7f63bc0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.626+0000 7f63d9400640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f63bc09f0a0 0x7f63bc0a1560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f63c8035000 tx=0x7f63c8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.626+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd298070 0x55d2bd298450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.626+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 0x55d2bd2d3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.626+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd2d3740 0x55d2bd2d44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.626+0000 7f63e3e34740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd1cb210 con 0x55d2bd298990 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.626+0000 7f63e3e34740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd1c8740 con 0x55d2bd2d3740 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.626+0000 7f63e3e34740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd1c3f20 con 0x55d2bd298070 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63d9e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd298070 0x55d2bd298450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63d9400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 0x55d2bd2d3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63d9e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd298070 0x55d2bd298450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53092/0 (socket says 172.21.15.69:53092) 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63d9e00640 1 -- 172.21.15.69:0/1650236957 learned_addr learned my addr 172.21.15.69:0/1650236957 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63da800640 1 --2- 172.21.15.69:0/1650236957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd2d3740 0x55d2bd2d44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63d9e00640 1 -- 172.21.15.69:0/1650236957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd2d3740 msgr2=0x55d2bd2d44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63d9e00640 1 --2- 172.21.15.69:0/1650236957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd2d3740 0x55d2bd2d44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63d9e00640 1 -- 172.21.15.69:0/1650236957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 msgr2=0x55d2bd2d3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63d9e00640 1 --2- 172.21.15.69:0/1650236957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 0x55d2bd2d3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63d9e00640 1 -- 172.21.15.69:0/1650236957 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2bd185df0 con 0x55d2bd298070 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63d9e00640 1 --2- 172.21.15.69:0/1650236957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd298070 0x55d2bd298450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0c7d80 tx=0x7f63cc097ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d9985b25dccc62d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63c6a00640 1 -- 172.21.15.69:0/1650236957 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a0720 con 0x55d2bd298070 2024-02-21T07:44:50.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63c6a00640 1 -- 172.21.15.69:0/1650236957 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc094610 con 0x55d2bd298070 2024-02-21T07:44:50.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.627+0000 7f63c6a00640 1 -- 172.21.15.69:0/1650236957 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a0490 con 0x55d2bd298070 2024-02-21T07:44:50.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.628+0000 7f63e3e34740 1 -- 172.21.15.69:0/1650236957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd298070 msgr2=0x55d2bd298450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.628+0000 7f63e3e34740 1 --2- 172.21.15.69:0/1650236957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd298070 0x55d2bd298450 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f63cc0c7d80 tx=0x7f63cc097ac0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.628+0000 7f63e3e34740 1 -- 172.21.15.69:0/1650236957 shutdown_connections 2024-02-21T07:44:50.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.628+0000 7f63e3e34740 1 --2- 172.21.15.69:0/1650236957 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd2d3740 0x55d2bd2d44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.628+0000 7f63e3e34740 1 --2- 172.21.15.69:0/1650236957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 0x55d2bd2d3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.628+0000 7f63e3e34740 1 --2- 172.21.15.69:0/1650236957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd298070 0x55d2bd298450 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.628+0000 7f63e3e34740 1 -- 172.21.15.69:0/1650236957 >> 172.21.15.69:0/1650236957 conn(0x55d2bd25a640 msgr2=0x55d2bd25b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.628+0000 7f63e3e34740 1 -- 172.21.15.69:0/1650236957 shutdown_connections 2024-02-21T07:44:50.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.628+0000 7f63e3e34740 1 -- 172.21.15.69:0/1650236957 wait complete. 2024-02-21T07:44:50.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.629+0000 7f63e3e34740 1 -- start start 2024-02-21T07:44:50.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.629+0000 7f63e3e34740 1 Processor -- start 2024-02-21T07:44:50.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd28d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 0x55d2bd28fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2dcab0 0x55d2bd2e0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63e3e34740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd169150 con 0x55d2bd2d3740 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63e3e34740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd168df0 con 0x55d2bd298990 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63e3e34740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bcf321c0 con 0x55d2bd2dcab0 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63e3e34740 10 client.0 _ll_register_callbacks cb 0x55d2bd1b82b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63d9e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd28d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63d9400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 0x55d2bd28fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63d9e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd28d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:37924/0 (socket says 172.21.15.69:37924) 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63d9e00640 1 -- 172.21.15.69:0/554171828 learned_addr learned my addr 172.21.15.69:0/554171828 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63da800640 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2dcab0 0x55d2bd2e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63d9e00640 1 -- 172.21.15.69:0/554171828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2dcab0 msgr2=0x55d2bd2e0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63d9e00640 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2dcab0 0x55d2bd2e0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63d9e00640 1 -- 172.21.15.69:0/554171828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 msgr2=0x55d2bd28fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63d9e00640 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 0x55d2bd28fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.631+0000 7f63d9e00640 1 -- 172.21.15.69:0/554171828 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc179fa0 con 0x55d2bd298990 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.632+0000 7f63d9e00640 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd28d130 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f63cc098690 tx=0x7f63cc000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=232eae330ea5286 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.632+0000 7f63bb400640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.632+0000 7f63bb400640 1 -- 172.21.15.69:0/554171828 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc094780 con 0x55d2bd298990 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.632+0000 7f63bb400640 1 -- 172.21.15.69:0/554171828 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f63cc0a0720 con 0x55d2bd298990 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.632+0000 7f63e3e34740 1 -- 172.21.15.69:0/554171828 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2bcec37e0 con 0x55d2bd298990 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.632+0000 7f63bb400640 1 -- 172.21.15.69:0/554171828 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63cc093cf0 con 0x55d2bd298990 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.632+0000 7f63e3e34740 10 client.5827 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.633+0000 7f63e3e34740 1 -- 172.21.15.69:0/554171828 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55d2bd1c25a0 con 0x55d2bd298990 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.633+0000 7f63bb400640 1 -- 172.21.15.69:0/554171828 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2bcec37e0 con 0x55d2bd298990 2024-02-21T07:44:50.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.633+0000 7f63bb400640 1 -- 172.21.15.69:0/554171828 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f63cc09a030 con 0x55d2bd298990 2024-02-21T07:44:50.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.633+0000 7f63e3e34740 10 client.5827 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:50.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.633+0000 7f63e3e34740 10 client.5827 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.d 2024-02-21T07:44:50.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.633+0000 7f63e3e34740 20 client.5827 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:50.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.633+0000 7f63e3e34740 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d2bd2e0a30 0x55d2bd28dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.633+0000 7f63e3e34740 4 client.5827 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:50.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.633+0000 7f63e3e34740 1 -- 172.21.15.69:0/554171828 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2bcf00720 con 0x55d2bd2e0a30 2024-02-21T07:44:50.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.634+0000 7f63d9400640 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d2bd2e0a30 0x55d2bd28dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.634+0000 7f63d9400640 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d2bd2e0a30 0x55d2bd28dcd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=668e6d33870e9cd4 server_cookie=f1c0cdf88b257d72 in_seq=0 out_seq=0 2024-02-21T07:44:50.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.634+0000 7f63bb400640 10 client.5827 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:44:50.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.645+0000 7f63bb400640 1 -- 172.21.15.69:0/554171828 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d2bcf00720 con 0x55d2bd2e0a30 2024-02-21T07:44:50.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.645+0000 7f63bb400640 10 client.5827 handle_command_reply: tid=0 2024-02-21T07:44:50.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.645+0000 7f63e3e34740 1 client.5827 shutdown 2024-02-21T07:44:50.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 1 -- 172.21.15.69:0/554171828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 msgr2=0x55d2bd28d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd28d130 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f63cc098690 tx=0x7f63cc000bc0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 1 -- 172.21.15.69:0/554171828 shutdown_connections 2024-02-21T07:44:50.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d2bd2e0a30 0x55d2bd28dcd0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2dcab0 0x55d2bd2e0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 0x55d2bd28fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 1 --2- 172.21.15.69:0/554171828 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd28d130 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63bb400640 0 client.5827 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:44:50.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 1 -- 172.21.15.69:0/554171828 >> 172.21.15.69:0/554171828 conn(0x55d2bd298070 msgr2=0x55d2bd2d3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 1 -- 172.21.15.69:0/554171828 shutdown_connections 2024-02-21T07:44:50.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 1 -- 172.21.15.69:0/554171828 wait complete. 2024-02-21T07:44:50.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.646+0000 7f63e3e34740 20 client.5827 trim_cache size 0 max 16384 2024-02-21T07:44:50.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.661+0000 7f63e3e34740 1 Processor -- start 2024-02-21T07:44:50.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.661+0000 7f63e3e34740 1 -- start start 2024-02-21T07:44:50.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.662+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd261ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.662+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 0x55d2bd2c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.662+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2dcab0 0x55d2bd29de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.662+0000 7f63e3e34740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd2c8c80 con 0x55d2bd2d3740 2024-02-21T07:44:50.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.662+0000 7f63e3e34740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd2da840 con 0x55d2bd298990 2024-02-21T07:44:50.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.662+0000 7f63e3e34740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd25c630 con 0x55d2bd2dcab0 2024-02-21T07:44:50.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.662+0000 7f63d9400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 0x55d2bd2c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.662+0000 7f63d9400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 0x55d2bd2c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39636/0 (socket says 172.21.15.69:39636) 2024-02-21T07:44:50.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.662+0000 7f63d9400640 1 -- 172.21.15.69:0/2998897528 learned_addr learned my addr 172.21.15.69:0/2998897528 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.662+0000 7f63d9e00640 1 --2- 172.21.15.69:0/2998897528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd261ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.663+0000 7f63da800640 1 --2- 172.21.15.69:0/2998897528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2dcab0 0x55d2bd29de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.663+0000 7f63d9e00640 1 -- 172.21.15.69:0/2998897528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2dcab0 msgr2=0x55d2bd29de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.663+0000 7f63d9e00640 1 --2- 172.21.15.69:0/2998897528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2dcab0 0x55d2bd29de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.663+0000 7f63d9e00640 1 -- 172.21.15.69:0/2998897528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 msgr2=0x55d2bd2c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.663+0000 7f63d9e00640 1 --2- 172.21.15.69:0/2998897528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 0x55d2bd2c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.663+0000 7f63d9e00640 1 -- 172.21.15.69:0/2998897528 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2bd15eab0 con 0x55d2bd298990 2024-02-21T07:44:50.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.663+0000 7f63d9400640 1 --2- 172.21.15.69:0/2998897528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 0x55d2bd2c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:50.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.663+0000 7f63d9e00640 1 --2- 172.21.15.69:0/2998897528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd261ca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00cfd0 tx=0x7f63cc0ad040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79d7e3b2b22bfd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.663+0000 7f63c6000640 1 -- 172.21.15.69:0/2998897528 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc093cf0 con 0x55d2bd298990 2024-02-21T07:44:50.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.663+0000 7f63c6000640 1 -- 172.21.15.69:0/2998897528 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc094780 con 0x55d2bd298990 2024-02-21T07:44:50.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.664+0000 7f63c6000640 1 -- 172.21.15.69:0/2998897528 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a0720 con 0x55d2bd298990 2024-02-21T07:44:50.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.664+0000 7f63e3e34740 1 -- 172.21.15.69:0/2998897528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 msgr2=0x55d2bd261ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.664+0000 7f63e3e34740 1 --2- 172.21.15.69:0/2998897528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd261ca0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00cfd0 tx=0x7f63cc0ad040 comp rx=0 tx=0).stop 2024-02-21T07:44:50.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.665+0000 7f63e3e34740 1 -- 172.21.15.69:0/2998897528 shutdown_connections 2024-02-21T07:44:50.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.665+0000 7f63e3e34740 1 --2- 172.21.15.69:0/2998897528 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2dcab0 0x55d2bd29de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.665+0000 7f63e3e34740 1 --2- 172.21.15.69:0/2998897528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd2d3740 0x55d2bd2c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.665+0000 7f63e3e34740 1 --2- 172.21.15.69:0/2998897528 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd298990 0x55d2bd261ca0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.665+0000 7f63e3e34740 1 -- 172.21.15.69:0/2998897528 >> 172.21.15.69:0/2998897528 conn(0x55d2bd298070 msgr2=0x55d2bd2d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.665+0000 7f63e3e34740 1 -- 172.21.15.69:0/2998897528 shutdown_connections 2024-02-21T07:44:50.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.666+0000 7f63e3e34740 1 -- 172.21.15.69:0/2998897528 wait complete. 2024-02-21T07:44:50.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.667+0000 7f63e3e34740 1 -- start start 2024-02-21T07:44:50.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.667+0000 7f63e3e34740 1 Processor -- start 2024-02-21T07:44:50.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.669+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 0x55d2bd2d3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.669+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2d3740 0x55d2bd28e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.670+0000 7f63e3e34740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd2dcab0 0x55d2bd33b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.671+0000 7f63d9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 0x55d2bd2d3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.671+0000 7f63d9400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2d3740 0x55d2bd28e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.671+0000 7f63d9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 0x55d2bd2d3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39638/0 (socket says 172.21.15.69:39638) 2024-02-21T07:44:50.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.671+0000 7f63d9400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2d3740 0x55d2bd28e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53112/0 (socket says 172.21.15.69:53112) 2024-02-21T07:44:50.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.672+0000 7f63d9e00640 1 -- 172.21.15.69:0/3600131110 learned_addr learned my addr 172.21.15.69:0/3600131110 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.672+0000 7f63da800640 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd2dcab0 0x55d2bd33b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.673+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd2c0a20 con 0x55d2bd298990 2024-02-21T07:44:50.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.673+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd33be60 con 0x55d2bd2dcab0 2024-02-21T07:44:50.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.673+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd2c1560 con 0x55d2bd2d3740 2024-02-21T07:44:50.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.673+0000 7f63e3e34740 10 client.0 _ll_register_callbacks cb 0x7f63cc094240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:50.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.674+0000 7f63d9400640 1 -- 172.21.15.69:0/3600131110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd2dcab0 msgr2=0x55d2bd33b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.674+0000 7f63d9400640 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd2dcab0 0x55d2bd33b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.674+0000 7f63d9400640 1 -- 172.21.15.69:0/3600131110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 msgr2=0x55d2bd2d3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.674+0000 7f63d9400640 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 0x55d2bd2d3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.674+0000 7f63d9400640 1 -- 172.21.15.69:0/3600131110 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc1898d0 con 0x55d2bd2d3740 2024-02-21T07:44:50.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.674+0000 7f63d9e00640 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 0x55d2bd2d3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:50.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.675+0000 7f63d9400640 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2d3740 0x55d2bd28e580 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f63c8036040 tx=0x7f63c802e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=914008bf40fee664 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.675+0000 7f63bb400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:50.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.675+0000 7f63bb400640 1 -- 172.21.15.69:0/3600131110 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c804c040 con 0x55d2bd2d3740 2024-02-21T07:44:50.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.675+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f63cc094610 con 0x55d2bd2d3740 2024-02-21T07:44:50.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.676+0000 7f63bb400640 1 -- 172.21.15.69:0/3600131110 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f63c8054620 con 0x55d2bd2d3740 2024-02-21T07:44:50.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.676+0000 7f63bb400640 1 -- 172.21.15.69:0/3600131110 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63c80547e0 con 0x55d2bd2d3740 2024-02-21T07:44:50.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.676+0000 7f63e3e34740 10 client.5807 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:50.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.676+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55d2bd1c25a0 con 0x55d2bd2d3740 2024-02-21T07:44:50.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.677+0000 7f63bb400640 1 -- 172.21.15.69:0/3600131110 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc094610 con 0x55d2bd2d3740 2024-02-21T07:44:50.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.677+0000 7f63bb400640 1 -- 172.21.15.69:0/3600131110 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f63c8045040 con 0x55d2bd2d3740 2024-02-21T07:44:50.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.677+0000 7f63e3e34740 10 client.5807 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:50.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.677+0000 7f63e3e34740 10 client.5807 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.d 2024-02-21T07:44:50.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.677+0000 7f63e3e34740 20 client.5807 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:50.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.677+0000 7f63e3e34740 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d2bd3296d0 0x55d2bd29afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.677+0000 7f63e3e34740 4 client.5807 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:44:50.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.677+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d2bcf4f890 con 0x55d2bd3296d0 2024-02-21T07:44:50.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.679+0000 7f63d9e00640 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d2bd3296d0 0x55d2bd29afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.681+0000 7f63d9e00640 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d2bd3296d0 0x55d2bd29afc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=184bb302c27ca271 server_cookie=7d9380ce478eb03f in_seq=0 out_seq=0 2024-02-21T07:44:50.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.681+0000 7f63bb400640 10 client.5807 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:44:50.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.682+0000 7f63bb400640 1 -- 172.21.15.69:0/3600131110 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d2bcf4f890 con 0x55d2bd3296d0 2024-02-21T07:44:50.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.682+0000 7f63bb400640 10 client.5807 handle_command_reply: tid=0 2024-02-21T07:44:50.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.682+0000 7f63e3e34740 1 client.5807 shutdown 2024-02-21T07:44:50.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.682+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2d3740 msgr2=0x55d2bd28e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.682+0000 7f63e3e34740 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2d3740 0x55d2bd28e580 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f63c8036040 tx=0x7f63c802e000 comp rx=0 tx=0).stop 2024-02-21T07:44:50.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.683+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 shutdown_connections 2024-02-21T07:44:50.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.683+0000 7f63e3e34740 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d2bd3296d0 0x55d2bd29afc0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.683+0000 7f63e3e34740 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d2bd2dcab0 0x55d2bd33b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.683+0000 7f63e3e34740 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d2bd2d3740 0x55d2bd28e580 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.683+0000 7f63e3e34740 1 --2- 172.21.15.69:0/3600131110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2bd298990 0x55d2bd2d3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.683+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 >> 172.21.15.69:0/3600131110 conn(0x55d2bd298070 msgr2=0x55d2bd2c1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.683+0000 7f63bb400640 0 client.5807 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:44:50.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.683+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 shutdown_connections 2024-02-21T07:44:50.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.683+0000 7f63e3e34740 1 -- 172.21.15.69:0/3600131110 wait complete. 2024-02-21T07:44:50.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.683+0000 7f63e3e34740 20 client.5807 trim_cache size 0 max 16384 2024-02-21T07:44:50.690 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.684+0000 7f63db200640 1 -- 172.21.15.69:0/1080643027 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f63bc09f0a0 msgr2=0x7f63bc0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.684+0000 7f63db200640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f63bc09f0a0 0x7f63bc0a1560 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f63c8035000 tx=0x7f63c8008030 comp rx=0 tx=0).stop 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.684+0000 7f63db200640 1 -- 172.21.15.69:0/1080643027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63dc0cf230 msgr2=0x7f63dc223370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.684+0000 7f63db200640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63dc0cf230 0x7f63dc223370 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f63cc00e9b0 tx=0x7f63cc00ee70 comp rx=0 tx=0).stop 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.684+0000 7f63db200640 1 -- 172.21.15.69:0/1080643027 shutdown_connections 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.684+0000 7f63db200640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f63bc09f0a0 0x7f63bc0a1560 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.684+0000 7f63db200640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63dc187e10 0x7f63dc17ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.684+0000 7f63db200640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63dc1861e0 0x7f63dc17a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.684+0000 7f63db200640 1 --2- 172.21.15.69:0/1080643027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f63dc0cf230 0x7f63dc223370 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.684+0000 7f63db200640 1 -- 172.21.15.69:0/1080643027 >> 172.21.15.69:0/1080643027 conn(0x7f63dc0d2be0 msgr2=0x7f63dc0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.685+0000 7f63db200640 1 -- 172.21.15.69:0/1080643027 shutdown_connections 2024-02-21T07:44:50.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.685+0000 7f63db200640 1 -- 172.21.15.69:0/1080643027 wait complete. 2024-02-21T07:44:50.710 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:44:50.710 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:44:50.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.912+0000 7fc238e00640 1 Processor -- start 2024-02-21T07:44:50.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.912+0000 7fc238e00640 1 -- start start 2024-02-21T07:44:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.915+0000 7fc238e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc23417f610 0x7fc2340cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.915+0000 7fc238e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc2340cf5e0 0x7fc23418b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.915+0000 7fc238e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23417f9f0 con 0x7fc2340cf150 2024-02-21T07:44:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.915+0000 7fc238e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2340ff210 con 0x7fc2340cf5e0 2024-02-21T07:44:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.915+0000 7fc238e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23418a090 con 0x7fc23417f610 2024-02-21T07:44:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.915+0000 7fc232800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc2340cf5e0 0x7fc23418b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.915+0000 7fc231e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc23417f610 0x7fc2340cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.915+0000 7fc232800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc2340cf5e0 0x7fc23418b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39650/0 (socket says 172.21.15.69:39650) 2024-02-21T07:44:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.915+0000 7fc232800640 1 -- 172.21.15.69:0/2043376610 learned_addr learned my addr 172.21.15.69:0/2043376610 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.915+0000 7fc231e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc23417f610 0x7fc2340cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:37942/0 (socket says 172.21.15.69:37942) 2024-02-21T07:44:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.916+0000 7fc230a00640 1 -- 172.21.15.69:0/2043376610 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65436152 0 0) 0x7fc220001110 con 0x7fc2340cf150 2024-02-21T07:44:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.916+0000 7fc232800640 1 -- 172.21.15.69:0/2043376610 >> v2:172.21.15.174:3300/0 conn(0x7fc23417f610 msgr2=0x7fc2340cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.916+0000 7fc232800640 1 --2- 172.21.15.69:0/2043376610 >> v2:172.21.15.174:3300/0 conn(0x7fc23417f610 0x7fc2340cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.916+0000 7fc232800640 1 -- 172.21.15.69:0/2043376610 >> v1:172.21.15.184:6789/0 conn(0x7fc2340cf150 legacy=0x7fc23418b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.916+0000 7fc232800640 1 -- 172.21.15.69:0/2043376610 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23418a370 con 0x7fc2340cf5e0 2024-02-21T07:44:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.916+0000 7fc231e00640 1 --2- 172.21.15.69:0/2043376610 >> v2:172.21.15.174:3300/0 conn(0x7fc23417f610 0x7fc2340cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:50.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.917+0000 7fc232800640 1 --2- 172.21.15.69:0/2043376610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf5e0 0x7fc23418b840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc2340ff420 tx=0x7fc22c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9c31e430b0d93a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.917+0000 7fc230a00640 1 -- 172.21.15.69:0/2043376610 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c02ca80 con 0x7fc2340cf5e0 2024-02-21T07:44:50.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.917+0000 7fc230a00640 1 -- 172.21.15.69:0/2043376610 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c02cbe0 con 0x7fc2340cf5e0 2024-02-21T07:44:50.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.917+0000 7fc230a00640 1 -- 172.21.15.69:0/2043376610 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0343f0 con 0x7fc2340cf5e0 2024-02-21T07:44:50.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.918+0000 7fc238e00640 1 -- 172.21.15.69:0/2043376610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf5e0 msgr2=0x7fc23418b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.918+0000 7fc238e00640 1 --2- 172.21.15.69:0/2043376610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf5e0 0x7fc23418b840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc2340ff420 tx=0x7fc22c02bee0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.918+0000 7fc238e00640 1 -- 172.21.15.69:0/2043376610 shutdown_connections 2024-02-21T07:44:50.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.918+0000 7fc238e00640 1 --2- 172.21.15.69:0/2043376610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf5e0 0x7fc23418b840 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.918+0000 7fc238e00640 1 --2- 172.21.15.69:0/2043376610 >> v2:172.21.15.174:3300/0 conn(0x7fc23417f610 0x7fc2340cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.918+0000 7fc238e00640 1 -- 172.21.15.69:0/2043376610 >> 172.21.15.69:0/2043376610 conn(0x7fc2340668e0 msgr2=0x7fc234066cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.918+0000 7fc238e00640 1 -- 172.21.15.69:0/2043376610 shutdown_connections 2024-02-21T07:44:50.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.918+0000 7fc238e00640 1 -- 172.21.15.69:0/2043376610 wait complete. 2024-02-21T07:44:50.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.921+0000 7fc238e00640 1 Processor -- start 2024-02-21T07:44:50.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.921+0000 7fc238e00640 1 -- start start 2024-02-21T07:44:50.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc238e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf150 0x7fc2340d5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc238e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2340cf5e0 0x7fc234168450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc238e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23417f610 0x7fc234180710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc238e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23421e5e0 con 0x7fc2340cf150 2024-02-21T07:44:50.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc238e00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23421e020 con 0x7fc2340cf5e0 2024-02-21T07:44:50.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc238e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23421e300 con 0x7fc23417f610 2024-02-21T07:44:50.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc231e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf150 0x7fc2340d5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc232800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23417f610 0x7fc234180710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc231e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf150 0x7fc2340d5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39666/0 (socket says 172.21.15.69:39666) 2024-02-21T07:44:50.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc231e00640 1 -- 172.21.15.69:0/2547710710 learned_addr learned my addr 172.21.15.69:0/2547710710 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc231400640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2340cf5e0 0x7fc234168450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc231e00640 1 -- 172.21.15.69:0/2547710710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23417f610 msgr2=0x7fc234180710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc231e00640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23417f610 0x7fc234180710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc231e00640 1 -- 172.21.15.69:0/2547710710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2340cf5e0 msgr2=0x7fc234168450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc231e00640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2340cf5e0 0x7fc234168450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc231e00640 1 -- 172.21.15.69:0/2547710710 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc224009400 con 0x7fc2340cf150 2024-02-21T07:44:50.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.923+0000 7fc232800640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23417f610 0x7fc234180710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:50.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.924+0000 7fc231e00640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf150 0x7fc2340d5900 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc22400ebe0 tx=0x7fc22400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.924+0000 7fc22a000640 1 -- 172.21.15.69:0/2547710710 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224009760 con 0x7fc2340cf150 2024-02-21T07:44:50.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.924+0000 7fc22a000640 1 -- 172.21.15.69:0/2547710710 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22400cc30 con 0x7fc2340cf150 2024-02-21T07:44:50.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.924+0000 7fc238e00640 1 -- 172.21.15.69:0/2547710710 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22c009b30 con 0x7fc2340cf150 2024-02-21T07:44:50.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.924+0000 7fc22a000640 1 -- 172.21.15.69:0/2547710710 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22400eee0 con 0x7fc2340cf150 2024-02-21T07:44:50.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.924+0000 7fc238e00640 1 -- 172.21.15.69:0/2547710710 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23417ff10 con 0x7fc2340cf150 2024-02-21T07:44:50.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.927+0000 7fc22a000640 1 -- 172.21.15.69:0/2547710710 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc224013470 con 0x7fc2340cf150 2024-02-21T07:44:50.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.929+0000 7fc22a000640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc21409f0a0 0x7fc2140a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.929+0000 7fc22a000640 1 -- 172.21.15.69:0/2547710710 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc2240c9e30 con 0x7fc2340cf150 2024-02-21T07:44:50.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.929+0000 7fc23bbac740 1 Processor -- start 2024-02-21T07:44:50.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.929+0000 7fc231400640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc21409f0a0 0x7fc2140a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.929+0000 7fc23bbac740 1 -- start start 2024-02-21T07:44:50.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.930+0000 7fc231400640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc21409f0a0 0x7fc2140a1560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc220000f60 tx=0x7fc220009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e535ec0 0x55a14e5362a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e5367e0 0x55a14e571050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e572320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc23bbac740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e469210 con 0x55a14e5367e0 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc23bbac740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e466740 con 0x55a14e571590 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc23bbac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e461f20 con 0x55a14e535ec0 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc231400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e5367e0 0x55a14e571050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc231400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e5367e0 0x55a14e571050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39670/0 (socket says 172.21.15.69:39670) 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc231400640 1 -- 172.21.15.69:0/2772226540 learned_addr learned my addr 172.21.15.69:0/2772226540 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc231e00640 1 --2- 172.21.15.69:0/2772226540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e535ec0 0x55a14e5362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.931+0000 7fc232800640 1 --2- 172.21.15.69:0/2772226540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e572320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.932+0000 7fc231400640 1 -- 172.21.15.69:0/2772226540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e535ec0 msgr2=0x55a14e5362a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.932+0000 7fc231400640 1 --2- 172.21.15.69:0/2772226540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e535ec0 0x55a14e5362a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.932+0000 7fc231400640 1 -- 172.21.15.69:0/2772226540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 msgr2=0x55a14e572320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.932+0000 7fc231400640 1 --2- 172.21.15.69:0/2772226540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e572320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.932+0000 7fc231400640 1 -- 172.21.15.69:0/2772226540 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a14e423df0 con 0x55a14e5367e0 2024-02-21T07:44:50.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.932+0000 7fc231400640 1 --2- 172.21.15.69:0/2772226540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e5367e0 0x55a14e571050 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc22000f990 tx=0x7fc220012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77c1192e6de067b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.932+0000 7fc21ea00640 1 -- 172.21.15.69:0/2772226540 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220001d40 con 0x55a14e5367e0 2024-02-21T07:44:50.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.932+0000 7fc21ea00640 1 -- 172.21.15.69:0/2772226540 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc220014be0 con 0x55a14e5367e0 2024-02-21T07:44:50.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.932+0000 7fc21ea00640 1 -- 172.21.15.69:0/2772226540 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc220020410 con 0x55a14e5367e0 2024-02-21T07:44:50.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.933+0000 7fc23bbac740 1 -- 172.21.15.69:0/2772226540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e5367e0 msgr2=0x55a14e571050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.933+0000 7fc23bbac740 1 --2- 172.21.15.69:0/2772226540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e5367e0 0x55a14e571050 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc22000f990 tx=0x7fc220012000 comp rx=0 tx=0).stop 2024-02-21T07:44:50.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.933+0000 7fc23bbac740 1 -- 172.21.15.69:0/2772226540 shutdown_connections 2024-02-21T07:44:50.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.933+0000 7fc23bbac740 1 --2- 172.21.15.69:0/2772226540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e572320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.933+0000 7fc23bbac740 1 --2- 172.21.15.69:0/2772226540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e5367e0 0x55a14e571050 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.933+0000 7fc23bbac740 1 --2- 172.21.15.69:0/2772226540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e535ec0 0x55a14e5362a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.933+0000 7fc23bbac740 1 -- 172.21.15.69:0/2772226540 >> 172.21.15.69:0/2772226540 conn(0x55a14e4f8490 msgr2=0x55a14e4f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.933+0000 7fc23bbac740 1 -- 172.21.15.69:0/2772226540 shutdown_connections 2024-02-21T07:44:50.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.933+0000 7fc23bbac740 1 -- 172.21.15.69:0/2772226540 wait complete. 2024-02-21T07:44:50.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.934+0000 7fc23bbac740 1 -- start start 2024-02-21T07:44:50.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.935+0000 7fc23bbac740 1 Processor -- start 2024-02-21T07:44:50.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.936+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 0x55a14e52ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.936+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e52cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.936+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 0x55a14e57a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.936+0000 7fc23bbac740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e407150 con 0x55a14e529890 2024-02-21T07:44:50.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.936+0000 7fc23bbac740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e406df0 con 0x55a14e571590 2024-02-21T07:44:50.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.936+0000 7fc23bbac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e1d01c0 con 0x55a14e5367e0 2024-02-21T07:44:50.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.936+0000 7fc23bbac740 10 client.0 _ll_register_callbacks cb 0x55a14e4562b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:50.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc232800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 0x55a14e57a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 0x55a14e52ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 0x55a14e52ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53154/0 (socket says 172.21.15.69:53154) 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231e00640 1 -- 172.21.15.69:0/1953092551 learned_addr learned my addr 172.21.15.69:0/1953092551 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231400640 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e52cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231e00640 1 -- 172.21.15.69:0/1953092551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 msgr2=0x55a14e52cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231e00640 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e52cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231e00640 1 -- 172.21.15.69:0/1953092551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 msgr2=0x55a14e57a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231e00640 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 0x55a14e57a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231e00640 1 -- 172.21.15.69:0/1953092551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a14e4605a0 con 0x55a14e5367e0 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231400640 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e52cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc231e00640 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 0x55a14e52ff60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc224016000 tx=0x7fc224097a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de932feca815964e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.937+0000 7fc213400640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc213400640 1 -- 172.21.15.69:0/1953092551 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224093680 con 0x55a14e5367e0 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc213400640 1 -- 172.21.15.69:0/1953092551 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc2240937e0 con 0x55a14e5367e0 2024-02-21T07:44:50.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc23bbac740 1 -- 172.21.15.69:0/1953092551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a14e1617e0 con 0x55a14e5367e0 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc213400640 1 -- 172.21.15.69:0/1953092551 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2240939a0 con 0x55a14e5367e0 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc23bbac740 10 client.5819 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc23bbac740 1 -- 172.21.15.69:0/1953092551 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55a14e3fcab0 con 0x55a14e5367e0 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc213400640 1 -- 172.21.15.69:0/1953092551 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a14e1617e0 con 0x55a14e5367e0 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc213400640 1 -- 172.21.15.69:0/1953092551 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fc224011070 con 0x55a14e5367e0 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc23bbac740 10 client.5819 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc23bbac740 10 client.5819 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.g 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc23bbac740 20 client.5819 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc23bbac740 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a14e529c70 0x55a14e57b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc23bbac740 4 client.5819 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:50.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.938+0000 7fc23bbac740 1 -- 172.21.15.69:0/1953092551 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a14e19e720 con 0x55a14e529c70 2024-02-21T07:44:50.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.939+0000 7fc231400640 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a14e529c70 0x55a14e57b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.939+0000 7fc231400640 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a14e529c70 0x55a14e57b150 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=57abfbce5992942 server_cookie=242647ed89dffb88 in_seq=0 out_seq=0 2024-02-21T07:44:50.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.939+0000 7fc213400640 10 client.5819 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:44:50.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.940+0000 7fc213400640 1 -- 172.21.15.69:0/1953092551 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a14e19e720 con 0x55a14e529c70 2024-02-21T07:44:50.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.940+0000 7fc213400640 10 client.5819 handle_command_reply: tid=0 2024-02-21T07:44:50.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.940+0000 7fc23bbac740 1 client.5819 shutdown 2024-02-21T07:44:50.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.940+0000 7fc23bbac740 1 -- 172.21.15.69:0/1953092551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 msgr2=0x55a14e52ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.940+0000 7fc23bbac740 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 0x55a14e52ff60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc224016000 tx=0x7fc224097a80 comp rx=0 tx=0).stop 2024-02-21T07:44:50.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.940+0000 7fc23bbac740 1 -- 172.21.15.69:0/1953092551 shutdown_connections 2024-02-21T07:44:50.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.940+0000 7fc23bbac740 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a14e529c70 0x55a14e57b150 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.941+0000 7fc23bbac740 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 0x55a14e57a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.941+0000 7fc23bbac740 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e52cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.941+0000 7fc213400640 0 client.5819 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:44:50.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.941+0000 7fc23bbac740 1 --2- 172.21.15.69:0/1953092551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 0x55a14e52ff60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.941+0000 7fc23bbac740 1 -- 172.21.15.69:0/1953092551 >> 172.21.15.69:0/1953092551 conn(0x55a14e535ec0 msgr2=0x55a14e5719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.941+0000 7fc23bbac740 1 -- 172.21.15.69:0/1953092551 shutdown_connections 2024-02-21T07:44:50.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.941+0000 7fc23bbac740 1 -- 172.21.15.69:0/1953092551 wait complete. 2024-02-21T07:44:50.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.941+0000 7fc23bbac740 20 client.5819 trim_cache size 0 max 16384 2024-02-21T07:44:50.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.955+0000 7fc23bbac740 1 Processor -- start 2024-02-21T07:44:50.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.955+0000 7fc23bbac740 1 -- start start 2024-02-21T07:44:50.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e529890 0x55a14e4f7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e5367e0 0x55a14e52ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e571590 0x55a14e4f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc23bbac740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e4f94d0 con 0x55a14e571590 2024-02-21T07:44:50.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc23bbac740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e52c680 con 0x55a14e5367e0 2024-02-21T07:44:50.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc23bbac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e529030 con 0x55a14e529890 2024-02-21T07:44:50.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc231e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e529890 0x55a14e4f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc231e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e529890 0x55a14e4f7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53168/0 (socket says 172.21.15.69:53168) 2024-02-21T07:44:50.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc231400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e5367e0 0x55a14e52ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc231e00640 1 -- 172.21.15.69:0/1640384863 learned_addr learned my addr 172.21.15.69:0/1640384863 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.957+0000 7fc232800640 1 --2- 172.21.15.69:0/1640384863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e571590 0x55a14e4f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.958+0000 7fc231e00640 1 -- 172.21.15.69:0/1640384863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e5367e0 msgr2=0x55a14e52ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.958+0000 7fc231e00640 1 --2- 172.21.15.69:0/1640384863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e5367e0 0x55a14e52ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.958+0000 7fc231e00640 1 -- 172.21.15.69:0/1640384863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e571590 msgr2=0x55a14e4f6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.958+0000 7fc231e00640 1 --2- 172.21.15.69:0/1640384863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e571590 0x55a14e4f6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.958+0000 7fc231e00640 1 -- 172.21.15.69:0/1640384863 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a14e422650 con 0x55a14e529890 2024-02-21T07:44:50.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.958+0000 7fc231e00640 1 --2- 172.21.15.69:0/1640384863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e529890 0x55a14e4f7570 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc2240975c0 tx=0x7fc22401d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c239a6dba50fe5aa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.958+0000 7fc21e000640 1 -- 172.21.15.69:0/1640384863 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22409ba60 con 0x55a14e529890 2024-02-21T07:44:50.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.958+0000 7fc21e000640 1 -- 172.21.15.69:0/1640384863 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2240c7290 con 0x55a14e529890 2024-02-21T07:44:50.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.958+0000 7fc21e000640 1 -- 172.21.15.69:0/1640384863 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224093680 con 0x55a14e529890 2024-02-21T07:44:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.959+0000 7fc23bbac740 1 -- 172.21.15.69:0/1640384863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e529890 msgr2=0x55a14e4f7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.959+0000 7fc23bbac740 1 --2- 172.21.15.69:0/1640384863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e529890 0x55a14e4f7570 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc2240975c0 tx=0x7fc22401d000 comp rx=0 tx=0).stop 2024-02-21T07:44:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.959+0000 7fc23bbac740 1 -- 172.21.15.69:0/1640384863 shutdown_connections 2024-02-21T07:44:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.959+0000 7fc23bbac740 1 --2- 172.21.15.69:0/1640384863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e571590 0x55a14e4f6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.959+0000 7fc23bbac740 1 --2- 172.21.15.69:0/1640384863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e5367e0 0x55a14e52ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.959+0000 7fc23bbac740 1 --2- 172.21.15.69:0/1640384863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e529890 0x55a14e4f7570 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.959+0000 7fc23bbac740 1 -- 172.21.15.69:0/1640384863 >> 172.21.15.69:0/1640384863 conn(0x55a14e535ec0 msgr2=0x55a14e4f9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.959+0000 7fc23bbac740 1 -- 172.21.15.69:0/1640384863 shutdown_connections 2024-02-21T07:44:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.959+0000 7fc23bbac740 1 -- 172.21.15.69:0/1640384863 wait complete. 2024-02-21T07:44:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.960+0000 7fc23bbac740 1 -- start start 2024-02-21T07:44:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.960+0000 7fc23bbac740 1 Processor -- start 2024-02-21T07:44:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.961+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 0x55a14e4f9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.961+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 0x55a14e52d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.961+0000 7fc23bbac740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e5291a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.961+0000 7fc23bbac740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e5296e0 con 0x55a14e529890 2024-02-21T07:44:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.961+0000 7fc23bbac740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e500c80 con 0x55a14e571590 2024-02-21T07:44:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc23bbac740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14e57b7a0 con 0x55a14e5367e0 2024-02-21T07:44:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc23bbac740 10 client.0 _ll_register_callbacks cb 0x7fc220017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc232800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e5291a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc232800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e5291a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:37982/0 (socket says 172.21.15.69:37982) 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc232800640 1 -- 172.21.15.69:0/756979256 learned_addr learned my addr 172.21.15.69:0/756979256 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc231400640 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 0x55a14e52d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc231e00640 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 0x55a14e4f9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc232800640 1 -- 172.21.15.69:0/756979256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 msgr2=0x55a14e52d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc232800640 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 0x55a14e52d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc232800640 1 -- 172.21.15.69:0/756979256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 msgr2=0x55a14e4f9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc232800640 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 0x55a14e4f9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc232800640 1 -- 172.21.15.69:0/756979256 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a14e3fcab0 con 0x55a14e571590 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.962+0000 7fc231e00640 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 0x55a14e4f9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.963+0000 7fc232800640 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e5291a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009f40 tx=0x7fc22c004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=464176684e84c0b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.963+0000 7fc213400640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:44:50.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.963+0000 7fc213400640 1 -- 172.21.15.69:0/756979256 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c04e070 con 0x55a14e571590 2024-02-21T07:44:50.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.963+0000 7fc23bbac740 1 -- 172.21.15.69:0/756979256 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a14e56f010 con 0x55a14e571590 2024-02-21T07:44:50.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.963+0000 7fc213400640 1 -- 172.21.15.69:0/756979256 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc22c0079b0 con 0x55a14e571590 2024-02-21T07:44:50.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.963+0000 7fc213400640 1 -- 172.21.15.69:0/756979256 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc22c003ea0 con 0x55a14e571590 2024-02-21T07:44:50.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.963+0000 7fc23bbac740 10 client.5851 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:50.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.963+0000 7fc23bbac740 1 -- 172.21.15.69:0/756979256 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55a14e408ee0 con 0x55a14e571590 2024-02-21T07:44:50.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.963+0000 7fc213400640 1 -- 172.21.15.69:0/756979256 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a14e56f010 con 0x55a14e571590 2024-02-21T07:44:50.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.964+0000 7fc213400640 1 -- 172.21.15.69:0/756979256 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fc22c051020 con 0x55a14e571590 2024-02-21T07:44:50.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.964+0000 7fc23bbac740 10 client.5851 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:50.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.964+0000 7fc23bbac740 10 client.5851 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.g 2024-02-21T07:44:50.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.964+0000 7fc23bbac740 20 client.5851 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:50.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.964+0000 7fc23bbac740 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a14e52c3f0 0x55a14e4ffb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:50.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.964+0000 7fc23bbac740 4 client.5851 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:44:50.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.964+0000 7fc23bbac740 1 -- 172.21.15.69:0/756979256 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fc220014be0 con 0x55a14e52c3f0 2024-02-21T07:44:50.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.964+0000 7fc231e00640 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a14e52c3f0 0x55a14e4ffb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:50.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.965+0000 7fc231e00640 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a14e52c3f0 0x55a14e4ffb60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c3abc27d7438c3b server_cookie=13954ca88f62b7f2 in_seq=0 out_seq=0 2024-02-21T07:44:50.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.965+0000 7fc213400640 10 client.5851 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:44:50.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.965+0000 7fc213400640 1 -- 172.21.15.69:0/756979256 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fc220014be0 con 0x55a14e52c3f0 2024-02-21T07:44:50.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.965+0000 7fc213400640 10 client.5851 handle_command_reply: tid=0 2024-02-21T07:44:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.965+0000 7fc23bbac740 1 client.5851 shutdown 2024-02-21T07:44:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.965+0000 7fc23bbac740 1 -- 172.21.15.69:0/756979256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 msgr2=0x55a14e5291a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.965+0000 7fc23bbac740 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e5291a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009f40 tx=0x7fc22c004ab0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.966+0000 7fc23bbac740 1 -- 172.21.15.69:0/756979256 shutdown_connections 2024-02-21T07:44:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.966+0000 7fc23bbac740 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x55a14e52c3f0 0x55a14e4ffb60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.966+0000 7fc23bbac740 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55a14e571590 0x55a14e5291a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.966+0000 7fc23bbac740 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55a14e5367e0 0x55a14e52d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.966+0000 7fc23bbac740 1 --2- 172.21.15.69:0/756979256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a14e529890 0x55a14e4f9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.966+0000 7fc213400640 0 client.5851 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:44:50.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.966+0000 7fc23bbac740 1 -- 172.21.15.69:0/756979256 >> 172.21.15.69:0/756979256 conn(0x55a14e535ec0 msgr2=0x55a14e563db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.966+0000 7fc23bbac740 1 -- 172.21.15.69:0/756979256 shutdown_connections 2024-02-21T07:44:50.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.966+0000 7fc23bbac740 1 -- 172.21.15.69:0/756979256 wait complete. 2024-02-21T07:44:50.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.966+0000 7fc23bbac740 20 client.5851 trim_cache size 0 max 16384 2024-02-21T07:44:50.977 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:44:50.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 -- 172.21.15.69:0/2547710710 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc21409f0a0 msgr2=0x7fc2140a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc21409f0a0 0x7fc2140a1560 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc220000f60 tx=0x7fc220009040 comp rx=0 tx=0).stop 2024-02-21T07:44:50.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 -- 172.21.15.69:0/2547710710 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf150 msgr2=0x7fc2340d5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:50.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf150 0x7fc2340d5900 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc22400ebe0 tx=0x7fc22400c520 comp rx=0 tx=0).stop 2024-02-21T07:44:50.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 -- 172.21.15.69:0/2547710710 shutdown_connections 2024-02-21T07:44:50.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc21409f0a0 0x7fc2140a1560 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc23417f610 0x7fc234180710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc2340cf5e0 0x7fc234168450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 --2- 172.21.15.69:0/2547710710 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2340cf150 0x7fc2340d5900 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:50.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 -- 172.21.15.69:0/2547710710 >> 172.21.15.69:0/2547710710 conn(0x7fc2340668e0 msgr2=0x7fc23406c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:50.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 -- 172.21.15.69:0/2547710710 shutdown_connections 2024-02-21T07:44:50.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:50.967+0000 7fc238e00640 1 -- 172.21.15.69:0/2547710710 wait complete. 2024-02-21T07:44:50.989 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:44:50.989 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:44:51.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.168+0000 7f8535800640 1 Processor -- start 2024-02-21T07:44:51.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.168+0000 7f8535800640 1 -- start start 2024-02-21T07:44:51.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.169+0000 7f8535800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f853017f700 0x7f8530183670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.169+0000 7f8535800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f85301850e0 0x7f85300cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f8535800640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8530184c50 con 0x7f8530185cc0 2024-02-21T07:44:51.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f8535800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8530185560 con 0x7f85301850e0 2024-02-21T07:44:51.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f8535800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8530183d60 con 0x7f853017f700 2024-02-21T07:44:51.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f852f400640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8530185cc0 0x7f8530186130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44238/0 (socket says 172.21.15.69:44238) 2024-02-21T07:44:51.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f852f400640 1 -- 172.21.15.69:0/4001559103 learned_addr learned my addr 172.21.15.69:0/4001559103 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:51.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f852ea00640 1 --2- 172.21.15.69:0/4001559103 >> v2:172.21.15.184:3300/0 conn(0x7f853017f700 0x7f8530183670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f8526000640 1 --2- 172.21.15.69:0/4001559103 >> v2:172.21.15.174:3300/0 conn(0x7f85301850e0 0x7f85300cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f852e000640 1 -- 172.21.15.69:0/4001559103 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794014101 0 0) 0x7f8530184c50 con 0x7f8530185cc0 2024-02-21T07:44:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f852e000640 1 -- 172.21.15.69:0/4001559103 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8514005730 con 0x7f8530185cc0 2024-02-21T07:44:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f852ea00640 1 -- 172.21.15.69:0/4001559103 >> v2:172.21.15.174:3300/0 conn(0x7f85301850e0 msgr2=0x7f85300cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f852ea00640 1 --2- 172.21.15.69:0/4001559103 >> v2:172.21.15.174:3300/0 conn(0x7f85301850e0 0x7f85300cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f852ea00640 1 -- 172.21.15.69:0/4001559103 >> v1:172.21.15.69:6789/0 conn(0x7f8530185cc0 legacy=0x7f8530186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.170+0000 7f852ea00640 1 -- 172.21.15.69:0/4001559103 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8530184040 con 0x7f853017f700 2024-02-21T07:44:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.171+0000 7f8526000640 1 --2- 172.21.15.69:0/4001559103 >> v2:172.21.15.174:3300/0 conn(0x7f85301850e0 0x7f85300cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.172+0000 7f852ea00640 1 --2- 172.21.15.69:0/4001559103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853017f700 0x7f8530183670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f85300cbee0 tx=0x7f852002bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=275edd91ecce6de3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.172+0000 7f852e000640 1 -- 172.21.15.69:0/4001559103 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852002cb60 con 0x7f853017f700 2024-02-21T07:44:51.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.172+0000 7f852e000640 1 -- 172.21.15.69:0/4001559103 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852002ccc0 con 0x7f853017f700 2024-02-21T07:44:51.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.172+0000 7f852e000640 1 -- 172.21.15.69:0/4001559103 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520034660 con 0x7f853017f700 2024-02-21T07:44:51.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.172+0000 7f8535800640 1 -- 172.21.15.69:0/4001559103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853017f700 msgr2=0x7f8530183670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.172+0000 7f8535800640 1 --2- 172.21.15.69:0/4001559103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853017f700 0x7f8530183670 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f85300cbee0 tx=0x7f852002bdb0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.173+0000 7f8535800640 1 -- 172.21.15.69:0/4001559103 shutdown_connections 2024-02-21T07:44:51.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.173+0000 7f8535800640 1 --2- 172.21.15.69:0/4001559103 >> v2:172.21.15.174:3300/0 conn(0x7f85301850e0 0x7f85300cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.173+0000 7f8535800640 1 --2- 172.21.15.69:0/4001559103 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853017f700 0x7f8530183670 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.173+0000 7f8535800640 1 -- 172.21.15.69:0/4001559103 >> 172.21.15.69:0/4001559103 conn(0x7f85300ce3d0 msgr2=0x7f85300ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.173+0000 7f8535800640 1 -- 172.21.15.69:0/4001559103 shutdown_connections 2024-02-21T07:44:51.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.173+0000 7f8535800640 1 -- 172.21.15.69:0/4001559103 wait complete. 2024-02-21T07:44:51.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.175+0000 7f8535800640 1 Processor -- start 2024-02-21T07:44:51.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.175+0000 7f8535800640 1 -- start start 2024-02-21T07:44:51.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f8535800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853017f700 0x7f8530171d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f8535800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85301850e0 0x7f853021f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f8535800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8530185cc0 0x7f8530180270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f8535800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300eddb0 con 0x7f85301850e0 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f8535800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300ee090 con 0x7f8530185cc0 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f8535800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300ee370 con 0x7f853017f700 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f8526000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85301850e0 0x7f853021f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f8526000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85301850e0 0x7f853021f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39714/0 (socket says 172.21.15.69:39714) 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f8526000640 1 -- 172.21.15.69:0/2084569509 learned_addr learned my addr 172.21.15.69:0/2084569509 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f852f400640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8530185cc0 0x7f8530180270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.176+0000 7f852ea00640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853017f700 0x7f8530171d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8526000640 1 -- 172.21.15.69:0/2084569509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853017f700 msgr2=0x7f8530171d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8526000640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853017f700 0x7f8530171d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8526000640 1 -- 172.21.15.69:0/2084569509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8530185cc0 msgr2=0x7f8530180270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8526000640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8530185cc0 0x7f8530180270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8526000640 1 -- 172.21.15.69:0/2084569509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518009400 con 0x7f85301850e0 2024-02-21T07:44:51.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8526000640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85301850e0 0x7f853021f0f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f851800e960 tx=0x7f851800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8527400640 1 -- 172.21.15.69:0/2084569509 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851800ca00 con 0x7f85301850e0 2024-02-21T07:44:51.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8527400640 1 -- 172.21.15.69:0/2084569509 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851800cb60 con 0x7f85301850e0 2024-02-21T07:44:51.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8527400640 1 -- 172.21.15.69:0/2084569509 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8518013470 con 0x7f85301850e0 2024-02-21T07:44:51.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8535800640 1 -- 172.21.15.69:0/2084569509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8520009a70 con 0x7f85301850e0 2024-02-21T07:44:51.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.177+0000 7f8535800640 1 -- 172.21.15.69:0/2084569509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85300ee930 con 0x7f85301850e0 2024-02-21T07:44:51.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.180+0000 7f8527400640 1 -- 172.21.15.69:0/2084569509 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f85180135d0 con 0x7f85301850e0 2024-02-21T07:44:51.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.182+0000 7f8538448740 1 Processor -- start 2024-02-21T07:44:51.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.182+0000 7f8538448740 1 -- start start 2024-02-21T07:44:51.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.182+0000 7f8527400640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f850c09f0a0 0x7f850c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.183+0000 7f8527400640 1 -- 172.21.15.69:0/2084569509 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f85180c9d20 con 0x7f85301850e0 2024-02-21T07:44:51.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.183+0000 7f852f400640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f850c09f0a0 0x7f850c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.183+0000 7f852f400640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f850c09f0a0 0x7f850c0a1560 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f85280011e0 tx=0x7f8528007cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.183+0000 7f8538448740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c787180ec0 0x55c7871812a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f8538448740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c7871bc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f8538448740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 0x55c7871bd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f8538448740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7870b4210 con 0x55c7871817e0 2024-02-21T07:44:51.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f8538448740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7870b1740 con 0x55c7871bc590 2024-02-21T07:44:51.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f8538448740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7870acf20 con 0x55c787180ec0 2024-02-21T07:44:51.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f8526000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c7871bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f852ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c787180ec0 0x55c7871812a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f852f400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 0x55c7871bd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f852ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c787180ec0 0x55c7871812a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53202/0 (socket says 172.21.15.69:53202) 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f852ea00640 1 -- 172.21.15.69:0/92165894 learned_addr learned my addr 172.21.15.69:0/92165894 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f852ea00640 1 -- 172.21.15.69:0/92165894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 msgr2=0x55c7871bd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f852ea00640 1 --2- 172.21.15.69:0/92165894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 0x55c7871bd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f852ea00640 1 -- 172.21.15.69:0/92165894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 msgr2=0x55c7871bc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f852ea00640 1 --2- 172.21.15.69:0/92165894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c7871bc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f852ea00640 1 -- 172.21.15.69:0/92165894 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c78706edf0 con 0x55c787180ec0 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f852f400640 1 --2- 172.21.15.69:0/92165894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 0x55c7871bd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.184+0000 7f8526000640 1 --2- 172.21.15.69:0/92165894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c7871bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:51.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.185+0000 7f852ea00640 1 --2- 172.21.15.69:0/92165894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c787180ec0 0x55c7871812a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f852002c3c0 tx=0x7f852002e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b093b27e1f0ad4bc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.185+0000 7f851f400640 1 -- 172.21.15.69:0/92165894 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520034640 con 0x55c787180ec0 2024-02-21T07:44:51.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.185+0000 7f851f400640 1 -- 172.21.15.69:0/92165894 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85200347a0 con 0x55c787180ec0 2024-02-21T07:44:51.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.185+0000 7f851f400640 1 -- 172.21.15.69:0/92165894 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520034b50 con 0x55c787180ec0 2024-02-21T07:44:51.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.186+0000 7f8538448740 1 -- 172.21.15.69:0/92165894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c787180ec0 msgr2=0x55c7871812a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.186+0000 7f8538448740 1 --2- 172.21.15.69:0/92165894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c787180ec0 0x55c7871812a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f852002c3c0 tx=0x7f852002e000 comp rx=0 tx=0).stop 2024-02-21T07:44:51.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.186+0000 7f8538448740 1 -- 172.21.15.69:0/92165894 shutdown_connections 2024-02-21T07:44:51.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.186+0000 7f8538448740 1 --2- 172.21.15.69:0/92165894 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 0x55c7871bd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.186+0000 7f8538448740 1 --2- 172.21.15.69:0/92165894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c7871bc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.186+0000 7f8538448740 1 --2- 172.21.15.69:0/92165894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c787180ec0 0x55c7871812a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.186+0000 7f8538448740 1 -- 172.21.15.69:0/92165894 >> 172.21.15.69:0/92165894 conn(0x55c787143490 msgr2=0x55c787144510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.186+0000 7f8538448740 1 -- 172.21.15.69:0/92165894 shutdown_connections 2024-02-21T07:44:51.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.186+0000 7f8538448740 1 -- 172.21.15.69:0/92165894 wait complete. 2024-02-21T07:44:51.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.187+0000 7f8538448740 1 -- start start 2024-02-21T07:44:51.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.187+0000 7f8538448740 1 Processor -- start 2024-02-21T07:44:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f8538448740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c78716bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f8538448740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871bc590 0x55c78717f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f8538448740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871c45f0 0x55c7871c3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f8538448740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c787052150 con 0x55c7871817e0 2024-02-21T07:44:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f8538448740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c787051df0 con 0x55c7871c45f0 2024-02-21T07:44:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f8538448740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c786e1b1c0 con 0x55c7871bc590 2024-02-21T07:44:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f8538448740 10 client.0 _ll_register_callbacks cb 0x55c7870a12b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f852ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c78716bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f852ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c78716bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39724/0 (socket says 172.21.15.69:39724) 2024-02-21T07:44:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f852ea00640 1 -- 172.21.15.69:0/3167989489 learned_addr learned my addr 172.21.15.69:0/3167989489 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.188+0000 7f852f400640 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871c45f0 0x55c7871c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f8526000640 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871bc590 0x55c78717f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f852ea00640 1 -- 172.21.15.69:0/3167989489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871bc590 msgr2=0x55c78717f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f852ea00640 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871bc590 0x55c78717f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f852ea00640 1 -- 172.21.15.69:0/3167989489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871c45f0 msgr2=0x55c7871c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f852ea00640 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871c45f0 0x55c7871c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f852ea00640 1 -- 172.21.15.69:0/3167989489 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8530184040 con 0x55c7871817e0 2024-02-21T07:44:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f8526000640 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871bc590 0x55c78717f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:44:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f852f400640 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871c45f0 0x55c7871c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f852ea00640 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c78716bda0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55c787181cb0 tx=0x7f8520004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471bed565886ec65 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f8513e00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f8513e00640 1 -- 172.21.15.69:0/3167989489 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520003990 con 0x55c7871817e0 2024-02-21T07:44:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f8513e00640 1 -- 172.21.15.69:0/3167989489 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f852004f030 con 0x55c7871817e0 2024-02-21T07:44:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f8538448740 1 -- 172.21.15.69:0/3167989489 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c786dac7e0 con 0x55c7871817e0 2024-02-21T07:44:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f8513e00640 1 -- 172.21.15.69:0/3167989489 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8520003af0 con 0x55c7871817e0 2024-02-21T07:44:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f8538448740 10 client.5688 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.189+0000 7f8538448740 1 -- 172.21.15.69:0/3167989489 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55c7870ab5a0 con 0x55c7871817e0 2024-02-21T07:44:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.190+0000 7f8513e00640 1 -- 172.21.15.69:0/3167989489 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c786dac7e0 con 0x55c7871817e0 2024-02-21T07:44:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.190+0000 7f8513e00640 1 -- 172.21.15.69:0/3167989489 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f8520003c50 con 0x55c7871817e0 2024-02-21T07:44:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.190+0000 7f8538448740 10 client.5688 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.190+0000 7f8538448740 10 client.5688 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:44:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.190+0000 7f8538448740 20 client.5688 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.190+0000 7f8538448740 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55c7871c4a70 0x55c78717ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.190+0000 7f8538448740 4 client.5688 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.190+0000 7f8538448740 1 -- 172.21.15.69:0/3167989489 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c786de9720 con 0x55c7871c4a70 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.190+0000 7f8526000640 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55c7871c4a70 0x55c78717ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.191+0000 7f8526000640 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55c7871c4a70 0x55c78717ffb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b1f0b8e09e33161b server_cookie=f52a3cbbfb4d8ff5 in_seq=0 out_seq=0 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.191+0000 7f8513e00640 10 client.5688 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.191+0000 7f8513e00640 1 -- 172.21.15.69:0/3167989489 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c786de9720 con 0x55c7871c4a70 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.191+0000 7f8513e00640 10 client.5688 handle_command_reply: tid=0 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.191+0000 7f8538448740 1 client.5688 shutdown 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 1 -- 172.21.15.69:0/3167989489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 msgr2=0x55c78716bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c78716bda0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55c787181cb0 tx=0x7f8520004ab0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 1 -- 172.21.15.69:0/3167989489 shutdown_connections 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871c45f0 0x55c7871c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55c7871c4a70 0x55c78717ffb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871bc590 0x55c78717f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 1 --2- 172.21.15.69:0/3167989489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871817e0 0x55c78716bda0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8513e00640 0 client.5688 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:44:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 1 -- 172.21.15.69:0/3167989489 >> 172.21.15.69:0/3167989489 conn(0x55c787180ec0 msgr2=0x55c787144f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 1 -- 172.21.15.69:0/3167989489 shutdown_connections 2024-02-21T07:44:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 1 -- 172.21.15.69:0/3167989489 wait complete. 2024-02-21T07:44:51.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.192+0000 7f8538448740 20 client.5688 trim_cache size 0 max 16384 2024-02-21T07:44:51.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.205+0000 7f8538448740 1 Processor -- start 2024-02-21T07:44:51.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.205+0000 7f8538448740 1 -- start start 2024-02-21T07:44:51.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.206+0000 7f8538448740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871817e0 0x55c7871b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.206+0000 7f8538448740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871bc590 0x55c78714bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.206+0000 7f8538448740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871c45f0 0x55c78721bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.206+0000 7f8538448740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78717fb90 con 0x55c7871bc590 2024-02-21T07:44:51.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.206+0000 7f8538448740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78714c310 con 0x55c7871817e0 2024-02-21T07:44:51.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.206+0000 7f8538448740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78721ce00 con 0x55c7871c45f0 2024-02-21T07:44:51.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.206+0000 7f8526000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871bc590 0x55c78714bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f8526000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871bc590 0x55c78714bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39740/0 (socket says 172.21.15.69:39740) 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f8526000640 1 -- 172.21.15.69:0/2078440249 learned_addr learned my addr 172.21.15.69:0/2078440249 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f852ea00640 1 --2- 172.21.15.69:0/2078440249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871817e0 0x55c7871b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f852f400640 1 --2- 172.21.15.69:0/2078440249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871c45f0 0x55c78721bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f8526000640 1 -- 172.21.15.69:0/2078440249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871c45f0 msgr2=0x55c78721bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f8526000640 1 --2- 172.21.15.69:0/2078440249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871c45f0 0x55c78721bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f8526000640 1 -- 172.21.15.69:0/2078440249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871817e0 msgr2=0x55c7871b96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f8526000640 1 --2- 172.21.15.69:0/2078440249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871817e0 0x55c7871b96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f8526000640 1 -- 172.21.15.69:0/2078440249 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c787047ab0 con 0x55c7871bc590 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f8526000640 1 --2- 172.21.15.69:0/2078440249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871bc590 0x55c78714bdd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8518093d10 tx=0x7f85180c7590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38a1df8f346d083 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f851ea00640 1 -- 172.21.15.69:0/2078440249 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180c77d0 con 0x55c7871bc590 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f851ea00640 1 -- 172.21.15.69:0/2078440249 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8518095bb0 con 0x55c7871bc590 2024-02-21T07:44:51.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.207+0000 7f851ea00640 1 -- 172.21.15.69:0/2078440249 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180af200 con 0x55c7871bc590 2024-02-21T07:44:51.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.208+0000 7f8538448740 1 -- 172.21.15.69:0/2078440249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871bc590 msgr2=0x55c78714bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.208+0000 7f8538448740 1 --2- 172.21.15.69:0/2078440249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871bc590 0x55c78714bdd0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8518093d10 tx=0x7f85180c7590 comp rx=0 tx=0).stop 2024-02-21T07:44:51.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.208+0000 7f8538448740 1 -- 172.21.15.69:0/2078440249 shutdown_connections 2024-02-21T07:44:51.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.208+0000 7f8538448740 1 --2- 172.21.15.69:0/2078440249 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871c45f0 0x55c78721bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.208+0000 7f8538448740 1 --2- 172.21.15.69:0/2078440249 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871bc590 0x55c78714bdd0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.208+0000 7f8538448740 1 --2- 172.21.15.69:0/2078440249 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871817e0 0x55c7871b96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.208+0000 7f8538448740 1 -- 172.21.15.69:0/2078440249 >> 172.21.15.69:0/2078440249 conn(0x55c787180ec0 msgr2=0x55c787144f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.208+0000 7f8538448740 1 -- 172.21.15.69:0/2078440249 shutdown_connections 2024-02-21T07:44:51.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.208+0000 7f8538448740 1 -- 172.21.15.69:0/2078440249 wait complete. 2024-02-21T07:44:51.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.209+0000 7f8538448740 1 -- start start 2024-02-21T07:44:51.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.209+0000 7f8538448740 1 Processor -- start 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.210+0000 7f8538448740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871817e0 0x55c7871c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.210+0000 7f8538448740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 0x55c78721c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.210+0000 7f8538448740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871c45f0 0x55c7871cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.210+0000 7f8538448740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78722bee0 con 0x55c7871c45f0 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.210+0000 7f8538448740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7871444d0 con 0x55c7871bc590 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.210+0000 7f8538448740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c78721c160 con 0x55c7871817e0 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.210+0000 7f8538448740 10 client.0 _ll_register_callbacks cb 0x7f85140058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f852f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871c45f0 0x55c7871cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f852ea00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871817e0 0x55c7871c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f8526000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 0x55c78721c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f852f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871c45f0 0x55c7871cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39752/0 (socket says 172.21.15.69:39752) 2024-02-21T07:44:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f852f400640 1 -- 172.21.15.69:0/3740817995 learned_addr learned my addr 172.21.15.69:0/3740817995 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f852f400640 1 -- 172.21.15.69:0/3740817995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871817e0 msgr2=0x55c7871c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f852f400640 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871817e0 0x55c7871c31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f852f400640 1 -- 172.21.15.69:0/3740817995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 msgr2=0x55c78721c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f852f400640 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 0x55c78721c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f852f400640 1 -- 172.21.15.69:0/3740817995 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8520009a70 con 0x55c7871c45f0 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f852f400640 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871c45f0 0x55c7871cd4e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8528005fd0 tx=0x7f8528001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79440c345fec294f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f8513e00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f8513e00640 1 -- 172.21.15.69:0/3740817995 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280133f0 con 0x55c7871c45f0 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f8513e00640 1 -- 172.21.15.69:0/3740817995 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f852801b040 con 0x55c7871c45f0 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.211+0000 7f8538448740 1 -- 172.21.15.69:0/3740817995 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f85200347a0 con 0x55c7871c45f0 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8513e00640 1 -- 172.21.15.69:0/3740817995 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8528013550 con 0x55c7871c45f0 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8538448740 10 client.5694 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8538448740 1 -- 172.21.15.69:0/3740817995 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55c78706d650 con 0x55c7871c45f0 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8513e00640 1 -- 172.21.15.69:0/3740817995 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85200347a0 con 0x55c7871c45f0 2024-02-21T07:44:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8513e00640 1 -- 172.21.15.69:0/3740817995 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f8528012070 con 0x55c7871c45f0 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8538448740 10 client.5694 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8538448740 10 client.5694 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8538448740 20 client.5694 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8538448740 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55c787141020 0x55c787144680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8538448740 4 client.5694 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f8538448740 1 -- 172.21.15.69:0/3740817995 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c786e38890 con 0x55c787141020 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.212+0000 7f852ea00640 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55c787141020 0x55c787144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f852ea00640 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55c787141020 0x55c787144680 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c1c90ab4649a8b4b server_cookie=a9317d063b4af079 in_seq=0 out_seq=0 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8513e00640 10 client.5694 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8513e00640 1 -- 172.21.15.69:0/3740817995 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c786e38890 con 0x55c787141020 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8513e00640 10 client.5694 handle_command_reply: tid=0 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8538448740 1 client.5694 shutdown 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8538448740 1 -- 172.21.15.69:0/3740817995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871c45f0 msgr2=0x55c7871cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8538448740 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871c45f0 0x55c7871cd4e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8528005fd0 tx=0x7f8528001150 comp rx=0 tx=0).stop 2024-02-21T07:44:51.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8538448740 1 -- 172.21.15.69:0/3740817995 shutdown_connections 2024-02-21T07:44:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8538448740 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c7871c45f0 0x55c7871cd4e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8538448740 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c7871bc590 0x55c78721c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8538448740 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x55c787141020 0x55c787144680 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8538448740 1 --2- 172.21.15.69:0/3740817995 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c7871817e0 0x55c7871c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8538448740 1 -- 172.21.15.69:0/3740817995 >> 172.21.15.69:0/3740817995 conn(0x55c787180ec0 msgr2=0x55c78716bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.213+0000 7f8513e00640 0 client.5694 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:44:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8538448740 1 -- 172.21.15.69:0/3740817995 shutdown_connections 2024-02-21T07:44:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8538448740 1 -- 172.21.15.69:0/3740817995 wait complete. 2024-02-21T07:44:51.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8538448740 20 client.5694 trim_cache size 0 max 16384 2024-02-21T07:44:51.223 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:44:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8535800640 1 -- 172.21.15.69:0/2084569509 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f850c09f0a0 msgr2=0x7f850c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8535800640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f850c09f0a0 0x7f850c0a1560 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f85280011e0 tx=0x7f8528007cb0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8535800640 1 -- 172.21.15.69:0/2084569509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85301850e0 msgr2=0x7f853021f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8535800640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85301850e0 0x7f853021f0f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f851800e960 tx=0x7f851800ee20 comp rx=0 tx=0).stop 2024-02-21T07:44:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8535800640 1 -- 172.21.15.69:0/2084569509 shutdown_connections 2024-02-21T07:44:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8535800640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f850c09f0a0 0x7f850c0a1560 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8535800640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f8530185cc0 0x7f8530180270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8535800640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85301850e0 0x7f853021f0f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8535800640 1 --2- 172.21.15.69:0/2084569509 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f853017f700 0x7f8530171d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.214+0000 7f8535800640 1 -- 172.21.15.69:0/2084569509 >> 172.21.15.69:0/2084569509 conn(0x7f85300ce3d0 msgr2=0x7f8530183570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.215+0000 7f8535800640 1 -- 172.21.15.69:0/2084569509 shutdown_connections 2024-02-21T07:44:51.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.215+0000 7f8535800640 1 -- 172.21.15.69:0/2084569509 wait complete. 2024-02-21T07:44:51.235 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:44:51.235 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:44:51.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.430+0000 7f347de00640 1 Processor -- start 2024-02-21T07:44:51.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.430+0000 7f347de00640 1 -- start start 2024-02-21T07:44:51.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.432+0000 7f347de00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f347817ed70 0x7f34780d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.432+0000 7f347de00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f34780f8e10 0x7f34780f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.432+0000 7f347de00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34780d28e0 con 0x7f34780d0160 2024-02-21T07:44:51.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.432+0000 7f347de00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347817f1f0 con 0x7f347817ed70 2024-02-21T07:44:51.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.432+0000 7f347de00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34780d1020 con 0x7f34780f8e10 2024-02-21T07:44:51.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3476000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f347817ed70 0x7f34780d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3476a00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f34780d0160 0x7f3478182cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:40564/0 (socket says 172.21.15.69:40564) 2024-02-21T07:44:51.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3476a00640 1 -- 172.21.15.69:0/1496165107 learned_addr learned my addr 172.21.15.69:0/1496165107 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:51.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3477400640 1 --2- 172.21.15.69:0/1496165107 >> v2:172.21.15.184:3300/0 conn(0x7f34780f8e10 0x7f34780f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3475600640 1 -- 172.21.15.69:0/1496165107 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950922686 0 0) 0x7f34780d28e0 con 0x7f34780d0160 2024-02-21T07:44:51.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3475600640 1 -- 172.21.15.69:0/1496165107 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3458003520 con 0x7f34780d0160 2024-02-21T07:44:51.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3476000640 1 -- 172.21.15.69:0/1496165107 >> v2:172.21.15.184:3300/0 conn(0x7f34780f8e10 msgr2=0x7f34780f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3476000640 1 --2- 172.21.15.69:0/1496165107 >> v2:172.21.15.184:3300/0 conn(0x7f34780f8e10 0x7f34780f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3476000640 1 -- 172.21.15.69:0/1496165107 >> v1:172.21.15.174:6789/0 conn(0x7f34780d0160 legacy=0x7f3478182cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3476000640 1 -- 172.21.15.69:0/1496165107 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34780d1300 con 0x7f347817ed70 2024-02-21T07:44:51.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.433+0000 7f3477400640 1 --2- 172.21.15.69:0/1496165107 >> v2:172.21.15.184:3300/0 conn(0x7f34780f8e10 0x7f34780f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:51.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.435+0000 7f3476000640 1 --2- 172.21.15.69:0/1496165107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347817ed70 0x7f34780d23a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3478074f90 tx=0x7f346002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0abb79250957833 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.435+0000 7f3475600640 1 -- 172.21.15.69:0/1496165107 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346002cb60 con 0x7f347817ed70 2024-02-21T07:44:51.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.435+0000 7f3475600640 1 -- 172.21.15.69:0/1496165107 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346002ccc0 con 0x7f347817ed70 2024-02-21T07:44:51.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.435+0000 7f3475600640 1 -- 172.21.15.69:0/1496165107 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460034660 con 0x7f347817ed70 2024-02-21T07:44:51.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.435+0000 7f347de00640 1 -- 172.21.15.69:0/1496165107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347817ed70 msgr2=0x7f34780d23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.435+0000 7f347de00640 1 --2- 172.21.15.69:0/1496165107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347817ed70 0x7f34780d23a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3478074f90 tx=0x7f346002bdb0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.435+0000 7f347de00640 1 -- 172.21.15.69:0/1496165107 shutdown_connections 2024-02-21T07:44:51.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.435+0000 7f347de00640 1 --2- 172.21.15.69:0/1496165107 >> v2:172.21.15.184:3300/0 conn(0x7f34780f8e10 0x7f34780f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.435+0000 7f347de00640 1 --2- 172.21.15.69:0/1496165107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347817ed70 0x7f34780d23a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.435+0000 7f347de00640 1 -- 172.21.15.69:0/1496165107 >> 172.21.15.69:0/1496165107 conn(0x7f34780ce3d0 msgr2=0x7f34780ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.436+0000 7f347de00640 1 -- 172.21.15.69:0/1496165107 shutdown_connections 2024-02-21T07:44:51.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.436+0000 7f347de00640 1 -- 172.21.15.69:0/1496165107 wait complete. 2024-02-21T07:44:51.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.437+0000 7f347de00640 1 Processor -- start 2024-02-21T07:44:51.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.437+0000 7f347de00640 1 -- start start 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f347de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34780d0160 0x7f347815f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f347de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34780f8e10 0x7f3478178210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f347de00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f347817ed70 0x7f3478159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f347de00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3478177df0 con 0x7f34780f8e10 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f347de00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347815fdf0 con 0x7f347817ed70 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f347de00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3478178750 con 0x7f34780d0160 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3476000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34780f8e10 0x7f3478178210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3476000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34780f8e10 0x7f3478178210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39774/0 (socket says 172.21.15.69:39774) 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3476a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34780d0160 0x7f347815f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3476000640 1 -- 172.21.15.69:0/2620983876 learned_addr learned my addr 172.21.15.69:0/2620983876 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3477400640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f347817ed70 0x7f3478159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3476000640 1 -- 172.21.15.69:0/2620983876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34780d0160 msgr2=0x7f347815f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3476000640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34780d0160 0x7f347815f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3476000640 1 -- 172.21.15.69:0/2620983876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f347817ed70 msgr2=0x7f3478159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3476000640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f347817ed70 0x7f3478159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3476000640 1 -- 172.21.15.69:0/2620983876 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460009a70 con 0x7f34780f8e10 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.439+0000 7f3476a00640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34780d0160 0x7f347815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.440+0000 7f3476000640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34780f8e10 0x7f3478178210 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3460037040 tx=0x7f3460004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.440+0000 7f346f400640 1 -- 172.21.15.69:0/2620983876 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460040650 con 0x7f34780f8e10 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.440+0000 7f346f400640 1 -- 172.21.15.69:0/2620983876 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34600407b0 con 0x7f34780f8e10 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.440+0000 7f347de00640 1 -- 172.21.15.69:0/2620983876 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3478176e90 con 0x7f34780f8e10 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.440+0000 7f346f400640 1 -- 172.21.15.69:0/2620983876 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460040b60 con 0x7f34780f8e10 2024-02-21T07:44:51.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.440+0000 7f347de00640 1 -- 172.21.15.69:0/2620983876 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3478177450 con 0x7f34780f8e10 2024-02-21T07:44:51.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.443+0000 7f346f400640 1 -- 172.21.15.69:0/2620983876 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f3460040cc0 con 0x7f34780f8e10 2024-02-21T07:44:51.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.444+0000 7f3480a11740 1 Processor -- start 2024-02-21T07:44:51.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.444+0000 7f3480a11740 1 -- start start 2024-02-21T07:44:51.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.444+0000 7f346f400640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f345409f0a0 0x7f34540a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.445+0000 7f346f400640 1 -- 172.21.15.69:0/2620983876 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f34600ec920 con 0x7f34780f8e10 2024-02-21T07:44:51.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.445+0000 7f3477400640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f345409f0a0 0x7f34540a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.445+0000 7f3480a11740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e66ec0 0x563de9e672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.445+0000 7f3480a11740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9ea2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.445+0000 7f3480a11740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9ea3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.445+0000 7f3480a11740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9d9a210 con 0x563de9e66ec0 2024-02-21T07:44:51.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.445+0000 7f3480a11740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9d97740 con 0x563de9ea2590 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.445+0000 7f3480a11740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9d92f20 con 0x563de9e677e0 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e66ec0 0x563de9e672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e66ec0 0x563de9e672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39790/0 (socket says 172.21.15.69:39790) 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476a00640 1 -- 172.21.15.69:0/3116151203 learned_addr learned my addr 172.21.15.69:0/3116151203 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3477400640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f345409f0a0 0x7f34540a1560 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f34780d2970 tx=0x7f3470008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3477400640 1 --2- 172.21.15.69:0/3116151203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9ea3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476000640 1 --2- 172.21.15.69:0/3116151203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9ea2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476a00640 1 -- 172.21.15.69:0/3116151203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 msgr2=0x563de9ea2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476a00640 1 --2- 172.21.15.69:0/3116151203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9ea2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476a00640 1 -- 172.21.15.69:0/3116151203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 msgr2=0x563de9ea3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476a00640 1 --2- 172.21.15.69:0/3116151203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9ea3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476a00640 1 -- 172.21.15.69:0/3116151203 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563de9d54df0 con 0x563de9e66ec0 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476000640 1 --2- 172.21.15.69:0/3116151203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9ea2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3476a00640 1 --2- 172.21.15.69:0/3116151203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e66ec0 0x563de9e672a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3468001ad0 tx=0x7f3468000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dd53381193772f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.446+0000 7f3467400640 1 -- 172.21.15.69:0/3116151203 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346800fe50 con 0x563de9e66ec0 2024-02-21T07:44:51.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3467400640 1 -- 172.21.15.69:0/3116151203 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3468001ce0 con 0x563de9e66ec0 2024-02-21T07:44:51.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3467400640 1 -- 172.21.15.69:0/3116151203 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3468005af0 con 0x563de9e66ec0 2024-02-21T07:44:51.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3480a11740 1 -- 172.21.15.69:0/3116151203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e66ec0 msgr2=0x563de9e672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3480a11740 1 --2- 172.21.15.69:0/3116151203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e66ec0 0x563de9e672a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3468001ad0 tx=0x7f3468000bc0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3480a11740 1 -- 172.21.15.69:0/3116151203 shutdown_connections 2024-02-21T07:44:51.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3480a11740 1 --2- 172.21.15.69:0/3116151203 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9ea3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3480a11740 1 --2- 172.21.15.69:0/3116151203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9ea2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3480a11740 1 --2- 172.21.15.69:0/3116151203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e66ec0 0x563de9e672a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3480a11740 1 -- 172.21.15.69:0/3116151203 >> 172.21.15.69:0/3116151203 conn(0x563de9e29490 msgr2=0x563de9e2a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3480a11740 1 -- 172.21.15.69:0/3116151203 shutdown_connections 2024-02-21T07:44:51.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.447+0000 7f3480a11740 1 -- 172.21.15.69:0/3116151203 wait complete. 2024-02-21T07:44:51.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.448+0000 7f3480a11740 1 -- start start 2024-02-21T07:44:51.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.448+0000 7f3480a11740 1 Processor -- start 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.449+0000 7f3480a11740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e677e0 0x563de9e654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.449+0000 7f3480a11740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.449+0000 7f3480a11740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e25300 0x563de9e54650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.449+0000 7f3480a11740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9d38150 con 0x563de9e677e0 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3480a11740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9d37df0 con 0x563de9ea2590 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3480a11740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9b011c0 con 0x563de9e25300 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3480a11740 10 client.0 _ll_register_callbacks cb 0x563de9d872b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3476a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e677e0 0x563de9e654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3476a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e677e0 0x563de9e654c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39804/0 (socket says 172.21.15.69:39804) 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3477400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e25300 0x563de9e54650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3476a00640 1 -- 172.21.15.69:0/2566677125 learned_addr learned my addr 172.21.15.69:0/2566677125 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3476000640 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3476a00640 1 -- 172.21.15.69:0/2566677125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e25300 msgr2=0x563de9e54650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3476a00640 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e25300 0x563de9e54650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3476a00640 1 -- 172.21.15.69:0/2566677125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 msgr2=0x563de9eab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3476a00640 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3476a00640 1 -- 172.21.15.69:0/2566677125 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3458003520 con 0x563de9e677e0 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f3476a00640 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e677e0 0x563de9e654c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3468014000 tx=0x7f34680010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909ea2937b0ed906 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.450+0000 7f345fe00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f345fe00640 1 -- 172.21.15.69:0/2566677125 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34680074e0 con 0x563de9e677e0 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f345fe00640 1 -- 172.21.15.69:0/2566677125 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3468007640 con 0x563de9e677e0 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f3480a11740 1 -- 172.21.15.69:0/2566677125 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563de9a927e0 con 0x563de9e677e0 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f345fe00640 1 -- 172.21.15.69:0/2566677125 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3468026470 con 0x563de9e677e0 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f3480a11740 10 client.5706 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f3480a11740 1 -- 172.21.15.69:0/2566677125 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x563de9d915a0 con 0x563de9e677e0 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f345fe00640 1 -- 172.21.15.69:0/2566677125 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563de9a927e0 con 0x563de9e677e0 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f345fe00640 1 -- 172.21.15.69:0/2566677125 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f3468012070 con 0x563de9e677e0 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f3480a11740 10 client.5706 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f3480a11740 10 client.5706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f3480a11740 20 client.5706 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:51.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.451+0000 7f3480a11740 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563de9e65bd0 0x563de9e277c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.452+0000 7f3480a11740 4 client.5706 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:51.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.452+0000 7f3480a11740 1 -- 172.21.15.69:0/2566677125 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563de9acf720 con 0x563de9e65bd0 2024-02-21T07:44:51.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.452+0000 7f3476000640 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563de9e65bd0 0x563de9e277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.452+0000 7f345fe00640 10 client.5706 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:51.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.452+0000 7f3476000640 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563de9e65bd0 0x563de9e277c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5782a5f326e8990 server_cookie=a324e5930a274a07 in_seq=0 out_seq=0 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f345fe00640 1 -- 172.21.15.69:0/2566677125 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563de9acf720 con 0x563de9e65bd0 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f345fe00640 10 client.5706 handle_command_reply: tid=0 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 client.5706 shutdown 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 -- 172.21.15.69:0/2566677125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e677e0 msgr2=0x563de9e654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e677e0 0x563de9e654c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3468014000 tx=0x7f34680010a0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 -- 172.21.15.69:0/2566677125 shutdown_connections 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563de9e65bd0 0x563de9e277c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e25300 0x563de9e54650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 --2- 172.21.15.69:0/2566677125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e677e0 0x563de9e654c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f345fe00640 0 client.5706 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:51.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 -- 172.21.15.69:0/2566677125 >> 172.21.15.69:0/2566677125 conn(0x563de9e66ec0 msgr2=0x563de9e2af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 -- 172.21.15.69:0/2566677125 shutdown_connections 2024-02-21T07:44:51.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 1 -- 172.21.15.69:0/2566677125 wait complete. 2024-02-21T07:44:51.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.453+0000 7f3480a11740 20 client.5706 trim_cache size 0 max 16384 2024-02-21T07:44:51.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.466+0000 7f3480a11740 1 Processor -- start 2024-02-21T07:44:51.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.466+0000 7f3480a11740 1 -- start start 2024-02-21T07:44:51.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3480a11740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3480a11740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9e26460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3480a11740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eab640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3480a11740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9e2afb0 con 0x563de9e25300 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3480a11740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9ea1f50 con 0x563de9ea2590 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3480a11740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9e2b200 con 0x563de9e677e0 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3476a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3476a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39808/0 (socket says 172.21.15.69:39808) 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3476a00640 1 -- 172.21.15.69:0/3639100088 learned_addr learned my addr 172.21.15.69:0/3639100088 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3476000640 1 --2- 172.21.15.69:0/3639100088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9e26460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3477400640 1 --2- 172.21.15.69:0/3639100088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3476a00640 1 -- 172.21.15.69:0/3639100088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 msgr2=0x563de9e26460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.467+0000 7f3476a00640 1 --2- 172.21.15.69:0/3639100088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9e26460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.468+0000 7f3476a00640 1 -- 172.21.15.69:0/3639100088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 msgr2=0x563de9eab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.468+0000 7f3476a00640 1 --2- 172.21.15.69:0/3639100088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eab640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.468+0000 7f3476a00640 1 -- 172.21.15.69:0/3639100088 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563de9e9f620 con 0x563de9e25300 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.468+0000 7f3476a00640 1 --2- 172.21.15.69:0/3639100088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f34680266f0 tx=0x7f346801f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85980e246d3318a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.468+0000 7f3466a00640 1 -- 172.21.15.69:0/3639100088 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34680016f0 con 0x563de9e25300 2024-02-21T07:44:51.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.468+0000 7f3466a00640 1 -- 172.21.15.69:0/3639100088 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346801b380 con 0x563de9e25300 2024-02-21T07:44:51.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.468+0000 7f3466a00640 1 -- 172.21.15.69:0/3639100088 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34680072e0 con 0x563de9e25300 2024-02-21T07:44:51.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.468+0000 7f3480a11740 1 -- 172.21.15.69:0/3639100088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 msgr2=0x563de9e6c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.468+0000 7f3480a11740 1 --2- 172.21.15.69:0/3639100088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f34680266f0 tx=0x7f346801f070 comp rx=0 tx=0).stop 2024-02-21T07:44:51.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.469+0000 7f3480a11740 1 -- 172.21.15.69:0/3639100088 shutdown_connections 2024-02-21T07:44:51.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.469+0000 7f3480a11740 1 --2- 172.21.15.69:0/3639100088 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.469+0000 7f3480a11740 1 --2- 172.21.15.69:0/3639100088 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9e26460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.469+0000 7f3480a11740 1 --2- 172.21.15.69:0/3639100088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.469+0000 7f3480a11740 1 -- 172.21.15.69:0/3639100088 >> 172.21.15.69:0/3639100088 conn(0x563de9e66ec0 msgr2=0x563de9e24be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.469+0000 7f3480a11740 1 -- 172.21.15.69:0/3639100088 shutdown_connections 2024-02-21T07:44:51.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.469+0000 7f3480a11740 1 -- 172.21.15.69:0/3639100088 wait complete. 2024-02-21T07:44:51.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.469+0000 7f3480a11740 1 -- start start 2024-02-21T07:44:51.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.470+0000 7f3480a11740 1 Processor -- start 2024-02-21T07:44:51.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3480a11740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3480a11740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9e64df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3480a11740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eeba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3480a11740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9e28910 con 0x563de9e25300 2024-02-21T07:44:51.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3480a11740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9e6c080 con 0x563de9ea2590 2024-02-21T07:44:51.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3480a11740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x563de9eefa70 con 0x563de9e677e0 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3480a11740 10 client.0 _ll_register_callbacks cb 0x7f3468001640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3476a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3476a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39812/0 (socket says 172.21.15.69:39812) 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3476a00640 1 -- 172.21.15.69:0/3110353454 learned_addr learned my addr 172.21.15.69:0/3110353454 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3477400640 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eeba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3476000640 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9e64df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3476a00640 1 -- 172.21.15.69:0/3110353454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 msgr2=0x563de9e64df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3476a00640 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9e64df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3476a00640 1 -- 172.21.15.69:0/3110353454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 msgr2=0x563de9eeba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3476a00640 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eeba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.471+0000 7f3476a00640 1 -- 172.21.15.69:0/3110353454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563de9d915a0 con 0x563de9e25300 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.472+0000 7f3476a00640 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3468000f60 tx=0x7f3468009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0989cbe647f7a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.472+0000 7f345fe00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.472+0000 7f345fe00640 1 -- 172.21.15.69:0/3110353454 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34680074e0 con 0x563de9e25300 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.472+0000 7f345fe00640 1 -- 172.21.15.69:0/3110353454 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3468007640 con 0x563de9e25300 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.472+0000 7f3480a11740 1 -- 172.21.15.69:0/3110353454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3468001ce0 con 0x563de9e25300 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.472+0000 7f345fe00640 1 -- 172.21.15.69:0/3110353454 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f346801b8c0 con 0x563de9e25300 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.472+0000 7f3480a11740 10 client.5712 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.472+0000 7f3480a11740 1 -- 172.21.15.69:0/3110353454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x563de9d2dab0 con 0x563de9e25300 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.472+0000 7f345fe00640 1 -- 172.21.15.69:0/3110353454 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3468046080 con 0x563de9e25300 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.473+0000 7f345fe00640 1 -- 172.21.15.69:0/3110353454 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f346801ba20 con 0x563de9e25300 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.473+0000 7f3480a11740 10 client.5712 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.473+0000 7f3480a11740 10 client.5712 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.473+0000 7f3480a11740 20 client.5712 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.473+0000 7f3480a11740 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563de9f069b0 0x563de9e6b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:51.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.473+0000 7f3480a11740 4 client.5712 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.473+0000 7f3480a11740 1 -- 172.21.15.69:0/3110353454 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563de9b1e890 con 0x563de9f069b0 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.473+0000 7f3476000640 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563de9f069b0 0x563de9e6b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.473+0000 7f3476000640 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563de9f069b0 0x563de9e6b3b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fa3593afbe1c0a1 server_cookie=8ebed83aebd31005 in_seq=0 out_seq=0 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.473+0000 7f345fe00640 10 client.5712 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f345fe00640 1 -- 172.21.15.69:0/3110353454 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563de9b1e890 con 0x563de9f069b0 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f345fe00640 10 client.5712 handle_command_reply: tid=0 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 client.5712 shutdown 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 -- 172.21.15.69:0/3110353454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 msgr2=0x563de9e6c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3468000f60 tx=0x7f3468009040 comp rx=0 tx=0).stop 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 -- 172.21.15.69:0/3110353454 shutdown_connections 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x563de9f069b0 0x563de9e6b3b0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x563de9ea2590 0x563de9eeba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x563de9e677e0 0x563de9e64df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f345fe00640 0 client.5712 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:51.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 --2- 172.21.15.69:0/3110353454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de9e25300 0x563de9e6c920 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 -- 172.21.15.69:0/3110353454 >> 172.21.15.69:0/3110353454 conn(0x563de9e66ec0 msgr2=0x563de9e54250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 -- 172.21.15.69:0/3110353454 shutdown_connections 2024-02-21T07:44:51.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 1 -- 172.21.15.69:0/3110353454 wait complete. 2024-02-21T07:44:51.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.474+0000 7f3480a11740 20 client.5712 trim_cache size 0 max 16384 2024-02-21T07:44:51.484 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:44:51.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 -- 172.21.15.69:0/2620983876 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f345409f0a0 msgr2=0x7f34540a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f345409f0a0 0x7f34540a1560 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f34780d2970 tx=0x7f3470008040 comp rx=0 tx=0).stop 2024-02-21T07:44:51.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 -- 172.21.15.69:0/2620983876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34780f8e10 msgr2=0x7f3478178210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:51.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34780f8e10 0x7f3478178210 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3460037040 tx=0x7f3460004a40 comp rx=0 tx=0).stop 2024-02-21T07:44:51.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 -- 172.21.15.69:0/2620983876 shutdown_connections 2024-02-21T07:44:51.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f345409f0a0 0x7f34540a1560 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f347817ed70 0x7f3478159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34780f8e10 0x7f3478178210 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 --2- 172.21.15.69:0/2620983876 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f34780d0160 0x7f347815f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:51.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 -- 172.21.15.69:0/2620983876 >> 172.21.15.69:0/2620983876 conn(0x7f34780ce3d0 msgr2=0x7f34780725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:51.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 -- 172.21.15.69:0/2620983876 shutdown_connections 2024-02-21T07:44:51.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:51.475+0000 7f347de00640 1 -- 172.21.15.69:0/2620983876 wait complete. 2024-02-21T07:44:52.496 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T07:44:52.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:44:52.497 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T07:44:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.717+0000 7fdc63000640 1 Processor -- start 2024-02-21T07:44:52.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.717+0000 7fdc63000640 1 -- start start 2024-02-21T07:44:52.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.720+0000 7fdc63000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fdc5c182900 0x7fdc5c08d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.720+0000 7fdc63000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5c0d0a20 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.720+0000 7fdc63000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5c187f30 con 0x7fdc5c182ce0 2024-02-21T07:44:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.720+0000 7fdc63000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5c188210 con 0x7fdc5c182900 2024-02-21T07:44:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.720+0000 7fdc5b400640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fdc5c182ce0 0x7fdc5c0d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:51124/0 (socket says 172.21.15.69:51124) 2024-02-21T07:44:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.720+0000 7fdc5b400640 1 -- 172.21.15.69:0/4101355810 learned_addr learned my addr 172.21.15.69:0/4101355810 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:44:52.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.720+0000 7fdc5be00640 1 --2- 172.21.15.69:0/4101355810 >> v2:172.21.15.174:3300/0 conn(0x7fdc5c182900 0x7fdc5c08d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.720+0000 7fdc5aa00640 1 -- 172.21.15.69:0/4101355810 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202896043 0 0) 0x7fdc5c187f30 con 0x7fdc5c182ce0 2024-02-21T07:44:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.720+0000 7fdc5aa00640 1 -- 172.21.15.69:0/4101355810 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc40003520 con 0x7fdc5c182ce0 2024-02-21T07:44:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.721+0000 7fdc5be00640 1 -- 172.21.15.69:0/4101355810 >> v1:172.21.15.184:6789/0 conn(0x7fdc5c182ce0 legacy=0x7fdc5c0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.721+0000 7fdc5be00640 1 -- 172.21.15.69:0/4101355810 >> v1:172.21.15.174:6789/0 conn(0x7fdc5c0d18f0 legacy=0x7fdc5c1887d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.721+0000 7fdc5aa00640 1 -- 172.21.15.69:0/4101355810 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730399904 0 0) 0x7fdc5c0d0a20 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.721+0000 7fdc5be00640 1 -- 172.21.15.69:0/4101355810 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c1884f0 con 0x7fdc5c182900 2024-02-21T07:44:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.722+0000 7fdc5be00640 1 --2- 172.21.15.69:0/4101355810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5c182900 0x7fdc5c08d4e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009d90 tx=0x7fdc4c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55be3ee1a32cf03b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.722+0000 7fdc5aa00640 1 -- 172.21.15.69:0/4101355810 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c02cbd0 con 0x7fdc5c182900 2024-02-21T07:44:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.722+0000 7fdc5aa00640 1 -- 172.21.15.69:0/4101355810 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c02cd30 con 0x7fdc5c182900 2024-02-21T07:44:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.722+0000 7fdc5aa00640 1 -- 172.21.15.69:0/4101355810 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c02cea0 con 0x7fdc5c182900 2024-02-21T07:44:52.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.722+0000 7fdc63000640 1 -- 172.21.15.69:0/4101355810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5c182900 msgr2=0x7fdc5c08d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.722+0000 7fdc63000640 1 --2- 172.21.15.69:0/4101355810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5c182900 0x7fdc5c08d4e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009d90 tx=0x7fdc4c02be20 comp rx=0 tx=0).stop 2024-02-21T07:44:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.722+0000 7fdc63000640 1 -- 172.21.15.69:0/4101355810 shutdown_connections 2024-02-21T07:44:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.722+0000 7fdc63000640 1 --2- 172.21.15.69:0/4101355810 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5c182900 0x7fdc5c08d4e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.722+0000 7fdc63000640 1 -- 172.21.15.69:0/4101355810 >> 172.21.15.69:0/4101355810 conn(0x7fdc5c0d6580 msgr2=0x7fdc5c0d6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.723+0000 7fdc63000640 1 -- 172.21.15.69:0/4101355810 shutdown_connections 2024-02-21T07:44:52.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.723+0000 7fdc63000640 1 -- 172.21.15.69:0/4101355810 wait complete. 2024-02-21T07:44:52.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.724+0000 7fdc63000640 1 Processor -- start 2024-02-21T07:44:52.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.725+0000 7fdc63000640 1 -- start start 2024-02-21T07:44:52.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc63000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc5c0d18f0 0x7fdc5c21fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc63000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc5c182900 0x7fdc5c1845f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc63000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5c182ce0 0x7fdc5c16e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc63000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c183270 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc63000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c183550 con 0x7fdc5c182ce0 2024-02-21T07:44:52.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc63000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c183830 con 0x7fdc5c182900 2024-02-21T07:44:52.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc5be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc5c0d18f0 0x7fdc5c21fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc5be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc5c0d18f0 0x7fdc5c21fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39816/0 (socket says 172.21.15.69:39816) 2024-02-21T07:44:52.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc5be00640 1 -- 172.21.15.69:0/347540870 learned_addr learned my addr 172.21.15.69:0/347540870 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:52.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc61000640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5c182ce0 0x7fdc5c16e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc5b400640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc5c182900 0x7fdc5c1845f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc5be00640 1 -- 172.21.15.69:0/347540870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc5c182900 msgr2=0x7fdc5c1845f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc5be00640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc5c182900 0x7fdc5c1845f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc5be00640 1 -- 172.21.15.69:0/347540870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5c182ce0 msgr2=0x7fdc5c16e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc5be00640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5c182ce0 0x7fdc5c16e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.726+0000 7fdc5be00640 1 -- 172.21.15.69:0/347540870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c009a70 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.727+0000 7fdc5be00640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc5c0d18f0 0x7fdc5c21fb00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c037040 tx=0x7fdc4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:52.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.727+0000 7fdc53e00640 1 -- 172.21.15.69:0/347540870 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c02cea0 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.727+0000 7fdc53e00640 1 -- 172.21.15.69:0/347540870 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c040670 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.727+0000 7fdc53e00640 1 -- 172.21.15.69:0/347540870 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c040a20 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.727+0000 7fdc63000640 1 -- 172.21.15.69:0/347540870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5c183b10 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.727+0000 7fdc63000640 1 -- 172.21.15.69:0/347540870 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c1840d0 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.730+0000 7fdc53e00640 1 -- 172.21.15.69:0/347540870 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fdc4c040b80 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.731+0000 7fdc65c65740 1 Processor -- start 2024-02-21T07:44:52.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.731+0000 7fdc65c65740 1 -- start start 2024-02-21T07:44:52.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.732+0000 7fdc53e00640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc3809f150 0x7fdc380a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.732+0000 7fdc53e00640 1 -- 172.21.15.69:0/347540870 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdc4c0ec230 con 0x7fdc5c0d18f0 2024-02-21T07:44:52.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.732+0000 7fdc61000640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc3809f150 0x7fdc380a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c741c0 0x564e03c745a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c74ae0 0x564e03caf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 0x564e03cb0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc65c65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03bf4300 con 0x564e03c74ae0 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc65c65740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03ba6e50 con 0x564e03caf890 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc65c65740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03ba4380 con 0x564e03c741c0 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc61000640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc3809f150 0x7fdc380a1610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdc54000f60 tx=0x7fdc54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc61000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 0x564e03cb0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc5b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c74ae0 0x564e03caf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc61000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 0x564e03cb0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38086/0 (socket says 172.21.15.69:38086) 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc61000640 1 -- 172.21.15.69:0/384286119 learned_addr learned my addr 172.21.15.69:0/384286119 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc5be00640 1 --2- 172.21.15.69:0/384286119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c741c0 0x564e03c745a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc5be00640 1 -- 172.21.15.69:0/384286119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 msgr2=0x564e03cb0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc5be00640 1 --2- 172.21.15.69:0/384286119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 0x564e03cb0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc5be00640 1 -- 172.21.15.69:0/384286119 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c74ae0 msgr2=0x564e03caf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:52.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc5be00640 1 --2- 172.21.15.69:0/384286119 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c74ae0 0x564e03caf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.733+0000 7fdc5be00640 1 -- 172.21.15.69:0/384286119 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e03b68c80 con 0x564e03c741c0 2024-02-21T07:44:52.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.734+0000 7fdc5be00640 1 --2- 172.21.15.69:0/384286119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c741c0 0x564e03c745a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0e9ba0 tx=0x7fdc4c0b9c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f78773185d109e9f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:52.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.734+0000 7fdc50c00640 1 -- 172.21.15.69:0/384286119 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0ec070 con 0x564e03c741c0 2024-02-21T07:44:52.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.734+0000 7fdc50c00640 1 -- 172.21.15.69:0/384286119 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0b9d10 con 0x564e03c741c0 2024-02-21T07:44:52.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.734+0000 7fdc50c00640 1 -- 172.21.15.69:0/384286119 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0bde60 con 0x564e03c741c0 2024-02-21T07:44:52.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.734+0000 7fdc65c65740 1 -- 172.21.15.69:0/384286119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c741c0 msgr2=0x564e03c745a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.734+0000 7fdc65c65740 1 --2- 172.21.15.69:0/384286119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c741c0 0x564e03c745a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0e9ba0 tx=0x7fdc4c0b9c10 comp rx=0 tx=0).stop 2024-02-21T07:44:52.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.734+0000 7fdc65c65740 1 -- 172.21.15.69:0/384286119 shutdown_connections 2024-02-21T07:44:52.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.735+0000 7fdc65c65740 1 --2- 172.21.15.69:0/384286119 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 0x564e03cb0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.735+0000 7fdc65c65740 1 --2- 172.21.15.69:0/384286119 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c74ae0 0x564e03caf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.735+0000 7fdc65c65740 1 --2- 172.21.15.69:0/384286119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c741c0 0x564e03c745a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.735+0000 7fdc65c65740 1 -- 172.21.15.69:0/384286119 >> 172.21.15.69:0/384286119 conn(0x564e03c36790 msgr2=0x564e03c37810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:52.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.735+0000 7fdc65c65740 1 -- 172.21.15.69:0/384286119 shutdown_connections 2024-02-21T07:44:52.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.735+0000 7fdc65c65740 1 -- 172.21.15.69:0/384286119 wait complete. 2024-02-21T07:44:52.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.735+0000 7fdc65c65740 1 -- start start 2024-02-21T07:44:52.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.736+0000 7fdc65c65740 1 Processor -- start 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 0x564e03c68d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03c66e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c61c80 0x564e03c31f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc65c65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03b9fb60 con 0x564e03caf890 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc65c65740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03b44fd0 con 0x564e03c61c80 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc65c65740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03b44c70 con 0x564e03c74ae0 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc65c65740 10 client.0 _ll_register_callbacks cb 0x564e038b0c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc5b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03c66e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc5be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 0x564e03c68d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc5be00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 0x564e03c68d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53298/0 (socket says 172.21.15.69:53298) 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc5be00640 1 -- 172.21.15.69:0/4260709081 learned_addr learned my addr 172.21.15.69:0/4260709081 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:52.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc5b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03c66e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39834/0 (socket says 172.21.15.69:39834) 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.737+0000 7fdc61000640 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c61c80 0x564e03c31f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc5be00640 1 -- 172.21.15.69:0/4260709081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c61c80 msgr2=0x564e03c31f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc5be00640 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c61c80 0x564e03c31f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc5be00640 1 -- 172.21.15.69:0/4260709081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 msgr2=0x564e03c66e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc5be00640 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03c66e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc5be00640 1 -- 172.21.15.69:0/4260709081 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c1840d0 con 0x564e03c74ae0 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc5be00640 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 0x564e03c68d10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0b7fc0 tx=0x7fdc4c039000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac05e0ccbbc4443 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc49600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc49600640 1 -- 172.21.15.69:0/4260709081 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0d7370 con 0x564e03c74ae0 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc49600640 1 -- 172.21.15.69:0/4260709081 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdc4c0c24b0 con 0x564e03c74ae0 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc65c65740 1 -- 172.21.15.69:0/4260709081 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564e0389f860 con 0x564e03c74ae0 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc49600640 1 -- 172.21.15.69:0/4260709081 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc4c0bde60 con 0x564e03c74ae0 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc65c65740 10 client.5870 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc65c65740 1 -- 172.21.15.69:0/4260709081 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x564e03b9e1e0 con 0x564e03c74ae0 2024-02-21T07:44:52.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.738+0000 7fdc49600640 1 -- 172.21.15.69:0/4260709081 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c09d020 con 0x564e03c74ae0 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.739+0000 7fdc49600640 1 -- 172.21.15.69:0/4260709081 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fdc4c0b9f70 con 0x564e03c74ae0 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.739+0000 7fdc65c65740 10 client.5870 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.739+0000 7fdc65c65740 10 client.5870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.739+0000 7fdc65c65740 20 client.5870 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.739+0000 7fdc65c65740 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564e03cbc070 0x564e03cbc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.739+0000 7fdc65c65740 4 client.5870 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.739+0000 7fdc65c65740 1 -- 172.21.15.69:0/4260709081 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e038f0410 con 0x564e03cbc070 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.739+0000 7fdc5b400640 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564e03cbc070 0x564e03cbc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.740+0000 7fdc5b400640 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564e03cbc070 0x564e03cbc480 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46fa02b8f3aac3e1 server_cookie=a998c2c0b1d3884c in_seq=0 out_seq=0 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.740+0000 7fdc49600640 10 client.5870 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.740+0000 7fdc49600640 1 -- 172.21.15.69:0/4260709081 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564e038f0410 con 0x564e03cbc070 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.740+0000 7fdc49600640 10 client.5870 handle_command_reply: tid=0 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.740+0000 7fdc65c65740 1 client.5870 shutdown 2024-02-21T07:44:52.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.740+0000 7fdc65c65740 1 -- 172.21.15.69:0/4260709081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 msgr2=0x564e03c68d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.740+0000 7fdc65c65740 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 0x564e03c68d10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0b7fc0 tx=0x7fdc4c039000 comp rx=0 tx=0).stop 2024-02-21T07:44:52.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.741+0000 7fdc65c65740 1 -- 172.21.15.69:0/4260709081 shutdown_connections 2024-02-21T07:44:52.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.741+0000 7fdc65c65740 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564e03cbc070 0x564e03cbc480 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.741+0000 7fdc65c65740 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c61c80 0x564e03c31f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.741+0000 7fdc65c65740 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03c66e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.741+0000 7fdc65c65740 1 --2- 172.21.15.69:0/4260709081 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 0x564e03c68d10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.741+0000 7fdc49600640 0 client.5870 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:52.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.741+0000 7fdc65c65740 1 -- 172.21.15.69:0/4260709081 >> 172.21.15.69:0/4260709081 conn(0x564e03c741c0 msgr2=0x564e03c38200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:52.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.741+0000 7fdc65c65740 1 -- 172.21.15.69:0/4260709081 shutdown_connections 2024-02-21T07:44:52.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.741+0000 7fdc65c65740 1 -- 172.21.15.69:0/4260709081 wait complete. 2024-02-21T07:44:52.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.741+0000 7fdc65c65740 20 client.5870 trim_cache size 0 max 16384 2024-02-21T07:44:52.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.757+0000 7fdc65c65740 1 Processor -- start 2024-02-21T07:44:52.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.758+0000 7fdc65c65740 1 -- start start 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c61c80 0x564e03c31e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c74ae0 0x564e03d11d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03d12270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc65c65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e038e80c0 con 0x564e03caf890 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc65c65740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03c745a0 con 0x564e03c74ae0 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc65c65740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03c69060 con 0x564e03c61c80 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc61000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03d12270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc61000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03d12270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39844/0 (socket says 172.21.15.69:39844) 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc61000640 1 -- 172.21.15.69:0/1800930837 learned_addr learned my addr 172.21.15.69:0/1800930837 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc5be00640 1 --2- 172.21.15.69:0/1800930837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c61c80 0x564e03c31e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc5b400640 1 --2- 172.21.15.69:0/1800930837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c74ae0 0x564e03d11d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc61000640 1 -- 172.21.15.69:0/1800930837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c61c80 msgr2=0x564e03c31e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:52.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.759+0000 7fdc61000640 1 --2- 172.21.15.69:0/1800930837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c61c80 0x564e03c31e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.760+0000 7fdc61000640 1 -- 172.21.15.69:0/1800930837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c74ae0 msgr2=0x564e03d11d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:52.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.760+0000 7fdc61000640 1 --2- 172.21.15.69:0/1800930837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c74ae0 0x564e03d11d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.760+0000 7fdc61000640 1 -- 172.21.15.69:0/1800930837 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e03c35650 con 0x564e03caf890 2024-02-21T07:44:52.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.760+0000 7fdc5b400640 1 --2- 172.21.15.69:0/1800930837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c74ae0 0x564e03d11d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:52.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.760+0000 7fdc61000640 1 --2- 172.21.15.69:0/1800930837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03d12270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x564e03c78330 tx=0x7fdc54012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bec453db9bc43b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:52.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.760+0000 7fdc4be00640 1 -- 172.21.15.69:0/1800930837 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5400f7d0 con 0x564e03caf890 2024-02-21T07:44:52.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.760+0000 7fdc4be00640 1 -- 172.21.15.69:0/1800930837 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc54026070 con 0x564e03caf890 2024-02-21T07:44:52.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.760+0000 7fdc4be00640 1 -- 172.21.15.69:0/1800930837 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5400fb30 con 0x564e03caf890 2024-02-21T07:44:52.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.761+0000 7fdc65c65740 1 -- 172.21.15.69:0/1800930837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 msgr2=0x564e03d12270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.761+0000 7fdc65c65740 1 --2- 172.21.15.69:0/1800930837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03d12270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x564e03c78330 tx=0x7fdc54012000 comp rx=0 tx=0).stop 2024-02-21T07:44:52.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.761+0000 7fdc65c65740 1 -- 172.21.15.69:0/1800930837 shutdown_connections 2024-02-21T07:44:52.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.761+0000 7fdc65c65740 1 --2- 172.21.15.69:0/1800930837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03caf890 0x564e03d12270 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.761+0000 7fdc65c65740 1 --2- 172.21.15.69:0/1800930837 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03c74ae0 0x564e03d11d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.761+0000 7fdc65c65740 1 --2- 172.21.15.69:0/1800930837 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c61c80 0x564e03c31e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.761+0000 7fdc65c65740 1 -- 172.21.15.69:0/1800930837 >> 172.21.15.69:0/1800930837 conn(0x564e03c741c0 msgr2=0x564e03c66fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:52.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.761+0000 7fdc65c65740 1 -- 172.21.15.69:0/1800930837 shutdown_connections 2024-02-21T07:44:52.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.761+0000 7fdc65c65740 1 -- 172.21.15.69:0/1800930837 wait complete. 2024-02-21T07:44:52.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.762+0000 7fdc65c65740 1 -- start start 2024-02-21T07:44:52.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.762+0000 7fdc65c65740 1 Processor -- start 2024-02-21T07:44:52.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.763+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c61c80 0x564e03d1f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.763+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 0x564e03cc0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.763+0000 7fdc65c65740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 0x564e03ca83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.763+0000 7fdc65c65740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03c65d40 con 0x564e03c61c80 2024-02-21T07:44:52.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.763+0000 7fdc65c65740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03ca8910 con 0x564e03caf890 2024-02-21T07:44:52.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.763+0000 7fdc65c65740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e03caf670 con 0x564e03c74ae0 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.763+0000 7fdc65c65740 10 client.0 _ll_register_callbacks cb 0x7fdc4c02cc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.763+0000 7fdc5be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c61c80 0x564e03d1f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.763+0000 7fdc5be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c61c80 0x564e03d1f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39858/0 (socket says 172.21.15.69:39858) 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.763+0000 7fdc5be00640 1 -- 172.21.15.69:0/114071356 learned_addr learned my addr 172.21.15.69:0/114071356 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc5b400640 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 0x564e03cc0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc61000640 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 0x564e03ca83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc5be00640 1 -- 172.21.15.69:0/114071356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 msgr2=0x564e03cc0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc5be00640 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 0x564e03cc0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc5be00640 1 -- 172.21.15.69:0/114071356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 msgr2=0x564e03ca83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc5be00640 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 0x564e03ca83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc5be00640 1 -- 172.21.15.69:0/114071356 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc40003520 con 0x564e03c61c80 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc61000640 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 0x564e03ca83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc5be00640 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c61c80 0x564e03d1f8e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c02be60 tx=0x7fdc4c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151e0c0bfad9f6c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:52.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc49600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc49600640 1 -- 172.21.15.69:0/114071356 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0c2220 con 0x564e03c61c80 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc49600640 1 -- 172.21.15.69:0/114071356 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdc4c09e080 con 0x564e03c61c80 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.764+0000 7fdc65c65740 1 -- 172.21.15.69:0/114071356 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc4c0b9d10 con 0x564e03c61c80 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc49600640 1 -- 172.21.15.69:0/114071356 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc4c0b9ae0 con 0x564e03c61c80 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc65c65740 10 client.5727 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc65c65740 1 -- 172.21.15.69:0/114071356 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x7fdc54007090 con 0x564e03c61c80 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc49600640 1 -- 172.21.15.69:0/114071356 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0b9d10 con 0x564e03c61c80 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc49600640 1 -- 172.21.15.69:0/114071356 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fdc4c0b9160 con 0x564e03c61c80 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc65c65740 10 client.5727 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc65c65740 10 client.5727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc65c65740 20 client.5727 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc65c65740 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564e03cb8510 0x564e03cadd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc65c65740 4 client.5727 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc65c65740 1 -- 172.21.15.69:0/114071356 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x564e038dc7b0 con 0x564e03cb8510 2024-02-21T07:44:52.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.765+0000 7fdc5b400640 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564e03cb8510 0x564e03cadd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.766+0000 7fdc49600640 10 client.5727 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.766+0000 7fdc5b400640 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564e03cb8510 0x564e03cadd70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f85ae3a1ccc583b7 server_cookie=26c4e65ff6ce62d1 in_seq=0 out_seq=0 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.766+0000 7fdc49600640 1 -- 172.21.15.69:0/114071356 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564e038dc7b0 con 0x564e03cb8510 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.766+0000 7fdc49600640 10 client.5727 handle_command_reply: tid=0 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.766+0000 7fdc65c65740 1 client.5727 shutdown 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 1 -- 172.21.15.69:0/114071356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c61c80 msgr2=0x564e03d1f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c61c80 0x564e03d1f8e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c02be60 tx=0x7fdc4c000f40 comp rx=0 tx=0).stop 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 1 -- 172.21.15.69:0/114071356 shutdown_connections 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x564e03cb8510 0x564e03cadd70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x564e03caf890 0x564e03ca83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x564e03c74ae0 0x564e03cc0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 1 --2- 172.21.15.69:0/114071356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e03c61c80 0x564e03d1f8e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 1 -- 172.21.15.69:0/114071356 >> 172.21.15.69:0/114071356 conn(0x564e03c741c0 msgr2=0x564e03c35e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:52.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc49600640 0 client.5727 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:52.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 1 -- 172.21.15.69:0/114071356 shutdown_connections 2024-02-21T07:44:52.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 1 -- 172.21.15.69:0/114071356 wait complete. 2024-02-21T07:44:52.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.767+0000 7fdc65c65740 20 client.5727 trim_cache size 0 max 16384 2024-02-21T07:44:52.776 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:44:52.776 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-02-21T07:44:52.776 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "1080b564-9616-4dfd-8d96-17d3a4d8b811", 2024-02-21T07:44:52.776 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-02-21T07:44:52.776 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:44:52.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.768+0000 7fdc63000640 1 -- 172.21.15.69:0/347540870 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc3809f150 msgr2=0x7fdc380a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.768+0000 7fdc63000640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc3809f150 0x7fdc380a1610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdc54000f60 tx=0x7fdc54009040 comp rx=0 tx=0).stop 2024-02-21T07:44:52.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.768+0000 7fdc63000640 1 -- 172.21.15.69:0/347540870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc5c0d18f0 msgr2=0x7fdc5c21fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:52.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.768+0000 7fdc63000640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc5c0d18f0 0x7fdc5c21fb00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c037040 tx=0x7fdc4c004a40 comp rx=0 tx=0).stop 2024-02-21T07:44:52.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.768+0000 7fdc63000640 1 -- 172.21.15.69:0/347540870 shutdown_connections 2024-02-21T07:44:52.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.768+0000 7fdc63000640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fdc3809f150 0x7fdc380a1610 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.768+0000 7fdc63000640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fdc5c182ce0 0x7fdc5c16e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.768+0000 7fdc63000640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdc5c182900 0x7fdc5c1845f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.768+0000 7fdc63000640 1 --2- 172.21.15.69:0/347540870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc5c0d18f0 0x7fdc5c21fb00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.768+0000 7fdc63000640 1 -- 172.21.15.69:0/347540870 >> 172.21.15.69:0/347540870 conn(0x7fdc5c0d6580 msgr2=0x7fdc5c08cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.769+0000 7fdc63000640 1 -- 172.21.15.69:0/347540870 shutdown_connections 2024-02-21T07:44:52.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:52.769+0000 7fdc63000640 1 -- 172.21.15.69:0/347540870 wait complete. 2024-02-21T07:44:52.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:44:52.799 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:44:52.870 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.864+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b85 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3ae40580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b85:[<0x10000002b83/Makefile v4>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b85:[<0x10000002b83/Makefile v4>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.871 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.865+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b8c [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/ auth{0=1} v74 ap=1 f(v0 m2024-02-21T07:44:41.732393+0000 28=28+0) n(v0 rc2024-02-21T07:44:41.732393+0000 29=28+1) (inest lock) (ifile excl) (iversion lock) caps={4890=pAsLsXsFsx/pAsLsXsFsx@1},l=4890 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x561a3ae40b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002b8c:[<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002b8c:[<0x10000002b83/compressed v74>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:41.732393+0000 28=28+0)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:41.732393+0000 29=28+1)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:41.732393+0000 28=28+0)","memory_value.rstat":"n(v0 rc2024-02-21T07:44:41.732393+0000 29=28+1)","error_str":""},"return_code":0} 2024-02-21T07:44:52.871 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.865+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b86 [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/ auth{0=1} v16 ap=1 f(v0 m2024-02-21T07:44:41.670394+0000 5=5+0) n(v0 rc2024-02-21T07:44:41.670394+0000 6=5+1) (inest lock) (ifile excl) (iversion lock) caps={4890=pAsLsXsFsx/pAsLsXsFsx@1},l=4890 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x561a3ae40000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002b86:[<0x10000002b83/bootp v16>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002b86:[<0x10000002b83/bootp v16>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:41.670394+0000 5=5+0)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:41.670394+0000 6=5+1)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:41.670394+0000 5=5+0)","memory_value.rstat":"n(v0 rc2024-02-21T07:44:41.670394+0000 6=5+1)","error_str":""},"return_code":0} 2024-02-21T07:44:52.873 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.867+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002baa [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/ auth{0=1} v117 pv139 ap=13 f(v0 m2024-02-21T07:44:49.620213+0000 12=2+10)->f(v0 m2024-02-21T07:44:50.971182+0000 23=5+18) n(v2 rc2024-02-21T07:44:50.829185+0000 b92 506=495+11)->n(v2 rc2024-02-21T07:44:50.971182+0000 b92 602=579+23) (iauth sync r=1) (isnap sync r=26) (inest mix w=205 dirty) (ipolicy sync r=14) (ifile excl w=9) (iversion lock w=11 last_client=4890) caps={4890=pAsLsXsFsx/pAsLsXsFsx@13},l=4890 | dirtyscattered=1 lock=6 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561a3aab6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002baa:[<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002baa:[<0x10000002b83/dts v117>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:49.620213+0000 12=2+10)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:50.829185+0000 b92 506=495+11)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:49.620213+0000 12=2+10)","memory_value.rstat":"n(v2 rc2024-02-21T07:44:50.829185+0000 b92 506=495+11)","error_str":""},"return_code":0} 2024-02-21T07:44:52.873 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.867+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba9 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/deflate_xip_data.sh auth v76 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3aab7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ba9:[<0x10000002b83/deflate_xip_data.sh v76>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ba9:[<0x10000002b83/deflate_xip_data.sh v76>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.874 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.868+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b84 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/.gitignore auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3ae41080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b84:[<0x10000002b83/.gitignore v2>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b84:[<0x10000002b83/.gitignore v2>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.874 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.869+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cbb [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/ auth{0=1} v711 ap=1 f(v0 m2024-02-21T07:44:48.606236+0000 76=76+0) n(v0 rc2024-02-21T07:44:48.606236+0000 77=76+1) (inest lock) (ifile excl) (iversion lock) caps={4890=pAsLsXsFsx/pAsLsXsFsx@1},l=4890 | importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561a3ae41600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002cbb:[<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002cbb:[<0x10000002baa/aspeed v711>,<0x10000002b83/dts v117>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:48.606236+0000 76=76+0)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:48.606236+0000 77=76+1)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:48.606236+0000 76=76+0)","memory_value.rstat":"n(v0 rc2024-02-21T07:44:48.606236+0000 77=76+1)","error_str":""},"return_code":0} 2024-02-21T07:44:52.874 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.869+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cba [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/armv7-m.dtsi auth v554 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3ae41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cba:[<0x10000002baa/armv7-m.dtsi v554>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cba:[<0x10000002baa/armv7-m.dtsi v554>,<0x10000002b83/dts v117>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.875 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.869+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c98 [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/ auth{0=1} v552 ap=1 f(v0 m2024-02-21T07:44:42.837367+0000 33=33+0) n(v0 rc2024-02-21T07:44:42.837367+0000 34=33+1) (inest lock) (ifile excl) (iversion lock) caps={4890=pAsLsXsFsx/pAsLsXsFsx@1},l=4890 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x561a3ae42100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002c98:[<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002c98:[<0x10000002baa/arm v552>,<0x10000002b83/dts v117>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:42.837367+0000 33=33+0)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:42.837367+0000 34=33+1)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:42.837367+0000 33=33+0)","memory_value.rstat":"n(v0 rc2024-02-21T07:44:42.837367+0000 34=33+1)","error_str":""},"return_code":0} 2024-02-21T07:44:52.876 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.870+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c8b [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/ auth{0=1} v484 ap=1 f(v0 m2024-02-21T07:44:42.796368+0000 12=12+0) n(v0 rc2024-02-21T07:44:42.796368+0000 13=12+1) (inest lock) (ifile excl) (iversion lock) caps={4890=pAsLsXsFsx/pAsLsXsFsx@1},l=4890 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x561a3ae43180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002c8b:[<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002c8b:[<0x10000002baa/amlogic v484>,<0x10000002b83/dts v117>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:42.796368+0000 12=12+0)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:42.796368+0000 13=12+1)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:42.796368+0000 12=12+0)","memory_value.rstat":"n(v0 rc2024-02-21T07:44:42.796368+0000 13=12+1)","error_str":""},"return_code":0} 2024-02-21T07:44:52.880 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.872+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c87 [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon/ auth{0=1} v458 ap=1 f(v0 m2024-02-21T07:44:42.766369+0000 3=3+0) n(v0 rc2024-02-21T07:44:42.766369+0000 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={4890=pAsLsXsFsx/pAsLsXsFsx@1},l=4890 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x561a3ae43700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002c87:[<0x10000002baa/amazon v458>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002c87:[<0x10000002baa/amazon v458>,<0x10000002b83/dts v117>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:42.766369+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:42.766369+0000 4=3+1)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:42.766369+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-02-21T07:44:42.766369+0000 4=3+1)","error_str":""},"return_code":0} 2024-02-21T07:44:52.881 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.876+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bac [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/ auth{0=1} v22 ap=1 f(v0 m2024-02-21T07:44:41.759392+0000 9=9+0) n(v0 rc2024-02-21T07:44:41.759392+0000 10=9+1) (inest lock) (ifile excl) (iversion lock) caps={4890=pAsLsXsFsx/pAsLsXsFsx@1},l=4890 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x561a3ae42c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002bac:[<0x10000002baa/actions v22>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002bac:[<0x10000002baa/actions v22>,<0x10000002b83/dts v117>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:41.759392+0000 9=9+0)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:41.759392+0000 10=9+1)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:41.759392+0000 9=9+0)","memory_value.rstat":"n(v0 rc2024-02-21T07:44:41.759392+0000 10=9+1)","error_str":""},"return_code":0} 2024-02-21T07:44:52.882 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.876+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bab [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3ae42680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bab:[<0x10000002baa/Makefile v2>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bab:[<0x10000002baa/Makefile v2>,<0x10000002b83/dts v117>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.886 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.880+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b89 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/init.S auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afe1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b89:[<0x10000002b86/init.S v6>,<0x10000002b83/bootp v16>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b89:[<0x10000002b86/init.S v6>,<0x10000002b83/bootp v16>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.888 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.882+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b88 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/bootp.lds auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afe1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b88:[<0x10000002b86/bootp.lds v4>,<0x10000002b83/bootp v16>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b88:[<0x10000002b86/bootp.lds v4>,<0x10000002b83/bootp v16>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.888 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.883+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb6 [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha/ auth{0=1} v30 ap=1 f(v0 m2024-02-21T07:44:41.769392+0000 3=3+0) n(v0 rc2024-02-21T07:44:41.769392+0000 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={4890=pAsLsXsFsx/pAsLsXsFsx@1},l=4890 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x561a3b0ec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002bb6:[<0x10000002baa/airoha v30>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002bb6:[<0x10000002baa/airoha v30>,<0x10000002b83/dts v117>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:41.769392+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:41.769392+0000 4=3+1)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:41.769392+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-02-21T07:44:41.769392+0000 4=3+1)","error_str":""},"return_code":0} 2024-02-21T07:44:52.888 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.883+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c83 [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale/ auth{0=1} v450 ap=1 f(v0 m2024-02-21T07:44:42.756369+0000 3=3+0) n(v0 rc2024-02-21T07:44:42.756369+0000 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={4890=pAsLsXsFsx/pAsLsXsFsx@1},l=4890 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x561a3b0ec580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002c83:[<0x10000002baa/alphascale v450>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002c83:[<0x10000002baa/alphascale v450>,<0x10000002b83/dts v117>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:42.756369+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:42.756369+0000 4=3+1)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:42.756369+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-02-21T07:44:42.756369+0000 4=3+1)","error_str":""},"return_code":0} 2024-02-21T07:44:52.889 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.883+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b8a [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/initrd.S auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b094000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b8a:[<0x10000002b86/initrd.S v8>,<0x10000002b83/bootp v16>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b8a:[<0x10000002b86/initrd.S v8>,<0x10000002b83/bootp v16>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.890 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.885+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b8b [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/kernel.S auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b094b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b8b:[<0x10000002b86/kernel.S v10>,<0x10000002b83/bootp v16>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b8b:[<0x10000002b86/kernel.S v10>,<0x10000002b83/bootp v16>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.890 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.885+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b8f [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/ashldi3.S auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b095080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b8f:[<0x10000002b8c/ashldi3.S v6>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b8f:[<0x10000002b8c/ashldi3.S v6>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.891 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.885+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b87 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b094580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b87:[<0x10000002b86/Makefile v2>,<0x10000002b83/bootp v16>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b87:[<0x10000002b86/Makefile v2>,<0x10000002b83/bootp v16>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.891 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.885+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba6 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/piggy.S auth v52 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b095600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ba6:[<0x10000002b8c/piggy.S v52>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ba6:[<0x10000002b8c/piggy.S v52>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.891 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.885+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b94 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/decompress.c auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b096100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b94:[<0x10000002b8c/decompress.c v16>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b94:[<0x10000002b8c/decompress.c v16>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.891 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.886+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b92 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/bswapsdi2.S auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b095b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b92:[<0x10000002b8c/bswapsdi2.S v12>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b92:[<0x10000002b8c/bswapsdi2.S v12>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v38>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.999 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.993+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b91 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/big-endian.S auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b096680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b91:[<0x10000002b8c/big-endian.S v10>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b91:[<0x10000002b8c/big-endian.S v10>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:52.999 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.994+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba0 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/hyp-stub.S auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b096c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ba0:[<0x10000002b8c/hyp-stub.S v40>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ba0:[<0x10000002b8c/hyp-stub.S v40>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.000 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.994+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9a [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_wip.c auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b097700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b9a:[<0x10000002b8c/fdt_wip.c v28>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b9a:[<0x10000002b8c/fdt_wip.c v28>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.000 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.994+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba5 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/misc.h auth v50 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b097180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ba5:[<0x10000002b8c/misc.h v50>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ba5:[<0x10000002b8c/misc.h v50>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.000 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.995+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba3 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/misc-ep93xx.h auth v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b059080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ba3:[<0x10000002b8c/misc-ep93xx.h v46>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ba3:[<0x10000002b8c/misc-ep93xx.h v46>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.000 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.995+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba1 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/lib1funcs.S auth v42 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b058b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ba1:[<0x10000002b8c/lib1funcs.S v42>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ba1:[<0x10000002b8c/lib1funcs.S v42>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.001 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.995+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b90 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/atags_to_fdt.c auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b059600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b90:[<0x10000002b8c/atags_to_fdt.c v8>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b90:[<0x10000002b8c/atags_to_fdt.c v8>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.002 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.996+0000 7f3fb1400640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bba [...2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/allwinner/ auth{0=1} fragtree_t(*^3) v1443 ap=2 RANDEPHEMERALPIN f(v0 m2024-02-21T07:44:42.744370+0000 200=200+0) n(v0 rc2024-02-21T07:44:42.746370+0000 b92 201=200+1) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={4890=pAsLsXsFs/pAsLsXsFsx@2} | ptrwaiter=0 lock=3 importingcaps=0 dirfrag=8 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x561a3aab6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002bba:[<0x10000002baa/allwinner v442>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[]","memoryvalue":"(2)0x10000002bba:[<0x10000002baa/allwinner v442>,<0x10000002b83/dts v117>,<0x10000002b7c/boot v36>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-02-21T07:44:42.744370+0000 200=200+0)","ondisk_value.rstat":"n(v0 rc2024-02-21T07:44:42.744370+0000 b92 201=200+1)","memory_value.dirstat":"f(v0 m2024-02-21T07:44:42.744370+0000 200=200+0)","memory_value.rstat":"n(v0 rc2024-02-21T07:44:42.746370+0000 b92 201=200+1)","error_str":""},"return_code":0} 2024-02-21T07:44:53.002 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.996+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b99 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_rw.c auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b058580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b99:[<0x10000002b8c/fdt_rw.c v26>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b99:[<0x10000002b8c/fdt_rw.c v26>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.002 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.997+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9f [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head.S auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b058000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b9f:[<0x10000002b8c/head.S v38>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b9f:[<0x10000002b8c/head.S v38>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.003 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.997+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9e [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head-xscale.S auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b059b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b9e:[<0x10000002b8c/head-xscale.S v36>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b9e:[<0x10000002b8c/head-xscale.S v36>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.003 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:52.997+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b8e [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/Makefile auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b05a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b8e:[<0x10000002b8c/Makefile v4>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b8e:[<0x10000002b8c/Makefile v4>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.006 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.000+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9b [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/font.c auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b05a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b9b:[<0x10000002b8c/font.c v30>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b9b:[<0x10000002b8c/font.c v30>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.006 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.000+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba8 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/vmlinux.lds.S auth v56 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b05ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ba8:[<0x10000002b8c/vmlinux.lds.S v56>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ba8:[<0x10000002b8c/vmlinux.lds.S v56>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.006 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.000+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b96 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt.c auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b05b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b96:[<0x10000002b8c/fdt.c v20>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b96:[<0x10000002b8c/fdt.c v20>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.006 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.000+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b93 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/debug.S auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b05b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b93:[<0x10000002b8c/debug.S v14>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b93:[<0x10000002b8c/debug.S v14>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.007 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.001+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9d [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head-sharpsl.S auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b014000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b9d:[<0x10000002b8c/head-sharpsl.S v34>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b9d:[<0x10000002b8c/head-sharpsl.S v34>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.007 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.001+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b95 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/efi-header.S auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b014b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b95:[<0x10000002b8c/efi-header.S v18>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b95:[<0x10000002b8c/efi-header.S v18>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.007 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.001+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b8d [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/.gitignore auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b015b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b8d:[<0x10000002b8c/.gitignore v2>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b8d:[<0x10000002b8c/.gitignore v2>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.007 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.002+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b98 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_ro.c auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b014580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b98:[<0x10000002b8c/fdt_ro.c v24>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b98:[<0x10000002b8c/fdt_ro.c v24>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.008 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.002+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b9c [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head-sa1100.S auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b015080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b9c:[<0x10000002b8c/head-sa1100.S v32>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b9c:[<0x10000002b8c/head-sa1100.S v32>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.010 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.005+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002b97 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_check_mem_start.c auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b015600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002b97:[<0x10000002b8c/fdt_check_mem_start.c v22>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002b97:[<0x10000002b8c/fdt_check_mem_start.c v22>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.011 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.005+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba4 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/misc.c auth v48 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b016100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ba4:[<0x10000002b8c/misc.c v48>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ba4:[<0x10000002b8c/misc.c v48>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.011 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.005+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba7 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/string.c auth v54 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b016680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ba7:[<0x10000002b8c/string.c v54>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ba7:[<0x10000002b8c/string.c v54>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.011 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.006+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cbe [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-ast2600-evb-a1.dts auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0ecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cbe:[<0x10000002cbb/aspeed-ast2600-evb-a1.dts v6>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cbe:[<0x10000002cbb/aspeed-ast2600-evb-a1.dts v6>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.012 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.006+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ba2 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/ll_char_wr.S auth v44 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b016c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ba2:[<0x10000002b8c/ll_char_wr.S v44>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ba2:[<0x10000002b8c/ll_char_wr.S v44>,<0x10000002b83/compressed v74>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.013 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.007+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cc8 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-delta-ahe50dc.dts auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0ed600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cc8:[<0x10000002cbb/aspeed-bmc-delta-ahe50dc.dts v26>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cc8:[<0x10000002cbb/aspeed-bmc-delta-ahe50dc.dts v26>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.013 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.007+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ccf [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-greatlakes.dts auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0edb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ccf:[<0x10000002cbb/aspeed-bmc-facebook-greatlakes.dts v40>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ccf:[<0x10000002cbb/aspeed-bmc-facebook-greatlakes.dts v40>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.015 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.009+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cbf [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-ast2600-evb.dts auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0ef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cbf:[<0x10000002cbb/aspeed-ast2600-evb.dts v8>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cbf:[<0x10000002cbb/aspeed-ast2600-evb.dts v8>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.016 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.010+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd8 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-everest.dts auth v58 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cd8:[<0x10000002cbb/aspeed-bmc-ibm-everest.dts v58>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cd8:[<0x10000002cbb/aspeed-bmc-ibm-everest.dts v58>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.017 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.010+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd7 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-bonnell.dts auth v56 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cd7:[<0x10000002cbb/aspeed-bmc-ibm-bonnell.dts v56>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cd7:[<0x10000002cbb/aspeed-bmc-ibm-bonnell.dts v56>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.017 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.011+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cc0 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-amd-daytonax.dts auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cc0:[<0x10000002cbb/aspeed-bmc-amd-daytonax.dts v10>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cc0:[<0x10000002cbb/aspeed-bmc-amd-daytonax.dts v10>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.017 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.011+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ccc [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-elbert.dts auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ccc:[<0x10000002cbb/aspeed-bmc-facebook-elbert.dts v34>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ccc:[<0x10000002cbb/aspeed-bmc-facebook-elbert.dts v34>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.018 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.012+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cdc [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-inspur-fp5280g2.dts auth v66 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cdc:[<0x10000002cbb/aspeed-bmc-inspur-fp5280g2.dts v66>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cdc:[<0x10000002cbb/aspeed-bmc-inspur-fp5280g2.dts v66>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.018 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.012+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cdb [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-rainier.dts auth v64 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cdb:[<0x10000002cbb/aspeed-bmc-ibm-rainier.dts v64>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cdb:[<0x10000002cbb/aspeed-bmc-ibm-rainier.dts v64>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.019 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.013+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cc3 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ampere-mtmitchell.dts auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cc3:[<0x10000002cbb/aspeed-bmc-ampere-mtmitchell.dts v16>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cc3:[<0x10000002cbb/aspeed-bmc-ampere-mtmitchell.dts v16>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.019 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.013+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ccb [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-cmm.dts auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0f8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ccb:[<0x10000002cbb/aspeed-bmc-facebook-cmm.dts v32>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ccb:[<0x10000002cbb/aspeed-bmc-facebook-cmm.dts v32>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.019 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.013+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cca [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-cloudripper.dts auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0f8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cca:[<0x10000002cbb/aspeed-bmc-facebook-cloudripper.dts v30>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cca:[<0x10000002cbb/aspeed-bmc-facebook-cloudripper.dts v30>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.021 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.015+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cc7 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-bytedance-g220a.dts auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cc7:[<0x10000002cbb/aspeed-bmc-bytedance-g220a.dts v24>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cc7:[<0x10000002cbb/aspeed-bmc-bytedance-g220a.dts v24>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.022 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.017+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cc9 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-bletchley.dts auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0fa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cc9:[<0x10000002cbb/aspeed-bmc-facebook-bletchley.dts v28>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cc9:[<0x10000002cbb/aspeed-bmc-facebook-bletchley.dts v28>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.023 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.017+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cc6 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-asrock-romed8hm3.dts auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0fb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cc6:[<0x10000002cbb/aspeed-bmc-asrock-romed8hm3.dts v22>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cc6:[<0x10000002cbb/aspeed-bmc-asrock-romed8hm3.dts v22>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.023 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.018+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cda [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-rainier-4u.dts auth v62 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0ba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cda:[<0x10000002cbb/aspeed-bmc-ibm-rainier-4u.dts v62>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cda:[<0x10000002cbb/aspeed-bmc-ibm-rainier-4u.dts v62>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.024 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.019+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd9 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-rainier-1s4u.dts auth v60 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0bb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cd9:[<0x10000002cbb/aspeed-bmc-ibm-rainier-1s4u.dts v60>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cd9:[<0x10000002cbb/aspeed-bmc-ibm-rainier-1s4u.dts v60>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.025 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.019+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd1 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-tiogapass.dts auth v44 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0bb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cd1:[<0x10000002cbb/aspeed-bmc-facebook-tiogapass.dts v44>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cd1:[<0x10000002cbb/aspeed-bmc-facebook-tiogapass.dts v44>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.026 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.020+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cbc [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0bab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cbc:[<0x10000002cbb/Makefile v2>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cbc:[<0x10000002cbb/Makefile v2>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.026 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.021+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd2 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-wedge100.dts auth v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0bcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cd2:[<0x10000002cbb/aspeed-bmc-facebook-wedge100.dts v46>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cd2:[<0x10000002cbb/aspeed-bmc-facebook-wedge100.dts v46>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.027 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.021+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cc5 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-asrock-e3c246d4i.dts auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0bc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cc5:[<0x10000002cbb/aspeed-bmc-asrock-e3c246d4i.dts v20>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cc5:[<0x10000002cbb/aspeed-bmc-asrock-e3c246d4i.dts v20>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.027 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.021+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cbd [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-ast2500-evb.dts auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0bc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cbd:[<0x10000002cbb/aspeed-ast2500-evb.dts v4>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cbd:[<0x10000002cbb/aspeed-ast2500-evb.dts v4>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.027 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.021+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd3 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-wedge40.dts auth v48 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cd3:[<0x10000002cbb/aspeed-bmc-facebook-wedge40.dts v48>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cd3:[<0x10000002cbb/aspeed-bmc-facebook-wedge40.dts v48>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.027 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.022+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd5 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-yamp.dts auth v52 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cd5:[<0x10000002cbb/aspeed-bmc-facebook-yamp.dts v52>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cd5:[<0x10000002cbb/aspeed-bmc-facebook-yamp.dts v52>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.030 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.025+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cce [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-galaxy100.dts auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cce:[<0x10000002cbb/aspeed-bmc-facebook-galaxy100.dts v38>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cce:[<0x10000002cbb/aspeed-bmc-facebook-galaxy100.dts v38>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.032 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.026+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd0 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-minipack.dts auth v42 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cd0:[<0x10000002cbb/aspeed-bmc-facebook-minipack.dts v42>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cd0:[<0x10000002cbb/aspeed-bmc-facebook-minipack.dts v42>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.032 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.026+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd4 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-wedge400.dts auth v50 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0c6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cd4:[<0x10000002cbb/aspeed-bmc-facebook-wedge400.dts v50>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cd4:[<0x10000002cbb/aspeed-bmc-facebook-wedge400.dts v50>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.035 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.028+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ccd [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-fuji.dts auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0c9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ccd:[<0x10000002cbb/aspeed-bmc-facebook-fuji.dts v36>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ccd:[<0x10000002cbb/aspeed-bmc-facebook-fuji.dts v36>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.035 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.029+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cdd [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-inspur-nf5280m6.dts auth v68 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0c9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cdd:[<0x10000002cbb/aspeed-bmc-inspur-nf5280m6.dts v68>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cdd:[<0x10000002cbb/aspeed-bmc-inspur-nf5280m6.dts v68>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.036 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.029+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cc4 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-arm-stardragon4800-rep2.dts auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0ab080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cc4:[<0x10000002cbb/aspeed-bmc-arm-stardragon4800-rep2.dts v18>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cc4:[<0x10000002cbb/aspeed-bmc-arm-stardragon4800-rep2.dts v18>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.036 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.029+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cd6 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-yosemitev2.dts auth v54 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0ac100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cd6:[<0x10000002cbb/aspeed-bmc-facebook-yosemitev2.dts v54>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cd6:[<0x10000002cbb/aspeed-bmc-facebook-yosemitev2.dts v54>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.037 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.031+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002caf [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/mps2-an399.dts auth v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002caf:[<0x10000002c98/mps2-an399.dts v46>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002caf:[<0x10000002c98/mps2-an399.dts v46>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.038 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.032+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cc2 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ampere-mtjade.dts auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b0ad700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cc2:[<0x10000002cbb/aspeed-bmc-ampere-mtjade.dts v14>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cc2:[<0x10000002cbb/aspeed-bmc-ampere-mtjade.dts v14>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.038 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.032+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ca7 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pba8.dts auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ca7:[<0x10000002c98/arm-realview-pba8.dts v30>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ca7:[<0x10000002c98/arm-realview-pba8.dts v30>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.038 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.032+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cc1 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-amd-ethanolx.dts auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cc1:[<0x10000002cbb/aspeed-bmc-amd-ethanolx.dts v12>,<0x10000002baa/aspeed v624>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cc1:[<0x10000002cbb/aspeed-bmc-amd-ethanolx.dts v12>,<0x10000002baa/aspeed v711>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.039 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.032+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cb0 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/mps2.dtsi auth v48 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cb0:[<0x10000002c98/mps2.dtsi v48>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cb0:[<0x10000002c98/mps2.dtsi v48>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.039 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.033+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ca1 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-bbrevd.dtsi auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ca1:[<0x10000002c98/arm-realview-eb-bbrevd.dtsi v18>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ca1:[<0x10000002c98/arm-realview-eb-bbrevd.dtsi v18>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.039 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.033+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ca2 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-mp.dtsi auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ca2:[<0x10000002c98/arm-realview-eb-mp.dtsi v20>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ca2:[<0x10000002c98/arm-realview-eb-mp.dtsi v20>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.040 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.034+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ca4 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb.dtsi auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ca4:[<0x10000002c98/arm-realview-eb.dtsi v24>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ca4:[<0x10000002c98/arm-realview-eb.dtsi v24>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.041 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.034+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c9a [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp-bbrevd-ctrevb.dts auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c9a:[<0x10000002c98/arm-realview-eb-11mp-bbrevd-ctrevb.dts v4>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c9a:[<0x10000002c98/arm-realview-eb-11mp-bbrevd-ctrevb.dts v4>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.041 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.034+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cae [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/mps2-an385.dts auth v44 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cae:[<0x10000002c98/mps2-an385.dts v44>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cae:[<0x10000002c98/mps2-an385.dts v44>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.041 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.034+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cb5 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2m.dtsi auth v58 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cb5:[<0x10000002c98/vexpress-v2m.dtsi v58>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cb5:[<0x10000002c98/vexpress-v2m.dtsi v58>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.041 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.035+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ca9 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pbx.dtsi auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b07c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ca9:[<0x10000002c98/arm-realview-pbx.dtsi v34>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ca9:[<0x10000002c98/arm-realview-pbx.dtsi v34>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.041 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.035+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002caa [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integrator.dtsi auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b074000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002caa:[<0x10000002c98/integrator.dtsi v36>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002caa:[<0x10000002c98/integrator.dtsi v36>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.041 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.035+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cb2 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/versatile-ab.dts auth v52 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b075080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cb2:[<0x10000002c98/versatile-ab.dts v52>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cb2:[<0x10000002c98/versatile-ab.dts v52>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.042 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.035+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ca6 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pb11mp.dts auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b075600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ca6:[<0x10000002c98/arm-realview-pb11mp.dts v28>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ca6:[<0x10000002c98/arm-realview-pb11mp.dts v28>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.042 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.036+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c99 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b074580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c99:[<0x10000002c98/Makefile v2>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c99:[<0x10000002c98/Makefile v2>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.042 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.036+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ca3 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb.dts auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b074b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ca3:[<0x10000002c98/arm-realview-eb.dts v22>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ca3:[<0x10000002c98/arm-realview-eb.dts v22>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.042 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.037+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ca0 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-bbrevd.dts auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b076100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ca0:[<0x10000002c98/arm-realview-eb-bbrevd.dts v16>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ca0:[<0x10000002c98/arm-realview-eb-bbrevd.dts v16>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.043 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.037+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cb7 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca15_a7.dts auth v62 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b075b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cb7:[<0x10000002c98/vexpress-v2p-ca15_a7.dts v62>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cb7:[<0x10000002c98/vexpress-v2p-ca15_a7.dts v62>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.043 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.037+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cb4 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2m-rs1.dtsi auth v56 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b077180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cb4:[<0x10000002c98/vexpress-v2m-rs1.dtsi v56>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cb4:[<0x10000002c98/vexpress-v2m-rs1.dtsi v56>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.043 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.037+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c9f [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-a9mp.dts auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b076c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c9f:[<0x10000002c98/arm-realview-eb-a9mp.dts v14>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c9f:[<0x10000002c98/arm-realview-eb-a9mp.dts v14>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.043 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.038+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cb3 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/versatile-pb.dts auth v54 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b076680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cb3:[<0x10000002c98/versatile-pb.dts v54>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cb3:[<0x10000002c98/versatile-pb.dts v54>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.044 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.038+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cb8 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca5s.dts auth v64 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b077700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cb8:[<0x10000002c98/vexpress-v2p-ca5s.dts v64>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cb8:[<0x10000002c98/vexpress-v2p-ca5s.dts v64>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.045 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.038+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c9c [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp-ctrevb.dts auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c9c:[<0x10000002c98/arm-realview-eb-11mp-ctrevb.dts v8>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c9c:[<0x10000002c98/arm-realview-eb-11mp-ctrevb.dts v8>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.045 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.039+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cac [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integratorap.dts auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cac:[<0x10000002c98/integratorap.dts v40>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cac:[<0x10000002c98/integratorap.dts v40>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.045 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.039+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ca8 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pbx-a9.dts auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ca8:[<0x10000002c98/arm-realview-pbx-a9.dts v32>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ca8:[<0x10000002c98/arm-realview-pbx-a9.dts v32>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.046 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.040+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cb6 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca15-tc1.dts auth v60 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cb6:[<0x10000002c98/vexpress-v2p-ca15-tc1.dts v60>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cb6:[<0x10000002c98/vexpress-v2p-ca15-tc1.dts v60>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.046 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.040+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cad [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integratorcp.dts auth v42 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cad:[<0x10000002c98/integratorcp.dts v42>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cad:[<0x10000002c98/integratorcp.dts v42>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.046 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.040+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c9e [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-a9mp-bbrevd.dts auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c9e:[<0x10000002c98/arm-realview-eb-a9mp-bbrevd.dts v12>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c9e:[<0x10000002c98/arm-realview-eb-a9mp-bbrevd.dts v12>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.047 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.041+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cab [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integratorap-im-pd1.dts auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cab:[<0x10000002c98/integratorap-im-pd1.dts v38>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cab:[<0x10000002c98/integratorap-im-pd1.dts v38>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.047 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.042+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c9d [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp.dts auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c9d:[<0x10000002c98/arm-realview-eb-11mp.dts v10>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c9d:[<0x10000002c98/arm-realview-eb-11mp.dts v10>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.047 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.042+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002ca5 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pb1176.dts auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002ca5:[<0x10000002c98/arm-realview-pb1176.dts v26>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002ca5:[<0x10000002c98/arm-realview-pb1176.dts v26>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.048 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.042+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cb1 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/versatile-ab-ib2.dts auth v50 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cb1:[<0x10000002c98/versatile-ab-ib2.dts v50>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cb1:[<0x10000002c98/versatile-ab-ib2.dts v50>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.048 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.043+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cb9 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca9.dts auth v66 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b06f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002cb9:[<0x10000002c98/vexpress-v2p-ca9.dts v66>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002cb9:[<0x10000002c98/vexpress-v2p-ca9.dts v66>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.049 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.043+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c9b [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp-bbrevd.dts auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c9b:[<0x10000002c98/arm-realview-eb-11mp-bbrevd.dts v6>,<0x10000002baa/arm v552>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c9b:[<0x10000002c98/arm-realview-eb-11mp-bbrevd.dts v6>,<0x10000002baa/arm v552>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.051 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.044+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb1 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-labrador-base-m.dts auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bb1:[<0x10000002bac/owl-s500-labrador-base-m.dts v10>,<0x10000002baa/actions v22>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bb1:[<0x10000002bac/owl-s500-labrador-base-m.dts v10>,<0x10000002baa/actions v22>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.051 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.045+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb3 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-roseapplepi.dts auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bb3:[<0x10000002bac/owl-s500-roseapplepi.dts v14>,<0x10000002baa/actions v22>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bb3:[<0x10000002bac/owl-s500-roseapplepi.dts v14>,<0x10000002baa/actions v22>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.051 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.045+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bad [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bad:[<0x10000002bac/Makefile v2>,<0x10000002baa/actions v22>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bad:[<0x10000002bac/Makefile v2>,<0x10000002baa/actions v22>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.051 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.045+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb0 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-guitar.dtsi auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bb0:[<0x10000002bac/owl-s500-guitar.dtsi v8>,<0x10000002baa/actions v22>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bb0:[<0x10000002bac/owl-s500-guitar.dtsi v8>,<0x10000002baa/actions v22>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.051 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.045+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb2 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-labrador-v2.dtsi auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bb2:[<0x10000002bac/owl-s500-labrador-v2.dtsi v12>,<0x10000002baa/actions v22>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bb2:[<0x10000002bac/owl-s500-labrador-v2.dtsi v12>,<0x10000002baa/actions v22>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.052 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.045+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb4 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-sparky.dts auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bb4:[<0x10000002bac/owl-s500-sparky.dts v16>,<0x10000002baa/actions v22>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bb4:[<0x10000002bac/owl-s500-sparky.dts v16>,<0x10000002baa/actions v22>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.052 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.045+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002baf [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-guitar-bb-rev-b.dts auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002baf:[<0x10000002bac/owl-s500-guitar-bb-rev-b.dts v6>,<0x10000002baa/actions v22>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002baf:[<0x10000002bac/owl-s500-guitar-bb-rev-b.dts v6>,<0x10000002baa/actions v22>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.052 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.046+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb5 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500.dtsi auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bb5:[<0x10000002bac/owl-s500.dtsi v18>,<0x10000002baa/actions v22>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bb5:[<0x10000002bac/owl-s500.dtsi v18>,<0x10000002baa/actions v22>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.052 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.046+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bae [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-cubieboard6.dts auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bae:[<0x10000002bac/owl-s500-cubieboard6.dts v4>,<0x10000002baa/actions v22>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bae:[<0x10000002bac/owl-s500-cubieboard6.dts v4>,<0x10000002baa/actions v22>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.052 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.046+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c92 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b-ec100.dts auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b02d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c92:[<0x10000002c8b/meson8b-ec100.dts v14>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c92:[<0x10000002c8b/meson8b-ec100.dts v14>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.052 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.046+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c8f [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson6.dtsi auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b024000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c8f:[<0x10000002c8b/meson6.dtsi v8>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c8f:[<0x10000002c8b/meson6.dtsi v8>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.053 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.046+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c95 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b.dtsi auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b024580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c95:[<0x10000002c8b/meson8b.dtsi v20>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c95:[<0x10000002c8b/meson8b.dtsi v20>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.053 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.047+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c94 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b-odroidc1.dts auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b024b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c94:[<0x10000002c8b/meson8b-odroidc1.dts v18>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c94:[<0x10000002c8b/meson8b-odroidc1.dts v18>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.053 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.047+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c8d [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson.dtsi auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b025080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c8d:[<0x10000002c8b/meson.dtsi v4>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c8d:[<0x10000002c8b/meson.dtsi v4>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.053 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.048+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c91 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8.dtsi auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b026100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c91:[<0x10000002c8b/meson8.dtsi v12>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c91:[<0x10000002c8b/meson8.dtsi v12>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.054 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.049+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c8c [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b025600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c8c:[<0x10000002c8b/Makefile v2>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c8c:[<0x10000002c8b/Makefile v2>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.055 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.049+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c97 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8m2.dtsi auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b025b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c97:[<0x10000002c8b/meson8m2.dtsi v24>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c97:[<0x10000002c8b/meson8m2.dtsi v24>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.055 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.049+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c8e [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson6-atv1200.dts auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b026680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c8e:[<0x10000002c8b/meson6-atv1200.dts v6>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c8e:[<0x10000002c8b/meson6-atv1200.dts v6>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.055 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.049+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c96 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8m2-mxiii-plus.dts auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b026c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c96:[<0x10000002c8b/meson8m2-mxiii-plus.dts v22>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c96:[<0x10000002c8b/meson8m2-mxiii-plus.dts v22>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.056 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.049+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c93 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b-mxq.dts auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b027180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c93:[<0x10000002c8b/meson8b-mxq.dts v16>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c93:[<0x10000002c8b/meson8b-mxq.dts v16>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.056 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.050+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c90 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8-minix-neo-x8.dts auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3b027700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c90:[<0x10000002c8b/meson8-minix-neo-x8.dts v10>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c90:[<0x10000002c8b/meson8-minix-neo-x8.dts v10>,<0x10000002baa/amlogic v484>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.056 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.051+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c89 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon/alpine-db.dts auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afde000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c89:[<0x10000002c87/alpine-db.dts v4>,<0x10000002baa/amazon v458>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c89:[<0x10000002c87/alpine-db.dts v4>,<0x10000002baa/amazon v458>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.056 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.051+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c88 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afdeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c88:[<0x10000002c87/Makefile v2>,<0x10000002baa/amazon v458>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c88:[<0x10000002c87/Makefile v2>,<0x10000002baa/amazon v458>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.057 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.051+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c8a [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon/alpine.dtsi auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afde580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c8a:[<0x10000002c87/alpine.dtsi v6>,<0x10000002baa/amazon v458>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c8a:[<0x10000002c87/alpine.dtsi v6>,<0x10000002baa/amazon v458>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.086+0000 7fc36f200640 1 Processor -- start 2024-02-21T07:44:53.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.087+0000 7fc36f200640 1 -- start start 2024-02-21T07:44:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.089+0000 7fc36f200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc368182bf0 0x7fc3680ee380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.089+0000 7fc36f200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3680ee8c0 0x7fc368186a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.090+0000 7fc367e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc368182bf0 0x7fc3680ee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.090+0000 7fc367400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3680ee8c0 0x7fc368186a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.090+0000 7fc367400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fc3680ee8c0 0x7fc368186a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38120/0 (socket says 172.21.15.69:38120) 2024-02-21T07:44:53.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.090+0000 7fc367400640 1 -- 172.21.15.69:0/3540524703 learned_addr learned my addr 172.21.15.69:0/3540524703 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:53.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.090+0000 7fc36f200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc368182fd0 con 0x7fc368186f90 2024-02-21T07:44:53.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.091+0000 7fc36f200640 1 -- 172.21.15.69:0/3540524703 --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc368187440 con 0x7fc368182bf0 2024-02-21T07:44:53.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.091+0000 7fc36f200640 1 -- 172.21.15.69:0/3540524703 --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3680f92e0 con 0x7fc3680ee8c0 2024-02-21T07:44:53.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.091+0000 7fc366a00640 1 -- 172.21.15.69:0/3540524703 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787917116 0 0) 0x7fc368182fd0 con 0x7fc368186f90 2024-02-21T07:44:53.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.091+0000 7fc366a00640 1 -- 172.21.15.69:0/3540524703 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc34c003520 con 0x7fc368186f90 2024-02-21T07:44:53.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.092+0000 7fc367400640 1 -- 172.21.15.69:0/3540524703 >> v2:172.21.15.69:3300/0 conn(0x7fc368182bf0 msgr2=0x7fc3680ee380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:53.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.092+0000 7fc366a00640 1 -- 172.21.15.69:0/3540524703 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1473045046 0 0) 0x7fc34c003520 con 0x7fc368186f90 2024-02-21T07:44:53.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.092+0000 7fc367400640 1 --2- 172.21.15.69:0/3540524703 >> v2:172.21.15.69:3300/0 conn(0x7fc368182bf0 0x7fc3680ee380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.092+0000 7fc367400640 1 -- 172.21.15.69:0/3540524703 >> v1:172.21.15.174:6789/0 conn(0x7fc368186f90 legacy=0x7fc368073c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:53.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.092+0000 7fc367400640 1 -- 172.21.15.69:0/3540524703 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680f95c0 con 0x7fc3680ee8c0 2024-02-21T07:44:53.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.093+0000 7fc367e00640 1 --2- 172.21.15.69:0/3540524703 >> v2:172.21.15.69:3300/0 conn(0x7fc368182bf0 0x7fc3680ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.094+0000 7fc367400640 1 --2- 172.21.15.69:0/3540524703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3680ee8c0 0x7fc368186a50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc3680f8dc0 tx=0x7fc35402b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3bbb1e9e04e9f22 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:53.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.094+0000 7fc366a00640 1 -- 172.21.15.69:0/3540524703 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3600019f0 con 0x7fc3680ee8c0 2024-02-21T07:44:53.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.094+0000 7fc366a00640 1 -- 172.21.15.69:0/3540524703 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35402e050 con 0x7fc3680ee8c0 2024-02-21T07:44:53.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.094+0000 7fc366a00640 1 -- 172.21.15.69:0/3540524703 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354004250 con 0x7fc3680ee8c0 2024-02-21T07:44:53.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.095+0000 7fc36f200640 1 -- 172.21.15.69:0/3540524703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3680ee8c0 msgr2=0x7fc368186a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:53.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.095+0000 7fc36f200640 1 --2- 172.21.15.69:0/3540524703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3680ee8c0 0x7fc368186a50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc3680f8dc0 tx=0x7fc35402b7e0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.101 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.095+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb9 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha/en7523.dtsi auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afdf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bb9:[<0x10000002bb6/en7523.dtsi v6>,<0x10000002baa/airoha v30>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bb9:[<0x10000002bb6/en7523.dtsi v6>,<0x10000002baa/airoha v30>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.096+0000 7fc36f200640 1 -- 172.21.15.69:0/3540524703 shutdown_connections 2024-02-21T07:44:53.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.096+0000 7fc36f200640 1 --2- 172.21.15.69:0/3540524703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc3680ee8c0 0x7fc368186a50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.096+0000 7fc36f200640 1 --2- 172.21.15.69:0/3540524703 >> v2:172.21.15.69:3300/0 conn(0x7fc368182bf0 0x7fc3680ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.096+0000 7fc36f200640 1 -- 172.21.15.69:0/3540524703 >> 172.21.15.69:0/3540524703 conn(0x7fc3680f7cc0 msgr2=0x7fc3680f80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:53.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.096+0000 7fc36f200640 1 -- 172.21.15.69:0/3540524703 shutdown_connections 2024-02-21T07:44:53.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.096+0000 7fc36f200640 1 -- 172.21.15.69:0/3540524703 wait complete. 2024-02-21T07:44:53.103 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.096+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb8 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha/en7523-evb.dts auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afdf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bb8:[<0x10000002bb6/en7523-evb.dts v4>,<0x10000002baa/airoha v30>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bb8:[<0x10000002bb6/en7523-evb.dts v4>,<0x10000002baa/airoha v30>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.103 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.097+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002bb7 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afdfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002bb7:[<0x10000002bb6/Makefile v2>,<0x10000002baa/airoha v30>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002bb7:[<0x10000002bb6/Makefile v2>,<0x10000002baa/airoha v30>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.103 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.097+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c84 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afe0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c84:[<0x10000002c83/Makefile v2>,<0x10000002baa/alphascale v450>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c84:[<0x10000002c83/Makefile v2>,<0x10000002baa/alphascale v450>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.103 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.097+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c86 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale/alphascale-asm9260.dtsi auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afe0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c86:[<0x10000002c83/alphascale-asm9260.dtsi v6>,<0x10000002baa/alphascale v450>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c86:[<0x10000002c83/alphascale-asm9260.dtsi v6>,<0x10000002baa/alphascale v450>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.104 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:44:53.099+0000 7f3fa9200640 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002c85 [2,head] /volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale/alphascale-asm9260-devkit.dts auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={4890=0-4194304@1} caps={4890=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=4890 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561a3afe0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000002c85:[<0x10000002c83/alphascale-asm9260-devkit.dts v4>,<0x10000002baa/alphascale v450>,<0x10000002b83/dts v100>,<0x10000002b7c/boot v28>,<0x10000002972/arm v98>,<0x100000007da/arch v364>,<0x100000007d9/linux-6.5.11 v113>,<0x100000005e3/t v89>,<0x100000005e2/tmp v85>,<0x100000001fb/client.0 v74>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v89>,<0x10000000001/sv_1 v101>,<0x10000000000/qa v90>,<0x1/volumes v86>]//[3]","memoryvalue":"(4)0x10000002c85:[<0x10000002c83/alphascale-asm9260-devkit.dts v4>,<0x10000002baa/alphascale v450>,<0x10000002b83/dts v144>,<0x10000002b7c/boot v40>,<0x10000002972/arm v119>,<0x100000007da/arch v404>,<0x100000007d9/linux-6.5.11 v138>,<0x100000005e3/t v101>,<0x100000005e2/tmp v91>,<0x100000001fb/client.0 v64>,<0x100000001fa/6989bedb-7d3c-4e34-9eeb-627a4df85844 v99>,<0x10000000001/sv_1 v106>,<0x10000000000/qa v98>,<0x1/volumes v78>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-02-21T07:44:53.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.099+0000 7fc36f200640 1 Processor -- start 2024-02-21T07:44:53.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.099+0000 7fc36f200640 1 -- start start 2024-02-21T07:44:53.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.101+0000 7fc36f200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3680ee8c0 0x7fc3680ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.101+0000 7fc36f200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc368182bf0 0x7fc3680cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.101+0000 7fc36f200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc368186f90 0x7fc368187610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.101+0000 7fc36f200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3682239b0 con 0x7fc3680ee8c0 2024-02-21T07:44:53.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.101+0000 7fc36f200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3681883e0 con 0x7fc368186f90 2024-02-21T07:44:53.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.101+0000 7fc36f200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3681886c0 con 0x7fc368182bf0 2024-02-21T07:44:53.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.101+0000 7fc36d200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc368186f90 0x7fc368187610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.101+0000 7fc36d200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc368186f90 0x7fc368187610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38136/0 (socket says 172.21.15.69:38136) 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.101+0000 7fc36d200640 1 -- 172.21.15.69:0/941840551 learned_addr learned my addr 172.21.15.69:0/941840551 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.102+0000 7fc367400640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc368182bf0 0x7fc3680cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.102+0000 7fc367e00640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3680ee8c0 0x7fc3680ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.102+0000 7fc36d200640 1 -- 172.21.15.69:0/941840551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc368182bf0 msgr2=0x7fc3680cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.102+0000 7fc36d200640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc368182bf0 0x7fc3680cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.102+0000 7fc36d200640 1 -- 172.21.15.69:0/941840551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3680ee8c0 msgr2=0x7fc3680ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.102+0000 7fc36d200640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3680ee8c0 0x7fc3680ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.102+0000 7fc36d200640 1 -- 172.21.15.69:0/941840551 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358009400 con 0x7fc368186f90 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.102+0000 7fc367e00640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3680ee8c0 0x7fc3680ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:44:53.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.102+0000 7fc367400640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc368182bf0 0x7fc3680cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:44:53.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.103+0000 7fc36d200640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc368186f90 0x7fc368187610 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc36000caa0 tx=0x7fc36000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:53.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.105+0000 7fc35fe00640 1 -- 172.21.15.69:0/941840551 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000a6d0 con 0x7fc368186f90 2024-02-21T07:44:53.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.105+0000 7fc35fe00640 1 -- 172.21.15.69:0/941840551 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36000a830 con 0x7fc368186f90 2024-02-21T07:44:53.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.105+0000 7fc35fe00640 1 -- 172.21.15.69:0/941840551 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000abe0 con 0x7fc368186f90 2024-02-21T07:44:53.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.105+0000 7fc36f200640 1 -- 172.21.15.69:0/941840551 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3540094d0 con 0x7fc368186f90 2024-02-21T07:44:53.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.106+0000 7fc36f200640 1 -- 172.21.15.69:0/941840551 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc368188c80 con 0x7fc368186f90 2024-02-21T07:44:53.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.113+0000 7fc35fe00640 1 -- 172.21.15.69:0/941840551 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fc36000ad40 con 0x7fc368186f90 2024-02-21T07:44:53.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.114+0000 7fc371fc5740 1 Processor -- start 2024-02-21T07:44:53.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.114+0000 7fc371fc5740 1 -- start start 2024-02-21T07:44:53.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.115+0000 7fc35fe00640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc34809f1f0 0x7fc3480a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.115+0000 7fc35fe00640 1 -- 172.21.15.69:0/941840551 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc3600c9b00 con 0x7fc368186f90 2024-02-21T07:44:53.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.116+0000 7fc367400640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc34809f1f0 0x7fc3480a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.117+0000 7fc367400640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc34809f1f0 0x7fc3480a16b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc354034000 tx=0x7fc354008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:53.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.117+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b9500a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.117+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 0x5589b94cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.118+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b948def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.118+0000 7fc371fc5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b9402150 con 0x5589b94cafc0 2024-02-21T07:44:53.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.118+0000 7fc371fc5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b93ff680 con 0x5589b94cb8e0 2024-02-21T07:44:53.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.118+0000 7fc371fc5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b93fae60 con 0x5589b9500f80 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.118+0000 7fc367400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 0x5589b94cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.118+0000 7fc367e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b9500a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.118+0000 7fc36d200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b948def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.118+0000 7fc36d200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b948def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38152/0 (socket says 172.21.15.69:38152) 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.118+0000 7fc36d200640 1 -- 172.21.15.69:0/3313261054 learned_addr learned my addr 172.21.15.69:0/3313261054 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.118+0000 7fc36d200640 1 -- 172.21.15.69:0/3313261054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 msgr2=0x5589b94cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.119+0000 7fc36d200640 1 --2- 172.21.15.69:0/3313261054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 0x5589b94cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.119+0000 7fc36d200640 1 -- 172.21.15.69:0/3313261054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 msgr2=0x5589b9500a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.119+0000 7fc36d200640 1 --2- 172.21.15.69:0/3313261054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b9500a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.119+0000 7fc36d200640 1 -- 172.21.15.69:0/3313261054 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589b93b4060 con 0x5589b94cb8e0 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.119+0000 7fc367e00640 1 --2- 172.21.15.69:0/3313261054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b9500a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.119+0000 7fc36d200640 1 --2- 172.21.15.69:0/3313261054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b948def0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc360097280 tx=0x7fc3600957e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=813d032794427007 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.119+0000 7fc35cc00640 1 -- 172.21.15.69:0/3313261054 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3600af1c0 con 0x5589b94cb8e0 2024-02-21T07:44:53.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.119+0000 7fc35cc00640 1 -- 172.21.15.69:0/3313261054 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36009fd80 con 0x5589b94cb8e0 2024-02-21T07:44:53.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.119+0000 7fc35cc00640 1 -- 172.21.15.69:0/3313261054 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360097840 con 0x5589b94cb8e0 2024-02-21T07:44:53.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.120+0000 7fc371fc5740 1 -- 172.21.15.69:0/3313261054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 msgr2=0x5589b948def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:53.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.120+0000 7fc371fc5740 1 --2- 172.21.15.69:0/3313261054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b948def0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc360097280 tx=0x7fc3600957e0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.121+0000 7fc371fc5740 1 -- 172.21.15.69:0/3313261054 shutdown_connections 2024-02-21T07:44:53.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.121+0000 7fc371fc5740 1 --2- 172.21.15.69:0/3313261054 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b948def0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.121+0000 7fc371fc5740 1 --2- 172.21.15.69:0/3313261054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 0x5589b94cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.121+0000 7fc371fc5740 1 --2- 172.21.15.69:0/3313261054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b9500a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.121+0000 7fc371fc5740 1 -- 172.21.15.69:0/3313261054 >> 172.21.15.69:0/3313261054 conn(0x5589b945a5a0 msgr2=0x5589b9491eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:53.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.121+0000 7fc371fc5740 1 -- 172.21.15.69:0/3313261054 shutdown_connections 2024-02-21T07:44:53.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.121+0000 7fc371fc5740 1 -- 172.21.15.69:0/3313261054 wait complete. 2024-02-21T07:44:53.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.123+0000 7fc371fc5740 1 -- start start 2024-02-21T07:44:53.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.123+0000 7fc371fc5740 1 Processor -- start 2024-02-21T07:44:53.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.126+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 0x5589b948de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.126+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b95112f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.126+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b948e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.126+0000 7fc367e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 0x5589b948de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.126+0000 7fc367e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 0x5589b948de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53344/0 (socket says 172.21.15.69:53344) 2024-02-21T07:44:53.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.126+0000 7fc367400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b95112f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.127+0000 7fc367400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b95112f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38166/0 (socket says 172.21.15.69:38166) 2024-02-21T07:44:53.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.129+0000 7fc367e00640 1 -- 172.21.15.69:0/3533578849 learned_addr learned my addr 172.21.15.69:0/3533578849 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:53.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.129+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b939fec0 con 0x5589b9500f80 2024-02-21T07:44:53.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.130+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b939fb60 con 0x5589b94cb8e0 2024-02-21T07:44:53.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.130+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b91691c0 con 0x5589b94cafc0 2024-02-21T07:44:53.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.130+0000 7fc371fc5740 10 client.0 _ll_register_callbacks cb 0x5589b93b3960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:53.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.130+0000 7fc36d200640 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b948e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.130+0000 7fc367e00640 1 -- 172.21.15.69:0/3533578849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 msgr2=0x5589b95112f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:53.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.130+0000 7fc367e00640 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b95112f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.130+0000 7fc367e00640 1 -- 172.21.15.69:0/3533578849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 msgr2=0x5589b948e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:53.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.131+0000 7fc367e00640 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b948e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.131+0000 7fc367e00640 1 -- 172.21.15.69:0/3533578849 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc368188c80 con 0x5589b94cafc0 2024-02-21T07:44:53.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.131+0000 7fc367400640 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b95112f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:44:53.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.132+0000 7fc36d200640 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b948e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:44:53.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.132+0000 7fc367e00640 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 0x5589b948de60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc358009fd0 tx=0x7fc358013770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d230b7bbb02d9eb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:53.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.132+0000 7fc351600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:44:53.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.132+0000 7fc351600640 1 -- 172.21.15.69:0/3533578849 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358016870 con 0x5589b94cafc0 2024-02-21T07:44:53.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.132+0000 7fc351600640 1 -- 172.21.15.69:0/3533578849 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc3580169d0 con 0x5589b94cafc0 2024-02-21T07:44:53.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.132+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589b90fa7e0 con 0x5589b94cafc0 2024-02-21T07:44:53.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc351600640 1 -- 172.21.15.69:0/3533578849 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc358016b90 con 0x5589b94cafc0 2024-02-21T07:44:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc371fc5740 10 client.5882 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5589b93f94e0 con 0x5589b94cafc0 2024-02-21T07:44:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc351600640 1 -- 172.21.15.69:0/3533578849 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5589b90fa7e0 con 0x5589b94cafc0 2024-02-21T07:44:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc351600640 1 -- 172.21.15.69:0/3533578849 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fc358016cf0 con 0x5589b94cafc0 2024-02-21T07:44:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc371fc5740 10 client.5882 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc371fc5740 10 client.5882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc371fc5740 20 client.5882 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc371fc5740 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5589b94bdfa0 0x5589b94fe500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc371fc5740 4 client.5882 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:44:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.133+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589b9137720 con 0x5589b94bdfa0 2024-02-21T07:44:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.134+0000 7fc367400640 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5589b94bdfa0 0x5589b94fe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.134+0000 7fc367400640 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5589b94bdfa0 0x5589b94fe500 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62239d3397be784c server_cookie=1452c2dcb9a3c162 in_seq=0 out_seq=0 2024-02-21T07:44:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.134+0000 7fc351600640 10 client.5882 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:53.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.138+0000 7fc351600640 1 -- 172.21.15.69:0/3533578849 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5589b9137720 con 0x5589b94bdfa0 2024-02-21T07:44:53.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.138+0000 7fc351600640 10 client.5882 handle_command_reply: tid=0 2024-02-21T07:44:53.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.138+0000 7fc371fc5740 1 client.5882 shutdown 2024-02-21T07:44:53.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.138+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 msgr2=0x5589b948de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.138+0000 7fc371fc5740 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 0x5589b948de60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc358009fd0 tx=0x7fc358013770 comp rx=0 tx=0).stop 2024-02-21T07:44:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.139+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 shutdown_connections 2024-02-21T07:44:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.139+0000 7fc371fc5740 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5589b94bdfa0 0x5589b94fe500 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.139+0000 7fc371fc5740 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b948e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.139+0000 7fc371fc5740 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b95112f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.139+0000 7fc371fc5740 1 --2- 172.21.15.69:0/3533578849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 0x5589b948de60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.139+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 >> 172.21.15.69:0/3533578849 conn(0x5589b945a5a0 msgr2=0x5589b9500810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.139+0000 7fc351600640 0 client.5882 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.139+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 shutdown_connections 2024-02-21T07:44:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.139+0000 7fc371fc5740 1 -- 172.21.15.69:0/3533578849 wait complete. 2024-02-21T07:44:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.139+0000 7fc371fc5740 20 client.5882 trim_cache size 0 max 16384 2024-02-21T07:44:53.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.168+0000 7fc371fc5740 1 Processor -- start 2024-02-21T07:44:53.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.168+0000 7fc371fc5740 1 -- start start 2024-02-21T07:44:53.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.170+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 0x5589b94d41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.170+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b94fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.170+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b955f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.170+0000 7fc371fc5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b950fa60 con 0x5589b9500f80 2024-02-21T07:44:53.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.170+0000 7fc371fc5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b94f8a80 con 0x5589b94cb8e0 2024-02-21T07:44:53.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.170+0000 7fc371fc5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b94992d0 con 0x5589b94cafc0 2024-02-21T07:44:53.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.170+0000 7fc36d200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b955f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.170+0000 7fc36d200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b955f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39894/0 (socket says 172.21.15.69:39894) 2024-02-21T07:44:53.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.170+0000 7fc36d200640 1 -- 172.21.15.69:0/882535067 learned_addr learned my addr 172.21.15.69:0/882535067 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:53.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.170+0000 7fc367400640 1 --2- 172.21.15.69:0/882535067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b94fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.171+0000 7fc36d200640 1 -- 172.21.15.69:0/882535067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 msgr2=0x5589b94d41d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T07:44:53.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.171+0000 7fc36d200640 1 --2- 172.21.15.69:0/882535067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 0x5589b94d41d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.171+0000 7fc36d200640 1 -- 172.21.15.69:0/882535067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 msgr2=0x5589b94fcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:53.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.171+0000 7fc36d200640 1 --2- 172.21.15.69:0/882535067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b94fcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.171+0000 7fc36d200640 1 -- 172.21.15.69:0/882535067 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589b9395950 con 0x5589b9500f80 2024-02-21T07:44:53.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.171+0000 7fc36d200640 1 --2- 172.21.15.69:0/882535067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b955f030 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc3600b6010 tx=0x7fc360040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab5c0b37a28de7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:53.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.171+0000 7fc353e00640 1 -- 172.21.15.69:0/882535067 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3600af1c0 con 0x5589b9500f80 2024-02-21T07:44:53.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.172+0000 7fc353e00640 1 -- 172.21.15.69:0/882535067 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36009b730 con 0x5589b9500f80 2024-02-21T07:44:53.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.172+0000 7fc353e00640 1 -- 172.21.15.69:0/882535067 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360097840 con 0x5589b9500f80 2024-02-21T07:44:53.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.172+0000 7fc371fc5740 1 -- 172.21.15.69:0/882535067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 msgr2=0x5589b955f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:53.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.172+0000 7fc371fc5740 1 --2- 172.21.15.69:0/882535067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b955f030 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc3600b6010 tx=0x7fc360040000 comp rx=0 tx=0).stop 2024-02-21T07:44:53.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.172+0000 7fc371fc5740 1 -- 172.21.15.69:0/882535067 shutdown_connections 2024-02-21T07:44:53.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.172+0000 7fc371fc5740 1 --2- 172.21.15.69:0/882535067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b9500f80 0x5589b955f030 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.173+0000 7fc371fc5740 1 --2- 172.21.15.69:0/882535067 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b94fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.173+0000 7fc371fc5740 1 --2- 172.21.15.69:0/882535067 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b94cafc0 0x5589b94d41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.173+0000 7fc371fc5740 1 -- 172.21.15.69:0/882535067 >> 172.21.15.69:0/882535067 conn(0x5589b945a5a0 msgr2=0x5589b94c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:53.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.173+0000 7fc371fc5740 1 -- 172.21.15.69:0/882535067 shutdown_connections 2024-02-21T07:44:53.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.173+0000 7fc371fc5740 1 -- 172.21.15.69:0/882535067 wait complete. 2024-02-21T07:44:53.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.174+0000 7fc371fc5740 1 -- start start 2024-02-21T07:44:53.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.174+0000 7fc371fc5740 1 Processor -- start 2024-02-21T07:44:53.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b94c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b9492020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc371fc5740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 0x5589b9559720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc371fc5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b9570db0 con 0x5589b94cafc0 2024-02-21T07:44:53.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc371fc5740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b9492660 con 0x5589b94cb8e0 2024-02-21T07:44:53.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc371fc5740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589b9559c60 con 0x5589b9500f80 2024-02-21T07:44:53.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc371fc5740 10 client.0 _ll_register_callbacks cb 0x7fc3580097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:44:53.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc367e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b94c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc36d200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 0x5589b9559720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc367e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b94c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39898/0 (socket says 172.21.15.69:39898) 2024-02-21T07:44:53.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.176+0000 7fc367e00640 1 -- 172.21.15.69:0/151345478 learned_addr learned my addr 172.21.15.69:0/151345478 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:44:53.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.177+0000 7fc367400640 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b9492020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.177+0000 7fc367e00640 1 -- 172.21.15.69:0/151345478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 msgr2=0x5589b9559720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:53.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.177+0000 7fc367e00640 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 0x5589b9559720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.177+0000 7fc367e00640 1 -- 172.21.15.69:0/151345478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 msgr2=0x5589b9492020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:44:53.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.177+0000 7fc367e00640 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b9492020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.177+0000 7fc367e00640 1 -- 172.21.15.69:0/151345478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589b93b4060 con 0x5589b94cafc0 2024-02-21T07:44:53.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.177+0000 7fc36d200640 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 0x5589b9559720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:53.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.177+0000 7fc367400640 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b9492020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:44:53.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.178+0000 7fc367e00640 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b94c48c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc358009fa0 tx=0x7fc3580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafea5053c1105a0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:44:53.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.178+0000 7fc351600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:44:53.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.178+0000 7fc351600640 1 -- 172.21.15.69:0/151345478 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580207c0 con 0x5589b94cafc0 2024-02-21T07:44:53.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.179+0000 7fc351600640 1 -- 172.21.15.69:0/151345478 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc358000e40 con 0x5589b94cafc0 2024-02-21T07:44:53.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.179+0000 7fc371fc5740 1 -- 172.21.15.69:0/151345478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc36009fd80 con 0x5589b94cafc0 2024-02-21T07:44:53.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.179+0000 7fc351600640 1 -- 172.21.15.69:0/151345478 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc358020920 con 0x5589b94cafc0 2024-02-21T07:44:53.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.179+0000 7fc371fc5740 10 client.5742 fetch_fsmap learned FSMap version 22 2024-02-21T07:44:53.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.179+0000 7fc371fc5740 1 -- 172.21.15.69:0/151345478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x5589b93bb430 con 0x5589b94cafc0 2024-02-21T07:44:53.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.179+0000 7fc351600640 1 -- 172.21.15.69:0/151345478 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36009fd80 con 0x5589b94cafc0 2024-02-21T07:44:53.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.180+0000 7fc351600640 1 -- 172.21.15.69:0/151345478 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fc358020a80 con 0x5589b94cafc0 2024-02-21T07:44:53.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.180+0000 7fc371fc5740 10 client.5742 fetch_fsmap finished waiting for FSMap version 22 2024-02-21T07:44:53.186 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.180+0000 7fc371fc5740 10 client.5742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:44:53.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.180+0000 7fc371fc5740 20 client.5742 populate_metadata read hostname 'smithi069' 2024-02-21T07:44:53.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.180+0000 7fc371fc5740 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5589b94f89f0 0x5589b9571240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:44:53.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.180+0000 7fc371fc5740 4 client.5742 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:44:53.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.180+0000 7fc371fc5740 1 -- 172.21.15.69:0/151345478 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5589b9186890 con 0x5589b94f89f0 2024-02-21T07:44:53.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.180+0000 7fc367400640 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5589b94f89f0 0x5589b9571240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:44:53.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.181+0000 7fc351600640 10 client.5742 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:53.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.181+0000 7fc367400640 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5589b94f89f0 0x5589b9571240 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec73d9f62209a7c9 server_cookie=80c5bba7e831448c in_seq=0 out_seq=0 2024-02-21T07:44:53.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.182+0000 7fc351600640 1 -- 172.21.15.69:0/151345478 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x5589b9186890 con 0x5589b94f89f0 2024-02-21T07:44:53.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.182+0000 7fc351600640 10 client.5742 handle_command_reply: tid=0 2024-02-21T07:44:53.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.182+0000 7fc371fc5740 1 client.5742 shutdown 2024-02-21T07:44:53.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.183+0000 7fc371fc5740 1 -- 172.21.15.69:0/151345478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 msgr2=0x5589b94c48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:53.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.183+0000 7fc371fc5740 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b94c48c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc358009fa0 tx=0x7fc3580046c0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.183+0000 7fc371fc5740 1 -- 172.21.15.69:0/151345478 shutdown_connections 2024-02-21T07:44:53.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.183+0000 7fc371fc5740 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5589b94f89f0 0x5589b9571240 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.183+0000 7fc371fc5740 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5589b9500f80 0x5589b9559720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.183+0000 7fc371fc5740 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5589b94cb8e0 0x5589b9492020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.183+0000 7fc371fc5740 1 --2- 172.21.15.69:0/151345478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589b94cafc0 0x5589b94c48c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.183+0000 7fc351600640 0 client.5742 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:44:53.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.183+0000 7fc371fc5740 1 -- 172.21.15.69:0/151345478 >> 172.21.15.69:0/151345478 conn(0x5589b945a5a0 msgr2=0x5589b94fea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:53.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.183+0000 7fc371fc5740 1 -- 172.21.15.69:0/151345478 shutdown_connections 2024-02-21T07:44:53.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.184+0000 7fc371fc5740 1 -- 172.21.15.69:0/151345478 wait complete. 2024-02-21T07:44:53.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.184+0000 7fc371fc5740 20 client.5742 trim_cache size 0 max 16384 2024-02-21T07:44:53.190 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:44:53.190 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "scrub active (1605 inodes in the stack)", 2024-02-21T07:44:53.190 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2024-02-21T07:44:53.190 INFO:teuthology.orchestra.run.smithi069.stdout: "1080b564-9616-4dfd-8d96-17d3a4d8b811": { 2024-02-21T07:44:53.191 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2024-02-21T07:44:53.191 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "1080b564-9616-4dfd-8d96-17d3a4d8b811", 2024-02-21T07:44:53.191 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2024-02-21T07:44:53.191 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:44:53.191 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:44:53.191 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:44:53.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.184+0000 7fc36f200640 1 -- 172.21.15.69:0/941840551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc34809f1f0 msgr2=0x7fc3480a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:53.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.184+0000 7fc36f200640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc34809f1f0 0x7fc3480a16b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc354034000 tx=0x7fc354008030 comp rx=0 tx=0).stop 2024-02-21T07:44:53.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.184+0000 7fc36f200640 1 -- 172.21.15.69:0/941840551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc368186f90 msgr2=0x7fc368187610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:44:53.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.184+0000 7fc36f200640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc368186f90 0x7fc368187610 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc36000caa0 tx=0x7fc36000cf60 comp rx=0 tx=0).stop 2024-02-21T07:44:53.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.185+0000 7fc36f200640 1 -- 172.21.15.69:0/941840551 shutdown_connections 2024-02-21T07:44:53.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.185+0000 7fc36f200640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fc34809f1f0 0x7fc3480a16b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.185+0000 7fc36f200640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fc368186f90 0x7fc368187610 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.185+0000 7fc36f200640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc368182bf0 0x7fc3680cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.185+0000 7fc36f200640 1 --2- 172.21.15.69:0/941840551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3680ee8c0 0x7fc3680ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:44:53.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.185+0000 7fc36f200640 1 -- 172.21.15.69:0/941840551 >> 172.21.15.69:0/941840551 conn(0x7fc3680f7cc0 msgr2=0x7fc36808cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:44:53.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.187+0000 7fc36f200640 1 -- 172.21.15.69:0/941840551 shutdown_connections 2024-02-21T07:44:53.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:44:53.187+0000 7fc36f200640 1 -- 172.21.15.69:0/941840551 wait complete. 2024-02-21T07:44:53.215 INFO:tasks.cephfs.filesystem:scrub status for tag:1080b564-9616-4dfd-8d96-17d3a4d8b811 - {'path': '/', 'tag': '1080b564-9616-4dfd-8d96-17d3a4d8b811', 'options': 'recursive,force'} 2024-02-21T07:44:56.915 INFO:tasks.ceph.mon.a.smithi069.stderr:2024-02-21T07:44:56.910+0000 7f1206400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-02-21T07:45:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.776+0000 7f14c0400640 1 Processor -- start 2024-02-21T07:45:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.776+0000 7f14c0400640 1 -- start start 2024-02-21T07:45:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.778+0000 7f14c0400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14b80f89d0 0x7f14b80f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.778+0000 7f14c0400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f14b80619a0 0x7f14b8061e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14c0400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b80f9370 con 0x7f14b80615c0 2024-02-21T07:45:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14c0400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b8188160 con 0x7f14b80619a0 2024-02-21T07:45:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14c0400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b818ce50 con 0x7f14b80f89d0 2024-02-21T07:45:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14be400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f14b80619a0 0x7f14b8061e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14bd000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f14b80f89d0 0x7f14b80f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14bda00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f14b80615c0 0x7f14b81867c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:46098/0 (socket says 172.21.15.69:46098) 2024-02-21T07:45:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14bda00640 1 -- 172.21.15.69:0/3070449728 learned_addr learned my addr 172.21.15.69:0/3070449728 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14bd000640 1 -- 172.21.15.69:0/3070449728 >> v2:172.21.15.69:3300/0 conn(0x7f14b80619a0 msgr2=0x7f14b8061e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14bd000640 1 --2- 172.21.15.69:0/3070449728 >> v2:172.21.15.69:3300/0 conn(0x7f14b80619a0 0x7f14b8061e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14bd000640 1 -- 172.21.15.69:0/3070449728 >> v1:172.21.15.174:6789/0 conn(0x7f14b80615c0 legacy=0x7f14b81867c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.779+0000 7f14bd000640 1 -- 172.21.15.69:0/3070449728 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b8189860 con 0x7f14b80f89d0 2024-02-21T07:45:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.781+0000 7f14bd000640 1 --2- 172.21.15.69:0/3070449728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14b80f89d0 0x7f14b80f8e30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f14b80fd920 tx=0x7f14a402b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de405d7eae76782d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:02.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.781+0000 7f14b7e00640 1 -- 172.21.15.69:0/3070449728 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4031710 con 0x7f14b80f89d0 2024-02-21T07:45:02.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.781+0000 7f14b7e00640 1 -- 172.21.15.69:0/3070449728 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a402f050 con 0x7f14b80f89d0 2024-02-21T07:45:02.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.781+0000 7f14b7e00640 1 -- 172.21.15.69:0/3070449728 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4031a90 con 0x7f14b80f89d0 2024-02-21T07:45:02.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.782+0000 7f14c0400640 1 -- 172.21.15.69:0/3070449728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14b80f89d0 msgr2=0x7f14b80f8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.782+0000 7f14c0400640 1 --2- 172.21.15.69:0/3070449728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14b80f89d0 0x7f14b80f8e30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f14b80fd920 tx=0x7f14a402b7b0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.782+0000 7f14c0400640 1 -- 172.21.15.69:0/3070449728 shutdown_connections 2024-02-21T07:45:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.782+0000 7f14c0400640 1 --2- 172.21.15.69:0/3070449728 >> v2:172.21.15.69:3300/0 conn(0x7f14b80619a0 0x7f14b8061e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.782+0000 7f14c0400640 1 --2- 172.21.15.69:0/3070449728 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14b80f89d0 0x7f14b80f8e30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.782+0000 7f14c0400640 1 -- 172.21.15.69:0/3070449728 >> 172.21.15.69:0/3070449728 conn(0x7f14b80fe050 msgr2=0x7f14b80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.782+0000 7f14c0400640 1 -- 172.21.15.69:0/3070449728 shutdown_connections 2024-02-21T07:45:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.782+0000 7f14c0400640 1 -- 172.21.15.69:0/3070449728 wait complete. 2024-02-21T07:45:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.784+0000 7f14c0400640 1 Processor -- start 2024-02-21T07:45:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.784+0000 7f14c0400640 1 -- start start 2024-02-21T07:45:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14c0400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b80615c0 0x7f14b816eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14c0400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14b80619a0 0x7f14b80d5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14c0400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14b80f89d0 0x7f14b80d5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14c0400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80d06f0 con 0x7f14b80615c0 2024-02-21T07:45:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14c0400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80d09d0 con 0x7f14b80619a0 2024-02-21T07:45:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14c0400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b80d0cb0 con 0x7f14b80f89d0 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14bda00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b80615c0 0x7f14b816eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14bda00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b80615c0 0x7f14b816eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56958/0 (socket says 172.21.15.69:56958) 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14bda00640 1 -- 172.21.15.69:0/2022560821 learned_addr learned my addr 172.21.15.69:0/2022560821 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14bd000640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14b80619a0 0x7f14b80d5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.786+0000 7f14be400640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14b80f89d0 0x7f14b80d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.787+0000 7f14bda00640 1 -- 172.21.15.69:0/2022560821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14b80f89d0 msgr2=0x7f14b80d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.787+0000 7f14bda00640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14b80f89d0 0x7f14b80d5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.787+0000 7f14bda00640 1 -- 172.21.15.69:0/2022560821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14b80619a0 msgr2=0x7f14b80d5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.787+0000 7f14bda00640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14b80619a0 0x7f14b80d5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.787+0000 7f14bda00640 1 -- 172.21.15.69:0/2022560821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a4009400 con 0x7f14b80615c0 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.787+0000 7f14bda00640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b80615c0 0x7f14b816eeb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00c3c0 tx=0x7f14ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.787+0000 7f14b5600640 1 -- 172.21.15.69:0/2022560821 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac005ce0 con 0x7f14b80615c0 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.787+0000 7f14b5600640 1 -- 172.21.15.69:0/2022560821 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac005e40 con 0x7f14b80615c0 2024-02-21T07:45:02.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.787+0000 7f14b5600640 1 -- 172.21.15.69:0/2022560821 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0072d0 con 0x7f14b80615c0 2024-02-21T07:45:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.787+0000 7f14c0400640 1 -- 172.21.15.69:0/2022560821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b80d0f90 con 0x7f14b80615c0 2024-02-21T07:45:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.788+0000 7f14c0400640 1 -- 172.21.15.69:0/2022560821 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b80d1550 con 0x7f14b80615c0 2024-02-21T07:45:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.791+0000 7f14b5600640 1 -- 172.21.15.69:0/2022560821 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f14ac0074f0 con 0x7f14b80615c0 2024-02-21T07:45:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.792+0000 7f14c3019740 1 Processor -- start 2024-02-21T07:45:02.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.793+0000 7f14c3019740 1 -- start start 2024-02-21T07:45:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.793+0000 7f14b5600640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f149809f0a0 0x7f14980a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.794+0000 7f14b5600640 1 -- 172.21.15.69:0/2022560821 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f14ac0c8fe0 con 0x7f14b80615c0 2024-02-21T07:45:02.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.794+0000 7f14be400640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f149809f0a0 0x7f14980a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.794+0000 7f14be400640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f149809f0a0 0x7f14980a1560 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f14b0011340 tx=0x7f14b000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.794+0000 7f14c3019740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf7077d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14c3019740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 0x55cf70782a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14c3019740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 0x55cf707be450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14c3019740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7073e620 con 0x55cf707f24d0 2024-02-21T07:45:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14c3019740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf706f08c0 con 0x55cf70782f90 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14c3019740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf706eddf0 con 0x55cf707be070 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14bd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 0x55cf70782a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14be400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 0x55cf707be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14be400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 0x55cf707be450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:56256/0 (socket says 172.21.15.69:56256) 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14be400640 1 -- 172.21.15.69:0/2550616797 learned_addr learned my addr 172.21.15.69:0/2550616797 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14bda00640 1 --2- 172.21.15.69:0/2550616797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf7077d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14be400640 1 -- 172.21.15.69:0/2550616797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 msgr2=0x55cf7077d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14be400640 1 --2- 172.21.15.69:0/2550616797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf7077d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14be400640 1 -- 172.21.15.69:0/2550616797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 msgr2=0x55cf70782a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14be400640 1 --2- 172.21.15.69:0/2550616797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 0x55cf70782a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14be400640 1 -- 172.21.15.69:0/2550616797 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf7066ab00 con 0x55cf70782f90 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.795+0000 7f14bda00640 1 --2- 172.21.15.69:0/2550616797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf7077d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.796+0000 7f14be400640 1 --2- 172.21.15.69:0/2550616797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 0x55cf707be450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14b00177c0 tx=0x7f14b0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b4698f642af1adb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.796+0000 7f14aa000640 1 -- 172.21.15.69:0/2550616797 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b001c040 con 0x55cf70782f90 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.796+0000 7f14aa000640 1 -- 172.21.15.69:0/2550616797 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b000f040 con 0x55cf70782f90 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.796+0000 7f14aa000640 1 -- 172.21.15.69:0/2550616797 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000e040 con 0x55cf70782f90 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.797+0000 7f14c3019740 1 -- 172.21.15.69:0/2550616797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 msgr2=0x55cf707be450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.797+0000 7f14c3019740 1 --2- 172.21.15.69:0/2550616797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 0x55cf707be450 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14b00177c0 tx=0x7f14b0014000 comp rx=0 tx=0).stop 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.797+0000 7f14c3019740 1 -- 172.21.15.69:0/2550616797 shutdown_connections 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.797+0000 7f14c3019740 1 --2- 172.21.15.69:0/2550616797 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 0x55cf707be450 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.797+0000 7f14c3019740 1 --2- 172.21.15.69:0/2550616797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 0x55cf70782a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.797+0000 7f14c3019740 1 --2- 172.21.15.69:0/2550616797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf7077d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.797+0000 7f14c3019740 1 -- 172.21.15.69:0/2550616797 >> 172.21.15.69:0/2550616797 conn(0x55cf7074a4b0 msgr2=0x55cf70781ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.797+0000 7f14c3019740 1 -- 172.21.15.69:0/2550616797 shutdown_connections 2024-02-21T07:45:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.797+0000 7f14c3019740 1 -- 172.21.15.69:0/2550616797 wait complete. 2024-02-21T07:45:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.798+0000 7f14c3019740 1 -- start start 2024-02-21T07:45:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.798+0000 7f14c3019740 1 Processor -- start 2024-02-21T07:45:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.799+0000 7f14c3019740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.799+0000 7f14c3019740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707be070 0x55cf70803380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.799+0000 7f14c3019740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707f24d0 0x55cf707b4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.799+0000 7f14c3019740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf706e95d0 con 0x55cf70782f90 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14c3019740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7068eb50 con 0x55cf707be070 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14c3019740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7068e7f0 con 0x55cf707f24d0 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14c3019740 10 client.0 _ll_register_callbacks cb 0x55cf706a2550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14bda00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14bda00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707b6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56976/0 (socket says 172.21.15.69:56976) 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14bda00640 1 -- 172.21.15.69:0/2393959264 learned_addr learned my addr 172.21.15.69:0/2393959264 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14be400640 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707f24d0 0x55cf707b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14bd000640 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707be070 0x55cf70803380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14bda00640 1 -- 172.21.15.69:0/2393959264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707f24d0 msgr2=0x55cf707b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14bda00640 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707f24d0 0x55cf707b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14bda00640 1 -- 172.21.15.69:0/2393959264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707be070 msgr2=0x55cf70803380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14bda00640 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707be070 0x55cf70803380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14bda00640 1 -- 172.21.15.69:0/2393959264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b0017440 con 0x55cf70782f90 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f14bda00640 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707b6d50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00cd80 tx=0x7f14ac096d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4836b8f7e079b05c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.800+0000 7f149ea00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.801+0000 7f149ea00640 1 -- 172.21.15.69:0/2393959264 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0c6ea0 con 0x55cf70782f90 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.801+0000 7f149ea00640 1 -- 172.21.15.69:0/2393959264 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f14ac0aad70 con 0x55cf70782f90 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.801+0000 7f14c3019740 1 -- 172.21.15.69:0/2393959264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf706bbcd0 con 0x55cf70782f90 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.801+0000 7f149ea00640 1 -- 172.21.15.69:0/2393959264 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14ac096020 con 0x55cf70782f90 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.801+0000 7f14c3019740 10 client.5754 fetch_fsmap learned FSMap version 25 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.801+0000 7f14c3019740 1 -- 172.21.15.69:0/2393959264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55cf706e7c50 con 0x55cf70782f90 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.801+0000 7f149ea00640 1 -- 172.21.15.69:0/2393959264 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cf706bbcd0 con 0x55cf70782f90 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.801+0000 7f149ea00640 1 -- 172.21.15.69:0/2393959264 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f14ac096180 con 0x55cf70782f90 2024-02-21T07:45:02.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.802+0000 7f14c3019740 10 client.5754 fetch_fsmap finished waiting for FSMap version 25 2024-02-21T07:45:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.802+0000 7f14c3019740 10 client.5754 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:45:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.802+0000 7f14c3019740 20 client.5754 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.802+0000 7f14c3019740 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cf707b5fd0 0x55cf707b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.802+0000 7f14c3019740 4 client.5754 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:45:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.802+0000 7f14c3019740 1 -- 172.21.15.69:0/2393959264 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf706dfce0 con 0x55cf707b5fd0 2024-02-21T07:45:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.802+0000 7f14bd000640 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cf707b5fd0 0x55cf707b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.803+0000 7f14bd000640 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cf707b5fd0 0x55cf707b63e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68aae42634271897 server_cookie=ea3d0d42f372e0c6 in_seq=0 out_seq=0 2024-02-21T07:45:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.803+0000 7f149ea00640 10 client.5754 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.803+0000 7f149ea00640 1 -- 172.21.15.69:0/2393959264 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cf706dfce0 con 0x55cf707b5fd0 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.803+0000 7f149ea00640 10 client.5754 handle_command_reply: tid=0 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.803+0000 7f14c3019740 1 client.5754 shutdown 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 1 -- 172.21.15.69:0/2393959264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 msgr2=0x55cf707b6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707b6d50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00cd80 tx=0x7f14ac096d10 comp rx=0 tx=0).stop 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 1 -- 172.21.15.69:0/2393959264 shutdown_connections 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cf707b5fd0 0x55cf707b63e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707f24d0 0x55cf707b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707be070 0x55cf70803380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f149ea00640 0 client.5754 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 1 --2- 172.21.15.69:0/2393959264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707b6d50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 1 -- 172.21.15.69:0/2393959264 >> 172.21.15.69:0/2393959264 conn(0x55cf7074a4b0 msgr2=0x55cf707f2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 1 -- 172.21.15.69:0/2393959264 shutdown_connections 2024-02-21T07:45:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 1 -- 172.21.15.69:0/2393959264 wait complete. 2024-02-21T07:45:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.804+0000 7f14c3019740 20 client.5754 trim_cache size 0 max 16384 2024-02-21T07:45:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.818+0000 7f14c3019740 1 Processor -- start 2024-02-21T07:45:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.819+0000 7f14c3019740 1 -- start start 2024-02-21T07:45:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14c3019740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 0x55cf7077f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14c3019740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf70812ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14c3019740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 0x55cf70780c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14c3019740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf70431e60 con 0x55cf707f24d0 2024-02-21T07:45:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14c3019740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf70780790 con 0x55cf70782f90 2024-02-21T07:45:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14c3019740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf707b6530 con 0x55cf707be070 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14be400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 0x55cf70780c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14be400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 0x55cf70780c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56986/0 (socket says 172.21.15.69:56986) 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14be400640 1 -- 172.21.15.69:0/945862165 learned_addr learned my addr 172.21.15.69:0/945862165 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14bda00640 1 --2- 172.21.15.69:0/945862165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 0x55cf7077f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14bd000640 1 --2- 172.21.15.69:0/945862165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf70812ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14be400640 1 -- 172.21.15.69:0/945862165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 msgr2=0x55cf70812ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14be400640 1 --2- 172.21.15.69:0/945862165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf70812ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14be400640 1 -- 172.21.15.69:0/945862165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 msgr2=0x55cf7077f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14be400640 1 --2- 172.21.15.69:0/945862165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 0x55cf7077f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.820+0000 7f14be400640 1 -- 172.21.15.69:0/945862165 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf70684530 con 0x55cf707f24d0 2024-02-21T07:45:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.821+0000 7f14be400640 1 --2- 172.21.15.69:0/945862165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 0x55cf70780c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f14b0011bd0 tx=0x7f14b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c908070b37f008e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.821+0000 7f14a9600640 1 -- 172.21.15.69:0/945862165 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b000e050 con 0x55cf707f24d0 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.821+0000 7f14a9600640 1 -- 172.21.15.69:0/945862165 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b0007000 con 0x55cf707f24d0 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.821+0000 7f14a9600640 1 -- 172.21.15.69:0/945862165 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b0031070 con 0x55cf707f24d0 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.822+0000 7f14c3019740 1 -- 172.21.15.69:0/945862165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 msgr2=0x55cf70780c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.822+0000 7f14c3019740 1 --2- 172.21.15.69:0/945862165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 0x55cf70780c20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f14b0011bd0 tx=0x7f14b0019000 comp rx=0 tx=0).stop 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.822+0000 7f14c3019740 1 -- 172.21.15.69:0/945862165 shutdown_connections 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.822+0000 7f14c3019740 1 --2- 172.21.15.69:0/945862165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf707f24d0 0x55cf70780c20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.822+0000 7f14c3019740 1 --2- 172.21.15.69:0/945862165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf70812ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.822+0000 7f14c3019740 1 --2- 172.21.15.69:0/945862165 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf70782f90 0x55cf7077f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.822+0000 7f14c3019740 1 -- 172.21.15.69:0/945862165 >> 172.21.15.69:0/945862165 conn(0x55cf7074a4b0 msgr2=0x55cf7080a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.822+0000 7f14c3019740 1 -- 172.21.15.69:0/945862165 shutdown_connections 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.822+0000 7f14c3019740 1 -- 172.21.15.69:0/945862165 wait complete. 2024-02-21T07:45:02.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.823+0000 7f14c3019740 1 -- start start 2024-02-21T07:45:02.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.823+0000 7f14c3019740 1 Processor -- start 2024-02-21T07:45:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14c3019740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707e09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14c3019740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf7077c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14c3019740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707f24d0 0x55cf707eb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14c3019740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf707e1690 con 0x55cf70782f90 2024-02-21T07:45:02.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14c3019740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf708511d0 con 0x55cf707f24d0 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14c3019740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf707e0f00 con 0x55cf707be070 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14c3019740 10 client.0 _ll_register_callbacks cb 0x7f14ac096530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14bda00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707e09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14bda00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707e09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56990/0 (socket says 172.21.15.69:56990) 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14bda00640 1 -- 172.21.15.69:0/2917232360 learned_addr learned my addr 172.21.15.69:0/2917232360 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14be400640 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707f24d0 0x55cf707eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.824+0000 7f14bd000640 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf7077c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f14bda00640 1 -- 172.21.15.69:0/2917232360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 msgr2=0x55cf7077c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f14bda00640 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf7077c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f14bda00640 1 -- 172.21.15.69:0/2917232360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707f24d0 msgr2=0x55cf707eb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f14bda00640 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707f24d0 0x55cf707eb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f14bda00640 1 -- 172.21.15.69:0/2917232360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf7066ab00 con 0x55cf70782f90 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f14be400640 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707f24d0 0x55cf707eb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:02.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f14bda00640 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707e09c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f14ac093030 tx=0x7f14ac0c68b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797ff6ba9a40c7ee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f149ea00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f149ea00640 1 -- 172.21.15.69:0/2917232360 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0c6ea0 con 0x55cf70782f90 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f149ea00640 1 -- 172.21.15.69:0/2917232360 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f14ac096020 con 0x55cf70782f90 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f14c3019740 1 -- 172.21.15.69:0/2917232360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf7070ed30 con 0x55cf70782f90 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f149ea00640 1 -- 172.21.15.69:0/2917232360 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14ac00e040 con 0x55cf70782f90 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f14c3019740 10 client.5760 fetch_fsmap learned FSMap version 25 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.825+0000 7f14c3019740 1 -- 172.21.15.69:0/2917232360 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55cf706aa2c0 con 0x55cf70782f90 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.826+0000 7f149ea00640 1 -- 172.21.15.69:0/2917232360 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cf7070ed30 con 0x55cf70782f90 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.826+0000 7f149ea00640 1 -- 172.21.15.69:0/2917232360 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 25) v1 ==== 7922+0+0 (secure 0 0 0) 0x7f14ac076b10 con 0x55cf70782f90 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.826+0000 7f14c3019740 10 client.5760 fetch_fsmap finished waiting for FSMap version 25 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.826+0000 7f14c3019740 10 client.5760 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.826+0000 7f14c3019740 20 client.5760 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:02.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.826+0000 7f14c3019740 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cf707b7640 0x55cf70860380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.826+0000 7f14c3019740 4 client.5760 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:45:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.826+0000 7f14c3019740 1 -- 172.21.15.69:0/2917232360 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cf703e9600 con 0x55cf707b7640 2024-02-21T07:45:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.826+0000 7f14bd000640 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cf707b7640 0x55cf70860380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.827+0000 7f14bd000640 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cf707b7640 0x55cf70860380 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=210e69896e2c41ce server_cookie=b27e61fec4b094fe in_seq=0 out_seq=0 2024-02-21T07:45:02.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:02.827+0000 7f149ea00640 10 client.5760 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f149ea00640 1 -- 172.21.15.69:0/2917232360 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cf703e9600 con 0x55cf707b7640 2024-02-21T07:45:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f149ea00640 10 client.5760 handle_command_reply: tid=0 2024-02-21T07:45:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f14c3019740 1 client.5760 shutdown 2024-02-21T07:45:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f14c3019740 1 -- 172.21.15.69:0/2917232360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 msgr2=0x55cf707e09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f14c3019740 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707e09c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f14ac093030 tx=0x7f14ac0c68b0 comp rx=0 tx=0).stop 2024-02-21T07:45:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f14c3019740 1 -- 172.21.15.69:0/2917232360 shutdown_connections 2024-02-21T07:45:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f14c3019740 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55cf707b7640 0x55cf70860380 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f14c3019740 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55cf707f24d0 0x55cf707eb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f14c3019740 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55cf707be070 0x55cf7077c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f14c3019740 1 --2- 172.21.15.69:0/2917232360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cf70782f90 0x55cf707e09c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f14c3019740 1 -- 172.21.15.69:0/2917232360 >> 172.21.15.69:0/2917232360 conn(0x55cf7074a4b0 msgr2=0x55cf70812ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.353+0000 7f149ea00640 0 client.5760 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.354+0000 7f14c3019740 1 -- 172.21.15.69:0/2917232360 shutdown_connections 2024-02-21T07:45:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.354+0000 7f14c3019740 1 -- 172.21.15.69:0/2917232360 wait complete. 2024-02-21T07:45:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.354+0000 7f14c3019740 20 client.5760 trim_cache size 0 max 16384 2024-02-21T07:45:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-02-21T07:45:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-02-21T07:45:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-02-21T07:45:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-02-21T07:45:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.354+0000 7f14c0400640 1 -- 172.21.15.69:0/2022560821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f149809f0a0 msgr2=0x7f14980a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f149809f0a0 0x7f14980a1560 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f14b0011340 tx=0x7f14b000b040 comp rx=0 tx=0).stop 2024-02-21T07:45:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 -- 172.21.15.69:0/2022560821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b80615c0 msgr2=0x7f14b816eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b80615c0 0x7f14b816eeb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00c3c0 tx=0x7f14ac00c880 comp rx=0 tx=0).stop 2024-02-21T07:45:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 -- 172.21.15.69:0/2022560821 shutdown_connections 2024-02-21T07:45:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f149809f0a0 0x7f14980a1560 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14b80f89d0 0x7f14b80d5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f14b80619a0 0x7f14b80d5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 --2- 172.21.15.69:0/2022560821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14b80615c0 0x7f14b816eeb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 -- 172.21.15.69:0/2022560821 >> 172.21.15.69:0/2022560821 conn(0x7f14b80fe050 msgr2=0x7f14b80cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 -- 172.21.15.69:0/2022560821 shutdown_connections 2024-02-21T07:45:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:03.355+0000 7f14c0400640 1 -- 172.21.15.69:0/2022560821 wait complete. 2024-02-21T07:45:12.951 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:12.959 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:12.962 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.497+0000 7f48af000640 1 Processor -- start 2024-02-21T07:45:16.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.497+0000 7f48af000640 1 -- start start 2024-02-21T07:45:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.500+0000 7f48af000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f48a8189c80 0x7f48a818b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.500+0000 7f48af000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f48a808d450 0x7f48a808d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.500+0000 7f48af000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a818a2e0 con 0x7f48a815a770 2024-02-21T07:45:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.500+0000 7f48af000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a818a5c0 con 0x7f48a8189c80 2024-02-21T07:45:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.500+0000 7f48af000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a818a8a0 con 0x7f48a808d450 2024-02-21T07:45:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f48ad000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f48a808d450 0x7f48a808d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f48a7e00640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f48a815a770 0x7f48a8186700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:46612/0 (socket says 172.21.15.69:46612) 2024-02-21T07:45:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f48ad000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f48a808d450 0x7f48a808d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:36136/0 (socket says 172.21.15.69:36136) 2024-02-21T07:45:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f48a7e00640 1 -- 172.21.15.69:0/52879768 learned_addr learned my addr 172.21.15.69:0/52879768 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f48ad000640 1 -- 172.21.15.69:0/52879768 >> v2:172.21.15.69:3300/0 conn(0x7f48a8189c80 msgr2=0x7f48a818b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f48a7400640 1 -- 172.21.15.69:0/52879768 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967546096 0 0) 0x7f48a818a2e0 con 0x7f48a815a770 2024-02-21T07:45:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f489fe00640 1 --2- 172.21.15.69:0/52879768 >> v2:172.21.15.69:3300/0 conn(0x7f48a8189c80 0x7f48a818b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f48ad000640 1 --2- 172.21.15.69:0/52879768 >> v2:172.21.15.69:3300/0 conn(0x7f48a8189c80 0x7f48a818b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f48ad000640 1 -- 172.21.15.69:0/52879768 >> v1:172.21.15.184:6789/0 conn(0x7f48a815a770 legacy=0x7f48a8186700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f48ad000640 1 -- 172.21.15.69:0/52879768 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a818ab80 con 0x7f48a808d450 2024-02-21T07:45:16.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.501+0000 7f489fe00640 1 --2- 172.21.15.69:0/52879768 >> v2:172.21.15.69:3300/0 conn(0x7f48a8189c80 0x7f48a818b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.502+0000 7f48ad000640 1 --2- 172.21.15.69:0/52879768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48a808d450 0x7f48a808d880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f48a8186360 tx=0x7f48a002bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6495c3b9b6742f8a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.503+0000 7f48a7400640 1 -- 172.21.15.69:0/52879768 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a002cb50 con 0x7f48a808d450 2024-02-21T07:45:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.503+0000 7f48a7400640 1 -- 172.21.15.69:0/52879768 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a002ccb0 con 0x7f48a808d450 2024-02-21T07:45:16.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.503+0000 7f48a7400640 1 -- 172.21.15.69:0/52879768 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0034660 con 0x7f48a808d450 2024-02-21T07:45:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.504+0000 7f48af000640 1 -- 172.21.15.69:0/52879768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48a808d450 msgr2=0x7f48a808d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.504+0000 7f48af000640 1 --2- 172.21.15.69:0/52879768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48a808d450 0x7f48a808d880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f48a8186360 tx=0x7f48a002bda0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.504+0000 7f48af000640 1 -- 172.21.15.69:0/52879768 shutdown_connections 2024-02-21T07:45:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.504+0000 7f48af000640 1 --2- 172.21.15.69:0/52879768 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48a808d450 0x7f48a808d880 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.504+0000 7f48af000640 1 --2- 172.21.15.69:0/52879768 >> v2:172.21.15.69:3300/0 conn(0x7f48a8189c80 0x7f48a818b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.504+0000 7f48af000640 1 -- 172.21.15.69:0/52879768 >> 172.21.15.69:0/52879768 conn(0x7f48a80615c0 msgr2=0x7f48a80619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.504+0000 7f48af000640 1 -- 172.21.15.69:0/52879768 shutdown_connections 2024-02-21T07:45:16.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.504+0000 7f48af000640 1 -- 172.21.15.69:0/52879768 wait complete. 2024-02-21T07:45:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.506+0000 7f48af000640 1 Processor -- start 2024-02-21T07:45:16.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.506+0000 7f48af000640 1 -- start start 2024-02-21T07:45:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.508+0000 7f48af000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48a808d450 0x7f48a8220da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.508+0000 7f48af000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48a815a770 0x7f48a817ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.508+0000 7f48af000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8189c80 0x7f48a80fcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.508+0000 7f48af000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a821fa20 con 0x7f48a808d450 2024-02-21T07:45:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.508+0000 7f48af000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a821fd00 con 0x7f48a8189c80 2024-02-21T07:45:16.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.508+0000 7f48af000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a821ffe0 con 0x7f48a815a770 2024-02-21T07:45:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.508+0000 7f48a7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48a808d450 0x7f48a8220da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.508+0000 7f489fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48a815a770 0x7f48a817ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.508+0000 7f48a7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48a808d450 0x7f48a8220da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58988/0 (socket says 172.21.15.69:58988) 2024-02-21T07:45:16.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.508+0000 7f48a7e00640 1 -- 172.21.15.69:0/3403083095 learned_addr learned my addr 172.21.15.69:0/3403083095 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.509+0000 7f489fe00640 1 -- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8189c80 msgr2=0x7f48a80fcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.509+0000 7f48ad000640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8189c80 0x7f48a80fcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.509+0000 7f489fe00640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8189c80 0x7f48a80fcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.509+0000 7f489fe00640 1 -- 172.21.15.69:0/3403083095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48a808d450 msgr2=0x7f48a8220da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.509+0000 7f489fe00640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48a808d450 0x7f48a8220da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.509+0000 7f489fe00640 1 -- 172.21.15.69:0/3403083095 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a0009a70 con 0x7f48a815a770 2024-02-21T07:45:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.509+0000 7f48a7e00640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48a808d450 0x7f48a8220da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.509+0000 7f48ad000640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8189c80 0x7f48a80fcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.509+0000 7f489fe00640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48a815a770 0x7f48a817ee00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f489000c5e0 tx=0x7f489000caa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.510+0000 7f48a4c00640 1 -- 172.21.15.69:0/3403083095 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890011800 con 0x7f48a815a770 2024-02-21T07:45:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.510+0000 7f48a4c00640 1 -- 172.21.15.69:0/3403083095 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4890011960 con 0x7f48a815a770 2024-02-21T07:45:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.510+0000 7f48a4c00640 1 -- 172.21.15.69:0/3403083095 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890011d30 con 0x7f48a815a770 2024-02-21T07:45:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.510+0000 7f48af000640 1 -- 172.21.15.69:0/3403083095 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a82202c0 con 0x7f48a815a770 2024-02-21T07:45:16.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.510+0000 7f48af000640 1 -- 172.21.15.69:0/3403083095 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a8220880 con 0x7f48a815a770 2024-02-21T07:45:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.514+0000 7f48b1e2e740 1 Processor -- start 2024-02-21T07:45:16.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.514+0000 7f48b1e2e740 1 -- start start 2024-02-21T07:45:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 0x56243158c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 0x562431591a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 0x5624315cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243154d620 con 0x5624315cd070 2024-02-21T07:45:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624314ff8c0 con 0x562431591f90 2024-02-21T07:45:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624314fcdf0 con 0x5624316014d0 2024-02-21T07:45:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48a4c00640 1 -- 172.21.15.69:0/3403083095 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f489001a450 con 0x7f48a815a770 2024-02-21T07:45:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48ad000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 0x56243158c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48ad000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 0x56243158c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59004/0 (socket says 172.21.15.69:59004) 2024-02-21T07:45:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48ad000640 1 -- 172.21.15.69:0/506163082 learned_addr learned my addr 172.21.15.69:0/506163082 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48a7e00640 1 --2- 172.21.15.69:0/506163082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 0x562431591a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f489fe00640 1 --2- 172.21.15.69:0/506163082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 0x5624315cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48ad000640 1 -- 172.21.15.69:0/506163082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 msgr2=0x562431591a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48ad000640 1 --2- 172.21.15.69:0/506163082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 0x562431591a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.516+0000 7f48ad000640 1 -- 172.21.15.69:0/506163082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 msgr2=0x5624315cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.517+0000 7f48ad000640 1 --2- 172.21.15.69:0/506163082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 0x5624315cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.517+0000 7f48ad000640 1 -- 172.21.15.69:0/506163082 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562431479b00 con 0x5624315cd070 2024-02-21T07:45:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.517+0000 7f489fe00640 1 --2- 172.21.15.69:0/506163082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 0x5624315cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.517+0000 7f48ad000640 1 --2- 172.21.15.69:0/506163082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 0x56243158c440 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009e50 tx=0x7f48a002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ee6bce44193f12 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.518+0000 7f489cc00640 1 -- 172.21.15.69:0/506163082 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0034740 con 0x5624315cd070 2024-02-21T07:45:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.518+0000 7f48a4c00640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f488409f0a0 0x7f48840a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.518+0000 7f489cc00640 1 -- 172.21.15.69:0/506163082 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a00348a0 con 0x5624315cd070 2024-02-21T07:45:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.518+0000 7f489cc00640 1 -- 172.21.15.69:0/506163082 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0034c10 con 0x5624315cd070 2024-02-21T07:45:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.518+0000 7f48a4c00640 1 -- 172.21.15.69:0/3403083095 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f48900ca000 con 0x7f48a815a770 2024-02-21T07:45:16.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.518+0000 7f48a7e00640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f488409f0a0 0x7f48840a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.518+0000 7f48b1e2e740 1 -- 172.21.15.69:0/506163082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 msgr2=0x56243158c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.518+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/506163082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 0x56243158c440 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009e50 tx=0x7f48a002e000 comp rx=0 tx=0).stop 2024-02-21T07:45:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.519+0000 7f48b1e2e740 1 -- 172.21.15.69:0/506163082 shutdown_connections 2024-02-21T07:45:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.519+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/506163082 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 0x5624315cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.519+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/506163082 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 0x562431591a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.519+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/506163082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 0x56243158c440 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.519+0000 7f48b1e2e740 1 -- 172.21.15.69:0/506163082 >> 172.21.15.69:0/506163082 conn(0x5624315594b0 msgr2=0x562431590ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.519+0000 7f48a7e00640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f488409f0a0 0x7f48840a1560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x56243158ffe0 tx=0x7f4898007190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.519+0000 7f48b1e2e740 1 -- 172.21.15.69:0/506163082 shutdown_connections 2024-02-21T07:45:16.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.519+0000 7f48b1e2e740 1 -- 172.21.15.69:0/506163082 wait complete. 2024-02-21T07:45:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.520+0000 7f48b1e2e740 1 -- start start 2024-02-21T07:45:16.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.520+0000 7f48b1e2e740 1 Processor -- start 2024-02-21T07:45:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.522+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 0x562431612c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.522+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624315cd070 0x5624315be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.522+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624316014d0 0x5624315f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.522+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624314f85d0 con 0x5624316014d0 2024-02-21T07:45:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.522+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243149db50 con 0x562431591f90 2024-02-21T07:45:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.522+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56243149d7f0 con 0x5624315cd070 2024-02-21T07:45:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.522+0000 7f48b1e2e740 10 client.0 _ll_register_callbacks cb 0x5624314b1550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:16.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f489fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624315cd070 0x5624315be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f48a7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 0x562431612c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f489fe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624315cd070 0x5624315be5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:36172/0 (socket says 172.21.15.69:36172) 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f489fe00640 1 -- 172.21.15.69:0/2317921946 learned_addr learned my addr 172.21.15.69:0/2317921946 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f48ad000640 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624316014d0 0x5624315f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f489fe00640 1 -- 172.21.15.69:0/2317921946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 msgr2=0x562431612c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f489fe00640 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 0x562431612c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f489fe00640 1 -- 172.21.15.69:0/2317921946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624316014d0 msgr2=0x5624315f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f489fe00640 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624316014d0 0x5624315f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f489fe00640 1 -- 172.21.15.69:0/2317921946 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a818ab80 con 0x5624315cd070 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f489fe00640 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624315cd070 0x5624315be5d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f489009fd50 tx=0x7f48900981e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97dba3994a38c82 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f4895600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f4895600640 1 -- 172.21.15.69:0/2317921946 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48900a0280 con 0x5624315cd070 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.523+0000 7f4895600640 1 -- 172.21.15.69:0/2317921946 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f48900cd020 con 0x5624315cd070 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f48b1e2e740 1 -- 172.21.15.69:0/2317921946 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624314cacd0 con 0x5624315cd070 2024-02-21T07:45:16.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f4895600640 1 -- 172.21.15.69:0/2317921946 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48900cd200 con 0x5624315cd070 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f48b1e2e740 10 client.5915 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f48b1e2e740 1 -- 172.21.15.69:0/2317921946 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5624314f6c50 con 0x5624315cd070 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f4895600640 1 -- 172.21.15.69:0/2317921946 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624314cacd0 con 0x5624315cd070 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f4895600640 1 -- 172.21.15.69:0/2317921946 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f4890022070 con 0x5624315cd070 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f48b1e2e740 10 client.5915 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f48b1e2e740 10 client.5915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f48b1e2e740 20 client.5915 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5624315f5a50 0x5624315f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f48b1e2e740 4 client.5915 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.524+0000 7f48b1e2e740 1 -- 172.21.15.69:0/2317921946 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624314eece0 con 0x5624315f5a50 2024-02-21T07:45:16.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.525+0000 7f48a7e00640 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5624315f5a50 0x5624315f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.525+0000 7f48a7e00640 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5624315f5a50 0x5624315f5e60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcef46260e13d037 server_cookie=adff03c14aa5da1a in_seq=0 out_seq=0 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.525+0000 7f4895600640 10 client.5915 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f4895600640 1 -- 172.21.15.69:0/2317921946 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5624314eece0 con 0x5624315f5a50 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f4895600640 10 client.5915 handle_command_reply: tid=0 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f48b1e2e740 1 client.5915 shutdown 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f48b1e2e740 1 -- 172.21.15.69:0/2317921946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624315cd070 msgr2=0x5624315be5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624315cd070 0x5624315be5d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f489009fd50 tx=0x7f48900981e0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f48b1e2e740 1 -- 172.21.15.69:0/2317921946 shutdown_connections 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x5624315f5a50 0x5624315f5e60 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624316014d0 0x5624315f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624315cd070 0x5624315be5d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/2317921946 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x562431591f90 0x562431612c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f48b1e2e740 1 -- 172.21.15.69:0/2317921946 >> 172.21.15.69:0/2317921946 conn(0x5624315594b0 msgr2=0x562431601950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.526+0000 7f4895600640 0 client.5915 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.527+0000 7f48b1e2e740 1 -- 172.21.15.69:0/2317921946 shutdown_connections 2024-02-21T07:45:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.527+0000 7f48b1e2e740 1 -- 172.21.15.69:0/2317921946 wait complete. 2024-02-21T07:45:16.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.527+0000 7f48b1e2e740 20 client.5915 trim_cache size 0 max 16384 2024-02-21T07:45:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.542+0000 7f48b1e2e740 1 Processor -- start 2024-02-21T07:45:16.547 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.542+0000 7f48b1e2e740 1 -- start start 2024-02-21T07:45:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562431591f90 0x56243158ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624315cd070 0x5624315edc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 0x5624315ee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x562431240e60 con 0x562431591f90 2024-02-21T07:45:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x562431588230 con 0x5624315cd070 2024-02-21T07:45:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624315ee690 con 0x5624316014d0 2024-02-21T07:45:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f48ad000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 0x5624315ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f48a7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562431591f90 0x56243158ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f48ad000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 0x5624315ee150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:36178/0 (socket says 172.21.15.69:36178) 2024-02-21T07:45:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f48ad000640 1 -- 172.21.15.69:0/1113706215 learned_addr learned my addr 172.21.15.69:0/1113706215 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:16.550 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.543+0000 7f489fe00640 1 --2- 172.21.15.69:0/1113706215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624315cd070 0x5624315edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f489fe00640 1 -- 172.21.15.69:0/1113706215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 msgr2=0x5624315ee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f489fe00640 1 --2- 172.21.15.69:0/1113706215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 0x5624315ee150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f489fe00640 1 -- 172.21.15.69:0/1113706215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562431591f90 msgr2=0x56243158ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:16.551 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f489fe00640 1 --2- 172.21.15.69:0/1113706215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562431591f90 0x56243158ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f489fe00640 1 -- 172.21.15.69:0/1113706215 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562431493530 con 0x5624315cd070 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f48ad000640 1 --2- 172.21.15.69:0/1113706215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 0x5624315ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f48a7e00640 1 --2- 172.21.15.69:0/1113706215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562431591f90 0x56243158ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f489fe00640 1 --2- 172.21.15.69:0/1113706215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624315cd070 0x5624315edc10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4890097a70 tx=0x7f48900c9000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dc0f7f958adc163 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f4897e00640 1 -- 172.21.15.69:0/1113706215 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48900a0280 con 0x5624315cd070 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f4897e00640 1 -- 172.21.15.69:0/1113706215 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4890011e90 con 0x5624315cd070 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.544+0000 7f4897e00640 1 -- 172.21.15.69:0/1113706215 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48900abb30 con 0x5624315cd070 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.545+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1113706215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624315cd070 msgr2=0x5624315edc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.545+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/1113706215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624315cd070 0x5624315edc10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4890097a70 tx=0x7f48900c9000 comp rx=0 tx=0).stop 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.545+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1113706215 shutdown_connections 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.545+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/1113706215 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x5624316014d0 0x5624315ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.545+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/1113706215 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624315cd070 0x5624315edc10 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.545+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/1113706215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562431591f90 0x56243158ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.545+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1113706215 >> 172.21.15.69:0/1113706215 conn(0x5624315594b0 msgr2=0x5624315f4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.545+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1113706215 shutdown_connections 2024-02-21T07:45:16.553 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.545+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1113706215 wait complete. 2024-02-21T07:45:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.546+0000 7f48b1e2e740 1 -- start start 2024-02-21T07:45:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.546+0000 7f48b1e2e740 1 Processor -- start 2024-02-21T07:45:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562431591f90 0x562431596390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 0x5624315f1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48b1e2e740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624316014d0 0x562431650f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624315fe030 con 0x5624315cd070 2024-02-21T07:45:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x562431596f50 con 0x5624316014d0 2024-02-21T07:45:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48b1e2e740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624315f1170 con 0x562431591f90 2024-02-21T07:45:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48b1e2e740 10 client.0 _ll_register_callbacks cb 0x7f48a0037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:16.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48a7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562431591f90 0x562431596390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48a7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562431591f90 0x562431596390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:36186/0 (socket says 172.21.15.69:36186) 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48ad000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624316014d0 0x562431650f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48a7e00640 1 -- 172.21.15.69:0/1846047226 learned_addr learned my addr 172.21.15.69:0/1846047226 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f489fe00640 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 0x5624315f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48a7e00640 1 -- 172.21.15.69:0/1846047226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624316014d0 msgr2=0x562431650f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48a7e00640 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624316014d0 0x562431650f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48a7e00640 1 -- 172.21.15.69:0/1846047226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 msgr2=0x5624315f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48a7e00640 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 0x5624315f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.548+0000 7f48a7e00640 1 -- 172.21.15.69:0/1846047226 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562431479b00 con 0x562431591f90 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.549+0000 7f48a7e00640 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562431591f90 0x562431596390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4898000f60 tx=0x7f4898015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7016c04b0afbb1e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.549+0000 7f4895600640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.549+0000 7f4895600640 1 -- 172.21.15.69:0/1846047226 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898028890 con 0x562431591f90 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.549+0000 7f4895600640 1 -- 172.21.15.69:0/1846047226 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f489801e040 con 0x562431591f90 2024-02-21T07:45:16.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.549+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1846047226 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56243151dd30 con 0x562431591f90 2024-02-21T07:45:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.549+0000 7f4895600640 1 -- 172.21.15.69:0/1846047226 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4898015720 con 0x562431591f90 2024-02-21T07:45:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.549+0000 7f48b1e2e740 10 client.5921 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.549+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1846047226 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5624314f6c50 con 0x562431591f90 2024-02-21T07:45:16.557 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.549+0000 7f4895600640 1 -- 172.21.15.69:0/1846047226 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56243151dd30 con 0x562431591f90 2024-02-21T07:45:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.550+0000 7f4895600640 1 -- 172.21.15.69:0/1846047226 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f4898015880 con 0x562431591f90 2024-02-21T07:45:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.550+0000 7f48b1e2e740 10 client.5921 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.550+0000 7f48b1e2e740 10 client.5921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:45:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.550+0000 7f48b1e2e740 20 client.5921 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.550+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562431597dc0 0x5624316514d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.550+0000 7f48b1e2e740 4 client.5921 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:45:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.550+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1846047226 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5624311f8600 con 0x562431597dc0 2024-02-21T07:45:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.550+0000 7f489fe00640 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562431597dc0 0x5624316514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.551+0000 7f489fe00640 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562431597dc0 0x5624316514d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=385a230469fa29e7 server_cookie=d95a54c50d80bf62 in_seq=0 out_seq=0 2024-02-21T07:45:16.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:16.551+0000 7f4895600640 10 client.5921 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f4895600640 1 -- 172.21.15.69:0/1846047226 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5624311f8600 con 0x562431597dc0 2024-02-21T07:45:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f4895600640 10 client.5921 handle_command_reply: tid=0 2024-02-21T07:45:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f48b1e2e740 1 client.5921 shutdown 2024-02-21T07:45:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1846047226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562431591f90 msgr2=0x562431596390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562431591f90 0x562431596390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4898000f60 tx=0x7f4898015000 comp rx=0 tx=0).stop 2024-02-21T07:45:17.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1846047226 shutdown_connections 2024-02-21T07:45:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x562431597dc0 0x5624316514d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x5624316014d0 0x562431650f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624315cd070 0x5624315f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f48b1e2e740 1 --2- 172.21.15.69:0/1846047226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x562431591f90 0x562431596390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1846047226 >> 172.21.15.69:0/1846047226 conn(0x5624315594b0 msgr2=0x562431658350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f4895600640 0 client.5921 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.727+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1846047226 shutdown_connections 2024-02-21T07:45:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.728+0000 7f48b1e2e740 1 -- 172.21.15.69:0/1846047226 wait complete. 2024-02-21T07:45:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.728+0000 7f48b1e2e740 20 client.5921 trim_cache size 0 max 16384 2024-02-21T07:45:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-02-21T07:45:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-02-21T07:45:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-02-21T07:45:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.729+0000 7f48af000640 1 -- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f488409f0a0 msgr2=0x7f48840a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.729+0000 7f48af000640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f488409f0a0 0x7f48840a1560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x56243158ffe0 tx=0x7f4898007190 comp rx=0 tx=0).stop 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.729+0000 7f48af000640 1 -- 172.21.15.69:0/3403083095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48a815a770 msgr2=0x7f48a817ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.729+0000 7f48af000640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48a815a770 0x7f48a817ee00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f489000c5e0 tx=0x7f489000caa0 comp rx=0 tx=0).stop 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.729+0000 7f48af000640 1 -- 172.21.15.69:0/3403083095 shutdown_connections 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.729+0000 7f48af000640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f488409f0a0 0x7f48840a1560 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.729+0000 7f48af000640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f48a8189c80 0x7f48a80fcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.729+0000 7f48af000640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f48a815a770 0x7f48a817ee00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.729+0000 7f48af000640 1 --2- 172.21.15.69:0/3403083095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f48a808d450 0x7f48a8220da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.729+0000 7f48af000640 1 -- 172.21.15.69:0/3403083095 >> 172.21.15.69:0/3403083095 conn(0x7f48a80615c0 msgr2=0x7f48a80619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.730+0000 7f48af000640 1 -- 172.21.15.69:0/3403083095 shutdown_connections 2024-02-21T07:45:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:17.730+0000 7f48af000640 1 -- 172.21.15.69:0/3403083095 wait complete. 2024-02-21T07:45:20.653 INFO:tasks.ceph.mds.f.smithi184.stderr:*** Caught signal (Segmentation fault) ** 2024-02-21T07:45:20.653 INFO:tasks.ceph.mds.f.smithi184.stderr: in thread 7f4b9e9b5640 thread_name:MR_Finisher 2024-02-21T07:45:21.261 INFO:tasks.ceph.mds.f.smithi184.stderr:daemon-helper: command crashed with signal 11 2024-02-21T07:45:23.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T07:45:23.216 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T07:45:23.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.441+0000 7f2880c00640 1 Processor -- start 2024-02-21T07:45:23.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.442+0000 7f2880c00640 1 -- start start 2024-02-21T07:45:23.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.443+0000 7f2880c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f287c0ee640 0x7f287c0eead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.443+0000 7f2880c00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f287c186bc0 0x7f287c187010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.443+0000 7f2880c00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0ef010 con 0x7f287c183ea0 2024-02-21T07:45:23.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.443+0000 7f2880c00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c186010 con 0x7f287c186bc0 2024-02-21T07:45:23.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.443+0000 7f2880c00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c184df0 con 0x7f287c0ee640 2024-02-21T07:45:23.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.443+0000 7f2879e00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f287c183ea0 0x7f287c1846e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60730/0 (socket says 172.21.15.69:60730) 2024-02-21T07:45:23.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.443+0000 7f2879e00640 1 -- 172.21.15.69:0/6832585 learned_addr learned my addr 172.21.15.69:0/6832585 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:23.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.443+0000 7f287a800640 1 --2- 172.21.15.69:0/6832585 >> v2:172.21.15.69:3300/0 conn(0x7f287c186bc0 0x7f287c187010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.443+0000 7f2873e00640 1 --2- 172.21.15.69:0/6832585 >> v2:172.21.15.184:3300/0 conn(0x7f287c0ee640 0x7f287c0eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.444+0000 7f2879400640 1 -- 172.21.15.69:0/6832585 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854755613 0 0) 0x7f287c0ef010 con 0x7f287c183ea0 2024-02-21T07:45:23.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.444+0000 7f2879400640 1 -- 172.21.15.69:0/6832585 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2860003520 con 0x7f287c183ea0 2024-02-21T07:45:23.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.444+0000 7f287a800640 1 -- 172.21.15.69:0/6832585 >> v2:172.21.15.184:3300/0 conn(0x7f287c0ee640 msgr2=0x7f287c0eead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:23.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.444+0000 7f287a800640 1 --2- 172.21.15.69:0/6832585 >> v2:172.21.15.184:3300/0 conn(0x7f287c0ee640 0x7f287c0eead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.444+0000 7f287a800640 1 -- 172.21.15.69:0/6832585 >> v1:172.21.15.69:6789/0 conn(0x7f287c183ea0 legacy=0x7f287c1846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.444+0000 7f287a800640 1 -- 172.21.15.69:0/6832585 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c1850b0 con 0x7f287c186bc0 2024-02-21T07:45:23.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.444+0000 7f2873e00640 1 --2- 172.21.15.69:0/6832585 >> v2:172.21.15.184:3300/0 conn(0x7f287c0ee640 0x7f287c0eead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:23.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.445+0000 7f287a800640 1 --2- 172.21.15.69:0/6832585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 0x7f287c187010 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f287c0faf60 tx=0x7f287402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bf34fd2d6683e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.445+0000 7f2879400640 1 -- 172.21.15.69:0/6832585 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287402cbf0 con 0x7f287c186bc0 2024-02-21T07:45:23.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.445+0000 7f2879400640 1 -- 172.21.15.69:0/6832585 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287402cd50 con 0x7f287c186bc0 2024-02-21T07:45:23.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.445+0000 7f2879400640 1 -- 172.21.15.69:0/6832585 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2874034660 con 0x7f287c186bc0 2024-02-21T07:45:23.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.446+0000 7f2880c00640 1 -- 172.21.15.69:0/6832585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 msgr2=0x7f287c187010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.446+0000 7f2880c00640 1 --2- 172.21.15.69:0/6832585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 0x7f287c187010 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f287c0faf60 tx=0x7f287402be40 comp rx=0 tx=0).stop 2024-02-21T07:45:23.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.446+0000 7f2880c00640 1 -- 172.21.15.69:0/6832585 shutdown_connections 2024-02-21T07:45:23.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.446+0000 7f2880c00640 1 --2- 172.21.15.69:0/6832585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 0x7f287c187010 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.446+0000 7f2880c00640 1 --2- 172.21.15.69:0/6832585 >> v2:172.21.15.184:3300/0 conn(0x7f287c0ee640 0x7f287c0eead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.446+0000 7f2880c00640 1 -- 172.21.15.69:0/6832585 >> 172.21.15.69:0/6832585 conn(0x7f287c0ce3d0 msgr2=0x7f287c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.446+0000 7f2880c00640 1 -- 172.21.15.69:0/6832585 shutdown_connections 2024-02-21T07:45:23.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.446+0000 7f2880c00640 1 -- 172.21.15.69:0/6832585 wait complete. 2024-02-21T07:45:23.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.448+0000 7f2880c00640 1 Processor -- start 2024-02-21T07:45:23.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.448+0000 7f2880c00640 1 -- start start 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.450+0000 7f2880c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c0ee640 0x7f287c169380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2880c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c183ea0 0x7f287c188230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2880c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 0x7f287c182da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2880c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c188c70 con 0x7f287c186bc0 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2880c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c188f50 con 0x7f287c0ee640 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2880c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c189230 con 0x7f287c183ea0 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f287a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 0x7f287c182da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2873e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c183ea0 0x7f287c188230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2879e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c0ee640 0x7f287c169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f287a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 0x7f287c182da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43290/0 (socket says 172.21.15.69:43290) 2024-02-21T07:45:23.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f287a800640 1 -- 172.21.15.69:0/3891934740 learned_addr learned my addr 172.21.15.69:0/3891934740 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:23.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2873e00640 1 -- 172.21.15.69:0/3891934740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c0ee640 msgr2=0x7f287c169380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2873e00640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c0ee640 0x7f287c169380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2873e00640 1 -- 172.21.15.69:0/3891934740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 msgr2=0x7f287c182da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.451+0000 7f2873e00640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 0x7f287c182da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.452+0000 7f2873e00640 1 -- 172.21.15.69:0/3891934740 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2864009400 con 0x7f287c183ea0 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.452+0000 7f287a800640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 0x7f287c182da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.452+0000 7f2873e00640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c183ea0 0x7f287c188230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f286400e870 tx=0x7f286400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.452+0000 7f2872000640 1 -- 172.21.15.69:0/3891934740 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400c940 con 0x7f287c183ea0 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.452+0000 7f2872000640 1 -- 172.21.15.69:0/3891934740 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286400caa0 con 0x7f287c183ea0 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.452+0000 7f2872000640 1 -- 172.21.15.69:0/3891934740 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286400ce30 con 0x7f287c183ea0 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.452+0000 7f2880c00640 1 -- 172.21.15.69:0/3891934740 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2874009a70 con 0x7f287c183ea0 2024-02-21T07:45:23.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.452+0000 7f2880c00640 1 -- 172.21.15.69:0/3891934740 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c1897f0 con 0x7f287c183ea0 2024-02-21T07:45:23.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.456+0000 7f2872000640 1 -- 172.21.15.69:0/3891934740 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2864013470 con 0x7f287c183ea0 2024-02-21T07:45:23.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.458+0000 7f2883814740 1 Processor -- start 2024-02-21T07:45:23.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.458+0000 7f2872000640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f285809f0d0 0x7f28580a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.458+0000 7f2883814740 1 -- start start 2024-02-21T07:45:23.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.458+0000 7f2872000640 1 -- 172.21.15.69:0/3891934740 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f28640c9cf0 con 0x7f287c183ea0 2024-02-21T07:45:23.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.458+0000 7f287a800640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f285809f0d0 0x7f28580a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.459+0000 7f287a800640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f285809f0d0 0x7f28580a1590 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f287402be80 tx=0x7f2874030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2883814740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c2d8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2883814740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c2a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2883814740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c265700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2883814740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c1d1150 con 0x55d41c2a27d0 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2883814740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c1ce680 con 0x55d41c2d8790 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2883814740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c1c9e60 con 0x55d41c2a30f0 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2873e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c2a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2879e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c2d8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2873e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c2a2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38092/0 (socket says 172.21.15.69:38092) 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2873e00640 1 -- 172.21.15.69:0/3628443672 learned_addr learned my addr 172.21.15.69:0/3628443672 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2879e00640 1 --2- 172.21.15.69:0/3628443672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c2d8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43296/0 (socket says 172.21.15.69:43296) 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f287a800640 1 --2- 172.21.15.69:0/3628443672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c265700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2879e00640 1 -- 172.21.15.69:0/3628443672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 msgr2=0x55d41c265700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2879e00640 1 --2- 172.21.15.69:0/3628443672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c265700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2879e00640 1 -- 172.21.15.69:0/3628443672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 msgr2=0x55d41c2a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.460+0000 7f2879e00640 1 --2- 172.21.15.69:0/3628443672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c2a2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.461+0000 7f2879e00640 1 -- 172.21.15.69:0/3628443672 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d41c183060 con 0x55d41c2a27d0 2024-02-21T07:45:23.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.461+0000 7f2879e00640 1 --2- 172.21.15.69:0/3628443672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c2d8250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f286c000f60 tx=0x7f286c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f4e28cfcb9670c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.461+0000 7f286a600640 1 -- 172.21.15.69:0/3628443672 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0058b0 con 0x55d41c2a27d0 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.461+0000 7f286a600640 1 -- 172.21.15.69:0/3628443672 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c005a10 con 0x55d41c2a27d0 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.461+0000 7f286a600640 1 -- 172.21.15.69:0/3628443672 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c005d80 con 0x55d41c2a27d0 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.462+0000 7f2883814740 1 -- 172.21.15.69:0/3628443672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 msgr2=0x55d41c2d8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.462+0000 7f2883814740 1 --2- 172.21.15.69:0/3628443672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c2d8250 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f286c000f60 tx=0x7f286c000bc0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.462+0000 7f2883814740 1 -- 172.21.15.69:0/3628443672 shutdown_connections 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.462+0000 7f2883814740 1 --2- 172.21.15.69:0/3628443672 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c265700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.462+0000 7f2883814740 1 --2- 172.21.15.69:0/3628443672 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c2a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.462+0000 7f2883814740 1 --2- 172.21.15.69:0/3628443672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c2d8250 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.462+0000 7f2883814740 1 -- 172.21.15.69:0/3628443672 >> 172.21.15.69:0/3628443672 conn(0x55d41c2295a0 msgr2=0x55d41c2696c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.462+0000 7f2883814740 1 -- 172.21.15.69:0/3628443672 shutdown_connections 2024-02-21T07:45:23.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.462+0000 7f2883814740 1 -- 172.21.15.69:0/3628443672 wait complete. 2024-02-21T07:45:23.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.464+0000 7f2883814740 1 -- start start 2024-02-21T07:45:23.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.464+0000 7f2883814740 1 Processor -- start 2024-02-21T07:45:23.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.466+0000 7f2883814740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2a27d0 0x55d41c2cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.466+0000 7f2883814740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c29fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.466+0000 7f2883814740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2d8790 0x55d41c293ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.466+0000 7f2883814740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c16eec0 con 0x55d41c2d8790 2024-02-21T07:45:23.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.466+0000 7f2883814740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c16eb60 con 0x55d41c2a27d0 2024-02-21T07:45:23.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.466+0000 7f2883814740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41bf381c0 con 0x55d41c2a30f0 2024-02-21T07:45:23.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.466+0000 7f2883814740 10 client.0 _ll_register_callbacks cb 0x55d41c182960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:23.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.466+0000 7f287a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2d8790 0x55d41c293ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.466+0000 7f287a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2d8790 0x55d41c293ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43298/0 (socket says 172.21.15.69:43298) 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.466+0000 7f287a800640 1 -- 172.21.15.69:0/2774626705 learned_addr learned my addr 172.21.15.69:0/2774626705 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.467+0000 7f2879e00640 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2a27d0 0x55d41c2cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.467+0000 7f2873e00640 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c29fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.467+0000 7f287a800640 1 -- 172.21.15.69:0/2774626705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 msgr2=0x55d41c29fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.467+0000 7f287a800640 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c29fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.467+0000 7f287a800640 1 -- 172.21.15.69:0/2774626705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2a27d0 msgr2=0x55d41c2cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.467+0000 7f287a800640 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2a27d0 0x55d41c2cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.467+0000 7f287a800640 1 -- 172.21.15.69:0/2774626705 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2860003520 con 0x55d41c2d8790 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.467+0000 7f2879e00640 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2a27d0 0x55d41c2cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.467+0000 7f287a800640 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2d8790 0x55d41c293ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2874034ed0 tx=0x7f2874004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76ad3b92f3be974 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.467+0000 7f285ea00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:45:23.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.468+0000 7f285ea00640 1 -- 172.21.15.69:0/2774626705 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287403fe40 con 0x55d41c2d8790 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.468+0000 7f285ea00640 1 -- 172.21.15.69:0/2774626705 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2874052070 con 0x55d41c2d8790 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.468+0000 7f2883814740 1 -- 172.21.15.69:0/2774626705 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d41bec97e0 con 0x55d41c2d8790 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.468+0000 7f285ea00640 1 -- 172.21.15.69:0/2774626705 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2874057480 con 0x55d41c2d8790 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.468+0000 7f2883814740 10 client.5790 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.468+0000 7f2883814740 1 -- 172.21.15.69:0/2774626705 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55d41c1c84e0 con 0x55d41c2d8790 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.469+0000 7f285ea00640 1 -- 172.21.15.69:0/2774626705 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d41bec97e0 con 0x55d41c2d8790 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.469+0000 7f285ea00640 1 -- 172.21.15.69:0/2774626705 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f2874047040 con 0x55d41c2d8790 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.469+0000 7f2883814740 10 client.5790 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.469+0000 7f2883814740 10 client.5790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.469+0000 7f2883814740 20 client.5790 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.469+0000 7f2883814740 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55d41c2eb080 0x55d41c294010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.469+0000 7f2883814740 4 client.5790 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:45:23.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.469+0000 7f2883814740 1 -- 172.21.15.69:0/2774626705 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d41bf06720 con 0x55d41c2eb080 2024-02-21T07:45:23.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.469+0000 7f2879e00640 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55d41c2eb080 0x55d41c294010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.470+0000 7f2879e00640 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55d41c2eb080 0x55d41c294010 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91bc839017d318a8 server_cookie=ef2b3b72c1ee8e0f in_seq=0 out_seq=0 2024-02-21T07:45:23.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.470+0000 7f285ea00640 10 client.5790 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:23.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.471+0000 7f285ea00640 1 -- 172.21.15.69:0/2774626705 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d41bf06720 con 0x55d41c2eb080 2024-02-21T07:45:23.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.471+0000 7f285ea00640 10 client.5790 handle_command_reply: tid=0 2024-02-21T07:45:23.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.471+0000 7f2883814740 1 client.5790 shutdown 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f2883814740 1 -- 172.21.15.69:0/2774626705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2d8790 msgr2=0x55d41c293ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f2883814740 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2d8790 0x55d41c293ad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2874034ed0 tx=0x7f2874004ab0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f2883814740 1 -- 172.21.15.69:0/2774626705 shutdown_connections 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f2883814740 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55d41c2eb080 0x55d41c294010 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f2883814740 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2d8790 0x55d41c293ad0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f2883814740 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c29fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f2883814740 1 --2- 172.21.15.69:0/2774626705 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2a27d0 0x55d41c2cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f2883814740 1 -- 172.21.15.69:0/2774626705 >> 172.21.15.69:0/2774626705 conn(0x55d41c2295a0 msgr2=0x55d41c270ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f285ea00640 0 client.5790 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f2883814740 1 -- 172.21.15.69:0/2774626705 shutdown_connections 2024-02-21T07:45:23.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.472+0000 7f2883814740 1 -- 172.21.15.69:0/2774626705 wait complete. 2024-02-21T07:45:23.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.473+0000 7f2883814740 20 client.5790 trim_cache size 0 max 16384 2024-02-21T07:45:23.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.489+0000 7f2883814740 1 Processor -- start 2024-02-21T07:45:23.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.489+0000 7f2883814740 1 -- start start 2024-02-21T07:45:23.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.490+0000 7f2883814740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a27d0 0x55d41c2916f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.490+0000 7f2883814740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a30f0 0x55d41c2cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.490+0000 7f2883814740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c2f1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.490+0000 7f2883814740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c270210 con 0x55d41c2a30f0 2024-02-21T07:45:23.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.490+0000 7f2883814740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c267350 con 0x55d41c2d8790 2024-02-21T07:45:23.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.490+0000 7f2883814740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c29f910 con 0x55d41c2a27d0 2024-02-21T07:45:23.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f2879e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a27d0 0x55d41c2916f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f2879e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a27d0 0x55d41c2916f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53670/0 (socket says 172.21.15.69:53670) 2024-02-21T07:45:23.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f2879e00640 1 -- 172.21.15.69:0/593299033 learned_addr learned my addr 172.21.15.69:0/593299033 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:23.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f287a800640 1 --2- 172.21.15.69:0/593299033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c2f1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f2873e00640 1 --2- 172.21.15.69:0/593299033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a30f0 0x55d41c2cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f2879e00640 1 -- 172.21.15.69:0/593299033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 msgr2=0x55d41c2f1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:23.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f2879e00640 1 --2- 172.21.15.69:0/593299033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c2f1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f2879e00640 1 -- 172.21.15.69:0/593299033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a30f0 msgr2=0x55d41c2cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:23.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f2879e00640 1 --2- 172.21.15.69:0/593299033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a30f0 0x55d41c2cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f2879e00640 1 -- 172.21.15.69:0/593299033 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d41c164950 con 0x55d41c2a27d0 2024-02-21T07:45:23.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.491+0000 7f2873e00640 1 --2- 172.21.15.69:0/593299033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a30f0 0x55d41c2cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:23.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.492+0000 7f2879e00640 1 --2- 172.21.15.69:0/593299033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a27d0 0x55d41c2916f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f286c000c00 tx=0x7f286c012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab070ebc0cd3b80 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.492+0000 7f2869c00640 1 -- 172.21.15.69:0/593299033 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c022040 con 0x55d41c2a27d0 2024-02-21T07:45:23.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.492+0000 7f2869c00640 1 -- 172.21.15.69:0/593299033 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c007450 con 0x55d41c2a27d0 2024-02-21T07:45:23.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.492+0000 7f2869c00640 1 -- 172.21.15.69:0/593299033 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c026a90 con 0x55d41c2a27d0 2024-02-21T07:45:23.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.493+0000 7f2883814740 1 -- 172.21.15.69:0/593299033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a27d0 msgr2=0x55d41c2916f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.493+0000 7f2883814740 1 --2- 172.21.15.69:0/593299033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a27d0 0x55d41c2916f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f286c000c00 tx=0x7f286c012000 comp rx=0 tx=0).stop 2024-02-21T07:45:23.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.493+0000 7f2883814740 1 -- 172.21.15.69:0/593299033 shutdown_connections 2024-02-21T07:45:23.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.493+0000 7f2883814740 1 --2- 172.21.15.69:0/593299033 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c2f1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.493+0000 7f2883814740 1 --2- 172.21.15.69:0/593299033 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a30f0 0x55d41c2cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.493+0000 7f2883814740 1 --2- 172.21.15.69:0/593299033 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a27d0 0x55d41c2916f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.493+0000 7f2883814740 1 -- 172.21.15.69:0/593299033 >> 172.21.15.69:0/593299033 conn(0x55d41c2295a0 msgr2=0x55d41c291f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.493+0000 7f2883814740 1 -- 172.21.15.69:0/593299033 shutdown_connections 2024-02-21T07:45:23.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.493+0000 7f2883814740 1 -- 172.21.15.69:0/593299033 wait complete. 2024-02-21T07:45:23.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.494+0000 7f2883814740 1 -- start start 2024-02-21T07:45:23.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.494+0000 7f2883814740 1 Processor -- start 2024-02-21T07:45:23.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.495+0000 7f2883814740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c290f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.495+0000 7f2883814740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c33e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.495+0000 7f2883814740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c291f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.495+0000 7f2883814740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c2ac050 con 0x55d41c2a27d0 2024-02-21T07:45:23.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.495+0000 7f2883814740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c2aaa70 con 0x55d41c2d8790 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.495+0000 7f2883814740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d41c33eca0 con 0x55d41c2a30f0 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.495+0000 7f2883814740 10 client.0 _ll_register_callbacks cb 0x7f28600036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2879e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c290f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2879e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c290f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43324/0 (socket says 172.21.15.69:43324) 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2879e00640 1 -- 172.21.15.69:0/3075010688 learned_addr learned my addr 172.21.15.69:0/3075010688 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2873e00640 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c33e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f287a800640 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c291f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2873e00640 1 -- 172.21.15.69:0/3075010688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 msgr2=0x55d41c291f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2873e00640 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c291f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2873e00640 1 -- 172.21.15.69:0/3075010688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 msgr2=0x55d41c290f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2873e00640 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c290f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2873e00640 1 -- 172.21.15.69:0/3075010688 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d41c183060 con 0x55d41c2a30f0 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2879e00640 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c290f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f2873e00640 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c33e760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f286409fa40 tx=0x7f2864095ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e9d6876a5f5daed server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.496+0000 7f285ea00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:45:23.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.497+0000 7f285ea00640 1 -- 172.21.15.69:0/3075010688 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28640af170 con 0x55d41c2a30f0 2024-02-21T07:45:23.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.497+0000 7f285ea00640 1 -- 172.21.15.69:0/3075010688 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f28640af2d0 con 0x55d41c2a30f0 2024-02-21T07:45:23.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.497+0000 7f2883814740 1 -- 172.21.15.69:0/3075010688 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d41c29f550 con 0x55d41c2a30f0 2024-02-21T07:45:23.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.497+0000 7f285ea00640 1 -- 172.21.15.69:0/3075010688 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2864096cd0 con 0x55d41c2a30f0 2024-02-21T07:45:23.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.497+0000 7f2883814740 10 client.5939 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:23.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.497+0000 7f2883814740 1 -- 172.21.15.69:0/3075010688 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55d41c18a430 con 0x55d41c2a30f0 2024-02-21T07:45:23.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.497+0000 7f285ea00640 1 -- 172.21.15.69:0/3075010688 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d41c29f550 con 0x55d41c2a30f0 2024-02-21T07:45:23.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.497+0000 7f285ea00640 1 -- 172.21.15.69:0/3075010688 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f2864011070 con 0x55d41c2a30f0 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.498+0000 7f2883814740 10 client.5939 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.498+0000 7f2883814740 10 client.5939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.498+0000 7f2883814740 20 client.5939 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.498+0000 7f2883814740 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55d41c2aac20 0x55d41c2c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.498+0000 7f2883814740 4 client.5939 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.498+0000 7f2883814740 1 -- 172.21.15.69:0/3075010688 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f286c005a10 con 0x55d41c2aac20 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.498+0000 7f2879e00640 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55d41c2aac20 0x55d41c2c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.498+0000 7f2879e00640 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55d41c2aac20 0x55d41c2c84a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=423f2c39f9e5c151 server_cookie=3f19a8185e6fe49b in_seq=0 out_seq=0 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.498+0000 7f285ea00640 10 client.5939 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.499+0000 7f285ea00640 1 -- 172.21.15.69:0/3075010688 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f286c005a10 con 0x55d41c2aac20 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.499+0000 7f285ea00640 10 client.5939 handle_command_reply: tid=0 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.499+0000 7f2883814740 1 client.5939 shutdown 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.499+0000 7f2883814740 1 -- 172.21.15.69:0/3075010688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 msgr2=0x55d41c33e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f2883814740 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c33e760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f286409fa40 tx=0x7f2864095ab0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f2883814740 1 -- 172.21.15.69:0/3075010688 shutdown_connections 2024-02-21T07:45:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f2883814740 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55d41c2aac20 0x55d41c2c84a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f2883814740 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d41c2d8790 0x55d41c291f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f2883814740 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d41c2a30f0 0x55d41c33e760 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f285ea00640 0 client.5939 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f2883814740 1 --2- 172.21.15.69:0/3075010688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d41c2a27d0 0x55d41c290f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f2883814740 1 -- 172.21.15.69:0/3075010688 >> 172.21.15.69:0/3075010688 conn(0x55d41c2295a0 msgr2=0x55d41c2661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f2883814740 1 -- 172.21.15.69:0/3075010688 shutdown_connections 2024-02-21T07:45:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f2883814740 1 -- 172.21.15.69:0/3075010688 wait complete. 2024-02-21T07:45:23.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.500+0000 7f2883814740 20 client.5939 trim_cache size 0 max 16384 2024-02-21T07:45:23.508 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-02-21T07:45:23.509 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-02-21T07:45:23.509 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-02-21T07:45:23.509 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 -- 172.21.15.69:0/3891934740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f285809f0d0 msgr2=0x7f28580a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f285809f0d0 0x7f28580a1590 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f287402be80 tx=0x7f2874030000 comp rx=0 tx=0).stop 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 -- 172.21.15.69:0/3891934740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c183ea0 msgr2=0x7f287c188230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c183ea0 0x7f287c188230 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f286400e870 tx=0x7f286400ed30 comp rx=0 tx=0).stop 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 -- 172.21.15.69:0/3891934740 shutdown_connections 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f285809f0d0 0x7f28580a1590 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f287c186bc0 0x7f287c182da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f287c183ea0 0x7f287c188230 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 --2- 172.21.15.69:0/3891934740 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f287c0ee640 0x7f287c169380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 -- 172.21.15.69:0/3891934740 >> 172.21.15.69:0/3891934740 conn(0x7f287c0ce3d0 msgr2=0x7f287c1845e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 -- 172.21.15.69:0/3891934740 shutdown_connections 2024-02-21T07:45:23.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.501+0000 7f2880c00640 1 -- 172.21.15.69:0/3891934740 wait complete. 2024-02-21T07:45:23.530 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T07:45:23.530 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T07:45:23.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.748+0000 7f99afe00640 1 Processor -- start 2024-02-21T07:45:23.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.748+0000 7f99afe00640 1 -- start start 2024-02-21T07:45:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.750+0000 7f99afe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f99b00fd740 0x7f99b00fe050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.750+0000 7f99afe00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b01897f0 con 0x7f99b015dad0 2024-02-21T07:45:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.750+0000 7f99afe00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b00fdbd0 con 0x7f99b00fe590 2024-02-21T07:45:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.750+0000 7f99afe00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b00fc3c0 con 0x7f99b00fd740 2024-02-21T07:45:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.750+0000 7f99ae000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f99b00fd740 0x7f99b00fe050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.750+0000 7f99aea00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f99b015dad0 0x7f99b0189d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:45316/0 (socket says 172.21.15.69:45316) 2024-02-21T07:45:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.750+0000 7f99aea00640 1 -- 172.21.15.69:0/2996104091 learned_addr learned my addr 172.21.15.69:0/2996104091 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:23.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.751+0000 7f99ad600640 1 -- 172.21.15.69:0/2996104091 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229312632 0 0) 0x7f99b00fdbd0 con 0x7f99b00fe590 2024-02-21T07:45:23.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.751+0000 7f99ae000640 1 -- 172.21.15.69:0/2996104091 >> v1:172.21.15.184:6789/0 conn(0x7f99b00fe590 legacy=0x7f99b00fe9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.751+0000 7f99ae000640 1 -- 172.21.15.69:0/2996104091 >> v1:172.21.15.174:6789/0 conn(0x7f99b015dad0 legacy=0x7f99b0189d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.751+0000 7f99ae000640 1 -- 172.21.15.69:0/2996104091 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b00fc6a0 con 0x7f99b00fd740 2024-02-21T07:45:23.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.752+0000 7f99ae000640 1 --2- 172.21.15.69:0/2996104091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b00fd740 0x7f99b00fe050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99980097a0 tx=0x7f999802b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea8501fcda7accd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.752+0000 7f99ad600640 1 -- 172.21.15.69:0/2996104091 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998030710 con 0x7f99b00fd740 2024-02-21T07:45:23.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.752+0000 7f99ad600640 1 -- 172.21.15.69:0/2996104091 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999802e050 con 0x7f99b00fd740 2024-02-21T07:45:23.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.752+0000 7f99ad600640 1 -- 172.21.15.69:0/2996104091 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998030a90 con 0x7f99b00fd740 2024-02-21T07:45:23.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.753+0000 7f99afe00640 1 -- 172.21.15.69:0/2996104091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b00fd740 msgr2=0x7f99b00fe050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.753+0000 7f99afe00640 1 --2- 172.21.15.69:0/2996104091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b00fd740 0x7f99b00fe050 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99980097a0 tx=0x7f999802b680 comp rx=0 tx=0).stop 2024-02-21T07:45:23.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.753+0000 7f99afe00640 1 -- 172.21.15.69:0/2996104091 shutdown_connections 2024-02-21T07:45:23.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.753+0000 7f99afe00640 1 --2- 172.21.15.69:0/2996104091 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b00fd740 0x7f99b00fe050 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.753+0000 7f99afe00640 1 -- 172.21.15.69:0/2996104091 >> 172.21.15.69:0/2996104091 conn(0x7f99b00d2c90 msgr2=0x7f99b00d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:23.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.753+0000 7f99afe00640 1 -- 172.21.15.69:0/2996104091 shutdown_connections 2024-02-21T07:45:23.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.753+0000 7f99afe00640 1 -- 172.21.15.69:0/2996104091 wait complete. 2024-02-21T07:45:23.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.756+0000 7f99afe00640 1 Processor -- start 2024-02-21T07:45:23.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.756+0000 7f99afe00640 1 -- start start 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.758+0000 7f99afe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b00fd740 0x7f99b0157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.758+0000 7f99afe00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99b00fe590 0x7f99b0153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.758+0000 7f99afe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b015dad0 0x7f99b017e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.758+0000 7f99afe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b021fc00 con 0x7f99b00fd740 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.758+0000 7f99afe00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b021fee0 con 0x7f99b015dad0 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.758+0000 7f99afe00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0158420 con 0x7f99b00fe590 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99aea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b00fd740 0x7f99b0157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99aea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b00fd740 0x7f99b0157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43328/0 (socket says 172.21.15.69:43328) 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99aea00640 1 -- 172.21.15.69:0/1451338867 learned_addr learned my addr 172.21.15.69:0/1451338867 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99ae000640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99b00fe590 0x7f99b0153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99af400640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b015dad0 0x7f99b017e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99aea00640 1 -- 172.21.15.69:0/1451338867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99b00fe590 msgr2=0x7f99b0153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99aea00640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99b00fe590 0x7f99b0153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99aea00640 1 -- 172.21.15.69:0/1451338867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b015dad0 msgr2=0x7f99b017e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:23.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99aea00640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b015dad0 0x7f99b017e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:23.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99aea00640 1 -- 172.21.15.69:0/1451338867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998009400 con 0x7f99b00fd740 2024-02-21T07:45:23.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.759+0000 7f99aea00640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b00fd740 0x7f99b0157d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f99a000cb20 tx=0x7f99a0002070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.760+0000 7f99a6a00640 1 -- 172.21.15.69:0/1451338867 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a000a6a0 con 0x7f99b00fd740 2024-02-21T07:45:23.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.760+0000 7f99a6a00640 1 -- 172.21.15.69:0/1451338867 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a000a800 con 0x7f99b00fd740 2024-02-21T07:45:23.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.760+0000 7f99a6a00640 1 -- 172.21.15.69:0/1451338867 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a000abb0 con 0x7f99b00fd740 2024-02-21T07:45:23.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.760+0000 7f99afe00640 1 -- 172.21.15.69:0/1451338867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b0158700 con 0x7f99b00fd740 2024-02-21T07:45:23.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.760+0000 7f99afe00640 1 -- 172.21.15.69:0/1451338867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b0158cc0 con 0x7f99b00fd740 2024-02-21T07:45:23.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.761+0000 7f99afe00640 1 -- 172.21.15.69:0/1451338867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b006cba0 con 0x7f99b00fd740 2024-02-21T07:45:23.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.763+0000 7f99a6a00640 1 -- 172.21.15.69:0/1451338867 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f99a000ad10 con 0x7f99b00fd740 2024-02-21T07:45:23.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.764+0000 7f99a6a00640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f998c09f0a0 0x7f998c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:23.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.765+0000 7f99a6a00640 1 -- 172.21.15.69:0/1451338867 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f99a00c90f0 con 0x7f99b00fd740 2024-02-21T07:45:23.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.765+0000 7f99ae000640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f998c09f0a0 0x7f998c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:23.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.766+0000 7f99ae000640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f998c09f0a0 0x7f998c0a1560 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9998034000 tx=0x7f9998008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:23.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:23.770+0000 7f99a6a00640 1 -- 172.21.15.69:0/1451338867 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f99a0092f20 con 0x7f99b00fd740 2024-02-21T07:45:24.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.007+0000 7f99afe00640 1 -- 172.21.15.69:0/1451338867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99b0069c10 con 0x7f99b00fd740 2024-02-21T07:45:24.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.008+0000 7f99a6a00640 1 -- 172.21.15.69:0/1451338867 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11387 (secure 0 0 0) 0x7f99a00965e0 con 0x7f99b00fd740 2024-02-21T07:45:24.015 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:45:24.015 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4312,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6836/132938467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6834","nonce":132938467},{"type":"v1","addr":"172.21.15.174:6836","nonce":132938467}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.174:6837/2118263689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6835","nonce":2118263689},{"type":"v1","addr":"172.21.15.174:6837","nonce":2118263689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T07:42:02.396796+0000","modified":"2024-02-21T07:45:05.667629+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4378,"mds_1":4375,"mds_2":4363,"mds_3":4360,"mds_4":4321},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4318":{"gid":4318,"name":"h","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.174:6839/2813302146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6838","nonce":2813302146},{"type":"v1","addr":"172.21.15.174:6839","nonce":2813302146}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4321":{"gid":4321,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.174:6841/2567176191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6840","nonce":2567176191},{"type":"v1","addr":"172.21.15.174:6841","nonce":2567176191}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4325":{"gid":4325,"name":"c","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6833/241275309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6832","nonce":241275309},{"type":"v1","addr":"172.21.15.184:6833","nonce":241275309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4334":{"gid":4334,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6839/1152335050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6838","nonce":1152335050},{"type":"v1","addr":"172.21.15.184:6839","nonce":1152335050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4345":{"gid":4345,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6835/833362199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6834","nonce":833362199},{"type":"v1","addr":"172.21.15.184:6835","nonce":833362199}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.184:6837/2656539850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6836","nonce":2656539850},{"type":"v1","addr":"172.21.15.184:6837","nonce":2656539850}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4360":{"gid":4360,"name":"d","rank":3,"incarnation":14,"state":"up:active","state_seq":47,"addr":"172.21.15.69:6833/3664160916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3664160916},{"type":"v1","addr":"172.21.15.69:6833","nonce":3664160916}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4363":{"gid":4363,"name":"g","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6835/3538407092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":3538407092},{"type":"v1","addr":"172.21.15.69:6835","nonce":3538407092}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4375":{"gid":4375,"name":"j","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.69:6837/2966352085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2966352085},{"type":"v1","addr":"172.21.15.69:6837","nonce":2966352085}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4378":{"gid":4378,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6839/3963425058","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":3963425058},{"type":"v1","addr":"172.21.15.69:6839","nonce":3963425058}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T07:45:24.015 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 26 2024-02-21T07:45:24.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 -- 172.21.15.69:0/1451338867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f998c09f0a0 msgr2=0x7f998c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f998c09f0a0 0x7f998c0a1560 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9998034000 tx=0x7f9998008030 comp rx=0 tx=0).stop 2024-02-21T07:45:24.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 -- 172.21.15.69:0/1451338867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b00fd740 msgr2=0x7f99b0157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b00fd740 0x7f99b0157d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f99a000cb20 tx=0x7f99a0002070 comp rx=0 tx=0).stop 2024-02-21T07:45:24.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 -- 172.21.15.69:0/1451338867 shutdown_connections 2024-02-21T07:45:24.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f998c09f0a0 0x7f998c0a1560 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f99b015dad0 0x7f99b017e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f99b00fe590 0x7f99b0153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 --2- 172.21.15.69:0/1451338867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b00fd740 0x7f99b0157d70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 -- 172.21.15.69:0/1451338867 >> 172.21.15.69:0/1451338867 conn(0x7f99b00d2c90 msgr2=0x7f99b00d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.011+0000 7f99afe00640 1 -- 172.21.15.69:0/1451338867 shutdown_connections 2024-02-21T07:45:24.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.012+0000 7f99afe00640 1 -- 172.21.15.69:0/1451338867 wait complete. 2024-02-21T07:45:24.039 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:45:24.039 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-02-21T07:45:24.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.231+0000 7f2664c00640 1 Processor -- start 2024-02-21T07:45:24.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.232+0000 7f2664c00640 1 -- start start 2024-02-21T07:45:24.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.233+0000 7f2664c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f266018ba20 0x7f2660186910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.233+0000 7f2664c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f2660186e50 0x7f266018c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.233+0000 7f2664c00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266018a6a0 con 0x7f266018bf90 2024-02-21T07:45:24.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.233+0000 7f2664c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266018a980 con 0x7f2660186e50 2024-02-21T07:45:24.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.233+0000 7f2664c00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266018ac60 con 0x7f266018ba20 2024-02-21T07:45:24.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265de00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f266018bf90 0x7f2660189e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60744/0 (socket says 172.21.15.69:60744) 2024-02-21T07:45:24.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265de00640 1 -- 172.21.15.69:0/2633399689 learned_addr learned my addr 172.21.15.69:0/2633399689 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:24.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265d400640 1 --2- 172.21.15.69:0/2633399689 >> v2:172.21.15.184:3300/0 conn(0x7f266018ba20 0x7f2660186910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265e800640 1 --2- 172.21.15.69:0/2633399689 >> v2:172.21.15.174:3300/0 conn(0x7f2660186e50 0x7f266018c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265ca00640 1 -- 172.21.15.69:0/2633399689 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084826399 0 0) 0x7f266018a6a0 con 0x7f266018bf90 2024-02-21T07:45:24.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265ca00640 1 -- 172.21.15.69:0/2633399689 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2644003520 con 0x7f266018bf90 2024-02-21T07:45:24.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265d400640 1 -- 172.21.15.69:0/2633399689 >> v2:172.21.15.174:3300/0 conn(0x7f2660186e50 msgr2=0x7f266018c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265d400640 1 --2- 172.21.15.69:0/2633399689 >> v2:172.21.15.174:3300/0 conn(0x7f2660186e50 0x7f266018c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265d400640 1 -- 172.21.15.69:0/2633399689 >> v1:172.21.15.69:6789/0 conn(0x7f266018bf90 legacy=0x7f2660189e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265d400640 1 -- 172.21.15.69:0/2633399689 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266018af40 con 0x7f266018ba20 2024-02-21T07:45:24.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.234+0000 7f265e800640 1 --2- 172.21.15.69:0/2633399689 >> v2:172.21.15.174:3300/0 conn(0x7f2660186e50 0x7f266018c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.236+0000 7f265d400640 1 --2- 172.21.15.69:0/2633399689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f266018ba20 0x7f2660186910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f264c0097a0 tx=0x7f264c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7da9cd1e370daf76 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.236+0000 7f265ca00640 1 -- 172.21.15.69:0/2633399689 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c031830 con 0x7f266018ba20 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.236+0000 7f265ca00640 1 -- 172.21.15.69:0/2633399689 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c031990 con 0x7f266018ba20 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.236+0000 7f265ca00640 1 -- 172.21.15.69:0/2633399689 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c031d20 con 0x7f266018ba20 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.237+0000 7f2664c00640 1 -- 172.21.15.69:0/2633399689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f266018ba20 msgr2=0x7f2660186910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.237+0000 7f2664c00640 1 --2- 172.21.15.69:0/2633399689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f266018ba20 0x7f2660186910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f264c0097a0 tx=0x7f264c02b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.237+0000 7f2664c00640 1 -- 172.21.15.69:0/2633399689 shutdown_connections 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.237+0000 7f2664c00640 1 --2- 172.21.15.69:0/2633399689 >> v2:172.21.15.174:3300/0 conn(0x7f2660186e50 0x7f266018c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.237+0000 7f2664c00640 1 --2- 172.21.15.69:0/2633399689 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f266018ba20 0x7f2660186910 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.237+0000 7f2664c00640 1 -- 172.21.15.69:0/2633399689 >> 172.21.15.69:0/2633399689 conn(0x7f26600fc150 msgr2=0x7f26600fc560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.237+0000 7f2664c00640 1 -- 172.21.15.69:0/2633399689 shutdown_connections 2024-02-21T07:45:24.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.237+0000 7f2664c00640 1 -- 172.21.15.69:0/2633399689 wait complete. 2024-02-21T07:45:24.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.239+0000 7f2664c00640 1 Processor -- start 2024-02-21T07:45:24.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.239+0000 7f2664c00640 1 -- start start 2024-02-21T07:45:24.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.240+0000 7f2664c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660186e50 0x7f266015f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.240+0000 7f2664c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f266018ba20 0x7f266017b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.240+0000 7f2664c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f266018bf90 0x7f266015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.240+0000 7f2664c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266015cb70 con 0x7f266018bf90 2024-02-21T07:45:24.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.240+0000 7f2664c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2660188af0 con 0x7f266018ba20 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.240+0000 7f2664c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2660188dd0 con 0x7f2660186e50 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265e800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f266018bf90 0x7f266015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265d400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f266018ba20 0x7f266017b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660186e50 0x7f266015f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265d400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f266018ba20 0x7f266017b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38126/0 (socket says 172.21.15.69:38126) 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265e800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f266018bf90 0x7f266015d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43344/0 (socket says 172.21.15.69:43344) 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265d400640 1 -- 172.21.15.69:0/1925585855 learned_addr learned my addr 172.21.15.69:0/1925585855 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265e800640 1 -- 172.21.15.69:0/1925585855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660186e50 msgr2=0x7f266015f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265e800640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660186e50 0x7f266015f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265e800640 1 -- 172.21.15.69:0/1925585855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f266018ba20 msgr2=0x7f266017b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265e800640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f266018ba20 0x7f266017b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265e800640 1 -- 172.21.15.69:0/1925585855 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2658009a70 con 0x7f266018bf90 2024-02-21T07:45:24.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.241+0000 7f265e800640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f266018bf90 0x7f266015d5c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f265800ef90 tx=0x7f265800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.242+0000 7f2656000640 1 -- 172.21.15.69:0/1925585855 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265800cd30 con 0x7f266018bf90 2024-02-21T07:45:24.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.242+0000 7f2656000640 1 -- 172.21.15.69:0/1925585855 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265800f040 con 0x7f266018bf90 2024-02-21T07:45:24.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.242+0000 7f2656000640 1 -- 172.21.15.69:0/1925585855 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658003bd0 con 0x7f266018bf90 2024-02-21T07:45:24.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.242+0000 7f2664c00640 1 -- 172.21.15.69:0/1925585855 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c009400 con 0x7f266018bf90 2024-02-21T07:45:24.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.242+0000 7f2664c00640 1 -- 172.21.15.69:0/1925585855 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266015cdc0 con 0x7f266018bf90 2024-02-21T07:45:24.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.245+0000 7f2656000640 1 -- 172.21.15.69:0/1925585855 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f2658014480 con 0x7f266018bf90 2024-02-21T07:45:24.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.246+0000 7f26677de740 1 Processor -- start 2024-02-21T07:45:24.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.246+0000 7f26677de740 1 -- start start 2024-02-21T07:45:24.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.246+0000 7f2656000640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f264009f0a0 0x7f26400a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.246+0000 7f2656000640 1 -- 172.21.15.69:0/1925585855 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f26580ca740 con 0x7f266018bf90 2024-02-21T07:45:24.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.246+0000 7f265d400640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f264009f0a0 0x7f26400a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.247+0000 7f265d400640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f264009f0a0 0x7f26400a1560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2660161180 tx=0x7f264c03c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.247+0000 7f26677de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce5943ec0 0x561ce59442a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.247+0000 7f26677de740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce597f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.247+0000 7f26677de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce597f590 0x561ce5980320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.247+0000 7f26677de740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce5877210 con 0x561ce59447e0 2024-02-21T07:45:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.247+0000 7f26677de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce5874740 con 0x561ce597f590 2024-02-21T07:45:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.247+0000 7f26677de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce586ff20 con 0x561ce5943ec0 2024-02-21T07:45:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce597f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce597f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43348/0 (socket says 172.21.15.69:43348) 2024-02-21T07:45:24.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265d400640 1 -- 172.21.15.69:0/1058208881 learned_addr learned my addr 172.21.15.69:0/1058208881 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265e800640 1 --2- 172.21.15.69:0/1058208881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce597f590 0x561ce5980320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265de00640 1 --2- 172.21.15.69:0/1058208881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce5943ec0 0x561ce59442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265d400640 1 -- 172.21.15.69:0/1058208881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce5943ec0 msgr2=0x561ce59442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265d400640 1 --2- 172.21.15.69:0/1058208881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce5943ec0 0x561ce59442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265d400640 1 -- 172.21.15.69:0/1058208881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce597f590 msgr2=0x561ce5980320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265d400640 1 --2- 172.21.15.69:0/1058208881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce597f590 0x561ce5980320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265d400640 1 -- 172.21.15.69:0/1058208881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ce5831df0 con 0x561ce59447e0 2024-02-21T07:45:24.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.248+0000 7f265d400640 1 --2- 172.21.15.69:0/1058208881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce597f050 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f264c031b80 tx=0x7f264c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a4931686da6e82 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.249+0000 7f264a600640 1 -- 172.21.15.69:0/1058208881 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c04a070 con 0x561ce59447e0 2024-02-21T07:45:24.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.249+0000 7f264a600640 1 -- 172.21.15.69:0/1058208881 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c045ad0 con 0x561ce59447e0 2024-02-21T07:45:24.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.249+0000 7f264a600640 1 -- 172.21.15.69:0/1058208881 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c03f040 con 0x561ce59447e0 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.249+0000 7f26677de740 1 -- 172.21.15.69:0/1058208881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 msgr2=0x561ce597f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.249+0000 7f26677de740 1 --2- 172.21.15.69:0/1058208881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce597f050 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f264c031b80 tx=0x7f264c030000 comp rx=0 tx=0).stop 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.249+0000 7f26677de740 1 -- 172.21.15.69:0/1058208881 shutdown_connections 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.249+0000 7f26677de740 1 --2- 172.21.15.69:0/1058208881 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce597f590 0x561ce5980320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.249+0000 7f26677de740 1 --2- 172.21.15.69:0/1058208881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce597f050 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.249+0000 7f26677de740 1 --2- 172.21.15.69:0/1058208881 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce5943ec0 0x561ce59442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.249+0000 7f26677de740 1 -- 172.21.15.69:0/1058208881 >> 172.21.15.69:0/1058208881 conn(0x561ce5906490 msgr2=0x561ce5907510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.250+0000 7f26677de740 1 -- 172.21.15.69:0/1058208881 shutdown_connections 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.250+0000 7f26677de740 1 -- 172.21.15.69:0/1058208881 wait complete. 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.250+0000 7f26677de740 1 -- start start 2024-02-21T07:45:24.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.251+0000 7f26677de740 1 Processor -- start 2024-02-21T07:45:24.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f26677de740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce59899c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f26677de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce597f590 0x561ce597c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f26677de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce598b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f26677de740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce5815150 con 0x561ce59447e0 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f26677de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce5814df0 con 0x561ce598c310 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f26677de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce55de1c0 con 0x561ce597f590 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f26677de740 10 client.0 _ll_register_callbacks cb 0x561ce58642b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f265de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce59899c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f265de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce59899c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43356/0 (socket says 172.21.15.69:43356) 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f265de00640 1 -- 172.21.15.69:0/452763875 learned_addr learned my addr 172.21.15.69:0/452763875 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f265e800640 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce598b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.252+0000 7f265d400640 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce597f590 0x561ce597c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f265de00640 1 -- 172.21.15.69:0/452763875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce597f590 msgr2=0x561ce597c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f265de00640 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce597f590 0x561ce597c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f265de00640 1 -- 172.21.15.69:0/452763875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 msgr2=0x561ce598b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f265de00640 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce598b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f265de00640 1 -- 172.21.15.69:0/452763875 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266018af40 con 0x561ce59447e0 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f265e800640 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce598b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f265d400640 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce597f590 0x561ce597c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f265de00640 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce59899c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f26500122f0 tx=0x7f26500127b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaaf26cef79a094 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f263ea00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f263ea00640 1 -- 172.21.15.69:0/452763875 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650005ac0 con 0x561ce59447e0 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f263ea00640 1 -- 172.21.15.69:0/452763875 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f2650005c20 con 0x561ce59447e0 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f26677de740 1 -- 172.21.15.69:0/452763875 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ce556f7e0 con 0x561ce59447e0 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f263ea00640 1 -- 172.21.15.69:0/452763875 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2650005de0 con 0x561ce59447e0 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f26677de740 10 client.5808 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.253+0000 7f26677de740 1 -- 172.21.15.69:0/452763875 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x561ce586e5a0 con 0x561ce59447e0 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.254+0000 7f263ea00640 1 -- 172.21.15.69:0/452763875 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ce556f7e0 con 0x561ce59447e0 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.254+0000 7f263ea00640 1 -- 172.21.15.69:0/452763875 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f26500070d0 con 0x561ce59447e0 2024-02-21T07:45:24.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.254+0000 7f26677de740 10 client.5808 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:24.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.254+0000 7f26677de740 10 client.5808 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.b 2024-02-21T07:45:24.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.254+0000 7f26677de740 20 client.5808 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:24.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.254+0000 7f26677de740 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x561ce592e750 0x561ce59368c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.254+0000 7f26677de740 4 client.5808 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:45:24.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.254+0000 7f26677de740 1 -- 172.21.15.69:0/452763875 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ce55ac720 con 0x561ce592e750 2024-02-21T07:45:24.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.254+0000 7f265d400640 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x561ce592e750 0x561ce59368c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.255+0000 7f265d400640 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x561ce592e750 0x561ce59368c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aeb356544506b0ab server_cookie=24f100f00125be91 in_seq=0 out_seq=0 2024-02-21T07:45:24.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.255+0000 7f263ea00640 10 client.5808 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:45:24.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f263ea00640 1 -- 172.21.15.69:0/452763875 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561ce55ac720 con 0x561ce592e750 2024-02-21T07:45:24.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f263ea00640 10 client.5808 handle_command_reply: tid=0 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 client.5808 shutdown 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 -- 172.21.15.69:0/452763875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 msgr2=0x561ce59899c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce59899c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f26500122f0 tx=0x7f26500127b0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 -- 172.21.15.69:0/452763875 shutdown_connections 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x561ce592e750 0x561ce59368c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce598b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce597f590 0x561ce597c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 --2- 172.21.15.69:0/452763875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce59447e0 0x561ce59899c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f263ea00640 0 client.5808 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 -- 172.21.15.69:0/452763875 >> 172.21.15.69:0/452763875 conn(0x561ce5943ec0 msgr2=0x561ce5907f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 -- 172.21.15.69:0/452763875 shutdown_connections 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 1 -- 172.21.15.69:0/452763875 wait complete. 2024-02-21T07:45:24.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.256+0000 7f26677de740 20 client.5808 trim_cache size 0 max 16384 2024-02-21T07:45:24.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.269+0000 7f26677de740 1 Processor -- start 2024-02-21T07:45:24.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.269+0000 7f26677de740 1 -- start start 2024-02-21T07:45:24.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.270+0000 7f26677de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce5905570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.270+0000 7f26677de740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce58fe4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.270+0000 7f26677de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce5902000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.270+0000 7f26677de740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce59404d0 con 0x561ce597f590 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.270+0000 7f26677de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce59045c0 con 0x561ce598c310 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.270+0000 7f26677de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce58fe9e0 con 0x561ce59447e0 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce58fe4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce58fe4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43364/0 (socket says 172.21.15.69:43364) 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265d400640 1 -- 172.21.15.69:0/4063128029 learned_addr learned my addr 172.21.15.69:0/4063128029 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265de00640 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce5905570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265e800640 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce5902000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265d400640 1 -- 172.21.15.69:0/4063128029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 msgr2=0x561ce5905570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265d400640 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce5905570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265d400640 1 -- 172.21.15.69:0/4063128029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 msgr2=0x561ce5902000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265d400640 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce5902000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265d400640 1 -- 172.21.15.69:0/4063128029 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ce580aab0 con 0x561ce597f590 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265de00640 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce5905570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:24.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265e800640 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce5902000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.271+0000 7f265d400640 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce58fe4a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f264c0098c0 tx=0x7f264c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff2fa9e527f65fe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f2649c00640 1 -- 172.21.15.69:0/4063128029 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c04a040 con 0x561ce597f590 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f2649c00640 1 -- 172.21.15.69:0/4063128029 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c04f8d0 con 0x561ce597f590 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f2649c00640 1 -- 172.21.15.69:0/4063128029 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c04fc80 con 0x561ce597f590 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f26677de740 1 -- 172.21.15.69:0/4063128029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 msgr2=0x561ce58fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f26677de740 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce58fe4a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f264c0098c0 tx=0x7f264c009190 comp rx=0 tx=0).stop 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f26677de740 1 -- 172.21.15.69:0/4063128029 shutdown_connections 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f26677de740 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce5902000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f26677de740 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce58fe4a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f26677de740 1 --2- 172.21.15.69:0/4063128029 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce5905570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f26677de740 1 -- 172.21.15.69:0/4063128029 >> 172.21.15.69:0/4063128029 conn(0x561ce5943ec0 msgr2=0x561ce597f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f26677de740 1 -- 172.21.15.69:0/4063128029 shutdown_connections 2024-02-21T07:45:24.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.272+0000 7f26677de740 1 -- 172.21.15.69:0/4063128029 wait complete. 2024-02-21T07:45:24.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.273+0000 7f26677de740 1 -- start start 2024-02-21T07:45:24.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.273+0000 7f26677de740 1 Processor -- start 2024-02-21T07:45:24.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.274+0000 7f26677de740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce592dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f26677de740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce597efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f26677de740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce59354a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f26677de740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce59359e0 con 0x561ce597f590 2024-02-21T07:45:24.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f26677de740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce5934fc0 con 0x561ce598c310 2024-02-21T07:45:24.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f26677de740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ce59e2790 con 0x561ce59447e0 2024-02-21T07:45:24.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f26677de740 10 client.0 _ll_register_callbacks cb 0x7f26580095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:24.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce597efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce592dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265de00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce592dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53734/0 (socket says 172.21.15.69:53734) 2024-02-21T07:45:24.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265de00640 1 -- 172.21.15.69:0/3113408967 learned_addr learned my addr 172.21.15.69:0/3113408967 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265e800640 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce59354a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265de00640 1 -- 172.21.15.69:0/3113408967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 msgr2=0x561ce59354a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265de00640 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce59354a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265de00640 1 -- 172.21.15.69:0/3113408967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 msgr2=0x561ce597efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265de00640 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce597efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265de00640 1 -- 172.21.15.69:0/3113408967 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ce5831df0 con 0x561ce59447e0 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.275+0000 7f265d400640 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce597efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.276+0000 7f265de00640 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce592dce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2650000ea0 tx=0x7f26500010a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=237950d1d56d38be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.276+0000 7f263ea00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.276+0000 7f263ea00640 1 -- 172.21.15.69:0/3113408967 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650005cc0 con 0x561ce59447e0 2024-02-21T07:45:24.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.276+0000 7f26677de740 1 -- 172.21.15.69:0/3113408967 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f264c045ad0 con 0x561ce59447e0 2024-02-21T07:45:24.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.276+0000 7f263ea00640 1 -- 172.21.15.69:0/3113408967 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f26500079d0 con 0x561ce59447e0 2024-02-21T07:45:24.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.276+0000 7f263ea00640 1 -- 172.21.15.69:0/3113408967 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2650001d70 con 0x561ce59447e0 2024-02-21T07:45:24.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.276+0000 7f26677de740 10 client.5963 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:24.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.276+0000 7f26677de740 1 -- 172.21.15.69:0/3113408967 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x561ce5830650 con 0x561ce59447e0 2024-02-21T07:45:24.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.276+0000 7f263ea00640 1 -- 172.21.15.69:0/3113408967 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2650035020 con 0x561ce59447e0 2024-02-21T07:45:24.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.277+0000 7f263ea00640 1 -- 172.21.15.69:0/3113408967 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f265002f070 con 0x561ce59447e0 2024-02-21T07:45:24.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.277+0000 7f26677de740 10 client.5963 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.277+0000 7f26677de740 10 client.5963 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.b 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.277+0000 7f26677de740 20 client.5963 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.277+0000 7f26677de740 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x561ce5903220 0x561ce59dfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.277+0000 7f26677de740 4 client.5963 mds_command: new command op to 4321 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.277+0000 7f26677de740 1 -- 172.21.15.69:0/3113408967 --> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561ce55fb890 con 0x561ce5903220 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.277+0000 7f265d400640 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x561ce5903220 0x561ce59dfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.277+0000 7f265d400640 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x561ce5903220 0x561ce59dfba0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3859afcd2ee3b701 server_cookie=cfde2313c22cc57e in_seq=0 out_seq=0 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.277+0000 7f263ea00640 10 client.5963 ms_handle_connect on v2:172.21.15.174:6840/2567176191 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f263ea00640 1 -- 172.21.15.69:0/3113408967 <== mds.4 v2:172.21.15.174:6840/2567176191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561ce55fb890 con 0x561ce5903220 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f263ea00640 10 client.5963 handle_command_reply: tid=0 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 client.5963 shutdown 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 -- 172.21.15.69:0/3113408967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 msgr2=0x561ce592dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce592dce0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2650000ea0 tx=0x7f26500010a0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 -- 172.21.15.69:0/3113408967 shutdown_connections 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.174:6840/2567176191,v1:172.21.15.174:6841/2567176191] conn(0x561ce5903220 0x561ce59dfba0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x561ce598c310 0x561ce59354a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561ce597f590 0x561ce597efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f263ea00640 0 client.5963 ms_handle_reset on v2:172.21.15.174:6840/2567176191 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 --2- 172.21.15.69:0/3113408967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x561ce59447e0 0x561ce592dce0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 -- 172.21.15.69:0/3113408967 >> 172.21.15.69:0/3113408967 conn(0x561ce5943ec0 msgr2=0x561ce5902330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 -- 172.21.15.69:0/3113408967 shutdown_connections 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 1 -- 172.21.15.69:0/3113408967 wait complete. 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.278+0000 7f26677de740 20 client.5963 trim_cache size 0 max 16384 2024-02-21T07:45:24.290 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:45:24.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 -- 172.21.15.69:0/1925585855 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f264009f0a0 msgr2=0x7f26400a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f264009f0a0 0x7f26400a1560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2660161180 tx=0x7f264c03c040 comp rx=0 tx=0).stop 2024-02-21T07:45:24.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 -- 172.21.15.69:0/1925585855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f266018bf90 msgr2=0x7f266015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f266018bf90 0x7f266015d5c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f265800ef90 tx=0x7f265800c490 comp rx=0 tx=0).stop 2024-02-21T07:45:24.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 -- 172.21.15.69:0/1925585855 shutdown_connections 2024-02-21T07:45:24.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f264009f0a0 0x7f26400a1560 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f266018bf90 0x7f266015d5c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f266018ba20 0x7f266017b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 --2- 172.21.15.69:0/1925585855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660186e50 0x7f266015f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 -- 172.21.15.69:0/1925585855 >> 172.21.15.69:0/1925585855 conn(0x7f26600fc150 msgr2=0x7f2660189d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 -- 172.21.15.69:0/1925585855 shutdown_connections 2024-02-21T07:45:24.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.279+0000 7f2664c00640 1 -- 172.21.15.69:0/1925585855 wait complete. 2024-02-21T07:45:24.301 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:45:24.301 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-02-21T07:45:24.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.491+0000 7f47b4c00640 1 Processor -- start 2024-02-21T07:45:24.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.491+0000 7f47b4c00640 1 -- start start 2024-02-21T07:45:24.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.493+0000 7f47b4c00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f47b0183ea0 0x7f47b01846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.493+0000 7f47b4c00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b01850b0 con 0x7f47b00eed50 2024-02-21T07:45:24.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.493+0000 7f47b4c00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b0185390 con 0x7f47b0184c20 2024-02-21T07:45:24.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.493+0000 7f47b4c00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b0186010 con 0x7f47b0183ea0 2024-02-21T07:45:24.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.493+0000 7f47ae800640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f47b00eed50 0x7f47b0186bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60746/0 (socket says 172.21.15.69:60746) 2024-02-21T07:45:24.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.493+0000 7f47ae800640 1 -- 172.21.15.69:0/183783808 learned_addr learned my addr 172.21.15.69:0/183783808 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:24.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.494+0000 7f47ade00640 1 --2- 172.21.15.69:0/183783808 >> v2:172.21.15.174:3300/0 conn(0x7f47b0183ea0 0x7f47b01846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.494+0000 7f47ad400640 1 -- 172.21.15.69:0/183783808 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947918630 0 0) 0x7f47b01850b0 con 0x7f47b00eed50 2024-02-21T07:45:24.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.494+0000 7f47ad400640 1 -- 172.21.15.69:0/183783808 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4794003520 con 0x7f47b00eed50 2024-02-21T07:45:24.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.494+0000 7f47ade00640 1 -- 172.21.15.69:0/183783808 >> v1:172.21.15.184:6789/0 conn(0x7f47b0184c20 legacy=0x7f47b00ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.494+0000 7f47ad400640 1 -- 172.21.15.69:0/183783808 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201884556 0 0) 0x7f47b0185390 con 0x7f47b0184c20 2024-02-21T07:45:24.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.494+0000 7f47ade00640 1 -- 172.21.15.69:0/183783808 >> v1:172.21.15.69:6789/0 conn(0x7f47b00eed50 legacy=0x7f47b0186bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.494+0000 7f47ade00640 1 -- 172.21.15.69:0/183783808 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0185670 con 0x7f47b0183ea0 2024-02-21T07:45:24.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.495+0000 7f47ade00640 1 --2- 172.21.15.69:0/183783808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47b0183ea0 0x7f47b01846e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f47a00097a0 tx=0x7f47a002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da62d584b3d837f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.495+0000 7f47ad400640 1 -- 172.21.15.69:0/183783808 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0031830 con 0x7f47b0183ea0 2024-02-21T07:45:24.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.496+0000 7f47ad400640 1 -- 172.21.15.69:0/183783808 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a0031990 con 0x7f47b0183ea0 2024-02-21T07:45:24.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.496+0000 7f47ad400640 1 -- 172.21.15.69:0/183783808 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0031d00 con 0x7f47b0183ea0 2024-02-21T07:45:24.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.496+0000 7f47b4c00640 1 -- 172.21.15.69:0/183783808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47b0183ea0 msgr2=0x7f47b01846e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.496+0000 7f47b4c00640 1 --2- 172.21.15.69:0/183783808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47b0183ea0 0x7f47b01846e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f47a00097a0 tx=0x7f47a002b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.496+0000 7f47b4c00640 1 -- 172.21.15.69:0/183783808 shutdown_connections 2024-02-21T07:45:24.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.496+0000 7f47b4c00640 1 --2- 172.21.15.69:0/183783808 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47b0183ea0 0x7f47b01846e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.496+0000 7f47b4c00640 1 -- 172.21.15.69:0/183783808 >> 172.21.15.69:0/183783808 conn(0x7f47b00ce3d0 msgr2=0x7f47b00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.496+0000 7f47b4c00640 1 -- 172.21.15.69:0/183783808 shutdown_connections 2024-02-21T07:45:24.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.496+0000 7f47b4c00640 1 -- 172.21.15.69:0/183783808 wait complete. 2024-02-21T07:45:24.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.498+0000 7f47b4c00640 1 Processor -- start 2024-02-21T07:45:24.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.498+0000 7f47b4c00640 1 -- start start 2024-02-21T07:45:24.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47b4c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b00eed50 0x7f47b021c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47b4c00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47b0183ea0 0x7f47b016e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47b4c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47b016e9e0 0x7f47b0179510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47b4c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b01752e0 con 0x7f47b00eed50 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47b4c00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0174760 con 0x7f47b0183ea0 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47b4c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0174a40 con 0x7f47b016e9e0 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47ade00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b00eed50 0x7f47b021c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47ade00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b00eed50 0x7f47b021c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43384/0 (socket says 172.21.15.69:43384) 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47ade00640 1 -- 172.21.15.69:0/3607865988 learned_addr learned my addr 172.21.15.69:0/3607865988 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47ae800640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47b016e9e0 0x7f47b0179510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.500+0000 7f47a7e00640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47b0183ea0 0x7f47b016e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.501+0000 7f47ade00640 1 -- 172.21.15.69:0/3607865988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47b016e9e0 msgr2=0x7f47b0179510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.501+0000 7f47ade00640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47b016e9e0 0x7f47b0179510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.501+0000 7f47ade00640 1 -- 172.21.15.69:0/3607865988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47b0183ea0 msgr2=0x7f47b016e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.501+0000 7f47ade00640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47b0183ea0 0x7f47b016e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.501+0000 7f47ade00640 1 -- 172.21.15.69:0/3607865988 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a0009400 con 0x7f47b00eed50 2024-02-21T07:45:24.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.501+0000 7f47ade00640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b00eed50 0x7f47b021c720 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f47a00098c0 tx=0x7f47a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.501+0000 7f47a6000640 1 -- 172.21.15.69:0/3607865988 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0004450 con 0x7f47b00eed50 2024-02-21T07:45:24.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.501+0000 7f47a6000640 1 -- 172.21.15.69:0/3607865988 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a0003610 con 0x7f47b00eed50 2024-02-21T07:45:24.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.502+0000 7f47a6000640 1 -- 172.21.15.69:0/3607865988 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0003980 con 0x7f47b00eed50 2024-02-21T07:45:24.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.502+0000 7f47b4c00640 1 -- 172.21.15.69:0/3607865988 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b01865b0 con 0x7f47b00eed50 2024-02-21T07:45:24.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.502+0000 7f47b4c00640 1 -- 172.21.15.69:0/3607865988 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b0175000 con 0x7f47b00eed50 2024-02-21T07:45:24.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.505+0000 7f47a6000640 1 -- 172.21.15.69:0/3607865988 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f47a0003ae0 con 0x7f47b00eed50 2024-02-21T07:45:24.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.506+0000 7f47b77d8740 1 Processor -- start 2024-02-21T07:45:24.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.506+0000 7f47b77d8740 1 -- start start 2024-02-21T07:45:24.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.507+0000 7f47a6000640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f478c09f0a0 0x7f478c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.507+0000 7f47a6000640 1 -- 172.21.15.69:0/3607865988 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f47a00ebbe0 con 0x7f47b00eed50 2024-02-21T07:45:24.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.507+0000 7f47ae800640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f478c09f0a0 0x7f478c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdb3390 0x55d5dcdb3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcded730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdedc70 0x55d5dcdba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47b77d8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dcce2210 con 0x55d5dcdedc70 2024-02-21T07:45:24.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47b77d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dccdf740 con 0x55d5dcdb3390 2024-02-21T07:45:24.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47b77d8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dccdaf20 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47ae800640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f478c09f0a0 0x7f478c0a1560 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f47a8001560 tx=0x7f47a8001970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47ade00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdb3390 0x55d5dcdb3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47ade00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdb3390 0x55d5dcdb3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38198/0 (socket says 172.21.15.69:38198) 2024-02-21T07:45:24.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47ade00640 1 -- 172.21.15.69:0/651971027 learned_addr learned my addr 172.21.15.69:0/651971027 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.508+0000 7f47ae800640 1 --2- 172.21.15.69:0/651971027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdedc70 0x55d5dcdba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.509+0000 7f47a7e00640 1 --2- 172.21.15.69:0/651971027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcded730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.509+0000 7f47ade00640 1 -- 172.21.15.69:0/651971027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 msgr2=0x55d5dcded730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.509+0000 7f47ade00640 1 --2- 172.21.15.69:0/651971027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcded730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.509+0000 7f47ade00640 1 -- 172.21.15.69:0/651971027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdedc70 msgr2=0x55d5dcdba3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.509+0000 7f47ade00640 1 --2- 172.21.15.69:0/651971027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdedc70 0x55d5dcdba3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.509+0000 7f47ade00640 1 -- 172.21.15.69:0/651971027 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5dcc9cdf0 con 0x55d5dcdb3390 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.509+0000 7f47ade00640 1 --2- 172.21.15.69:0/651971027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdb3390 0x55d5dcdb3770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f47a00b9650 tx=0x7f47a00b5a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dab1fbf04b84712 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.509+0000 7f479e600640 1 -- 172.21.15.69:0/651971027 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00c1e60 con 0x55d5dcdb3390 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.509+0000 7f479e600640 1 -- 172.21.15.69:0/651971027 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a0003d90 con 0x55d5dcdb3390 2024-02-21T07:45:24.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.509+0000 7f479e600640 1 -- 172.21.15.69:0/651971027 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00b5d30 con 0x55d5dcdb3390 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.510+0000 7f47b77d8740 1 -- 172.21.15.69:0/651971027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdb3390 msgr2=0x55d5dcdb3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.510+0000 7f47b77d8740 1 --2- 172.21.15.69:0/651971027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdb3390 0x55d5dcdb3770 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f47a00b9650 tx=0x7f47a00b5a10 comp rx=0 tx=0).stop 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.510+0000 7f47b77d8740 1 -- 172.21.15.69:0/651971027 shutdown_connections 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.510+0000 7f47b77d8740 1 --2- 172.21.15.69:0/651971027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdedc70 0x55d5dcdba3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.510+0000 7f47b77d8740 1 --2- 172.21.15.69:0/651971027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcded730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.510+0000 7f47b77d8740 1 --2- 172.21.15.69:0/651971027 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdb3390 0x55d5dcdb3770 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.510+0000 7f47b77d8740 1 -- 172.21.15.69:0/651971027 >> 172.21.15.69:0/651971027 conn(0x55d5dcd71490 msgr2=0x55d5dcd72510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.510+0000 7f47b77d8740 1 -- 172.21.15.69:0/651971027 shutdown_connections 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.510+0000 7f47b77d8740 1 -- 172.21.15.69:0/651971027 wait complete. 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.511+0000 7f47b77d8740 1 -- start start 2024-02-21T07:45:24.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.511+0000 7f47b77d8740 1 Processor -- start 2024-02-21T07:45:24.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dcd9ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcde4ff0 0x55d5dcdfb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47b77d8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dcc80150 con 0x55d5dcde4ff0 2024-02-21T07:45:24.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47b77d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dcc7fdf0 con 0x55d5dcdedc70 2024-02-21T07:45:24.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47b77d8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dca491c0 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47b77d8740 10 client.0 _ll_register_callbacks cb 0x55d5dcccf2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47ade00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dcd9ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47ade00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53756/0 (socket says 172.21.15.69:53756) 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47ade00640 1 -- 172.21.15.69:0/1254306275 learned_addr learned my addr 172.21.15.69:0/1254306275 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47ae800640 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcde4ff0 0x55d5dcdfb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47ade00640 1 -- 172.21.15.69:0/1254306275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 msgr2=0x55d5dcd9ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47ade00640 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dcd9ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47ade00640 1 -- 172.21.15.69:0/1254306275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcde4ff0 msgr2=0x55d5dcdfb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47ade00640 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcde4ff0 0x55d5dcdfb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.513+0000 7f47ade00640 1 -- 172.21.15.69:0/1254306275 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b0175000 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.514+0000 7f47ade00640 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfa5f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f47a00b9650 tx=0x7f47a00a4070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a50760ea7acde84 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.514+0000 7f4792a00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.514+0000 7f4792a00640 1 -- 172.21.15.69:0/1254306275 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00c1e60 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.514+0000 7f47b77d8740 1 -- 172.21.15.69:0/1254306275 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5dc9da7e0 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.514+0000 7f4792a00640 1 -- 172.21.15.69:0/1254306275 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f47a00b5d30 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.514+0000 7f4792a00640 1 -- 172.21.15.69:0/1254306275 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47a00b5ef0 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.514+0000 7f47b77d8740 10 client.5975 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.514+0000 7f47b77d8740 1 -- 172.21.15.69:0/1254306275 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55d5dccd95a0 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.514+0000 7f4792a00640 1 -- 172.21.15.69:0/1254306275 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d5dc9da7e0 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.515+0000 7f4792a00640 1 -- 172.21.15.69:0/1254306275 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f47a00a40e0 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.515+0000 7f47b77d8740 10 client.5975 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.515+0000 7f47b77d8740 10 client.5975 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.d 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.515+0000 7f47b77d8740 20 client.5975 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.515+0000 7f47b77d8740 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d5dcde5470 0x55d5dcdfad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.515+0000 7f47b77d8740 4 client.5975 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.515+0000 7f47b77d8740 1 -- 172.21.15.69:0/1254306275 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d5dca17720 con 0x55d5dcde5470 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.515+0000 7f47a7e00640 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d5dcde5470 0x55d5dcdfad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.515+0000 7f47a7e00640 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d5dcde5470 0x55d5dcdfad20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=848998a038e251be server_cookie=b3539afe1e7d8c8e in_seq=0 out_seq=0 2024-02-21T07:45:24.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.515+0000 7f4792a00640 10 client.5975 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f4792a00640 1 -- 172.21.15.69:0/1254306275 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d5dca17720 con 0x55d5dcde5470 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f4792a00640 10 client.5975 handle_command_reply: tid=0 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f47b77d8740 1 client.5975 shutdown 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f47b77d8740 1 -- 172.21.15.69:0/1254306275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 msgr2=0x55d5dcdfa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f47b77d8740 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfa5f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f47a00b9650 tx=0x7f47a00a4070 comp rx=0 tx=0).stop 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f47b77d8740 1 -- 172.21.15.69:0/1254306275 shutdown_connections 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f47b77d8740 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d5dcde5470 0x55d5dcdfad20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f47b77d8740 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcde4ff0 0x55d5dcdfb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f47b77d8740 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dcd9ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f47b77d8740 1 --2- 172.21.15.69:0/1254306275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfa5f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f4792a00640 0 client.5975 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.516+0000 7f47b77d8740 1 -- 172.21.15.69:0/1254306275 >> 172.21.15.69:0/1254306275 conn(0x55d5dcdb3390 msgr2=0x55d5dcde5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.517+0000 7f47b77d8740 1 -- 172.21.15.69:0/1254306275 shutdown_connections 2024-02-21T07:45:24.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.517+0000 7f47b77d8740 1 -- 172.21.15.69:0/1254306275 wait complete. 2024-02-21T07:45:24.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.517+0000 7f47b77d8740 20 client.5975 trim_cache size 0 max 16384 2024-02-21T07:45:24.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.530+0000 7f47b77d8740 1 Processor -- start 2024-02-21T07:45:24.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.530+0000 7f47b77d8740 1 -- start start 2024-02-21T07:45:24.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcd72f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dcd9d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dce51460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47b77d8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dcd6f850 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47b77d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dce07d20 con 0x55d5dcdedc70 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47b77d8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dcd72be0 con 0x55d5dcde4ff0 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dcd9d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dcd9d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53762/0 (socket says 172.21.15.69:53762) 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47ae800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dce51460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47a7e00640 1 -- 172.21.15.69:0/2785332751 learned_addr learned my addr 172.21.15.69:0/2785332751 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.531+0000 7f47ade00640 1 --2- 172.21.15.69:0/2785332751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcd72f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.532+0000 7f47a7e00640 1 -- 172.21.15.69:0/2785332751 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 msgr2=0x55d5dce51460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.532+0000 7f47a7e00640 1 --2- 172.21.15.69:0/2785332751 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dce51460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.532+0000 7f47a7e00640 1 -- 172.21.15.69:0/2785332751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 msgr2=0x55d5dcd72f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.532+0000 7f47a7e00640 1 --2- 172.21.15.69:0/2785332751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcd72f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.532+0000 7f47a7e00640 1 -- 172.21.15.69:0/2785332751 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5dcc75ab0 con 0x55d5dcde4ff0 2024-02-21T07:45:24.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.532+0000 7f47a7e00640 1 --2- 172.21.15.69:0/2785332751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dcd9d130 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4798000fb0 tx=0x7f4798009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a54ad1a510faa5b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.532+0000 7f479dc00640 1 -- 172.21.15.69:0/2785332751 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798001b70 con 0x55d5dcde4ff0 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.532+0000 7f479dc00640 1 -- 172.21.15.69:0/2785332751 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479801c040 con 0x55d5dcde4ff0 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.532+0000 7f479dc00640 1 -- 172.21.15.69:0/2785332751 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798001cf0 con 0x55d5dcde4ff0 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.533+0000 7f47b77d8740 1 -- 172.21.15.69:0/2785332751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 msgr2=0x55d5dcd9d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.533+0000 7f47b77d8740 1 --2- 172.21.15.69:0/2785332751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dcd9d130 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4798000fb0 tx=0x7f4798009040 comp rx=0 tx=0).stop 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.533+0000 7f47b77d8740 1 -- 172.21.15.69:0/2785332751 shutdown_connections 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.533+0000 7f47b77d8740 1 --2- 172.21.15.69:0/2785332751 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dce51460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.533+0000 7f47b77d8740 1 --2- 172.21.15.69:0/2785332751 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dcd9d130 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.533+0000 7f47b77d8740 1 --2- 172.21.15.69:0/2785332751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcd72f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.533+0000 7f47b77d8740 1 -- 172.21.15.69:0/2785332751 >> 172.21.15.69:0/2785332751 conn(0x55d5dcdb3390 msgr2=0x55d5dcd724d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.533+0000 7f47b77d8740 1 -- 172.21.15.69:0/2785332751 shutdown_connections 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.533+0000 7f47b77d8740 1 -- 172.21.15.69:0/2785332751 wait complete. 2024-02-21T07:45:24.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.534+0000 7f47b77d8740 1 -- start start 2024-02-21T07:45:24.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.534+0000 7f47b77d8740 1 Processor -- start 2024-02-21T07:45:24.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.535+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.535+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dce50600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.535+0000 7f47b77d8740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dcde5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.535+0000 7f47b77d8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dce5b240 con 0x55d5dcdb3cb0 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.535+0000 7f47b77d8740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dcdf4b20 con 0x55d5dcdedc70 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.535+0000 7f47b77d8740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5dcda0880 con 0x55d5dcde4ff0 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.535+0000 7f47b77d8740 10 client.0 _ll_register_callbacks cb 0x7f47a00b5960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47ade00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dce50600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47a7e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dce50600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53770/0 (socket says 172.21.15.69:53770) 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47a7e00640 1 -- 172.21.15.69:0/346300526 learned_addr learned my addr 172.21.15.69:0/346300526 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47ae800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dcde5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47a7e00640 1 -- 172.21.15.69:0/346300526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 msgr2=0x55d5dcde5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47a7e00640 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dcde5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47a7e00640 1 -- 172.21.15.69:0/346300526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 msgr2=0x55d5dcdfadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47a7e00640 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47a7e00640 1 -- 172.21.15.69:0/346300526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47980016d0 con 0x55d5dcde4ff0 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47ae800640 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dcde5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47ade00640 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f47a7e00640 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dce50600 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f47b00f4010 tx=0x7f479801ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c7f96c2070738f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.536+0000 7f4792a00640 10 client.0 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f4792a00640 1 -- 172.21.15.69:0/346300526 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479801cb00 con 0x55d5dcde4ff0 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f4792a00640 1 -- 172.21.15.69:0/346300526 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f479801cc60 con 0x55d5dcde4ff0 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f47b77d8740 1 -- 172.21.15.69:0/346300526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47a0003d90 con 0x55d5dcde4ff0 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f4792a00640 1 -- 172.21.15.69:0/346300526 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f479801ce60 con 0x55d5dcde4ff0 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f47b77d8740 10 client.5981 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f47b77d8740 1 -- 172.21.15.69:0/346300526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55d5dcc9b650 con 0x55d5dcde4ff0 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f4792a00640 1 -- 172.21.15.69:0/346300526 <== mon.2 v2:172.21.15.184:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a0003d90 con 0x55d5dcde4ff0 2024-02-21T07:45:24.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f4792a00640 1 -- 172.21.15.69:0/346300526 <== mon.2 v2:172.21.15.184:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f4798012040 con 0x55d5dcde4ff0 2024-02-21T07:45:24.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f47b77d8740 10 client.5981 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:24.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f47b77d8740 10 client.5981 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.d 2024-02-21T07:45:24.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f47b77d8740 20 client.5981 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:24.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f47b77d8740 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d5dcd9c5b0 0x55d5dcd9fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f47b77d8740 4 client.5981 mds_command: new command op to 4360 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:45:24.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.537+0000 7f47b77d8740 1 -- 172.21.15.69:0/346300526 --> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d5dca66890 con 0x55d5dcd9c5b0 2024-02-21T07:45:24.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.538+0000 7f47ade00640 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d5dcd9c5b0 0x55d5dcd9fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.538+0000 7f47ade00640 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d5dcd9c5b0 0x55d5dcd9fc60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d04ad163feca190d server_cookie=43f1c4a25b83091e in_seq=0 out_seq=0 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.538+0000 7f4792a00640 10 client.5981 ms_handle_connect on v2:172.21.15.69:6832/3664160916 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f4792a00640 1 -- 172.21.15.69:0/346300526 <== mds.3 v2:172.21.15.69:6832/3664160916 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+36098 (crc 0 0 0) 0x55d5dca66890 con 0x55d5dcd9c5b0 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f4792a00640 10 client.5981 handle_command_reply: tid=0 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f47b77d8740 1 client.5981 shutdown 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f47b77d8740 1 -- 172.21.15.69:0/346300526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 msgr2=0x55d5dce50600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f47b77d8740 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dce50600 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f47b00f4010 tx=0x7f479801ca90 comp rx=0 tx=0).stop 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f47b77d8740 1 -- 172.21.15.69:0/346300526 shutdown_connections 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f47b77d8740 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.69:6832/3664160916,v1:172.21.15.69:6833/3664160916] conn(0x55d5dcd9c5b0 0x55d5dcd9fc60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f47b77d8740 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55d5dcdedc70 0x55d5dcde5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f47b77d8740 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55d5dcde4ff0 0x55d5dce50600 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f47b77d8740 1 --2- 172.21.15.69:0/346300526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5dcdb3cb0 0x55d5dcdfadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f4792a00640 0 client.5981 ms_handle_reset on v2:172.21.15.69:6832/3664160916 2024-02-21T07:45:24.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.539+0000 7f47b77d8740 1 -- 172.21.15.69:0/346300526 >> 172.21.15.69:0/346300526 conn(0x55d5dcdb3390 msgr2=0x55d5dcded0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b77d8740 1 -- 172.21.15.69:0/346300526 shutdown_connections 2024-02-21T07:45:24.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b77d8740 1 -- 172.21.15.69:0/346300526 wait complete. 2024-02-21T07:45:24.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b77d8740 20 client.5981 trim_cache size 0 max 16384 2024-02-21T07:45:24.549 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2024-02-21T07:45:24.549 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 69231526, 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638927, 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/ashldi3.S" 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 78314067, 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639177, 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon/alpine-db.dts" 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 82185073, 2024-02-21T07:45:24.550 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638922, 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/initrd.S" 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 97984042, 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639221, 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2m.dtsi" 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 197122323, 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638934, 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt.c" 2024-02-21T07:45:24.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 226417844, 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639207, 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pba8.dts" 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 249448892, 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638924, 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed" 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.552 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 291221242, 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639218, 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/versatile-ab.dts" 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 312761067, 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639260, 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-inspur-fp5280g2.dts" 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 353311600, 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639206, 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pb11mp.dts" 2024-02-21T07:45:24.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 388395603, 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639198, 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-a9mp-bbrevd.dts" 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 402249297, 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639238, 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-asrock-romed8hm3.dts" 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.554 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 408128786, 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639237, 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-asrock-e3c246d4i.dts" 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 431684528, 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638940, 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head-sa1100.S" 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 437576810, 2024-02-21T07:45:24.555 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638939, 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/font.c" 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 454370785, 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639241, 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-bletchley.dts" 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 458988190, 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638961, 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-labrador-base-m.dts" 2024-02-21T07:45:24.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 506229407, 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639201, 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-bbrevd.dtsi" 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 535975702, 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639230, 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-ast2600-evb-a1.dts" 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.557 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 552242686, 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638956, 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions" 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 555582568, 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639175, 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon" 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 582034362, 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639202, 2024-02-21T07:45:24.558 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-mp.dtsi" 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 696611832, 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639182, 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson6-atv1200.dts" 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 706773161, 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638960, 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-guitar.dtsi" 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.559 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 723594147, 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638928, 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/atags_to_fdt.c" 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 757749660, 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638920, 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/bootp.lds" 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.560 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 770088332, 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639244, 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-elbert.dts" 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 815067501, 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639252, 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-wedge400.dts" 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 838824294, 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639234, 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ampere-mtjade.dts" 2024-02-21T07:45:24.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 859972125, 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639245, 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-fuji.dts" 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 877751893, 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639203, 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb.dts" 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.562 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 899751112, 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639186, 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b-ec100.dts" 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 919065281, 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638963, 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-roseapplepi.dts" 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 928927234, 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639246, 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-galaxy100.dts" 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.563 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 936201585, 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639189, 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b.dtsi" 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 985824581, 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638947, 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/misc-ep93xx.h" 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1053006290, 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638958, 2024-02-21T07:45:24.564 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-cubieboard6.dts" 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1071203032, 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638970, 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/allwinner" 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1097915021, 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638964, 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-sparky.dts" 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.565 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1118540226, 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639193, 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/Makefile" 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1132151966, 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639199, 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-a9mp.dts" 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1132673610, 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639233, 2024-02-21T07:45:24.566 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-amd-ethanolx.dts" 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1136721589, 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639225, 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca9.dts" 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1167935146, 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638951, 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/string.c" 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.567 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1195766014, 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639205, 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pb1176.dts" 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1215945755, 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638955, 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/Makefile" 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1287687624, 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638969, 2024-02-21T07:45:24.568 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha/en7523.dtsi" 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1313317579, 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639180, 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/Makefile" 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1374349471, 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638918, 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp" 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.569 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1436432111, 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638938, 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_wip.c" 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1440285141, 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638941, 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head-sharpsl.S" 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1460194008, 2024-02-21T07:45:24.570 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638926, 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/Makefile" 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1461006802, 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639224, 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca5s.dts" 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1465890344, 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638954, 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts" 2024-02-21T07:45:24.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1471714013, 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639213, 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integratorcp.dts" 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1572681122, 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639204, 2024-02-21T07:45:24.572 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb.dtsi" 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1591841320, 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638937, 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_rw.c" 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1594205374, 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639197, 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp.dts" 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.573 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1659485309, 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638925, 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/.gitignore" 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1728046995, 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639208, 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pbx-a9.dts" 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1783048893, 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638949, 2024-02-21T07:45:24.574 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/misc.h" 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1799263163, 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639248, 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-minipack.dts" 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1805890192, 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639192, 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm" 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.575 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1830391451, 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638923, 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/kernel.S" 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1858417762, 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639240, 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-delta-ahe50dc.dts" 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1877214470, 2024-02-21T07:45:24.576 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638933, 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/efi-header.S" 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1877990370, 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638959, 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-guitar-bb-rev-b.dts" 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1885163760, 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638942, 2024-02-21T07:45:24.577 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head-xscale.S" 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1886702318, 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639188, 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b-odroidc1.dts" 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1888347441, 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639215, 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/mps2-an399.dts" 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.578 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1949178378, 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638931, 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/debug.S" 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1949186250, 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639210, 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integrator.dtsi" 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1974682983, 2024-02-21T07:45:24.579 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639229, 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-ast2500-evb.dts" 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1988231527, 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639181, 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson.dtsi" 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2012206959, 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639212, 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integratorap.dts" 2024-02-21T07:45:24.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2020913847, 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639258, 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-rainier-4u.dts" 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2062578731, 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638967, 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha/Makefile" 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.581 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2071000019, 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639235, 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ampere-mtmitchell.dts" 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2107173078, 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638929, 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/big-endian.S" 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2128425889, 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639249, 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-tiogapass.dts" 2024-02-21T07:45:24.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2129899709, 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638919, 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/Makefile" 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2175589412, 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639211, 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integratorap-im-pd1.dts" 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.583 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2176348868, 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638945, 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/lib1funcs.S" 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2220587278, 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639250, 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-wedge100.dts" 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2234218690, 2024-02-21T07:45:24.584 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639236, 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-arm-stardragon4800-rep2.dts" 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2247310074, 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638944, 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/hyp-stub.S" 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2359480854, 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639259, 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-rainier.dts" 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.585 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2372724236, 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639190, 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8m2-mxiii-plus.dts" 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2402154800, 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639253, 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-yamp.dts" 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2403120497, 2024-02-21T07:45:24.586 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639173, 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale/alphascale-asm9260-devkit.dts" 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2404238055, 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638916, 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/.gitignore" 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2405792650, 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638935, 2024-02-21T07:45:24.587 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_check_mem_start.c" 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2479588027, 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639226, 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/armv7-m.dtsi" 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2510046555, 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639231, 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-ast2600-evb.dts" 2024-02-21T07:45:24.588 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2523641325, 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638948, 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/misc.c" 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2549929906, 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639227, 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed" 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.589 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2604782334, 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639171, 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale" 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2658122960, 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639228, 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/Makefile" 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2662578913, 2024-02-21T07:45:24.590 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639216, 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/mps2.dtsi" 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2671791454, 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639256, 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-everest.dts" 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2676430584, 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638921, 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/init.S" 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.591 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2680796021, 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639209, 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pbx.dtsi" 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2715834172, 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639239, 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-bytedance-g220a.dts" 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.592 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2745378445, 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639172, 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale/Makefile" 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2810269363, 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639232, 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-amd-daytonax.dts" 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2832136362, 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639261, 2024-02-21T07:45:24.593 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-inspur-nf5280m6.dts" 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2853444451, 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639196, 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp-ctrevb.dts" 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2913117693, 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638936, 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_ro.c" 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.594 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2950493860, 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639194, 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp-bbrevd-ctrevb.dts" 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2951016276, 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638966, 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha" 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2977413301, 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639242, 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-cloudripper.dts" 2024-02-21T07:45:24.595 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3028204206, 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638965, 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500.dtsi" 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3090735532, 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638943, 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head.S" 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.596 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3110483417, 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638962, 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-labrador-v2.dtsi" 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3139697536, 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638930, 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/bswapsdi2.S" 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3210609648, 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639223, 2024-02-21T07:45:24.597 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca15_a7.dts" 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3225627103, 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639255, 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-bonnell.dts" 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3241900798, 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639185, 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8.dtsi" 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.598 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3292990485, 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639184, 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8-minix-neo-x8.dts" 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3294885772, 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639174, 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale/alphascale-asm9260.dtsi" 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3301688191, 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639214, 2024-02-21T07:45:24.599 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/mps2-an385.dts" 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3395418473, 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639219, 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/versatile-pb.dts" 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3422691358, 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639257, 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-rainier-1s4u.dts" 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.600 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3441848882, 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639191, 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8m2.dtsi" 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3451699293, 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639178, 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon/alpine.dtsi" 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.601 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3467651647, 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638968, 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha/en7523-evb.dts" 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3471741455, 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639179, 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic" 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3478197610, 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639176, 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon/Makefile" 2024-02-21T07:45:24.602 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3525573019, 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638953, 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/deflate_xip_data.sh" 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3567577736, 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639222, 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca15-tc1.dts" 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.603 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3597539577, 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639200, 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-bbrevd.dts" 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3598581997, 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639183, 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson6.dtsi" 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3614608134, 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639195, 2024-02-21T07:45:24.604 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp-bbrevd.dts" 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3757813228, 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639217, 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/versatile-ab-ib2.dts" 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3815360501, 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639187, 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b-mxq.dts" 2024-02-21T07:45:24.605 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3908787923, 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638950, 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/piggy.S" 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3909507320, 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638946, 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/ll_char_wr.S" 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.606 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3933409022, 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639254, 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-yosemitev2.dts" 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3941839637, 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638957, 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/Makefile" 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3997927989, 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638952, 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/vmlinux.lds.S" 2024-02-21T07:45:24.607 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4027075258, 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639243, 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-cmm.dts" 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4192113818, 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639220, 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2m-rs1.dtsi" 2024-02-21T07:45:24.608 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4238752732, 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638917, 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/Makefile" 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4241744871, 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511638932, 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/decompress.c" 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.609 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4275620465, 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639247, 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-greatlakes.dts" 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4293479804, 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511639251, 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-wedge40.dts" 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-02-21T07:45:24.610 INFO:teuthology.orchestra.run.smithi069.stdout:] 2024-02-21T07:45:24.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b4c00640 1 -- 172.21.15.69:0/3607865988 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f478c09f0a0 msgr2=0x7f478c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b4c00640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f478c09f0a0 0x7f478c0a1560 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f47a8001560 tx=0x7f47a8001970 comp rx=0 tx=0).stop 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b4c00640 1 -- 172.21.15.69:0/3607865988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b00eed50 msgr2=0x7f47b021c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b4c00640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b00eed50 0x7f47b021c720 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f47a00098c0 tx=0x7f47a00046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b4c00640 1 -- 172.21.15.69:0/3607865988 shutdown_connections 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b4c00640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f478c09f0a0 0x7f478c0a1560 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b4c00640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f47b016e9e0 0x7f47b0179510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b4c00640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f47b0183ea0 0x7f47b016e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b4c00640 1 --2- 172.21.15.69:0/3607865988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b00eed50 0x7f47b021c720 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.540+0000 7f47b4c00640 1 -- 172.21.15.69:0/3607865988 >> 172.21.15.69:0/3607865988 conn(0x7f47b00ce3d0 msgr2=0x7f47b00ee590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.541+0000 7f47b4c00640 1 -- 172.21.15.69:0/3607865988 shutdown_connections 2024-02-21T07:45:24.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.541+0000 7f47b4c00640 1 -- 172.21.15.69:0/3607865988 wait complete. 2024-02-21T07:45:24.613 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:45:24.613 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T07:45:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.823+0000 7fa3dfa00640 1 Processor -- start 2024-02-21T07:45:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.823+0000 7fa3dfa00640 1 -- start start 2024-02-21T07:45:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.825+0000 7fa3dfa00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d8184c50 con 0x7fa3d817f700 2024-02-21T07:45:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.825+0000 7fa3dfa00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d8183af0 con 0x7fa3d8183670 2024-02-21T07:45:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.825+0000 7fa3dfa00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d8183d60 con 0x7fa3d81863d0 2024-02-21T07:45:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3dd000640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa3d817f700 0x7fa3d80cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60758/0 (socket says 172.21.15.69:60758) 2024-02-21T07:45:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3dd000640 1 -- 172.21.15.69:0/135804233 learned_addr learned my addr 172.21.15.69:0/135804233 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243725718 0 0) 0x7fa3d8184c50 con 0x7fa3d817f700 2024-02-21T07:45:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3bc005730 con 0x7fa3d817f700 2024-02-21T07:45:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726702454 0 0) 0x7fa3d8183d60 con 0x7fa3d81863d0 2024-02-21T07:45:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d8184c50 con 0x7fa3d81863d0 2024-02-21T07:45:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82000952 0 0) 0x7fa3d8183af0 con 0x7fa3d8183670 2024-02-21T07:45:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d8183d60 con 0x7fa3d8183670 2024-02-21T07:45:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 945691511 0 0) 0x7fa3bc005730 con 0x7fa3d817f700 2024-02-21T07:45:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 >> v1:172.21.15.184:6789/0 conn(0x7fa3d81863d0 legacy=0x7fa3d80f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 >> v1:172.21.15.174:6789/0 conn(0x7fa3d8183670 legacy=0x7fa3d8185cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8184040 con 0x7fa3d817f700 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.826+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7fa3c8001670 con 0x7fa3d817f700 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 >> v1:172.21.15.69:6789/0 conn(0x7fa3d817f700 legacy=0x7fa3d80cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3d7400640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3bc007360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3d7400640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3bc005a30 0x7fa3bc005eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3d7400640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3bc00bb80 0x7fa3bc00df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc00e500 con 0x7fa3bc006f80 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc00e670 con 0x7fa3bc00bb80 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc00e830 con 0x7fa3bc005a30 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3dd000640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3bc007360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3dda00640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3bc00bb80 0x7fa3bc00df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3d7e00640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3bc005a30 0x7fa3bc005eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3dd000640 1 -- 172.21.15.69:0/135804233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3bc005a30 msgr2=0x7fa3bc005eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3dd000640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3bc005a30 0x7fa3bc005eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3dd000640 1 -- 172.21.15.69:0/135804233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3bc00bb80 msgr2=0x7fa3bc00df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3dd000640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3bc00bb80 0x7fa3bc00df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.827+0000 7fa3dd000640 1 -- 172.21.15.69:0/135804233 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc005730 con 0x7fa3bc006f80 2024-02-21T07:45:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.828+0000 7fa3dda00640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3bc00bb80 0x7fa3bc00df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.828+0000 7fa3dda00640 1 -- 172.21.15.69:0/135804233 reap_dead start 2024-02-21T07:45:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.829+0000 7fa3dd000640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3bc007360 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c160 tx=0x7fa3bc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49855be7fe959b13 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.829+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8005ad0 con 0x7fa3bc006f80 2024-02-21T07:45:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.829+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c8005c50 con 0x7fa3bc006f80 2024-02-21T07:45:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.829+0000 7fa3d7400640 1 -- 172.21.15.69:0/135804233 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c802c830 con 0x7fa3bc006f80 2024-02-21T07:45:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.829+0000 7fa3dfa00640 1 -- 172.21.15.69:0/135804233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 msgr2=0x7fa3bc007360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.829+0000 7fa3dfa00640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3bc007360 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c160 tx=0x7fa3bc007a00 comp rx=0 tx=0).stop 2024-02-21T07:45:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.829+0000 7fa3dfa00640 1 -- 172.21.15.69:0/135804233 shutdown_connections 2024-02-21T07:45:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.829+0000 7fa3dfa00640 1 --2- 172.21.15.69:0/135804233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3bc007360 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.829+0000 7fa3dfa00640 1 -- 172.21.15.69:0/135804233 >> 172.21.15.69:0/135804233 conn(0x7fa3d80ce3d0 msgr2=0x7fa3d80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.830+0000 7fa3dfa00640 1 -- 172.21.15.69:0/135804233 shutdown_connections 2024-02-21T07:45:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.830+0000 7fa3dfa00640 1 -- 172.21.15.69:0/135804233 wait complete. 2024-02-21T07:45:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.832+0000 7fa3dfa00640 1 Processor -- start 2024-02-21T07:45:24.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.832+0000 7fa3dfa00640 1 -- start start 2024-02-21T07:45:24.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3dfa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3d81868a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3dfa00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3d821e0c0 0x7fa3d8188360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3dfa00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3d80f4ed0 0x7fa3d816fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3dfa00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8187e60 con 0x7fa3bc006f80 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3dfa00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d821e540 con 0x7fa3d80f4ed0 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3dfa00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8186f00 con 0x7fa3d821e0c0 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3dd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3d81868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3dd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3d81868a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43458/0 (socket says 172.21.15.69:43458) 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3dd000640 1 -- 172.21.15.69:0/2101858377 learned_addr learned my addr 172.21.15.69:0/2101858377 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3d7e00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3d821e0c0 0x7fa3d8188360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.833+0000 7fa3dda00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3d80f4ed0 0x7fa3d816fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3dd000640 1 -- 172.21.15.69:0/2101858377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3d821e0c0 msgr2=0x7fa3d8188360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3dd000640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3d821e0c0 0x7fa3d8188360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3dd000640 1 -- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3d80f4ed0 msgr2=0x7fa3d816fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3dd000640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3d80f4ed0 0x7fa3d816fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3dd000640 1 -- 172.21.15.69:0/2101858377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d81871e0 con 0x7fa3bc006f80 2024-02-21T07:45:24.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3dda00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3d80f4ed0 0x7fa3d816fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:24.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3dd000640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3d81868a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c160 tx=0x7fa3c80019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3d4c00640 1 -- 172.21.15.69:0/2101858377 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c803c040 con 0x7fa3bc006f80 2024-02-21T07:45:24.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3d4c00640 1 -- 172.21.15.69:0/2101858377 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c802ca30 con 0x7fa3bc006f80 2024-02-21T07:45:24.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3d4c00640 1 -- 172.21.15.69:0/2101858377 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c802cde0 con 0x7fa3bc006f80 2024-02-21T07:45:24.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.834+0000 7fa3dfa00640 1 -- 172.21.15.69:0/2101858377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d81874c0 con 0x7fa3bc006f80 2024-02-21T07:45:24.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.835+0000 7fa3dfa00640 1 -- 172.21.15.69:0/2101858377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d8187a80 con 0x7fa3bc006f80 2024-02-21T07:45:24.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.838+0000 7fa3d4c00640 1 -- 172.21.15.69:0/2101858377 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fa3c8032070 con 0x7fa3bc006f80 2024-02-21T07:45:24.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.839+0000 7fa3e2603740 1 Processor -- start 2024-02-21T07:45:24.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.839+0000 7fa3e2603740 1 -- start start 2024-02-21T07:45:24.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.839+0000 7fa3d4c00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3b409f0a0 0x7fa3b40a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.839+0000 7fa3d4c00640 1 -- 172.21.15.69:0/2101858377 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa3c80eaf80 con 0x7fa3bc006f80 2024-02-21T07:45:24.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.839+0000 7fa3dda00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3b409f0a0 0x7fa3b40a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3dda00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3b409f0a0 0x7fa3b40a1560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa3d808d7f0 tx=0x7fa3d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc45ec0 0x56328fc462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 0x56328fc81050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc81590 0x56328fc82320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3e2603740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fb79210 con 0x56328fc81590 2024-02-21T07:45:24.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3e2603740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fb76740 con 0x56328fc45ec0 2024-02-21T07:45:24.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3e2603740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fb71f20 con 0x56328fc467e0 2024-02-21T07:45:24.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3dd000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc45ec0 0x56328fc462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3dd000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc45ec0 0x56328fc462a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38270/0 (socket says 172.21.15.69:38270) 2024-02-21T07:45:24.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3dd000640 1 -- 172.21.15.69:0/339017703 learned_addr learned my addr 172.21.15.69:0/339017703 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3dda00640 1 --2- 172.21.15.69:0/339017703 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc81590 0x56328fc82320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.840+0000 7fa3d7e00640 1 --2- 172.21.15.69:0/339017703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 0x56328fc81050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.841+0000 7fa3dd000640 1 -- 172.21.15.69:0/339017703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 msgr2=0x56328fc81050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.841+0000 7fa3dd000640 1 --2- 172.21.15.69:0/339017703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 0x56328fc81050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.841+0000 7fa3dd000640 1 -- 172.21.15.69:0/339017703 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc81590 msgr2=0x56328fc82320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.841+0000 7fa3dd000640 1 --2- 172.21.15.69:0/339017703 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc81590 0x56328fc82320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.841+0000 7fa3dd000640 1 -- 172.21.15.69:0/339017703 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56328fb33df0 con 0x56328fc45ec0 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.841+0000 7fa3dd000640 1 --2- 172.21.15.69:0/339017703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc45ec0 0x56328fc462a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80b4f70 tx=0x7fa3c80b4ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6d64c4b22ffcb20 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.841+0000 7fa3cd600640 1 -- 172.21.15.69:0/339017703 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80c1200 con 0x56328fc45ec0 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.841+0000 7fa3cd600640 1 -- 172.21.15.69:0/339017703 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c80b6e10 con 0x56328fc45ec0 2024-02-21T07:45:24.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.841+0000 7fa3cd600640 1 -- 172.21.15.69:0/339017703 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80b5180 con 0x56328fc45ec0 2024-02-21T07:45:24.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.842+0000 7fa3e2603740 1 -- 172.21.15.69:0/339017703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc45ec0 msgr2=0x56328fc462a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.842+0000 7fa3e2603740 1 --2- 172.21.15.69:0/339017703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc45ec0 0x56328fc462a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80b4f70 tx=0x7fa3c80b4ee0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.842+0000 7fa3e2603740 1 -- 172.21.15.69:0/339017703 shutdown_connections 2024-02-21T07:45:24.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.842+0000 7fa3e2603740 1 --2- 172.21.15.69:0/339017703 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc81590 0x56328fc82320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.842+0000 7fa3e2603740 1 --2- 172.21.15.69:0/339017703 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 0x56328fc81050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.842+0000 7fa3e2603740 1 --2- 172.21.15.69:0/339017703 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc45ec0 0x56328fc462a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.842+0000 7fa3e2603740 1 -- 172.21.15.69:0/339017703 >> 172.21.15.69:0/339017703 conn(0x56328fc08490 msgr2=0x56328fc09510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.842+0000 7fa3e2603740 1 -- 172.21.15.69:0/339017703 shutdown_connections 2024-02-21T07:45:24.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.842+0000 7fa3e2603740 1 -- 172.21.15.69:0/339017703 wait complete. 2024-02-21T07:45:24.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.843+0000 7fa3e2603740 1 -- start start 2024-02-21T07:45:24.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.843+0000 7fa3e2603740 1 Processor -- start 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 0x56328fc3e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc81590 0x56328fc4ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc09540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3e2603740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fb17150 con 0x56328fc3c670 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3e2603740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fb16df0 con 0x56328fc81590 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3e2603740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328f8e01c0 con 0x56328fc467e0 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3e2603740 10 client.0 _ll_register_callbacks cb 0x56328fb662b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3dda00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc09540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3dd000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 0x56328fc3e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3d7e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc81590 0x56328fc4ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3dda00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc09540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43490/0 (socket says 172.21.15.69:43490) 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3dda00640 1 -- 172.21.15.69:0/4042135243 learned_addr learned my addr 172.21.15.69:0/4042135243 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3dda00640 1 -- 172.21.15.69:0/4042135243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 msgr2=0x56328fc3e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3dda00640 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 0x56328fc3e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3dda00640 1 -- 172.21.15.69:0/4042135243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc81590 msgr2=0x56328fc4ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3dda00640 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc81590 0x56328fc4ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3dda00640 1 -- 172.21.15.69:0/4042135243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d8187a80 con 0x56328fc3c670 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.845+0000 7fa3dd000640 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 0x56328fc3e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.846+0000 7fa3dda00640 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc09540 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa3d808d2e0 tx=0x7fa3d0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502160b03e215baa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.846+0000 7fa3c6000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.846+0000 7fa3c6000640 1 -- 172.21.15.69:0/4042135243 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0014950 con 0x56328fc3c670 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.846+0000 7fa3c6000640 1 -- 172.21.15.69:0/4042135243 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa3d0014ab0 con 0x56328fc3c670 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.846+0000 7fa3e2603740 1 -- 172.21.15.69:0/4042135243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56328f8717e0 con 0x56328fc3c670 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.846+0000 7fa3c6000640 1 -- 172.21.15.69:0/4042135243 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3d0014cc0 con 0x56328fc3c670 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.846+0000 7fa3e2603740 10 client.5844 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:24.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.846+0000 7fa3e2603740 1 -- 172.21.15.69:0/4042135243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x56328fb705a0 con 0x56328fc3c670 2024-02-21T07:45:24.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.846+0000 7fa3c6000640 1 -- 172.21.15.69:0/4042135243 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56328f8717e0 con 0x56328fc3c670 2024-02-21T07:45:24.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.847+0000 7fa3c6000640 1 -- 172.21.15.69:0/4042135243 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fa3d0022070 con 0x56328fc3c670 2024-02-21T07:45:24.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.847+0000 7fa3e2603740 10 client.5844 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:24.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.847+0000 7fa3e2603740 10 client.5844 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.g 2024-02-21T07:45:24.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.847+0000 7fa3e2603740 20 client.5844 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:24.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.847+0000 7fa3e2603740 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x56328fc4d1c0 0x56328fc8dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.847+0000 7fa3e2603740 4 client.5844 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:45:24.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.847+0000 7fa3e2603740 1 -- 172.21.15.69:0/4042135243 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56328f8ae720 con 0x56328fc4d1c0 2024-02-21T07:45:24.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.847+0000 7fa3dd000640 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x56328fc4d1c0 0x56328fc8dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.848+0000 7fa3dd000640 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x56328fc4d1c0 0x56328fc8dde0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c9d145126cd9ce5a server_cookie=a7d0efa86d0b3989 in_seq=0 out_seq=0 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.848+0000 7fa3c6000640 10 client.5844 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.848+0000 7fa3c6000640 1 -- 172.21.15.69:0/4042135243 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56328f8ae720 con 0x56328fc4d1c0 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.848+0000 7fa3c6000640 10 client.5844 handle_command_reply: tid=0 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.848+0000 7fa3e2603740 1 client.5844 shutdown 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.848+0000 7fa3e2603740 1 -- 172.21.15.69:0/4042135243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 msgr2=0x56328fc09540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.848+0000 7fa3e2603740 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc09540 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa3d808d2e0 tx=0x7fa3d0001630 comp rx=0 tx=0).stop 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.849+0000 7fa3e2603740 1 -- 172.21.15.69:0/4042135243 shutdown_connections 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.849+0000 7fa3e2603740 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x56328fc4d1c0 0x56328fc8dde0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.849+0000 7fa3e2603740 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc09540 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.849+0000 7fa3e2603740 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc81590 0x56328fc4ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.849+0000 7fa3e2603740 1 --2- 172.21.15.69:0/4042135243 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc467e0 0x56328fc3e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.849+0000 7fa3c6000640 0 client.5844 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.849+0000 7fa3e2603740 1 -- 172.21.15.69:0/4042135243 >> 172.21.15.69:0/4042135243 conn(0x56328fc45ec0 msgr2=0x56328fc4a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.849+0000 7fa3e2603740 1 -- 172.21.15.69:0/4042135243 shutdown_connections 2024-02-21T07:45:24.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.849+0000 7fa3e2603740 1 -- 172.21.15.69:0/4042135243 wait complete. 2024-02-21T07:45:24.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.849+0000 7fa3e2603740 20 client.5844 trim_cache size 0 max 16384 2024-02-21T07:45:24.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.862+0000 7fa3e2603740 1 Processor -- start 2024-02-21T07:45:24.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.862+0000 7fa3e2603740 1 -- start start 2024-02-21T07:45:24.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.863+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc4a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.863+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 0x56328fcd95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.863+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc81590 0x56328fcdf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.863+0000 7fa3e2603740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fc80670 con 0x56328fc3c670 2024-02-21T07:45:24.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.863+0000 7fa3e2603740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fc4ba00 con 0x56328fc467e0 2024-02-21T07:45:24.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.863+0000 7fa3e2603740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fc4a8c0 con 0x56328fc81590 2024-02-21T07:45:24.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.863+0000 7fa3dd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc4a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.863+0000 7fa3dd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc4a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43496/0 (socket says 172.21.15.69:43496) 2024-02-21T07:45:24.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.863+0000 7fa3dd000640 1 -- 172.21.15.69:0/3335533403 learned_addr learned my addr 172.21.15.69:0/3335533403 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.863+0000 7fa3d7e00640 1 --2- 172.21.15.69:0/3335533403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 0x56328fcd95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3dda00640 1 --2- 172.21.15.69:0/3335533403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc81590 0x56328fcdf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3dd000640 1 -- 172.21.15.69:0/3335533403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc81590 msgr2=0x56328fcdf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3dd000640 1 --2- 172.21.15.69:0/3335533403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc81590 0x56328fcdf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3dd000640 1 -- 172.21.15.69:0/3335533403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 msgr2=0x56328fcd95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3dd000640 1 --2- 172.21.15.69:0/3335533403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 0x56328fcd95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3dd000640 1 -- 172.21.15.69:0/3335533403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56328fb0cab0 con 0x56328fc3c670 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3d7e00640 1 --2- 172.21.15.69:0/3335533403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 0x56328fcd95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3dd000640 1 --2- 172.21.15.69:0/3335533403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc4a380 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa3c802c4a0 tx=0x7fa3c804d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de33c45ab89079c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3ccc00640 1 -- 172.21.15.69:0/3335533403 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80d60c0 con 0x56328fc3c670 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3ccc00640 1 -- 172.21.15.69:0/3335533403 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c8007c80 con 0x56328fc3c670 2024-02-21T07:45:24.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.864+0000 7fa3ccc00640 1 -- 172.21.15.69:0/3335533403 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80b7f60 con 0x56328fc3c670 2024-02-21T07:45:24.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.865+0000 7fa3e2603740 1 -- 172.21.15.69:0/3335533403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 msgr2=0x56328fc4a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.865+0000 7fa3e2603740 1 --2- 172.21.15.69:0/3335533403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc4a380 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa3c802c4a0 tx=0x7fa3c804d040 comp rx=0 tx=0).stop 2024-02-21T07:45:24.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.865+0000 7fa3e2603740 1 -- 172.21.15.69:0/3335533403 shutdown_connections 2024-02-21T07:45:24.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.865+0000 7fa3e2603740 1 --2- 172.21.15.69:0/3335533403 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc81590 0x56328fcdf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.865+0000 7fa3e2603740 1 --2- 172.21.15.69:0/3335533403 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 0x56328fcd95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.865+0000 7fa3e2603740 1 --2- 172.21.15.69:0/3335533403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc4a380 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.865+0000 7fa3e2603740 1 -- 172.21.15.69:0/3335533403 >> 172.21.15.69:0/3335533403 conn(0x56328fc45ec0 msgr2=0x56328fc094d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.865+0000 7fa3e2603740 1 -- 172.21.15.69:0/3335533403 shutdown_connections 2024-02-21T07:45:24.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.865+0000 7fa3e2603740 1 -- 172.21.15.69:0/3335533403 wait complete. 2024-02-21T07:45:24.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.866+0000 7fa3e2603740 1 -- start start 2024-02-21T07:45:24.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.866+0000 7fa3e2603740 1 Processor -- start 2024-02-21T07:45:24.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.867+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc3ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.867+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 0x56328fc3d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.867+0000 7fa3e2603740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc81590 0x56328fc48e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.867+0000 7fa3e2603740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fc3dfc0 con 0x56328fc3c670 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.867+0000 7fa3e2603740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fcd1a70 con 0x56328fc467e0 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.867+0000 7fa3e2603740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x56328fc392d0 con 0x56328fc81590 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.867+0000 7fa3e2603740 10 client.0 _ll_register_callbacks cb 0x7fa3c80b4e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.867+0000 7fa3dd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc3ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.867+0000 7fa3dd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc3ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43500/0 (socket says 172.21.15.69:43500) 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3dd000640 1 -- 172.21.15.69:0/713030670 learned_addr learned my addr 172.21.15.69:0/713030670 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3d7e00640 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 0x56328fc3d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3dda00640 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc81590 0x56328fc48e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3dd000640 1 -- 172.21.15.69:0/713030670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc81590 msgr2=0x56328fc48e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3dd000640 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc81590 0x56328fc48e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3dd000640 1 -- 172.21.15.69:0/713030670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 msgr2=0x56328fc3d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3dd000640 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 0x56328fc3d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3dd000640 1 -- 172.21.15.69:0/713030670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d8183d60 con 0x56328fc3c670 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3dd000640 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc3ca70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa3c802c4a0 tx=0x7fa3c8001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e4cb47a02bb08b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3c6000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3c6000640 1 -- 172.21.15.69:0/713030670 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80e6070 con 0x56328fc3c670 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3c6000640 1 -- 172.21.15.69:0/713030670 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fa3c80b5180 con 0x56328fc3c670 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.868+0000 7fa3e2603740 1 -- 172.21.15.69:0/713030670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3c80b6e10 con 0x56328fc3c670 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3c6000640 1 -- 172.21.15.69:0/713030670 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3c80b5340 con 0x56328fc3c670 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3e2603740 10 client.5850 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3e2603740 1 -- 172.21.15.69:0/713030670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x56328fb33df0 con 0x56328fc3c670 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3c6000640 1 -- 172.21.15.69:0/713030670 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c80b6e10 con 0x56328fc3c670 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3c6000640 1 -- 172.21.15.69:0/713030670 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fa3c80b7f60 con 0x56328fc3c670 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3e2603740 10 client.5850 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3e2603740 10 client.5850 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.g 2024-02-21T07:45:24.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3e2603740 20 client.5850 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3e2603740 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x56328fc3c270 0x56328fcd0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3e2603740 4 client.5850 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3e2603740 1 -- 172.21.15.69:0/713030670 --> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56328f8fd890 con 0x56328fc3c270 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.869+0000 7fa3d7e00640 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x56328fc3c270 0x56328fcd0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3d7e00640 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x56328fc3c270 0x56328fcd0dd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f498957ac89cf396 server_cookie=2440124dc3e39b62 in_seq=0 out_seq=0 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3c6000640 10 client.5850 ms_handle_connect on v2:172.21.15.69:6834/3538407092 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3c6000640 1 -- 172.21.15.69:0/713030670 <== mds.2 v2:172.21.15.69:6834/3538407092 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56328f8fd890 con 0x56328fc3c270 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3c6000640 10 client.5850 handle_command_reply: tid=0 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 client.5850 shutdown 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 -- 172.21.15.69:0/713030670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 msgr2=0x56328fc3ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc3ca70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa3c802c4a0 tx=0x7fa3c8001980 comp rx=0 tx=0).stop 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 -- 172.21.15.69:0/713030670 shutdown_connections 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.69:6834/3538407092,v1:172.21.15.69:6835/3538407092] conn(0x56328fc3c270 0x56328fcd0dd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x56328fc81590 0x56328fc48e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x56328fc467e0 0x56328fc3d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3c6000640 0 client.5850 ms_handle_reset on v2:172.21.15.69:6834/3538407092 2024-02-21T07:45:24.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 --2- 172.21.15.69:0/713030670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56328fc3c670 0x56328fc3ca70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 -- 172.21.15.69:0/713030670 >> 172.21.15.69:0/713030670 conn(0x56328fc45ec0 msgr2=0x56328fc06870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 -- 172.21.15.69:0/713030670 shutdown_connections 2024-02-21T07:45:24.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.870+0000 7fa3e2603740 1 -- 172.21.15.69:0/713030670 wait complete. 2024-02-21T07:45:24.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3e2603740 20 client.5850 trim_cache size 0 max 16384 2024-02-21T07:45:24.880 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:45:24.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 -- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3b409f0a0 msgr2=0x7fa3b40a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3b409f0a0 0x7fa3b40a1560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa3d808d7f0 tx=0x7fa3d0009040 comp rx=0 tx=0).stop 2024-02-21T07:45:24.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 -- 172.21.15.69:0/2101858377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 msgr2=0x7fa3d81868a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:24.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3d81868a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c160 tx=0x7fa3c80019f0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 -- 172.21.15.69:0/2101858377 shutdown_connections 2024-02-21T07:45:24.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fa3b409f0a0 0x7fa3b40a1560 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fa3d80f4ed0 0x7fa3d816fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa3d821e0c0 0x7fa3d8188360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 --2- 172.21.15.69:0/2101858377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa3bc006f80 0x7fa3d81868a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:24.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 -- 172.21.15.69:0/2101858377 >> 172.21.15.69:0/2101858377 conn(0x7fa3d80ce3d0 msgr2=0x7fa3d80cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:24.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 -- 172.21.15.69:0/2101858377 shutdown_connections 2024-02-21T07:45:24.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:24.871+0000 7fa3dfa00640 1 -- 172.21.15.69:0/2101858377 wait complete. 2024-02-21T07:45:24.894 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:45:24.894 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T07:45:25.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.096+0000 7f572d400640 1 Processor -- start 2024-02-21T07:45:25.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.096+0000 7f572d400640 1 -- start start 2024-02-21T07:45:25.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.098+0000 7f572d400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f57280ee640 0x7f57280eead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.099+0000 7f572d400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57280ef010 con 0x7f5728186bc0 2024-02-21T07:45:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.099+0000 7f572d400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5728187720 con 0x7f5728183ea0 2024-02-21T07:45:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.099+0000 7f572d400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5728186010 con 0x7f57280ee640 2024-02-21T07:45:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.099+0000 7f571de00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f57280ee640 0x7f57280eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.099+0000 7f5726800640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f5728183ea0 0x7f57281846e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:33278/0 (socket says 172.21.15.69:33278) 2024-02-21T07:45:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.099+0000 7f5726800640 1 -- 172.21.15.69:0/1622991956 learned_addr learned my addr 172.21.15.69:0/1622991956 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.099+0000 7f571de00640 1 -- 172.21.15.69:0/1622991956 >> v1:172.21.15.184:6789/0 conn(0x7f5728183ea0 legacy=0x7f57281846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.099+0000 7f571de00640 1 -- 172.21.15.69:0/1622991956 >> v1:172.21.15.174:6789/0 conn(0x7f5728186bc0 legacy=0x7f5728187010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.099+0000 7f571de00640 1 -- 172.21.15.69:0/1622991956 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728184df0 con 0x7f57280ee640 2024-02-21T07:45:25.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.100+0000 7f571de00640 1 --2- 172.21.15.69:0/1622991956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57280ee640 0x7f57280eead0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f57100097a0 tx=0x7f571002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de8093a69cbc97ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.101+0000 7f5725e00640 1 -- 172.21.15.69:0/1622991956 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710031830 con 0x7f57280ee640 2024-02-21T07:45:25.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.101+0000 7f5725e00640 1 -- 172.21.15.69:0/1622991956 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710031990 con 0x7f57280ee640 2024-02-21T07:45:25.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.101+0000 7f5725e00640 1 -- 172.21.15.69:0/1622991956 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5710031d20 con 0x7f57280ee640 2024-02-21T07:45:25.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.101+0000 7f572d400640 1 -- 172.21.15.69:0/1622991956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57280ee640 msgr2=0x7f57280eead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.101+0000 7f572d400640 1 --2- 172.21.15.69:0/1622991956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57280ee640 0x7f57280eead0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f57100097a0 tx=0x7f571002b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.101+0000 7f572d400640 1 -- 172.21.15.69:0/1622991956 shutdown_connections 2024-02-21T07:45:25.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.101+0000 7f572d400640 1 --2- 172.21.15.69:0/1622991956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57280ee640 0x7f57280eead0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.101+0000 7f572d400640 1 -- 172.21.15.69:0/1622991956 >> 172.21.15.69:0/1622991956 conn(0x7f57280ce3d0 msgr2=0x7f57280ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.101+0000 7f572d400640 1 -- 172.21.15.69:0/1622991956 shutdown_connections 2024-02-21T07:45:25.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.101+0000 7f572d400640 1 -- 172.21.15.69:0/1622991956 wait complete. 2024-02-21T07:45:25.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.103+0000 7f572d400640 1 Processor -- start 2024-02-21T07:45:25.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.104+0000 7f572d400640 1 -- start start 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f572d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57280ee640 0x7f57281694c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f572d400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5728183ea0 0x7f57280f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f572d400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5728186bc0 0x7f57280f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f572d400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57280ccc20 con 0x7f57280ee640 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f572d400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57280f8610 con 0x7f5728183ea0 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f572d400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57280f88f0 con 0x7f5728186bc0 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f5726800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57280ee640 0x7f57281694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f5726800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57280ee640 0x7f57281694c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43508/0 (socket says 172.21.15.69:43508) 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f5726800640 1 -- 172.21.15.69:0/166906443 learned_addr learned my addr 172.21.15.69:0/166906443 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f571de00640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5728183ea0 0x7f57280f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.105+0000 7f5727200640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5728186bc0 0x7f57280f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f5726800640 1 -- 172.21.15.69:0/166906443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5728186bc0 msgr2=0x7f57280f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f5726800640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5728186bc0 0x7f57280f8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f5726800640 1 -- 172.21.15.69:0/166906443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5728183ea0 msgr2=0x7f57280f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f5726800640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5728183ea0 0x7f57280f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f5726800640 1 -- 172.21.15.69:0/166906443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5710009400 con 0x7f57280ee640 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f5726800640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57280ee640 0x7f57281694c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f571800c480 tx=0x7f571800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f571f400640 1 -- 172.21.15.69:0/166906443 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718005ce0 con 0x7f57280ee640 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f571f400640 1 -- 172.21.15.69:0/166906443 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5718005e40 con 0x7f57280ee640 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f572d400640 1 -- 172.21.15.69:0/166906443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57280cbfa0 con 0x7f57280ee640 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f571f400640 1 -- 172.21.15.69:0/166906443 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57180072f0 con 0x7f57280ee640 2024-02-21T07:45:25.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.106+0000 7f572d400640 1 -- 172.21.15.69:0/166906443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57280cc560 con 0x7f57280ee640 2024-02-21T07:45:25.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.109+0000 7f571f400640 1 -- 172.21.15.69:0/166906443 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f5718007450 con 0x7f57280ee640 2024-02-21T07:45:25.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.111+0000 7f5730173740 1 Processor -- start 2024-02-21T07:45:25.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.111+0000 7f571f400640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f570409f0d0 0x7f57040a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.111+0000 7f5730173740 1 -- start start 2024-02-21T07:45:25.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.111+0000 7f571f400640 1 -- 172.21.15.69:0/166906443 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f57180c8f10 con 0x7f57280ee640 2024-02-21T07:45:25.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.111+0000 7f5727200640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f570409f0d0 0x7f57040a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f5727200640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f570409f0d0 0x7f57040a1590 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f57200012e0 tx=0x7f5720009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f5730173740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a287ec0 0x560e3a2882a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f5730173740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 0x560e3a2c3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f5730173740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 0x560e3a2c4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f5730173740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a1bb210 con 0x560e3a2887e0 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f5730173740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a1b8740 con 0x560e3a2c3590 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f5730173740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a1b3f20 con 0x560e3a287ec0 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f571de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 0x560e3a2c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f5727200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 0x560e3a2c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f571de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 0x560e3a2c3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43510/0 (socket says 172.21.15.69:43510) 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f571de00640 1 -- 172.21.15.69:0/3264131238 learned_addr learned my addr 172.21.15.69:0/3264131238 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.112+0000 7f5726800640 1 --2- 172.21.15.69:0/3264131238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a287ec0 0x560e3a2882a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.113+0000 7f5727200640 1 -- 172.21.15.69:0/3264131238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a287ec0 msgr2=0x560e3a2882a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.113+0000 7f5727200640 1 --2- 172.21.15.69:0/3264131238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a287ec0 0x560e3a2882a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.113+0000 7f5727200640 1 -- 172.21.15.69:0/3264131238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 msgr2=0x560e3a2c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.113+0000 7f5727200640 1 --2- 172.21.15.69:0/3264131238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 0x560e3a2c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.113+0000 7f5727200640 1 -- 172.21.15.69:0/3264131238 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e3a175df0 con 0x560e3a2c3590 2024-02-21T07:45:25.120 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.113+0000 7f571de00640 1 --2- 172.21.15.69:0/3264131238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 0x560e3a2c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:25.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.113+0000 7f5727200640 1 --2- 172.21.15.69:0/3264131238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 0x560e3a2c4320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f572000fad0 tx=0x7f5720012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cc5bf44820abd0f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.113+0000 7f5717000640 1 -- 172.21.15.69:0/3264131238 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720014ca0 con 0x560e3a2c3590 2024-02-21T07:45:25.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.113+0000 7f5717000640 1 -- 172.21.15.69:0/3264131238 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720014e00 con 0x560e3a2c3590 2024-02-21T07:45:25.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.113+0000 7f5717000640 1 -- 172.21.15.69:0/3264131238 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720020610 con 0x560e3a2c3590 2024-02-21T07:45:25.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.114+0000 7f5730173740 1 -- 172.21.15.69:0/3264131238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 msgr2=0x560e3a2c4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.114+0000 7f5730173740 1 --2- 172.21.15.69:0/3264131238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 0x560e3a2c4320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f572000fad0 tx=0x7f5720012000 comp rx=0 tx=0).stop 2024-02-21T07:45:25.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.114+0000 7f5730173740 1 -- 172.21.15.69:0/3264131238 shutdown_connections 2024-02-21T07:45:25.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.114+0000 7f5730173740 1 --2- 172.21.15.69:0/3264131238 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 0x560e3a2c4320 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.114+0000 7f5730173740 1 --2- 172.21.15.69:0/3264131238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 0x560e3a2c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.114+0000 7f5730173740 1 --2- 172.21.15.69:0/3264131238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a287ec0 0x560e3a2882a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.114+0000 7f5730173740 1 -- 172.21.15.69:0/3264131238 >> 172.21.15.69:0/3264131238 conn(0x560e3a24a490 msgr2=0x560e3a24b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.114+0000 7f5730173740 1 -- 172.21.15.69:0/3264131238 shutdown_connections 2024-02-21T07:45:25.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.114+0000 7f5730173740 1 -- 172.21.15.69:0/3264131238 wait complete. 2024-02-21T07:45:25.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.115+0000 7f5730173740 1 -- start start 2024-02-21T07:45:25.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.115+0000 7f5730173740 1 Processor -- start 2024-02-21T07:45:25.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f5730173740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2887e0 0x560e3a2cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f5730173740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a2d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f5730173740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 0x560e3a2487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f5730173740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a159150 con 0x560e3a2c3590 2024-02-21T07:45:25.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f5730173740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a158df0 con 0x560e3a2887e0 2024-02-21T07:45:25.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f5730173740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e39f221c0 con 0x560e3a2768b0 2024-02-21T07:45:25.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f5730173740 10 client.0 _ll_register_callbacks cb 0x560e3a1a82b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f571de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a2d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f571de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a2d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43512/0 (socket says 172.21.15.69:43512) 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f571de00640 1 -- 172.21.15.69:0/3144354456 learned_addr learned my addr 172.21.15.69:0/3144354456 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f5726800640 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2887e0 0x560e3a2cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f5727200640 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 0x560e3a2487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f571de00640 1 -- 172.21.15.69:0/3144354456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 msgr2=0x560e3a2487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f571de00640 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 0x560e3a2487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f571de00640 1 -- 172.21.15.69:0/3144354456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2887e0 msgr2=0x560e3a2cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f571de00640 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2887e0 0x560e3a2cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f571de00640 1 -- 172.21.15.69:0/3144354456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57280ef010 con 0x560e3a2c3590 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.117+0000 7f5726800640 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2887e0 0x560e3a2cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:25.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.118+0000 7f571de00640 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a2d0fc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5710031d30 tx=0x7f571002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962f99abc567d551 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.118+0000 7f570b400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.118+0000 7f570b400640 1 -- 172.21.15.69:0/3144354456 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571003f040 con 0x560e3a2c3590 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.118+0000 7f570b400640 1 -- 172.21.15.69:0/3144354456 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f571003a8f0 con 0x560e3a2c3590 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.118+0000 7f5730173740 1 -- 172.21.15.69:0/3144354456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e39eb37e0 con 0x560e3a2c3590 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.118+0000 7f570b400640 1 -- 172.21.15.69:0/3144354456 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f571003aab0 con 0x560e3a2c3590 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.118+0000 7f5730173740 10 client.5859 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.118+0000 7f5730173740 1 -- 172.21.15.69:0/3144354456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x560e3a1b25a0 con 0x560e3a2c3590 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.118+0000 7f570b400640 1 -- 172.21.15.69:0/3144354456 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710051020 con 0x560e3a2c3590 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.119+0000 7f570b400640 1 -- 172.21.15.69:0/3144354456 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f5710042030 con 0x560e3a2c3590 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.119+0000 7f5730173740 10 client.5859 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.119+0000 7f5730173740 10 client.5859 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.119+0000 7f5730173740 20 client.5859 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.119+0000 7f5730173740 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x560e3a248d10 0x560e3a28c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.119+0000 7f5730173740 4 client.5859 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:45:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.119+0000 7f5730173740 1 -- 172.21.15.69:0/3144354456 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e39ef0720 con 0x560e3a248d10 2024-02-21T07:45:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.119+0000 7f5726800640 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x560e3a248d10 0x560e3a28c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.120+0000 7f5726800640 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x560e3a248d10 0x560e3a28c380 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=177b6743ef83ff65 server_cookie=ff1817fd9141c139 in_seq=0 out_seq=0 2024-02-21T07:45:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.120+0000 7f570b400640 10 client.5859 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:45:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.120+0000 7f570b400640 1 -- 172.21.15.69:0/3144354456 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560e39ef0720 con 0x560e3a248d10 2024-02-21T07:45:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.120+0000 7f570b400640 10 client.5859 handle_command_reply: tid=0 2024-02-21T07:45:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.120+0000 7f5730173740 1 client.5859 shutdown 2024-02-21T07:45:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 1 -- 172.21.15.69:0/3144354456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 msgr2=0x560e3a2d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a2d0fc0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5710031d30 tx=0x7f571002e000 comp rx=0 tx=0).stop 2024-02-21T07:45:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 1 -- 172.21.15.69:0/3144354456 shutdown_connections 2024-02-21T07:45:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x560e3a248d10 0x560e3a28c380 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 0x560e3a2487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a2d0fc0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 1 --2- 172.21.15.69:0/3144354456 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2887e0 0x560e3a2cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f570b400640 0 client.5859 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:45:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 1 -- 172.21.15.69:0/3144354456 >> 172.21.15.69:0/3144354456 conn(0x560e3a287ec0 msgr2=0x560e3a24bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 1 -- 172.21.15.69:0/3144354456 shutdown_connections 2024-02-21T07:45:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 1 -- 172.21.15.69:0/3144354456 wait complete. 2024-02-21T07:45:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.121+0000 7f5730173740 20 client.5859 trim_cache size 0 max 16384 2024-02-21T07:45:25.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.134+0000 7f5730173740 1 Processor -- start 2024-02-21T07:45:25.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.134+0000 7f5730173740 1 -- start start 2024-02-21T07:45:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.135+0000 7f5730173740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2768b0 0x560e3a27d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.135+0000 7f5730173740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2887e0 0x560e3a2ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.135+0000 7f5730173740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a323260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.135+0000 7f5730173740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a249260 con 0x560e3a2c3590 2024-02-21T07:45:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.135+0000 7f5730173740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a2d8420 con 0x560e3a2768b0 2024-02-21T07:45:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.135+0000 7f5730173740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a2c3ce0 con 0x560e3a2887e0 2024-02-21T07:45:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f5727200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a323260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f5727200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a323260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43524/0 (socket says 172.21.15.69:43524) 2024-02-21T07:45:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f5727200640 1 -- 172.21.15.69:0/1142528250 learned_addr learned my addr 172.21.15.69:0/1142528250 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f571de00640 1 --2- 172.21.15.69:0/1142528250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2887e0 0x560e3a2ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f5726800640 1 --2- 172.21.15.69:0/1142528250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2768b0 0x560e3a27d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f5727200640 1 -- 172.21.15.69:0/1142528250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2887e0 msgr2=0x560e3a2ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f5727200640 1 --2- 172.21.15.69:0/1142528250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2887e0 0x560e3a2ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f5727200640 1 -- 172.21.15.69:0/1142528250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2768b0 msgr2=0x560e3a27d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f5727200640 1 --2- 172.21.15.69:0/1142528250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2768b0 0x560e3a27d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f5727200640 1 -- 172.21.15.69:0/1142528250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e3a14eab0 con 0x560e3a2c3590 2024-02-21T07:45:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f571de00640 1 --2- 172.21.15.69:0/1142528250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2887e0 0x560e3a2ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.136+0000 7f5727200640 1 --2- 172.21.15.69:0/1142528250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a323260 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5720014fd0 tx=0x7f5720015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911e81a68f2c0e07 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.137+0000 7f5716600640 1 -- 172.21.15.69:0/1142528250 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720020690 con 0x560e3a2c3590 2024-02-21T07:45:25.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.137+0000 7f5716600640 1 -- 172.21.15.69:0/1142528250 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57200207f0 con 0x560e3a2c3590 2024-02-21T07:45:25.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.137+0000 7f5716600640 1 -- 172.21.15.69:0/1142528250 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720020b60 con 0x560e3a2c3590 2024-02-21T07:45:25.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.137+0000 7f5730173740 1 -- 172.21.15.69:0/1142528250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 msgr2=0x560e3a323260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.137+0000 7f5730173740 1 --2- 172.21.15.69:0/1142528250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a323260 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5720014fd0 tx=0x7f5720015000 comp rx=0 tx=0).stop 2024-02-21T07:45:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.137+0000 7f5730173740 1 -- 172.21.15.69:0/1142528250 shutdown_connections 2024-02-21T07:45:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.137+0000 7f5730173740 1 --2- 172.21.15.69:0/1142528250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2c3590 0x560e3a323260 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.137+0000 7f5730173740 1 --2- 172.21.15.69:0/1142528250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2887e0 0x560e3a2ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.137+0000 7f5730173740 1 --2- 172.21.15.69:0/1142528250 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2768b0 0x560e3a27d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.137+0000 7f5730173740 1 -- 172.21.15.69:0/1142528250 >> 172.21.15.69:0/1142528250 conn(0x560e3a287ec0 msgr2=0x560e3a24b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.138+0000 7f5730173740 1 -- 172.21.15.69:0/1142528250 shutdown_connections 2024-02-21T07:45:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.138+0000 7f5730173740 1 -- 172.21.15.69:0/1142528250 wait complete. 2024-02-21T07:45:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.138+0000 7f5730173740 1 -- start start 2024-02-21T07:45:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.139+0000 7f5730173740 1 Processor -- start 2024-02-21T07:45:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5730173740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 0x560e3a26fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5730173740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 0x560e3a2bb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5730173740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 0x560e3a332fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5730173740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a2bba90 con 0x560e3a2887e0 2024-02-21T07:45:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5730173740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a2c1dc0 con 0x560e3a2c3590 2024-02-21T07:45:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5730173740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3a333510 con 0x560e3a2768b0 2024-02-21T07:45:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5730173740 10 client.0 _ll_register_callbacks cb 0x7f5720017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5726800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 0x560e3a26fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5726800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 0x560e3a26fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:53872/0 (socket says 172.21.15.69:53872) 2024-02-21T07:45:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5727200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 0x560e3a332fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5726800640 1 -- 172.21.15.69:0/3608096501 learned_addr learned my addr 172.21.15.69:0/3608096501 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f571de00640 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 0x560e3a2bb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5727200640 1 -- 172.21.15.69:0/3608096501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 msgr2=0x560e3a26fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.140+0000 7f5727200640 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 0x560e3a26fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.141+0000 7f5727200640 1 -- 172.21.15.69:0/3608096501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 msgr2=0x560e3a2bb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.141+0000 7f5727200640 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 0x560e3a2bb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.141+0000 7f5727200640 1 -- 172.21.15.69:0/3608096501 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e3a1b25a0 con 0x560e3a2c3590 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.141+0000 7f5726800640 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 0x560e3a26fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.141+0000 7f5727200640 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 0x560e3a332fd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x560e3a2493a0 tx=0x7f5720001250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c0282a56194d2b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.141+0000 7f570b400640 10 client.0 ms_handle_connect on v2:172.21.15.174:3300/0 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.141+0000 7f570b400640 1 -- 172.21.15.69:0/3608096501 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720034420 con 0x560e3a2c3590 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.141+0000 7f5730173740 1 -- 172.21.15.69:0/3608096501 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5720014e00 con 0x560e3a2c3590 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.141+0000 7f570b400640 1 -- 172.21.15.69:0/3608096501 <== mon.1 v2:172.21.15.174:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f572001c040 con 0x560e3a2c3590 2024-02-21T07:45:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f570b400640 1 -- 172.21.15.69:0/3608096501 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5720034580 con 0x560e3a2c3590 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f5730173740 10 client.6049 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f5730173740 1 -- 172.21.15.69:0/3608096501 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x560e3a175df0 con 0x560e3a2c3590 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f570b400640 1 -- 172.21.15.69:0/3608096501 <== mon.1 v2:172.21.15.174:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720049020 con 0x560e3a2c3590 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f570b400640 1 -- 172.21.15.69:0/3608096501 <== mon.1 v2:172.21.15.174:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f5720012070 con 0x560e3a2c3590 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f5730173740 10 client.6049 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f5730173740 10 client.6049 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.j 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f5730173740 20 client.6049 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f5730173740 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x560e3a2e1b10 0x560e3a250ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f5730173740 4 client.6049 mds_command: new command op to 4375 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f5730173740 1 -- 172.21.15.69:0/3608096501 --> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560e39f3f890 con 0x560e3a2e1b10 2024-02-21T07:45:25.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.142+0000 7f5726800640 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x560e3a2e1b10 0x560e3a250ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5726800640 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x560e3a2e1b10 0x560e3a250ed0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=663aa0be0d356207 server_cookie=26cf53e5cfdd5bf2 in_seq=0 out_seq=0 2024-02-21T07:45:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f570b400640 10 client.6049 ms_handle_connect on v2:172.21.15.69:6836/2966352085 2024-02-21T07:45:25.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f570b400640 1 -- 172.21.15.69:0/3608096501 <== mds.1 v2:172.21.15.69:6836/2966352085 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560e39f3f890 con 0x560e3a2e1b10 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f570b400640 10 client.6049 handle_command_reply: tid=0 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 client.6049 shutdown 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 -- 172.21.15.69:0/3608096501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 msgr2=0x560e3a332fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 0x560e3a332fd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x560e3a2493a0 tx=0x7f5720001250 comp rx=0 tx=0).stop 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 -- 172.21.15.69:0/3608096501 shutdown_connections 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x560e3a2c3590 0x560e3a332fd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e3a2887e0 0x560e3a2bb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.69:6836/2966352085,v1:172.21.15.69:6837/2966352085] conn(0x560e3a2e1b10 0x560e3a250ed0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 --2- 172.21.15.69:0/3608096501 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x560e3a2768b0 0x560e3a26fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f570b400640 0 client.6049 ms_handle_reset on v2:172.21.15.69:6836/2966352085 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 -- 172.21.15.69:0/3608096501 >> 172.21.15.69:0/3608096501 conn(0x560e3a287ec0 msgr2=0x560e3a242300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 -- 172.21.15.69:0/3608096501 shutdown_connections 2024-02-21T07:45:25.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.143+0000 7f5730173740 1 -- 172.21.15.69:0/3608096501 wait complete. 2024-02-21T07:45:25.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f5730173740 20 client.6049 trim_cache size 0 max 16384 2024-02-21T07:45:25.153 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 -- 172.21.15.69:0/166906443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f570409f0d0 msgr2=0x7f57040a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f570409f0d0 0x7f57040a1590 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f57200012e0 tx=0x7f5720009040 comp rx=0 tx=0).stop 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 -- 172.21.15.69:0/166906443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57280ee640 msgr2=0x7f57281694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57280ee640 0x7f57281694c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f571800c480 tx=0x7f571800c940 comp rx=0 tx=0).stop 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 -- 172.21.15.69:0/166906443 shutdown_connections 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f570409f0d0 0x7f57040a1590 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5728186bc0 0x7f57280f8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f5728183ea0 0x7f57280f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 --2- 172.21.15.69:0/166906443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57280ee640 0x7f57281694c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 -- 172.21.15.69:0/166906443 >> 172.21.15.69:0/166906443 conn(0x7f57280ce3d0 msgr2=0x7f5728186ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 -- 172.21.15.69:0/166906443 shutdown_connections 2024-02-21T07:45:25.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.144+0000 7f572d400640 1 -- 172.21.15.69:0/166906443 wait complete. 2024-02-21T07:45:25.169 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T07:45:25.169 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T07:45:25.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.363+0000 7fd1a5800640 1 Processor -- start 2024-02-21T07:45:25.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.363+0000 7fd1a5800640 1 -- start start 2024-02-21T07:45:25.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.365+0000 7fd1a5800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd1a017f700 0x7fd1a0183670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.365+0000 7fd1a5800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fd1a0185cc0 0x7fd1a0186130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.365+0000 7fd1a5800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a0184c50 con 0x7fd1a01850e0 2024-02-21T07:45:25.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.365+0000 7fd1a5800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a0185560 con 0x7fd1a017f700 2024-02-21T07:45:25.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.365+0000 7fd1a5800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a0186670 con 0x7fd1a0185cc0 2024-02-21T07:45:25.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.365+0000 7fd19ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd1a017f700 0x7fd1a0183670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.365+0000 7fd196000640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd1a01850e0 0x7fd1a00cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:33286/0 (socket says 172.21.15.69:33286) 2024-02-21T07:45:25.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.365+0000 7fd19ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd1a017f700 0x7fd1a0183670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43536/0 (socket says 172.21.15.69:43536) 2024-02-21T07:45:25.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.365+0000 7fd196000640 1 -- 172.21.15.69:0/2970694318 learned_addr learned my addr 172.21.15.69:0/2970694318 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:25.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.365+0000 7fd19f400640 1 --2- 172.21.15.69:0/2970694318 >> v2:172.21.15.174:3300/0 conn(0x7fd1a0185cc0 0x7fd1a0186130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.366+0000 7fd19e000640 1 -- 172.21.15.69:0/2970694318 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1573598198 0 0) 0x7fd1a0184c50 con 0x7fd1a01850e0 2024-02-21T07:45:25.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.366+0000 7fd19ea00640 1 -- 172.21.15.69:0/2970694318 >> v2:172.21.15.174:3300/0 conn(0x7fd1a0185cc0 msgr2=0x7fd1a0186130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.366+0000 7fd19ea00640 1 --2- 172.21.15.69:0/2970694318 >> v2:172.21.15.174:3300/0 conn(0x7fd1a0185cc0 0x7fd1a0186130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.366+0000 7fd19ea00640 1 -- 172.21.15.69:0/2970694318 >> v1:172.21.15.184:6789/0 conn(0x7fd1a01850e0 legacy=0x7fd1a00cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.366+0000 7fd19ea00640 1 -- 172.21.15.69:0/2970694318 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a0183d60 con 0x7fd1a017f700 2024-02-21T07:45:25.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.367+0000 7fd19ea00640 1 --2- 172.21.15.69:0/2970694318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a017f700 0x7fd1a0183670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd1a008d3c0 tx=0x7fd19002d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8785550e674ed6b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.367+0000 7fd19e000640 1 -- 172.21.15.69:0/2970694318 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190032880 con 0x7fd1a017f700 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.367+0000 7fd19e000640 1 -- 172.21.15.69:0/2970694318 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1900329e0 con 0x7fd1a017f700 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.367+0000 7fd19e000640 1 -- 172.21.15.69:0/2970694318 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190032d70 con 0x7fd1a017f700 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.368+0000 7fd1a5800640 1 -- 172.21.15.69:0/2970694318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a017f700 msgr2=0x7fd1a0183670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.368+0000 7fd1a5800640 1 --2- 172.21.15.69:0/2970694318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a017f700 0x7fd1a0183670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd1a008d3c0 tx=0x7fd19002d9c0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.368+0000 7fd1a5800640 1 -- 172.21.15.69:0/2970694318 shutdown_connections 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.368+0000 7fd1a5800640 1 --2- 172.21.15.69:0/2970694318 >> v2:172.21.15.174:3300/0 conn(0x7fd1a0185cc0 0x7fd1a0186130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.368+0000 7fd1a5800640 1 --2- 172.21.15.69:0/2970694318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a017f700 0x7fd1a0183670 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.368+0000 7fd1a5800640 1 -- 172.21.15.69:0/2970694318 >> 172.21.15.69:0/2970694318 conn(0x7fd1a00ce3d0 msgr2=0x7fd1a00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.368+0000 7fd1a5800640 1 -- 172.21.15.69:0/2970694318 shutdown_connections 2024-02-21T07:45:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.368+0000 7fd1a5800640 1 -- 172.21.15.69:0/2970694318 wait complete. 2024-02-21T07:45:25.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.370+0000 7fd1a5800640 1 Processor -- start 2024-02-21T07:45:25.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.370+0000 7fd1a5800640 1 -- start start 2024-02-21T07:45:25.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.371+0000 7fd1a5800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1a017f700 0x7fd1a017a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.371+0000 7fd1a5800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a01850e0 0x7fd1a017c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.371+0000 7fd1a5800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1a0185cc0 0x7fd1a00f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.371+0000 7fd1a5800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0222700 con 0x7fd1a01850e0 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.371+0000 7fd1a5800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0221a80 con 0x7fd1a017f700 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.371+0000 7fd1a5800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0221d60 con 0x7fd1a0185cc0 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.371+0000 7fd196000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a01850e0 0x7fd1a017c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.372+0000 7fd196000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a01850e0 0x7fd1a017c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43540/0 (socket says 172.21.15.69:43540) 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.372+0000 7fd196000640 1 -- 172.21.15.69:0/441650074 learned_addr learned my addr 172.21.15.69:0/441650074 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.372+0000 7fd19f400640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1a0185cc0 0x7fd1a00f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.372+0000 7fd19ea00640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1a017f700 0x7fd1a017a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.372+0000 7fd196000640 1 -- 172.21.15.69:0/441650074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1a0185cc0 msgr2=0x7fd1a00f0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.372+0000 7fd196000640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1a0185cc0 0x7fd1a00f0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.372+0000 7fd196000640 1 -- 172.21.15.69:0/441650074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1a017f700 msgr2=0x7fd1a017a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.372+0000 7fd196000640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1a017f700 0x7fd1a017a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.372+0000 7fd196000640 1 -- 172.21.15.69:0/441650074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd190009400 con 0x7fd1a01850e0 2024-02-21T07:45:25.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.372+0000 7fd196000640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a01850e0 0x7fd1a017c590 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c3f0 tx=0x7fd18800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.373+0000 7fd197400640 1 -- 172.21.15.69:0/441650074 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1880074e0 con 0x7fd1a01850e0 2024-02-21T07:45:25.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.373+0000 7fd197400640 1 -- 172.21.15.69:0/441650074 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd188007640 con 0x7fd1a01850e0 2024-02-21T07:45:25.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.373+0000 7fd197400640 1 -- 172.21.15.69:0/441650074 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188004a00 con 0x7fd1a01850e0 2024-02-21T07:45:25.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.373+0000 7fd1a5800640 1 -- 172.21.15.69:0/441650074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a0222040 con 0x7fd1a01850e0 2024-02-21T07:45:25.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.373+0000 7fd1a5800640 1 -- 172.21.15.69:0/441650074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a017cad0 con 0x7fd1a01850e0 2024-02-21T07:45:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.376+0000 7fd197400640 1 -- 172.21.15.69:0/441650074 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fd188004b60 con 0x7fd1a01850e0 2024-02-21T07:45:25.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.377+0000 7fd1a8612740 1 Processor -- start 2024-02-21T07:45:25.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.377+0000 7fd1a8612740 1 -- start start 2024-02-21T07:45:25.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.377+0000 7fd197400640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd17c09f0a0 0x7fd17c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.378+0000 7fd197400640 1 -- 172.21.15.69:0/441650074 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd1880c9790 con 0x7fd1a01850e0 2024-02-21T07:45:25.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.378+0000 7fd19f400640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd17c09f0a0 0x7fd17c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.378+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecaec0 0x55c2d8ecb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.378+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f06050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.378+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8f07320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.378+0000 7fd1a8612740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8dfe210 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.378+0000 7fd1a8612740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8dfb740 con 0x55c2d8ecaec0 2024-02-21T07:45:25.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.378+0000 7fd1a8612740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8df6f20 con 0x55c2d8f06590 2024-02-21T07:45:25.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.378+0000 7fd19f400640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd17c09f0a0 0x7fd17c0a1560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd1a017aab0 tx=0x7fd19800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd196000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f06050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd19ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecaec0 0x55c2d8ecb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd19ea00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecaec0 0x55c2d8ecb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38384/0 (socket says 172.21.15.69:38384) 2024-02-21T07:45:25.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd19ea00640 1 -- 172.21.15.69:0/1362177077 learned_addr learned my addr 172.21.15.69:0/1362177077 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:25.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd19f400640 1 --2- 172.21.15.69:0/1362177077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8f07320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd19ea00640 1 -- 172.21.15.69:0/1362177077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 msgr2=0x55c2d8f07320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd19ea00640 1 --2- 172.21.15.69:0/1362177077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8f07320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd19ea00640 1 -- 172.21.15.69:0/1362177077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 msgr2=0x55c2d8f06050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd19ea00640 1 --2- 172.21.15.69:0/1362177077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f06050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd19ea00640 1 -- 172.21.15.69:0/1362177077 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2d8db8df0 con 0x55c2d8ecaec0 2024-02-21T07:45:25.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd196000640 1 --2- 172.21.15.69:0/1362177077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f06050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:25.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.379+0000 7fd19ea00640 1 --2- 172.21.15.69:0/1362177077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecaec0 0x55c2d8ecb2a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd19002dfd0 tx=0x7fd190008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=580da0a86d280b20 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.380+0000 7fd18f400640 1 -- 172.21.15.69:0/1362177077 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190032d50 con 0x55c2d8ecaec0 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.380+0000 7fd18f400640 1 -- 172.21.15.69:0/1362177077 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd190032840 con 0x55c2d8ecaec0 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.380+0000 7fd18f400640 1 -- 172.21.15.69:0/1362177077 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1900466a0 con 0x55c2d8ecaec0 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.381+0000 7fd1a8612740 1 -- 172.21.15.69:0/1362177077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecaec0 msgr2=0x55c2d8ecb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.381+0000 7fd1a8612740 1 --2- 172.21.15.69:0/1362177077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecaec0 0x55c2d8ecb2a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd19002dfd0 tx=0x7fd190008030 comp rx=0 tx=0).stop 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.381+0000 7fd1a8612740 1 -- 172.21.15.69:0/1362177077 shutdown_connections 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.381+0000 7fd1a8612740 1 --2- 172.21.15.69:0/1362177077 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8f07320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.381+0000 7fd1a8612740 1 --2- 172.21.15.69:0/1362177077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f06050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.381+0000 7fd1a8612740 1 --2- 172.21.15.69:0/1362177077 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecaec0 0x55c2d8ecb2a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.381+0000 7fd1a8612740 1 -- 172.21.15.69:0/1362177077 >> 172.21.15.69:0/1362177077 conn(0x55c2d8e8d490 msgr2=0x55c2d8e8e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.381+0000 7fd1a8612740 1 -- 172.21.15.69:0/1362177077 shutdown_connections 2024-02-21T07:45:25.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.381+0000 7fd1a8612740 1 -- 172.21.15.69:0/1362177077 wait complete. 2024-02-21T07:45:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.382+0000 7fd1a8612740 1 -- start start 2024-02-21T07:45:25.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.382+0000 7fd1a8612740 1 Processor -- start 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.383+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f12cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.383+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8f06590 0x55c2d8ebf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.383+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 0x55c2d8ebf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.383+0000 7fd1a8612740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8d9c150 con 0x55c2d8f06590 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.383+0000 7fd1a8612740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8d9bdf0 con 0x55c2d8ed2620 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.383+0000 7fd1a8612740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8b651c0 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.383+0000 7fd1a8612740 10 client.0 _ll_register_callbacks cb 0x55c2d8deb2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.383+0000 7fd196000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8f06590 0x55c2d8ebf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.383+0000 7fd196000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8f06590 0x55c2d8ebf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43556/0 (socket says 172.21.15.69:43556) 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.383+0000 7fd196000640 1 -- 172.21.15.69:0/1282520974 learned_addr learned my addr 172.21.15.69:0/1282520974 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd19f400640 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 0x55c2d8ebf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd19ea00640 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f12cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd196000640 1 -- 172.21.15.69:0/1282520974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8ecb7e0 msgr2=0x55c2d8f12cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd196000640 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f12cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd196000640 1 -- 172.21.15.69:0/1282520974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 msgr2=0x55c2d8ebf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd196000640 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 0x55c2d8ebf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd196000640 1 -- 172.21.15.69:0/1282520974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a0183d60 con 0x55c2d8f06590 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd19f400640 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 0x55c2d8ebf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd19ea00640 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f12cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd196000640 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8f06590 0x55c2d8ebf440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd1880972f0 tx=0x7fd188097ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d6a42f64121c23 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd183e00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd183e00640 1 -- 172.21.15.69:0/1282520974 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188004e10 con 0x55c2d8f06590 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd183e00640 1 -- 172.21.15.69:0/1282520974 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd1880b4b30 con 0x55c2d8f06590 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.384+0000 7fd1a8612740 1 -- 172.21.15.69:0/1282520974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2d8af67e0 con 0x55c2d8f06590 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd183e00640 1 -- 172.21.15.69:0/1282520974 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1880967b0 con 0x55c2d8f06590 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd1a8612740 10 client.5877 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:25.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd1a8612740 1 -- 172.21.15.69:0/1282520974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55c2d8df55a0 con 0x55c2d8f06590 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd183e00640 1 -- 172.21.15.69:0/1282520974 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1880c4080 con 0x55c2d8f06590 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd183e00640 1 -- 172.21.15.69:0/1282520974 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fd18801b060 con 0x55c2d8f06590 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd1a8612740 10 client.5877 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd1a8612740 10 client.5877 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd1a8612740 20 client.5877 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd1a8612740 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55c2d8f03b70 0x55c2d8f03f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd1a8612740 4 client.5877 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd1a8612740 1 -- 172.21.15.69:0/1282520974 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2d8b33720 con 0x55c2d8f03b70 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.385+0000 7fd19ea00640 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55c2d8f03b70 0x55c2d8f03f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.386+0000 7fd19ea00640 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55c2d8f03b70 0x55c2d8f03f80 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8117192ba290d908 server_cookie=a398e98f89baa6fb in_seq=0 out_seq=0 2024-02-21T07:45:25.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.386+0000 7fd183e00640 10 client.5877 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:25.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd183e00640 1 -- 172.21.15.69:0/1282520974 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c2d8b33720 con 0x55c2d8f03b70 2024-02-21T07:45:25.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd183e00640 10 client.5877 handle_command_reply: tid=0 2024-02-21T07:45:25.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 client.5877 shutdown 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 -- 172.21.15.69:0/1282520974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8f06590 msgr2=0x55c2d8ebf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8f06590 0x55c2d8ebf440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd1880972f0 tx=0x7fd188097ba0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 -- 172.21.15.69:0/1282520974 shutdown_connections 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55c2d8f03b70 0x55c2d8f03f80 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 0x55c2d8ebf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8f06590 0x55c2d8ebf440 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 --2- 172.21.15.69:0/1282520974 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f12cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 -- 172.21.15.69:0/1282520974 >> 172.21.15.69:0/1282520974 conn(0x55c2d8ecaec0 msgr2=0x55c2d8e8ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd183e00640 0 client.5877 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 -- 172.21.15.69:0/1282520974 shutdown_connections 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 1 -- 172.21.15.69:0/1282520974 wait complete. 2024-02-21T07:45:25.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.387+0000 7fd1a8612740 20 client.5877 trim_cache size 0 max 16384 2024-02-21T07:45:25.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.400+0000 7fd1a8612740 1 Processor -- start 2024-02-21T07:45:25.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.401+0000 7fd1a8612740 1 -- start start 2024-02-21T07:45:25.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f02d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ed2620 0x55c2d8f05f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8eca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd1a8612740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8e8d880 con 0x55c2d8ed2620 2024-02-21T07:45:25.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd1a8612740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8ef7ac0 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd1a8612740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8ed3120 con 0x55c2d8f06590 2024-02-21T07:45:25.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd196000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ed2620 0x55c2d8f05f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd196000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ed2620 0x55c2d8f05f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43562/0 (socket says 172.21.15.69:43562) 2024-02-21T07:45:25.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd19f400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8eca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd196000640 1 -- 172.21.15.69:0/483408484 learned_addr learned my addr 172.21.15.69:0/483408484 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:25.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd19ea00640 1 --2- 172.21.15.69:0/483408484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f02d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd196000640 1 -- 172.21.15.69:0/483408484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 msgr2=0x55c2d8eca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd196000640 1 --2- 172.21.15.69:0/483408484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8eca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd196000640 1 -- 172.21.15.69:0/483408484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecb7e0 msgr2=0x55c2d8f02d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.402+0000 7fd196000640 1 --2- 172.21.15.69:0/483408484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f02d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.403+0000 7fd196000640 1 -- 172.21.15.69:0/483408484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2d8f17e20 con 0x55c2d8ed2620 2024-02-21T07:45:25.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.403+0000 7fd196000640 1 --2- 172.21.15.69:0/483408484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ed2620 0x55c2d8f05f50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd188093ce0 tx=0x7fd188099000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f140c695e25bf2f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.403+0000 7fd18ea00640 1 -- 172.21.15.69:0/483408484 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd188004e10 con 0x55c2d8ed2620 2024-02-21T07:45:25.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.403+0000 7fd18ea00640 1 -- 172.21.15.69:0/483408484 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1880b1030 con 0x55c2d8ed2620 2024-02-21T07:45:25.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.403+0000 7fd18ea00640 1 -- 172.21.15.69:0/483408484 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1880969f0 con 0x55c2d8ed2620 2024-02-21T07:45:25.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.404+0000 7fd1a8612740 1 -- 172.21.15.69:0/483408484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ed2620 msgr2=0x55c2d8f05f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.404+0000 7fd1a8612740 1 --2- 172.21.15.69:0/483408484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ed2620 0x55c2d8f05f50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd188093ce0 tx=0x7fd188099000 comp rx=0 tx=0).stop 2024-02-21T07:45:25.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.404+0000 7fd1a8612740 1 -- 172.21.15.69:0/483408484 shutdown_connections 2024-02-21T07:45:25.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.404+0000 7fd1a8612740 1 --2- 172.21.15.69:0/483408484 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8eca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.404+0000 7fd1a8612740 1 --2- 172.21.15.69:0/483408484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ed2620 0x55c2d8f05f50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.404+0000 7fd1a8612740 1 --2- 172.21.15.69:0/483408484 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8f02d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.404+0000 7fd1a8612740 1 -- 172.21.15.69:0/483408484 >> 172.21.15.69:0/483408484 conn(0x55c2d8ecaec0 msgr2=0x55c2d8e8ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.404+0000 7fd1a8612740 1 -- 172.21.15.69:0/483408484 shutdown_connections 2024-02-21T07:45:25.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.404+0000 7fd1a8612740 1 -- 172.21.15.69:0/483408484 wait complete. 2024-02-21T07:45:25.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.405+0000 7fd1a8612740 1 -- start start 2024-02-21T07:45:25.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.405+0000 7fd1a8612740 1 Processor -- start 2024-02-21T07:45:25.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.406+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8ec3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.406+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 0x55c2d8f67390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.406+0000 7fd1a8612740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8ef6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.406+0000 7fd1a8612740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8efafe0 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.406+0000 7fd1a8612740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8f05030 con 0x55c2d8ed2620 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.406+0000 7fd1a8612740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d8f03f50 con 0x55c2d8f06590 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.406+0000 7fd1a8612740 10 client.0 _ll_register_callbacks cb 0x7fd190009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.406+0000 7fd19ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8ec3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd19ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8ec3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43566/0 (socket says 172.21.15.69:43566) 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd19ea00640 1 -- 172.21.15.69:0/3706896200 learned_addr learned my addr 172.21.15.69:0/3706896200 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd196000640 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 0x55c2d8f67390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd19f400640 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8ef6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd19ea00640 1 -- 172.21.15.69:0/3706896200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 msgr2=0x55c2d8ef6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd19ea00640 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8ef6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd19ea00640 1 -- 172.21.15.69:0/3706896200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 msgr2=0x55c2d8f67390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:25.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd19ea00640 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 0x55c2d8f67390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd19ea00640 1 -- 172.21.15.69:0/3706896200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2d8df55a0 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd19ea00640 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8ec3ce0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd190032fd0 tx=0x7fd190030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff8feba88546a0a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:25.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd183e00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:45:25.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd183e00640 1 -- 172.21.15.69:0/3706896200 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190004240 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd183e00640 1 -- 172.21.15.69:0/3706896200 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd190040070 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.407+0000 7fd1a8612740 1 -- 172.21.15.69:0/3706896200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd190032840 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd183e00640 1 -- 172.21.15.69:0/3706896200 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd190032cd0 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd1a8612740 10 client.5883 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:25.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd1a8612740 1 -- 172.21.15.69:0/3706896200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55c2d8d91ab0 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd183e00640 1 -- 172.21.15.69:0/3706896200 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd190032840 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd183e00640 1 -- 172.21.15.69:0/3706896200 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7fd190030070 con 0x55c2d8ecb7e0 2024-02-21T07:45:25.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd1a8612740 10 client.5883 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:25.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd1a8612740 10 client.5883 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.a 2024-02-21T07:45:25.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd1a8612740 20 client.5883 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:25.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd1a8612740 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55c2d8f0fe10 0x55c2d8ef6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:25.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd1a8612740 4 client.5883 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T07:45:25.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.408+0000 7fd1a8612740 1 -- 172.21.15.69:0/3706896200 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c2d8b82890 con 0x55c2d8f0fe10 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd196000640 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55c2d8f0fe10 0x55c2d8ef6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd196000640 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55c2d8f0fe10 0x55c2d8ef6dc0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8233ab4e939b014a server_cookie=9d03548d173d4601 in_seq=0 out_seq=0 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd183e00640 10 client.5883 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd183e00640 1 -- 172.21.15.69:0/3706896200 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c2d8b82890 con 0x55c2d8f0fe10 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd183e00640 10 client.5883 handle_command_reply: tid=0 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd1a8612740 1 client.5883 shutdown 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd1a8612740 1 -- 172.21.15.69:0/3706896200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 msgr2=0x55c2d8ec3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd1a8612740 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8ec3ce0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd190032fd0 tx=0x7fd190030000 comp rx=0 tx=0).stop 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd1a8612740 1 -- 172.21.15.69:0/3706896200 shutdown_connections 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd1a8612740 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55c2d8f0fe10 0x55c2d8ef6dc0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd1a8612740 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55c2d8f06590 0x55c2d8ef6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd1a8612740 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55c2d8ed2620 0x55c2d8f67390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd1a8612740 1 --2- 172.21.15.69:0/3706896200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d8ecb7e0 0x55c2d8ec3ce0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd183e00640 0 client.5883 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:25.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.409+0000 7fd1a8612740 1 -- 172.21.15.69:0/3706896200 >> 172.21.15.69:0/3706896200 conn(0x55c2d8ecaec0 msgr2=0x55c2d8e8ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.410+0000 7fd1a8612740 1 -- 172.21.15.69:0/3706896200 shutdown_connections 2024-02-21T07:45:25.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.410+0000 7fd1a8612740 1 -- 172.21.15.69:0/3706896200 wait complete. 2024-02-21T07:45:25.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.410+0000 7fd1a8612740 20 client.5883 trim_cache size 0 max 16384 2024-02-21T07:45:25.419 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-02-21T07:45:25.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.410+0000 7fd1a5800640 1 -- 172.21.15.69:0/441650074 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd17c09f0a0 msgr2=0x7fd17c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.410+0000 7fd1a5800640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd17c09f0a0 0x7fd17c0a1560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd1a017aab0 tx=0x7fd19800b040 comp rx=0 tx=0).stop 2024-02-21T07:45:25.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.410+0000 7fd1a5800640 1 -- 172.21.15.69:0/441650074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a01850e0 msgr2=0x7fd1a017c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:25.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.410+0000 7fd1a5800640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a01850e0 0x7fd1a017c590 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd18800c3f0 tx=0x7fd18800c8b0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.411+0000 7fd1a5800640 1 -- 172.21.15.69:0/441650074 shutdown_connections 2024-02-21T07:45:25.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.411+0000 7fd1a5800640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fd17c09f0a0 0x7fd17c0a1560 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.411+0000 7fd1a5800640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd1a0185cc0 0x7fd1a00f0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.411+0000 7fd1a5800640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1a01850e0 0x7fd1a017c590 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.411+0000 7fd1a5800640 1 --2- 172.21.15.69:0/441650074 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fd1a017f700 0x7fd1a017a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:25.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.411+0000 7fd1a5800640 1 -- 172.21.15.69:0/441650074 >> 172.21.15.69:0/441650074 conn(0x7fd1a00ce3d0 msgr2=0x7fd1a01799a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:25.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.411+0000 7fd1a5800640 1 -- 172.21.15.69:0/441650074 shutdown_connections 2024-02-21T07:45:25.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:25.411+0000 7fd1a5800640 1 -- 172.21.15.69:0/441650074 wait complete. 2024-02-21T07:45:25.433 ERROR:tasks.fwd_scrub:rank 3 damaged: [{'damage_type': 'backtrace', 'id': 69231526, 'ino': 1099511638927, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/ashldi3.S'}, {'damage_type': 'backtrace', 'id': 78314067, 'ino': 1099511639177, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon/alpine-db.dts'}, {'damage_type': 'backtrace', 'id': 82185073, 'ino': 1099511638922, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/initrd.S'}, {'damage_type': 'backtrace', 'id': 97984042, 'ino': 1099511639221, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2m.dtsi'}, {'damage_type': 'backtrace', 'id': 197122323, 'ino': 1099511638934, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt.c'}, {'damage_type': 'backtrace', 'id': 226417844, 'ino': 1099511639207, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pba8.dts'}, {'damage_type': 'backtrace', 'id': 249448892, 'ino': 1099511638924, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed'}, {'damage_type': 'backtrace', 'id': 291221242, 'ino': 1099511639218, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/versatile-ab.dts'}, {'damage_type': 'backtrace', 'id': 312761067, 'ino': 1099511639260, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-inspur-fp5280g2.dts'}, {'damage_type': 'backtrace', 'id': 353311600, 'ino': 1099511639206, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pb11mp.dts'}, {'damage_type': 'backtrace', 'id': 388395603, 'ino': 1099511639198, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-a9mp-bbrevd.dts'}, {'damage_type': 'backtrace', 'id': 402249297, 'ino': 1099511639238, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-asrock-romed8hm3.dts'}, {'damage_type': 'backtrace', 'id': 408128786, 'ino': 1099511639237, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-asrock-e3c246d4i.dts'}, {'damage_type': 'backtrace', 'id': 431684528, 'ino': 1099511638940, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head-sa1100.S'}, {'damage_type': 'backtrace', 'id': 437576810, 'ino': 1099511638939, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/font.c'}, {'damage_type': 'backtrace', 'id': 454370785, 'ino': 1099511639241, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-bletchley.dts'}, {'damage_type': 'backtrace', 'id': 458988190, 'ino': 1099511638961, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-labrador-base-m.dts'}, {'damage_type': 'backtrace', 'id': 506229407, 'ino': 1099511639201, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-bbrevd.dtsi'}, {'damage_type': 'backtrace', 'id': 535975702, 'ino': 1099511639230, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-ast2600-evb-a1.dts'}, {'damage_type': 'backtrace', 'id': 552242686, 'ino': 1099511638956, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions'}, {'damage_type': 'backtrace', 'id': 555582568, 'ino': 1099511639175, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon'}, {'damage_type': 'backtrace', 'id': 582034362, 'ino': 1099511639202, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-mp.dtsi'}, {'damage_type': 'backtrace', 'id': 696611832, 'ino': 1099511639182, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson6-atv1200.dts'}, {'damage_type': 'backtrace', 'id': 706773161, 'ino': 1099511638960, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-guitar.dtsi'}, {'damage_type': 'backtrace', 'id': 723594147, 'ino': 1099511638928, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/atags_to_fdt.c'}, {'damage_type': 'backtrace', 'id': 757749660, 'ino': 1099511638920, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/bootp.lds'}, {'damage_type': 'backtrace', 'id': 770088332, 'ino': 1099511639244, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-elbert.dts'}, {'damage_type': 'backtrace', 'id': 815067501, 'ino': 1099511639252, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-wedge400.dts'}, {'damage_type': 'backtrace', 'id': 838824294, 'ino': 1099511639234, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ampere-mtjade.dts'}, {'damage_type': 'backtrace', 'id': 859972125, 'ino': 1099511639245, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-fuji.dts'}, {'damage_type': 'backtrace', 'id': 877751893, 'ino': 1099511639203, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb.dts'}, {'damage_type': 'backtrace', 'id': 899751112, 'ino': 1099511639186, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b-ec100.dts'}, {'damage_type': 'backtrace', 'id': 919065281, 'ino': 1099511638963, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-roseapplepi.dts'}, {'damage_type': 'backtrace', 'id': 928927234, 'ino': 1099511639246, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-galaxy100.dts'}, {'damage_type': 'backtrace', 'id': 936201585, 'ino': 1099511639189, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b.dtsi'}, {'damage_type': 'backtrace', 'id': 985824581, 'ino': 1099511638947, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/misc-ep93xx.h'}, {'damage_type': 'backtrace', 'id': 1053006290, 'ino': 1099511638958, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-cubieboard6.dts'}, {'damage_type': 'backtrace', 'id': 1071203032, 'ino': 1099511638970, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/allwinner'}, {'damage_type': 'backtrace', 'id': 1097915021, 'ino': 1099511638964, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-sparky.dts'}, {'damage_type': 'backtrace', 'id': 1118540226, 'ino': 1099511639193, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/Makefile'}, {'damage_type': 'backtrace', 'id': 1132151966, 'ino': 1099511639199, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-a9mp.dts'}, {'damage_type': 'backtrace', 'id': 1132673610, 'ino': 1099511639233, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-amd-ethanolx.dts'}, {'damage_type': 'backtrace', 'id': 1136721589, 'ino': 1099511639225, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca9.dts'}, {'damage_type': 'backtrace', 'id': 1167935146, 'ino': 1099511638951, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/string.c'}, {'damage_type': 'backtrace', 'id': 1195766014, 'ino': 1099511639205, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pb1176.dts'}, {'damage_type': 'backtrace', 'id': 1215945755, 'ino': 1099511638955, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/Makefile'}, {'damage_type': 'backtrace', 'id': 1287687624, 'ino': 1099511638969, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha/en7523.dtsi'}, {'damage_type': 'backtrace', 'id': 1313317579, 'ino': 1099511639180, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/Makefile'}, {'damage_type': 'backtrace', 'id': 1374349471, 'ino': 1099511638918, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp'}, {'damage_type': 'backtrace', 'id': 1436432111, 'ino': 1099511638938, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_wip.c'}, {'damage_type': 'backtrace', 'id': 1440285141, 'ino': 1099511638941, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head-sharpsl.S'}, {'damage_type': 'backtrace', 'id': 1460194008, 'ino': 1099511638926, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/Makefile'}, {'damage_type': 'backtrace', 'id': 1461006802, 'ino': 1099511639224, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca5s.dts'}, {'damage_type': 'backtrace', 'id': 1465890344, 'ino': 1099511638954, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts'}, {'damage_type': 'backtrace', 'id': 1471714013, 'ino': 1099511639213, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integratorcp.dts'}, {'damage_type': 'backtrace', 'id': 1572681122, 'ino': 1099511639204, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb.dtsi'}, {'damage_type': 'backtrace', 'id': 1591841320, 'ino': 1099511638937, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_rw.c'}, {'damage_type': 'backtrace', 'id': 1594205374, 'ino': 1099511639197, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp.dts'}, {'damage_type': 'backtrace', 'id': 1659485309, 'ino': 1099511638925, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/.gitignore'}, {'damage_type': 'backtrace', 'id': 1728046995, 'ino': 1099511639208, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pbx-a9.dts'}, {'damage_type': 'backtrace', 'id': 1783048893, 'ino': 1099511638949, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/misc.h'}, {'damage_type': 'backtrace', 'id': 1799263163, 'ino': 1099511639248, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-minipack.dts'}, {'damage_type': 'backtrace', 'id': 1805890192, 'ino': 1099511639192, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm'}, {'damage_type': 'backtrace', 'id': 1830391451, 'ino': 1099511638923, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/kernel.S'}, {'damage_type': 'backtrace', 'id': 1858417762, 'ino': 1099511639240, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-delta-ahe50dc.dts'}, {'damage_type': 'backtrace', 'id': 1877214470, 'ino': 1099511638933, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/efi-header.S'}, {'damage_type': 'backtrace', 'id': 1877990370, 'ino': 1099511638959, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-guitar-bb-rev-b.dts'}, {'damage_type': 'backtrace', 'id': 1885163760, 'ino': 1099511638942, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head-xscale.S'}, {'damage_type': 'backtrace', 'id': 1886702318, 'ino': 1099511639188, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b-odroidc1.dts'}, {'damage_type': 'backtrace', 'id': 1888347441, 'ino': 1099511639215, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/mps2-an399.dts'}, {'damage_type': 'backtrace', 'id': 1949178378, 'ino': 1099511638931, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/debug.S'}, {'damage_type': 'backtrace', 'id': 1949186250, 'ino': 1099511639210, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integrator.dtsi'}, {'damage_type': 'backtrace', 'id': 1974682983, 'ino': 1099511639229, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-ast2500-evb.dts'}, {'damage_type': 'backtrace', 'id': 1988231527, 'ino': 1099511639181, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson.dtsi'}, {'damage_type': 'backtrace', 'id': 2012206959, 'ino': 1099511639212, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integratorap.dts'}, {'damage_type': 'backtrace', 'id': 2020913847, 'ino': 1099511639258, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-rainier-4u.dts'}, {'damage_type': 'backtrace', 'id': 2062578731, 'ino': 1099511638967, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha/Makefile'}, {'damage_type': 'backtrace', 'id': 2071000019, 'ino': 1099511639235, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ampere-mtmitchell.dts'}, {'damage_type': 'backtrace', 'id': 2107173078, 'ino': 1099511638929, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/big-endian.S'}, {'damage_type': 'backtrace', 'id': 2128425889, 'ino': 1099511639249, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-tiogapass.dts'}, {'damage_type': 'backtrace', 'id': 2129899709, 'ino': 1099511638919, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/Makefile'}, {'damage_type': 'backtrace', 'id': 2175589412, 'ino': 1099511639211, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/integratorap-im-pd1.dts'}, {'damage_type': 'backtrace', 'id': 2176348868, 'ino': 1099511638945, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/lib1funcs.S'}, {'damage_type': 'backtrace', 'id': 2220587278, 'ino': 1099511639250, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-wedge100.dts'}, {'damage_type': 'backtrace', 'id': 2234218690, 'ino': 1099511639236, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-arm-stardragon4800-rep2.dts'}, {'damage_type': 'backtrace', 'id': 2247310074, 'ino': 1099511638944, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/hyp-stub.S'}, {'damage_type': 'backtrace', 'id': 2359480854, 'ino': 1099511639259, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-rainier.dts'}, {'damage_type': 'backtrace', 'id': 2372724236, 'ino': 1099511639190, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8m2-mxiii-plus.dts'}, {'damage_type': 'backtrace', 'id': 2402154800, 'ino': 1099511639253, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-yamp.dts'}, {'damage_type': 'backtrace', 'id': 2403120497, 'ino': 1099511639173, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale/alphascale-asm9260-devkit.dts'}, {'damage_type': 'backtrace', 'id': 2404238055, 'ino': 1099511638916, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/.gitignore'}, {'damage_type': 'backtrace', 'id': 2405792650, 'ino': 1099511638935, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_check_mem_start.c'}, {'damage_type': 'backtrace', 'id': 2479588027, 'ino': 1099511639226, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/armv7-m.dtsi'}, {'damage_type': 'backtrace', 'id': 2510046555, 'ino': 1099511639231, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-ast2600-evb.dts'}, {'damage_type': 'backtrace', 'id': 2523641325, 'ino': 1099511638948, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/misc.c'}, {'damage_type': 'backtrace', 'id': 2549929906, 'ino': 1099511639227, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed'}, {'damage_type': 'backtrace', 'id': 2604782334, 'ino': 1099511639171, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale'}, {'damage_type': 'backtrace', 'id': 2658122960, 'ino': 1099511639228, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/Makefile'}, {'damage_type': 'backtrace', 'id': 2662578913, 'ino': 1099511639216, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/mps2.dtsi'}, {'damage_type': 'backtrace', 'id': 2671791454, 'ino': 1099511639256, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-everest.dts'}, {'damage_type': 'backtrace', 'id': 2676430584, 'ino': 1099511638921, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/bootp/init.S'}, {'damage_type': 'backtrace', 'id': 2680796021, 'ino': 1099511639209, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-pbx.dtsi'}, {'damage_type': 'backtrace', 'id': 2715834172, 'ino': 1099511639239, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-bytedance-g220a.dts'}, {'damage_type': 'backtrace', 'id': 2745378445, 'ino': 1099511639172, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale/Makefile'}, {'damage_type': 'backtrace', 'id': 2810269363, 'ino': 1099511639232, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-amd-daytonax.dts'}, {'damage_type': 'backtrace', 'id': 2832136362, 'ino': 1099511639261, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-inspur-nf5280m6.dts'}, {'damage_type': 'backtrace', 'id': 2853444451, 'ino': 1099511639196, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp-ctrevb.dts'}, {'damage_type': 'backtrace', 'id': 2913117693, 'ino': 1099511638936, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/fdt_ro.c'}, {'damage_type': 'backtrace', 'id': 2950493860, 'ino': 1099511639194, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp-bbrevd-ctrevb.dts'}, {'damage_type': 'backtrace', 'id': 2951016276, 'ino': 1099511638966, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha'}, {'damage_type': 'backtrace', 'id': 2977413301, 'ino': 1099511639242, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-cloudripper.dts'}, {'damage_type': 'backtrace', 'id': 3028204206, 'ino': 1099511638965, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500.dtsi'}, {'damage_type': 'backtrace', 'id': 3090735532, 'ino': 1099511638943, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/head.S'}, {'damage_type': 'backtrace', 'id': 3110483417, 'ino': 1099511638962, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/owl-s500-labrador-v2.dtsi'}, {'damage_type': 'backtrace', 'id': 3139697536, 'ino': 1099511638930, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/bswapsdi2.S'}, {'damage_type': 'backtrace', 'id': 3210609648, 'ino': 1099511639223, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca15_a7.dts'}, {'damage_type': 'backtrace', 'id': 3225627103, 'ino': 1099511639255, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-bonnell.dts'}, {'damage_type': 'backtrace', 'id': 3241900798, 'ino': 1099511639185, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8.dtsi'}, {'damage_type': 'backtrace', 'id': 3292990485, 'ino': 1099511639184, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8-minix-neo-x8.dts'}, {'damage_type': 'backtrace', 'id': 3294885772, 'ino': 1099511639174, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/alphascale/alphascale-asm9260.dtsi'}, {'damage_type': 'backtrace', 'id': 3301688191, 'ino': 1099511639214, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/mps2-an385.dts'}, {'damage_type': 'backtrace', 'id': 3395418473, 'ino': 1099511639219, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/versatile-pb.dts'}, {'damage_type': 'backtrace', 'id': 3422691358, 'ino': 1099511639257, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-ibm-rainier-1s4u.dts'}, {'damage_type': 'backtrace', 'id': 3441848882, 'ino': 1099511639191, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8m2.dtsi'}, {'damage_type': 'backtrace', 'id': 3451699293, 'ino': 1099511639178, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon/alpine.dtsi'}, {'damage_type': 'backtrace', 'id': 3467651647, 'ino': 1099511638968, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/airoha/en7523-evb.dts'}, {'damage_type': 'backtrace', 'id': 3471741455, 'ino': 1099511639179, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic'}, {'damage_type': 'backtrace', 'id': 3478197610, 'ino': 1099511639176, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amazon/Makefile'}, {'damage_type': 'backtrace', 'id': 3525573019, 'ino': 1099511638953, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/deflate_xip_data.sh'}, {'damage_type': 'backtrace', 'id': 3567577736, 'ino': 1099511639222, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2p-ca15-tc1.dts'}, {'damage_type': 'backtrace', 'id': 3597539577, 'ino': 1099511639200, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-bbrevd.dts'}, {'damage_type': 'backtrace', 'id': 3598581997, 'ino': 1099511639183, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson6.dtsi'}, {'damage_type': 'backtrace', 'id': 3614608134, 'ino': 1099511639195, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/arm-realview-eb-11mp-bbrevd.dts'}, {'damage_type': 'backtrace', 'id': 3757813228, 'ino': 1099511639217, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/versatile-ab-ib2.dts'}, {'damage_type': 'backtrace', 'id': 3815360501, 'ino': 1099511639187, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/amlogic/meson8b-mxq.dts'}, {'damage_type': 'backtrace', 'id': 3908787923, 'ino': 1099511638950, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/piggy.S'}, {'damage_type': 'backtrace', 'id': 3909507320, 'ino': 1099511638946, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/ll_char_wr.S'}, {'damage_type': 'backtrace', 'id': 3933409022, 'ino': 1099511639254, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-yosemitev2.dts'}, {'damage_type': 'backtrace', 'id': 3941839637, 'ino': 1099511638957, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/actions/Makefile'}, {'damage_type': 'backtrace', 'id': 3997927989, 'ino': 1099511638952, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/vmlinux.lds.S'}, {'damage_type': 'backtrace', 'id': 4027075258, 'ino': 1099511639243, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-cmm.dts'}, {'damage_type': 'backtrace', 'id': 4192113818, 'ino': 1099511639220, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/arm/vexpress-v2m-rs1.dtsi'}, {'damage_type': 'backtrace', 'id': 4238752732, 'ino': 1099511638917, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/Makefile'}, {'damage_type': 'backtrace', 'id': 4241744871, 'ino': 1099511638932, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/compressed/decompress.c'}, {'damage_type': 'backtrace', 'id': 4275620465, 'ino': 1099511639247, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-greatlakes.dts'}, {'damage_type': 'backtrace', 'id': 4293479804, 'ino': 1099511639251, 'path': '/volumes/qa/sv_1/6989bedb-7d3c-4e34-9eeb-627a4df85844/client.0/tmp/t/linux-6.5.11/arch/arm/boot/dts/aspeed/aspeed-bmc-facebook-wedge40.dts'}] 2024-02-21T07:45:25.434 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-02-21T07:45:28.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-02-21T07:45:28.153 INFO:tasks.daemonwatchdog.daemon_watchdog:thrasher.fs.[cephfs] failed 2024-02-21T07:45:28.153 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-02-21T07:45:28.153 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:45:28.153 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:45:28.210 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:45:28.210 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:45:28.254 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:28.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.504+0000 7fb352200640 1 Processor -- start 2024-02-21T07:45:28.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.504+0000 7fb352200640 1 -- start start 2024-02-21T07:45:28.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.506+0000 7fb352200640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb34c15dad0 0x7fb34c0fd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:28.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.506+0000 7fb352200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c1897f0 con 0x7fb34c160c10 2024-02-21T07:45:28.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.506+0000 7fb352200640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb34c0fc3c0 con 0x7fb34c189d50 2024-02-21T07:45:28.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.506+0000 7fb352200640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34c0fdc80 con 0x7fb34c15dad0 2024-02-21T07:45:28.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.506+0000 7fb351800640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb34c160c10 0x7fb34c0d55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60762/0 (socket says 172.21.15.69:60762) 2024-02-21T07:45:28.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.506+0000 7fb351800640 1 -- 172.21.15.69:0/2971917797 learned_addr learned my addr 172.21.15.69:0/2971917797 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:28.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.506+0000 7fb350e00640 1 --2- 172.21.15.69:0/2971917797 >> v2:172.21.15.184:3300/0 conn(0x7fb34c15dad0 0x7fb34c0fd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:28.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.507+0000 7fb34b400640 1 -- 172.21.15.69:0/2971917797 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180895481 0 0) 0x7fb34c1897f0 con 0x7fb34c160c10 2024-02-21T07:45:28.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.507+0000 7fb34b400640 1 -- 172.21.15.69:0/2971917797 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb334003520 con 0x7fb34c160c10 2024-02-21T07:45:28.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.507+0000 7fb350e00640 1 -- 172.21.15.69:0/2971917797 >> v1:172.21.15.184:6789/0 conn(0x7fb34c189d50 legacy=0x7fb34c160500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.507+0000 7fb34b400640 1 -- 172.21.15.69:0/2971917797 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678262039 0 0) 0x7fb34c0fc3c0 con 0x7fb34c189d50 2024-02-21T07:45:28.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.507+0000 7fb350e00640 1 -- 172.21.15.69:0/2971917797 >> v1:172.21.15.69:6789/0 conn(0x7fb34c160c10 legacy=0x7fb34c0d55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.507+0000 7fb350e00640 1 -- 172.21.15.69:0/2971917797 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c0fc6a0 con 0x7fb34c15dad0 2024-02-21T07:45:28.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.509+0000 7fb350e00640 1 --2- 172.21.15.69:0/2971917797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb34c15dad0 0x7fb34c0fd740 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb3400097a0 tx=0x7fb34002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3713ad08fd3c5b65 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:28.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.509+0000 7fb34b400640 1 -- 172.21.15.69:0/2971917797 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340030610 con 0x7fb34c15dad0 2024-02-21T07:45:28.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.509+0000 7fb34b400640 1 -- 172.21.15.69:0/2971917797 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340030770 con 0x7fb34c15dad0 2024-02-21T07:45:28.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.509+0000 7fb34b400640 1 -- 172.21.15.69:0/2971917797 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340030b00 con 0x7fb34c15dad0 2024-02-21T07:45:28.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.510+0000 7fb352200640 1 -- 172.21.15.69:0/2971917797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb34c15dad0 msgr2=0x7fb34c0fd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.510+0000 7fb352200640 1 --2- 172.21.15.69:0/2971917797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb34c15dad0 0x7fb34c0fd740 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb3400097a0 tx=0x7fb34002b960 comp rx=0 tx=0).stop 2024-02-21T07:45:28.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.510+0000 7fb352200640 1 -- 172.21.15.69:0/2971917797 shutdown_connections 2024-02-21T07:45:28.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.510+0000 7fb352200640 1 --2- 172.21.15.69:0/2971917797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb34c15dad0 0x7fb34c0fd740 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.510+0000 7fb352200640 1 -- 172.21.15.69:0/2971917797 >> 172.21.15.69:0/2971917797 conn(0x7fb34c0d2c90 msgr2=0x7fb34c0d30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:28.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.510+0000 7fb352200640 1 -- 172.21.15.69:0/2971917797 shutdown_connections 2024-02-21T07:45:28.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.510+0000 7fb352200640 1 -- 172.21.15.69:0/2971917797 wait complete. 2024-02-21T07:45:28.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.512+0000 7fb352200640 1 Processor -- start 2024-02-21T07:45:28.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.512+0000 7fb352200640 1 -- start start 2024-02-21T07:45:28.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb352200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb34c15dad0 0x7fb34c1538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:28.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb352200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb34c160c10 0x7fb34c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:28.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb352200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb34c189d50 0x7fb34c0f9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:28.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb352200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0fa820 con 0x7fb34c189d50 2024-02-21T07:45:28.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb352200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c0fab00 con 0x7fb34c160c10 2024-02-21T07:45:28.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb352200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34c15df50 con 0x7fb34c15dad0 2024-02-21T07:45:28.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb34be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb34c160c10 0x7fb34c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:28.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb351800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb34c189d50 0x7fb34c0f9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:28.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb34be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb34c160c10 0x7fb34c15ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:38428/0 (socket says 172.21.15.69:38428) 2024-02-21T07:45:28.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb34be00640 1 -- 172.21.15.69:0/488938675 learned_addr learned my addr 172.21.15.69:0/488938675 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:28.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb350e00640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb34c15dad0 0x7fb34c1538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:28.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb350e00640 1 -- 172.21.15.69:0/488938675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb34c160c10 msgr2=0x7fb34c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb350e00640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb34c160c10 0x7fb34c15ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb350e00640 1 -- 172.21.15.69:0/488938675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb34c189d50 msgr2=0x7fb34c0f9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.514+0000 7fb350e00640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb34c189d50 0x7fb34c0f9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.515+0000 7fb350e00640 1 -- 172.21.15.69:0/488938675 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb340009400 con 0x7fb34c15dad0 2024-02-21T07:45:28.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.515+0000 7fb350e00640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb34c15dad0 0x7fb34c1538e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb340033000 tx=0x7fb3400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:28.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.515+0000 7fb348c00640 1 -- 172.21.15.69:0/488938675 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34003e070 con 0x7fb34c15dad0 2024-02-21T07:45:28.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.515+0000 7fb348c00640 1 -- 172.21.15.69:0/488938675 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340030e30 con 0x7fb34c15dad0 2024-02-21T07:45:28.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.515+0000 7fb352200640 1 -- 172.21.15.69:0/488938675 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb34c15e230 con 0x7fb34c15dad0 2024-02-21T07:45:28.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.515+0000 7fb348c00640 1 -- 172.21.15.69:0/488938675 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400399a0 con 0x7fb34c15dad0 2024-02-21T07:45:28.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.515+0000 7fb352200640 1 -- 172.21.15.69:0/488938675 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb34c15e7f0 con 0x7fb34c15dad0 2024-02-21T07:45:28.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.517+0000 7fb352200640 1 -- 172.21.15.69:0/488938675 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb34c06cba0 con 0x7fb34c15dad0 2024-02-21T07:45:28.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.519+0000 7fb348c00640 1 -- 172.21.15.69:0/488938675 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fb340042070 con 0x7fb34c15dad0 2024-02-21T07:45:28.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.520+0000 7fb348c00640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb32c09f0a0 0x7fb32c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:28.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.521+0000 7fb348c00640 1 -- 172.21.15.69:0/488938675 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb3400eb5a0 con 0x7fb34c15dad0 2024-02-21T07:45:28.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.521+0000 7fb34be00640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb32c09f0a0 0x7fb32c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:28.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.522+0000 7fb34be00640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb32c09f0a0 0x7fb32c0a1560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb34c15c780 tx=0x7fb338009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:28.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.522+0000 7fb348c00640 1 -- 172.21.15.69:0/488938675 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb3400b5430 con 0x7fb34c15dad0 2024-02-21T07:45:28.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.737+0000 7fb352200640 1 -- 172.21.15.69:0/488938675 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb34c069c10 con 0x7fb34c15dad0 2024-02-21T07:45:28.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.739+0000 7fb348c00640 1 -- 172.21.15.69:0/488938675 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23736 (secure 0 0 0) 0x7fb340049090 con 0x7fb34c15dad0 2024-02-21T07:45:28.746 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:45:28.746 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":31,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:48.463144+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:28.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 -- 172.21.15.69:0/488938675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb32c09f0a0 msgr2=0x7fb32c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb32c09f0a0 0x7fb32c0a1560 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb34c15c780 tx=0x7fb338009040 comp rx=0 tx=0).stop 2024-02-21T07:45:28.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 -- 172.21.15.69:0/488938675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb34c15dad0 msgr2=0x7fb34c1538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb34c15dad0 0x7fb34c1538e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb340033000 tx=0x7fb3400046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 -- 172.21.15.69:0/488938675 shutdown_connections 2024-02-21T07:45:28.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fb32c09f0a0 0x7fb32c0a1560 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb34c189d50 0x7fb34c0f9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fb34c160c10 0x7fb34c15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 --2- 172.21.15.69:0/488938675 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb34c15dad0 0x7fb34c1538e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 -- 172.21.15.69:0/488938675 >> 172.21.15.69:0/488938675 conn(0x7fb34c0d2c90 msgr2=0x7fb34c068a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:28.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 -- 172.21.15.69:0/488938675 shutdown_connections 2024-02-21T07:45:28.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.743+0000 7fb352200640 1 -- 172.21.15.69:0/488938675 wait complete. 2024-02-21T07:45:28.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:41:56.520105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:42:00.759386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:42:01.409274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:42:05.025537+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:45:28.771 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:45:28.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.964+0000 7f5198a00640 1 Processor -- start 2024-02-21T07:45:28.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.964+0000 7f5198a00640 1 -- start start 2024-02-21T07:45:28.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.966+0000 7f5198a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5194182b70 0x7f5194189df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:28.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.966+0000 7f5198a00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519418bae0 con 0x7f51940fb840 2024-02-21T07:45:28.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.966+0000 7f5198a00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519418abf0 con 0x7f519406ac20 2024-02-21T07:45:28.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.966+0000 7f5198a00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519418aed0 con 0x7f5194182b70 2024-02-21T07:45:28.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.966+0000 7f5191e00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f51940fb840 0x7f519418a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:33090/0 (socket says 172.21.15.69:33090) 2024-02-21T07:45:28.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.966+0000 7f5191e00640 1 -- 172.21.15.69:0/3542283554 learned_addr learned my addr 172.21.15.69:0/3542283554 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:28.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.966+0000 7f5192800640 1 --2- 172.21.15.69:0/3542283554 >> v2:172.21.15.69:3300/0 conn(0x7f5194182b70 0x7f5194189df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:28.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.967+0000 7f5192800640 1 -- 172.21.15.69:0/3542283554 >> v1:172.21.15.174:6789/0 conn(0x7f519406ac20 legacy=0x7f519406b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.967+0000 7f5192800640 1 -- 172.21.15.69:0/3542283554 >> v1:172.21.15.69:6789/0 conn(0x7f51940fb840 legacy=0x7f519418a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.967+0000 7f5192800640 1 -- 172.21.15.69:0/3542283554 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519418b1b0 con 0x7f5194182b70 2024-02-21T07:45:28.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.968+0000 7f5192800640 1 --2- 172.21.15.69:0/3542283554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 0x7f5194189df0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f51840097a0 tx=0x7f518402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64f9fd171cf2f41 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:28.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.968+0000 7f5191400640 1 -- 172.21.15.69:0/3542283554 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184031830 con 0x7f5194182b70 2024-02-21T07:45:28.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.968+0000 7f5191400640 1 -- 172.21.15.69:0/3542283554 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5184031990 con 0x7f5194182b70 2024-02-21T07:45:28.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.968+0000 7f5191400640 1 -- 172.21.15.69:0/3542283554 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5184031d20 con 0x7f5194182b70 2024-02-21T07:45:28.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.969+0000 7f5198a00640 1 -- 172.21.15.69:0/3542283554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 msgr2=0x7f5194189df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.969+0000 7f5198a00640 1 --2- 172.21.15.69:0/3542283554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 0x7f5194189df0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f51840097a0 tx=0x7f518402b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.969+0000 7f5198a00640 1 -- 172.21.15.69:0/3542283554 shutdown_connections 2024-02-21T07:45:28.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.969+0000 7f5198a00640 1 --2- 172.21.15.69:0/3542283554 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 0x7f5194189df0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.969+0000 7f5198a00640 1 -- 172.21.15.69:0/3542283554 >> 172.21.15.69:0/3542283554 conn(0x7f51940d2ae0 msgr2=0x7f51940d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:28.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.969+0000 7f5198a00640 1 -- 172.21.15.69:0/3542283554 shutdown_connections 2024-02-21T07:45:28.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.969+0000 7f5198a00640 1 -- 172.21.15.69:0/3542283554 wait complete. 2024-02-21T07:45:28.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.971+0000 7f5198a00640 1 Processor -- start 2024-02-21T07:45:28.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.971+0000 7f5198a00640 1 -- start start 2024-02-21T07:45:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.972+0000 7f5198a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f519406ac20 0x7f519417a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.972+0000 7f5198a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51940fb840 0x7f519416fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.972+0000 7f5198a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 0x7f51940d2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.972+0000 7f5198a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940d1f40 con 0x7f5194182b70 2024-02-21T07:45:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.972+0000 7f5198a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519417a990 con 0x7f519406ac20 2024-02-21T07:45:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.972+0000 7f5198a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51940d1070 con 0x7f51940fb840 2024-02-21T07:45:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5193200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 0x7f51940d2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5192800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f519406ac20 0x7f519417a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5193200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 0x7f51940d2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46630/0 (socket says 172.21.15.69:46630) 2024-02-21T07:45:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5192800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f519406ac20 0x7f519417a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40168/0 (socket says 172.21.15.69:40168) 2024-02-21T07:45:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5193200640 1 -- 172.21.15.69:0/1272825268 learned_addr learned my addr 172.21.15.69:0/1272825268 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5191e00640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51940fb840 0x7f519416fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5193200640 1 -- 172.21.15.69:0/1272825268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51940fb840 msgr2=0x7f519416fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5193200640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51940fb840 0x7f519416fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5193200640 1 -- 172.21.15.69:0/1272825268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f519406ac20 msgr2=0x7f519417a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5193200640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f519406ac20 0x7f519417a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5193200640 1 -- 172.21.15.69:0/1272825268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5184009400 con 0x7f5194182b70 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.973+0000 7f5192800640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f519406ac20 0x7f519417a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.974+0000 7f5193200640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 0x7f51940d2360 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c6e0 tx=0x7f518c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.974+0000 7f518aa00640 1 -- 172.21.15.69:0/1272825268 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c003b70 con 0x7f5194182b70 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.974+0000 7f518aa00640 1 -- 172.21.15.69:0/1272825268 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c003cf0 con 0x7f5194182b70 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.974+0000 7f518aa00640 1 -- 172.21.15.69:0/1272825268 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c005310 con 0x7f5194182b70 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.974+0000 7f5198a00640 1 -- 172.21.15.69:0/1272825268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5194170270 con 0x7f5194182b70 2024-02-21T07:45:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.974+0000 7f5198a00640 1 -- 172.21.15.69:0/1272825268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51940d12c0 con 0x7f5194182b70 2024-02-21T07:45:28.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.976+0000 7f5198a00640 1 -- 172.21.15.69:0/1272825268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51940d2080 con 0x7f5194182b70 2024-02-21T07:45:28.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.978+0000 7f518aa00640 1 -- 172.21.15.69:0/1272825268 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f518c005470 con 0x7f5194182b70 2024-02-21T07:45:28.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.979+0000 7f518aa00640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f517409f0a0 0x7f51740a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:28.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.979+0000 7f518aa00640 1 -- 172.21.15.69:0/1272825268 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f518c0c97f0 con 0x7f5194182b70 2024-02-21T07:45:28.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.979+0000 7f5192800640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f517409f0a0 0x7f51740a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:28.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.980+0000 7f5192800640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f517409f0a0 0x7f51740a1560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5184036000 tx=0x7f518403c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:28.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:28.985+0000 7f518aa00640 1 -- 172.21.15.69:0/1272825268 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f51940d2080 con 0x7f5194182b70 2024-02-21T07:45:29.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.193+0000 7f5198a00640 1 -- 172.21.15.69:0/1272825268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51940d2080 con 0x7f5194182b70 2024-02-21T07:45:29.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.194+0000 7f518aa00640 1 -- 172.21.15.69:0/1272825268 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51940d2080 con 0x7f5194182b70 2024-02-21T07:45:29.200 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-02-21T07:45:29.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 -- 172.21.15.69:0/1272825268 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f517409f0a0 msgr2=0x7f51740a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f517409f0a0 0x7f51740a1560 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5184036000 tx=0x7f518403c040 comp rx=0 tx=0).stop 2024-02-21T07:45:29.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 -- 172.21.15.69:0/1272825268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 msgr2=0x7f51940d2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 0x7f51940d2360 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c6e0 tx=0x7f518c00cba0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 -- 172.21.15.69:0/1272825268 shutdown_connections 2024-02-21T07:45:29.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f517409f0a0 0x7f51740a1560 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5194182b70 0x7f51940d2360 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f51940fb840 0x7f519416fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 --2- 172.21.15.69:0/1272825268 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f519406ac20 0x7f519417a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 -- 172.21.15.69:0/1272825268 >> 172.21.15.69:0/1272825268 conn(0x7f51940d2ae0 msgr2=0x7f519406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:29.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 -- 172.21.15.69:0/1272825268 shutdown_connections 2024-02-21T07:45:29.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.197+0000 7f5198a00640 1 -- 172.21.15.69:0/1272825268 wait complete. 2024-02-21T07:45:29.226 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:45:29.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.410+0000 7fab53400640 1 Processor -- start 2024-02-21T07:45:29.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.411+0000 7fab53400640 1 -- start start 2024-02-21T07:45:29.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.413+0000 7fab53400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fab4c070780 0x7fab4c074280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.413+0000 7fab53400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c0719e0 con 0x7fab4c17f4e0 2024-02-21T07:45:29.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.413+0000 7fab53400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c17f8c0 con 0x7fab4c0747c0 2024-02-21T07:45:29.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.413+0000 7fab53400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c06caa0 con 0x7fab4c070780 2024-02-21T07:45:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.413+0000 7fab50a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fab4c17f4e0 0x7fab4c0712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:33100/0 (socket says 172.21.15.69:33100) 2024-02-21T07:45:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.413+0000 7fab50a00640 1 -- 172.21.15.69:0/2193201222 learned_addr learned my addr 172.21.15.69:0/2193201222 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.414+0000 7fab43e00640 1 --2- 172.21.15.69:0/2193201222 >> v2:172.21.15.184:3300/0 conn(0x7fab4c070780 0x7fab4c074280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.414+0000 7fab43e00640 1 -- 172.21.15.69:0/2193201222 >> v1:172.21.15.174:6789/0 conn(0x7fab4c0747c0 legacy=0x7fab4c1889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.414+0000 7fab4be00640 1 -- 172.21.15.69:0/2193201222 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180979604 0 0) 0x7fab4c0719e0 con 0x7fab4c17f4e0 2024-02-21T07:45:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.414+0000 7fab43e00640 1 -- 172.21.15.69:0/2193201222 >> v1:172.21.15.69:6789/0 conn(0x7fab4c17f4e0 legacy=0x7fab4c0712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.414+0000 7fab43e00640 1 -- 172.21.15.69:0/2193201222 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c06f6e0 con 0x7fab4c070780 2024-02-21T07:45:29.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.415+0000 7fab43e00640 1 --2- 172.21.15.69:0/2193201222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c070780 0x7fab4c074280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fab340097a0 tx=0x7fab3402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f32127a43ee26e94 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:29.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.416+0000 7fab4be00640 1 -- 172.21.15.69:0/2193201222 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34031830 con 0x7fab4c070780 2024-02-21T07:45:29.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.416+0000 7fab4be00640 1 -- 172.21.15.69:0/2193201222 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab34031990 con 0x7fab4c070780 2024-02-21T07:45:29.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.416+0000 7fab4be00640 1 -- 172.21.15.69:0/2193201222 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34031d20 con 0x7fab4c070780 2024-02-21T07:45:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.417+0000 7fab53400640 1 -- 172.21.15.69:0/2193201222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c070780 msgr2=0x7fab4c074280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.417+0000 7fab53400640 1 --2- 172.21.15.69:0/2193201222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c070780 0x7fab4c074280 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fab340097a0 tx=0x7fab3402b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.417+0000 7fab53400640 1 -- 172.21.15.69:0/2193201222 shutdown_connections 2024-02-21T07:45:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.417+0000 7fab53400640 1 --2- 172.21.15.69:0/2193201222 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c070780 0x7fab4c074280 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.417+0000 7fab53400640 1 -- 172.21.15.69:0/2193201222 >> 172.21.15.69:0/2193201222 conn(0x7fab4c0cf570 msgr2=0x7fab4c0cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.417+0000 7fab53400640 1 -- 172.21.15.69:0/2193201222 shutdown_connections 2024-02-21T07:45:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.417+0000 7fab53400640 1 -- 172.21.15.69:0/2193201222 wait complete. 2024-02-21T07:45:29.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.419+0000 7fab53400640 1 Processor -- start 2024-02-21T07:45:29.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.419+0000 7fab53400640 1 -- start start 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.420+0000 7fab53400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab4c070780 0x7fab4c16e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.420+0000 7fab53400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c0747c0 0x7fab4c17e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab53400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4c17f4e0 0x7fab4c17e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab53400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c17dc70 con 0x7fab4c17f4e0 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab53400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c17d330 con 0x7fab4c070780 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab53400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0f73f0 con 0x7fab4c0747c0 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab51400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4c17f4e0 0x7fab4c17e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab51400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4c17f4e0 0x7fab4c17e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46638/0 (socket says 172.21.15.69:46638) 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab51400640 1 -- 172.21.15.69:0/542542863 learned_addr learned my addr 172.21.15.69:0/542542863 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab43e00640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c0747c0 0x7fab4c17e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab50a00640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab4c070780 0x7fab4c16e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab43e00640 1 -- 172.21.15.69:0/542542863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab4c070780 msgr2=0x7fab4c16e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab43e00640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab4c070780 0x7fab4c16e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab43e00640 1 -- 172.21.15.69:0/542542863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4c17f4e0 msgr2=0x7fab4c17e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab43e00640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4c17f4e0 0x7fab4c17e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.421+0000 7fab43e00640 1 -- 172.21.15.69:0/542542863 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34009400 con 0x7fab4c0747c0 2024-02-21T07:45:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.422+0000 7fab43e00640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c0747c0 0x7fab4c17e090 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fab34033000 tx=0x7fab340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.422+0000 7fab49600640 1 -- 172.21.15.69:0/542542863 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3403aa60 con 0x7fab4c0747c0 2024-02-21T07:45:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.422+0000 7fab49600640 1 -- 172.21.15.69:0/542542863 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3403abc0 con 0x7fab4c0747c0 2024-02-21T07:45:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.422+0000 7fab53400640 1 -- 172.21.15.69:0/542542863 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c0f76d0 con 0x7fab4c0747c0 2024-02-21T07:45:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.422+0000 7fab49600640 1 -- 172.21.15.69:0/542542863 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab340443f0 con 0x7fab4c0747c0 2024-02-21T07:45:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.422+0000 7fab53400640 1 -- 172.21.15.69:0/542542863 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c17d890 con 0x7fab4c0747c0 2024-02-21T07:45:29.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.423+0000 7fab53400640 1 -- 172.21.15.69:0/542542863 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c17ddb0 con 0x7fab4c0747c0 2024-02-21T07:45:29.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.426+0000 7fab49600640 1 -- 172.21.15.69:0/542542863 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fab3404d450 con 0x7fab4c0747c0 2024-02-21T07:45:29.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.427+0000 7fab49600640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fab2809f0a0 0x7fab280a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.427+0000 7fab49600640 1 -- 172.21.15.69:0/542542863 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fab340ebc70 con 0x7fab4c0747c0 2024-02-21T07:45:29.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.427+0000 7fab50a00640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fab2809f0a0 0x7fab280a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.428+0000 7fab50a00640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fab2809f0a0 0x7fab280a1560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fab3c000f60 tx=0x7fab3c007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:29.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.431+0000 7fab49600640 1 -- 172.21.15.69:0/542542863 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fab340b59f0 con 0x7fab4c0747c0 2024-02-21T07:45:29.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.689+0000 7fab53400640 1 -- 172.21.15.69:0/542542863 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab4c069d50 con 0x7fab4c0747c0 2024-02-21T07:45:29.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.689+0000 7fab49600640 1 -- 172.21.15.69:0/542542863 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab340b90b0 con 0x7fab4c0747c0 2024-02-21T07:45:29.695 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:45:29.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.692+0000 7fab53400640 1 -- 172.21.15.69:0/542542863 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fab2809f0a0 msgr2=0x7fab280a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.692+0000 7fab53400640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fab2809f0a0 0x7fab280a1560 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fab3c000f60 tx=0x7fab3c007d50 comp rx=0 tx=0).stop 2024-02-21T07:45:29.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.692+0000 7fab53400640 1 -- 172.21.15.69:0/542542863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c0747c0 msgr2=0x7fab4c17e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.692+0000 7fab53400640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c0747c0 0x7fab4c17e090 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fab34033000 tx=0x7fab340046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.692+0000 7fab53400640 1 -- 172.21.15.69:0/542542863 shutdown_connections 2024-02-21T07:45:29.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.692+0000 7fab53400640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fab2809f0a0 0x7fab280a1560 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.692+0000 7fab53400640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4c17f4e0 0x7fab4c17e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.692+0000 7fab53400640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab4c0747c0 0x7fab4c17e090 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.692+0000 7fab53400640 1 --2- 172.21.15.69:0/542542863 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fab4c070780 0x7fab4c16e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.692+0000 7fab53400640 1 -- 172.21.15.69:0/542542863 >> 172.21.15.69:0/542542863 conn(0x7fab4c0cf570 msgr2=0x7fab4c17b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:29.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.693+0000 7fab53400640 1 -- 172.21.15.69:0/542542863 shutdown_connections 2024-02-21T07:45:29.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.693+0000 7fab53400640 1 -- 172.21.15.69:0/542542863 wait complete. 2024-02-21T07:45:29.717 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:45:29.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.947+0000 7f04d7800640 1 Processor -- start 2024-02-21T07:45:29.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.947+0000 7f04d7800640 1 -- start start 2024-02-21T07:45:29.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.950+0000 7f04d7800640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d0190540 con 0x7f04d006db70 2024-02-21T07:45:29.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.950+0000 7f04d7800640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d01912c0 con 0x7f04d018a780 2024-02-21T07:45:29.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.950+0000 7f04d7800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d006e110 con 0x7f04d018b4b0 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.950+0000 7f04d5800640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f04d018b4b0 0x7f04d0072720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.69:43642/0 (socket says 172.21.15.69:43642) 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.950+0000 7f04d5800640 1 -- 172.21.15.69:0/813956123 learned_addr learned my addr 172.21.15.69:0/813956123 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.950+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995604218 0 0) 0x7f04d01912c0 con 0x7f04d018a780 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b8003520 con 0x7f04d018a780 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908634567 0 0) 0x7f04d006e110 con 0x7f04d018b4b0 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d01912c0 con 0x7f04d018b4b0 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366021143 0 0) 0x7f04d0190540 con 0x7f04d006db70 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d006e110 con 0x7f04d006db70 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1464172230 0 0) 0x7f04b8003520 con 0x7f04d018a780 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 >> v1:172.21.15.184:6789/0 conn(0x7f04d018b4b0 legacy=0x7f04d0072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 >> v1:172.21.15.69:6789/0 conn(0x7f04d006db70 legacy=0x7f04d018ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d01907e0 con 0x7f04d018a780 2024-02-21T07:45:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7f04c4001670 con 0x7f04d018a780 2024-02-21T07:45:29.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 >> v1:172.21.15.174:6789/0 conn(0x7f04d018a780 legacy=0x7f04d006d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b8004da0 0x7f04b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04b80037b0 0x7f04b8003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004340 0x7f04b800b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c8001590 con 0x7f04b80037b0 2024-02-21T07:45:29.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b800c2c0 con 0x7f04b8004340 2024-02-21T07:45:29.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.951+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b800c480 con 0x7f04b8004da0 2024-02-21T07:45:29.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.952+0000 7f04d4e00640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b8004da0 0x7f04b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.952+0000 7f04cfe00640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04b80037b0 0x7f04b8003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.952+0000 7f04d5800640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004340 0x7f04b800b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.952+0000 7f04d4e00640 1 -- 172.21.15.69:0/813956123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004340 msgr2=0x7f04b800b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:29.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.952+0000 7f04d4e00640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004340 0x7f04b800b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.952+0000 7f04d4e00640 1 -- 172.21.15.69:0/813956123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04b80037b0 msgr2=0x7f04b8003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:29.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.952+0000 7f04d4e00640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04b80037b0 0x7f04b8003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.952+0000 7f04d4e00640 1 -- 172.21.15.69:0/813956123 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b8003520 con 0x7f04b8004da0 2024-02-21T07:45:29.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.952+0000 7f04d5800640 1 -- 172.21.15.69:0/813956123 reap_dead start 2024-02-21T07:45:29.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.954+0000 7f04d4e00640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b8004da0 0x7f04b8005180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f04c4007ed0 tx=0x7f04b80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b9350cddaf130ac server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:29.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.954+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c402c8a0 con 0x7f04b8004da0 2024-02-21T07:45:29.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.954+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c402ca20 con 0x7f04b8004da0 2024-02-21T07:45:29.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.954+0000 7f04cf400640 1 -- 172.21.15.69:0/813956123 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c402cdd0 con 0x7f04b8004da0 2024-02-21T07:45:29.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.955+0000 7f04d7800640 1 -- 172.21.15.69:0/813956123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b8004da0 msgr2=0x7f04b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.955+0000 7f04d7800640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b8004da0 0x7f04b8005180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f04c4007ed0 tx=0x7f04b80057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.955+0000 7f04d7800640 1 -- 172.21.15.69:0/813956123 shutdown_connections 2024-02-21T07:45:29.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.955+0000 7f04d7800640 1 --2- 172.21.15.69:0/813956123 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04b8004da0 0x7f04b8005180 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.955+0000 7f04d7800640 1 -- 172.21.15.69:0/813956123 >> 172.21.15.69:0/813956123 conn(0x7f04d00f7250 msgr2=0x7f04d00f7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:29.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.956+0000 7f04d7800640 1 -- 172.21.15.69:0/813956123 shutdown_connections 2024-02-21T07:45:29.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.956+0000 7f04d7800640 1 -- 172.21.15.69:0/813956123 wait complete. 2024-02-21T07:45:29.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.958+0000 7f04d7800640 1 Processor -- start 2024-02-21T07:45:29.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.958+0000 7f04d7800640 1 -- start start 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d7800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004da0 0x7f04d0164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d7800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04d0164c60 0x7f04d018e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d7800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d018e6e0 0x7f04d02209d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d7800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d018eec0 con 0x7f04d018e6e0 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d7800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d018f1a0 con 0x7f04b8004da0 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d7800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d018f480 con 0x7f04d0164c60 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d4e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004da0 0x7f04d0164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d4e00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004da0 0x7f04d0164720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40200/0 (socket says 172.21.15.69:40200) 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d5800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d018e6e0 0x7f04d02209d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d4e00640 1 -- 172.21.15.69:0/1753269593 learned_addr learned my addr 172.21.15.69:0/1753269593 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:29.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04cfe00640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04d0164c60 0x7f04d018e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d4e00640 1 -- 172.21.15.69:0/1753269593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04d0164c60 msgr2=0x7f04d018e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d4e00640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04d0164c60 0x7f04d018e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d4e00640 1 -- 172.21.15.69:0/1753269593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d018e6e0 msgr2=0x7f04d02209d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:29.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d4e00640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d018e6e0 0x7f04d02209d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:29.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.960+0000 7f04d4e00640 1 -- 172.21.15.69:0/1753269593 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d018f760 con 0x7f04b8004da0 2024-02-21T07:45:29.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.961+0000 7f04d4e00640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004da0 0x7f04d0164720 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f04c402b950 tx=0x7f04c4001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:29.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.961+0000 7f04ccc00640 1 -- 172.21.15.69:0/1753269593 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c40010d0 con 0x7f04b8004da0 2024-02-21T07:45:29.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.961+0000 7f04ccc00640 1 -- 172.21.15.69:0/1753269593 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c40054e0 con 0x7f04b8004da0 2024-02-21T07:45:29.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.961+0000 7f04ccc00640 1 -- 172.21.15.69:0/1753269593 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4003830 con 0x7f04b8004da0 2024-02-21T07:45:29.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.961+0000 7f04d7800640 1 -- 172.21.15.69:0/1753269593 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d018fa40 con 0x7f04b8004da0 2024-02-21T07:45:29.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.961+0000 7f04d7800640 1 -- 172.21.15.69:0/1753269593 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d018eb60 con 0x7f04b8004da0 2024-02-21T07:45:29.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.963+0000 7f04d7800640 1 -- 172.21.15.69:0/1753269593 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d0069d50 con 0x7f04b8004da0 2024-02-21T07:45:29.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.965+0000 7f04ccc00640 1 -- 172.21.15.69:0/1753269593 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f04c403b050 con 0x7f04b8004da0 2024-02-21T07:45:29.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.966+0000 7f04ccc00640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f04b009f0a0 0x7f04b00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:29.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.966+0000 7f04ccc00640 1 -- 172.21.15.69:0/1753269593 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f04c40eb550 con 0x7f04b8004da0 2024-02-21T07:45:29.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.966+0000 7f04cfe00640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f04b009f0a0 0x7f04b00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:29.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.967+0000 7f04cfe00640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f04b009f0a0 0x7f04b00a1560 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04d00cd640 tx=0x7f04bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:29.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:29.968+0000 7f04ccc00640 1 -- 172.21.15.69:0/1753269593 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f04c40b52d0 con 0x7f04b8004da0 2024-02-21T07:45:30.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.190+0000 7f04d7800640 1 -- 172.21.15.69:0/1753269593 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04d018f1a0 con 0x7f04b8004da0 2024-02-21T07:45:30.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.190+0000 7f04ccc00640 1 -- 172.21.15.69:0/1753269593 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04c40390a0 con 0x7f04b8004da0 2024-02-21T07:45:30.196 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-02-21T07:45:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.193+0000 7f04d7800640 1 -- 172.21.15.69:0/1753269593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f04b009f0a0 msgr2=0x7f04b00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.193+0000 7f04d7800640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f04b009f0a0 0x7f04b00a1560 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04d00cd640 tx=0x7f04bc009040 comp rx=0 tx=0).stop 2024-02-21T07:45:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.193+0000 7f04d7800640 1 -- 172.21.15.69:0/1753269593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004da0 msgr2=0x7f04d0164720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.193+0000 7f04d7800640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004da0 0x7f04d0164720 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f04c402b950 tx=0x7f04c4001930 comp rx=0 tx=0).stop 2024-02-21T07:45:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.194+0000 7f04d7800640 1 -- 172.21.15.69:0/1753269593 shutdown_connections 2024-02-21T07:45:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.194+0000 7f04d7800640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f04b009f0a0 0x7f04b00a1560 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.194+0000 7f04d7800640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d018e6e0 0x7f04d02209d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.194+0000 7f04d7800640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f04d0164c60 0x7f04d018e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.194+0000 7f04d7800640 1 --2- 172.21.15.69:0/1753269593 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f04b8004da0 0x7f04d0164720 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.194+0000 7f04d7800640 1 -- 172.21.15.69:0/1753269593 >> 172.21.15.69:0/1753269593 conn(0x7f04d00f7250 msgr2=0x7f04d0071cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.194+0000 7f04d7800640 1 -- 172.21.15.69:0/1753269593 shutdown_connections 2024-02-21T07:45:30.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.194+0000 7f04d7800640 1 -- 172.21.15.69:0/1753269593 wait complete. 2024-02-21T07:45:30.221 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:45:30.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.420+0000 7fe77bc00640 1 Processor -- start 2024-02-21T07:45:30.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.420+0000 7fe77bc00640 1 -- start start 2024-02-21T07:45:30.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.423+0000 7fe77bc00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe774186210 0x7fe774186a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.423+0000 7fe77bc00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fe7740fa060 0x7fe77406d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.423+0000 7fe77bc00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe77406d9a0 0x7fe77406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.423+0000 7fe77bc00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe774186f40 con 0x7fe774186210 2024-02-21T07:45:30.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.423+0000 7fe77bc00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe774071280 con 0x7fe7740fa060 2024-02-21T07:45:30.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.423+0000 7fe77bc00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740f9050 con 0x7fe77406d9a0 2024-02-21T07:45:30.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.423+0000 7fe779200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe774186210 0x7fe774186a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.423+0000 7fe779c00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fe77406d9a0 0x7fe77406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.423+0000 7fe779200640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe774186210 0x7fe774186a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46666/0 (socket says 172.21.15.69:46666) 2024-02-21T07:45:30.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.423+0000 7fe779200640 1 -- 172.21.15.69:0/99724396 learned_addr learned my addr 172.21.15.69:0/99724396 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:30.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.424+0000 7fe773e00640 1 --2- 172.21.15.69:0/99724396 >> v2:172.21.15.174:3300/0 conn(0x7fe7740fa060 0x7fe77406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.424+0000 7fe779c00640 1 -- 172.21.15.69:0/99724396 >> v2:172.21.15.174:3300/0 conn(0x7fe7740fa060 msgr2=0x7fe77406d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:30.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.424+0000 7fe779c00640 1 --2- 172.21.15.69:0/99724396 >> v2:172.21.15.174:3300/0 conn(0x7fe7740fa060 0x7fe77406d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.424+0000 7fe779c00640 1 -- 172.21.15.69:0/99724396 >> v2:172.21.15.69:3300/0 conn(0x7fe774186210 msgr2=0x7fe774186a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:30.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.424+0000 7fe779c00640 1 --2- 172.21.15.69:0/99724396 >> v2:172.21.15.69:3300/0 conn(0x7fe774186210 0x7fe774186a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.424+0000 7fe779c00640 1 -- 172.21.15.69:0/99724396 --> v2:172.21.15.184:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7740f9bd0 con 0x7fe77406d9a0 2024-02-21T07:45:30.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.426+0000 7fe779c00640 1 --2- 172.21.15.69:0/99724396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77406d9a0 0x7fe77406ea50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe7740f7f00 tx=0x7fe76c02bdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fa7c5b0a0ac803 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:30.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.426+0000 7fe773400640 1 -- 172.21.15.69:0/99724396 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c02cb70 con 0x7fe77406d9a0 2024-02-21T07:45:30.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.426+0000 7fe773400640 1 -- 172.21.15.69:0/99724396 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c02ccd0 con 0x7fe77406d9a0 2024-02-21T07:45:30.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.426+0000 7fe773400640 1 -- 172.21.15.69:0/99724396 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c034660 con 0x7fe77406d9a0 2024-02-21T07:45:30.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.427+0000 7fe77bc00640 1 -- 172.21.15.69:0/99724396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77406d9a0 msgr2=0x7fe77406ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.427+0000 7fe77bc00640 1 --2- 172.21.15.69:0/99724396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77406d9a0 0x7fe77406ea50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe7740f7f00 tx=0x7fe76c02bdc0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.427+0000 7fe77bc00640 1 -- 172.21.15.69:0/99724396 shutdown_connections 2024-02-21T07:45:30.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.427+0000 7fe77bc00640 1 --2- 172.21.15.69:0/99724396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe77406d9a0 0x7fe77406ea50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.427+0000 7fe77bc00640 1 --2- 172.21.15.69:0/99724396 >> v2:172.21.15.174:3300/0 conn(0x7fe7740fa060 0x7fe77406d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.427+0000 7fe77bc00640 1 --2- 172.21.15.69:0/99724396 >> v2:172.21.15.69:3300/0 conn(0x7fe774186210 0x7fe774186a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.427+0000 7fe77bc00640 1 -- 172.21.15.69:0/99724396 >> 172.21.15.69:0/99724396 conn(0x7fe7740f7250 msgr2=0x7fe7740f7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:30.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.427+0000 7fe77bc00640 1 -- 172.21.15.69:0/99724396 shutdown_connections 2024-02-21T07:45:30.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.427+0000 7fe77bc00640 1 -- 172.21.15.69:0/99724396 wait complete. 2024-02-21T07:45:30.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.429+0000 7fe77bc00640 1 Processor -- start 2024-02-21T07:45:30.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.429+0000 7fe77bc00640 1 -- start start 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.430+0000 7fe77bc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77406d9a0 0x7fe77417a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe77bc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7740fa060 0x7fe774178c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe77bc00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe774186210 0x7fe7740f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe77bc00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7740f80d0 con 0x7fe77406d9a0 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe77bc00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77417ab30 con 0x7fe774186210 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe77bc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77417ae10 con 0x7fe7740fa060 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe779200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77406d9a0 0x7fe77417a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe773e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7740fa060 0x7fe774178c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe779200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77406d9a0 0x7fe77417a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46680/0 (socket says 172.21.15.69:46680) 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe779200640 1 -- 172.21.15.69:0/3653403526 learned_addr learned my addr 172.21.15.69:0/3653403526 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:30.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe779c00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe774186210 0x7fe7740f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.431+0000 7fe773e00640 1 -- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe774186210 msgr2=0x7fe7740f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe773e00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe774186210 0x7fe7740f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe773e00640 1 -- 172.21.15.69:0/3653403526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77406d9a0 msgr2=0x7fe77417a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe773e00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77406d9a0 0x7fe77417a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe773e00640 1 -- 172.21.15.69:0/3653403526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c009a70 con 0x7fe7740fa060 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe779200640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77406d9a0 0x7fe77417a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe779c00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe774186210 0x7fe7740f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe773e00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7740fa060 0x7fe774178c60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe76000e660 tx=0x7fe76000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe770c00640 1 -- 172.21.15.69:0/3653403526 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76000c730 con 0x7fe7740fa060 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe770c00640 1 -- 172.21.15.69:0/3653403526 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76000c890 con 0x7fe7740fa060 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe77bc00640 1 -- 172.21.15.69:0/3653403526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77417b0f0 con 0x7fe7740fa060 2024-02-21T07:45:30.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.432+0000 7fe77bc00640 1 -- 172.21.15.69:0/3653403526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77417b6b0 con 0x7fe7740fa060 2024-02-21T07:45:30.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.433+0000 7fe770c00640 1 -- 172.21.15.69:0/3653403526 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76000cc00 con 0x7fe7740fa060 2024-02-21T07:45:30.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.434+0000 7fe77bc00640 1 -- 172.21.15.69:0/3653403526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe750005290 con 0x7fe7740fa060 2024-02-21T07:45:30.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.436+0000 7fe770c00640 1 -- 172.21.15.69:0/3653403526 <== mon.2 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe760013470 con 0x7fe7740fa060 2024-02-21T07:45:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.438+0000 7fe770c00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe75409f0a0 0x7fe7540a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.438+0000 7fe770c00640 1 -- 172.21.15.69:0/3653403526 <== mon.2 v2:172.21.15.184:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe7600c9ac0 con 0x7fe7740fa060 2024-02-21T07:45:30.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.438+0000 7fe779200640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe75409f0a0 0x7fe7540a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.439+0000 7fe779200640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe75409f0a0 0x7fe7540a1560 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe774179e70 tx=0x7fe768009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:30.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.442+0000 7fe770c00640 1 -- 172.21.15.69:0/3653403526 <== mon.2 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe7600938c0 con 0x7fe7740fa060 2024-02-21T07:45:30.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.901+0000 7fe77bc00640 1 -- 172.21.15.69:0/3653403526 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe750005ac0 con 0x7fe7740fa060 2024-02-21T07:45:30.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.904+0000 7fe770c00640 1 -- 172.21.15.69:0/3653403526 <== mon.2 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe7600b4e60 con 0x7fe7740fa060 2024-02-21T07:45:30.910 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-02-21T07:45:30.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.910+0000 7fe77bc00640 1 -- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe75409f0a0 msgr2=0x7fe7540a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.910+0000 7fe77bc00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe75409f0a0 0x7fe7540a1560 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe774179e70 tx=0x7fe768009240 comp rx=0 tx=0).stop 2024-02-21T07:45:30.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.910+0000 7fe77bc00640 1 -- 172.21.15.69:0/3653403526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7740fa060 msgr2=0x7fe774178c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.910+0000 7fe77bc00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7740fa060 0x7fe774178c60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe76000e660 tx=0x7fe76000eb20 comp rx=0 tx=0).stop 2024-02-21T07:45:30.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.910+0000 7fe77bc00640 1 -- 172.21.15.69:0/3653403526 shutdown_connections 2024-02-21T07:45:30.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.910+0000 7fe77bc00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe75409f0a0 0x7fe7540a1560 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.910+0000 7fe77bc00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe774186210 0x7fe7740f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.910+0000 7fe77bc00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe7740fa060 0x7fe774178c60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.910+0000 7fe77bc00640 1 --2- 172.21.15.69:0/3653403526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe77406d9a0 0x7fe77417a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.910+0000 7fe77bc00640 1 -- 172.21.15.69:0/3653403526 >> 172.21.15.69:0/3653403526 conn(0x7fe7740f7250 msgr2=0x7fe774070a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:30.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.911+0000 7fe77bc00640 1 -- 172.21.15.69:0/3653403526 shutdown_connections 2024-02-21T07:45:30.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:30.911+0000 7fe77bc00640 1 -- 172.21.15.69:0/3653403526 wait complete. 2024-02-21T07:45:30.956 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T07:45:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.960+0000 7f32f2a00640 1 Processor -- start 2024-02-21T07:45:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.960+0000 7f32f2a00640 1 -- start start 2024-02-21T07:45:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.963+0000 7f32f2a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f32e410f210 0x7f32e40e3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.963+0000 7f32f2a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f32e40e3670 0x7f32e410d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.963+0000 7f32f2a00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e410f8d0 con 0x7f32e41077c0 2024-02-21T07:45:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.963+0000 7f32f2a00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e4111c10 con 0x7f32e40e3670 2024-02-21T07:45:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.963+0000 7f32f2a00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e410f6c0 con 0x7f32e410f210 2024-02-21T07:45:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.964+0000 7f32eb400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f32e410f210 0x7f32e40e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.965+0000 7f32ebe00640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7f32e41077c0 0x7f32e410eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:57662/0 (socket says 172.21.15.69:57662) 2024-02-21T07:45:30.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.965+0000 7f32ebe00640 1 -- 172.21.15.69:0/2130686698 learned_addr learned my addr 172.21.15.69:0/2130686698 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.966+0000 7f32eb400640 1 -- 172.21.15.69:0/2130686698 >> v2:172.21.15.69:3300/0 conn(0x7f32e40e3670 msgr2=0x7f32e410d840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:45:30.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.966+0000 7f32f0a00640 1 --2- 172.21.15.69:0/2130686698 >> v2:172.21.15.69:3300/0 conn(0x7f32e40e3670 0x7f32e410d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.966+0000 7f32eb400640 1 --2- 172.21.15.69:0/2130686698 >> v2:172.21.15.69:3300/0 conn(0x7f32e40e3670 0x7f32e410d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.966+0000 7f32eb400640 1 -- 172.21.15.69:0/2130686698 >> v1:172.21.15.174:6789/0 conn(0x7f32e41077c0 legacy=0x7f32e410eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.966+0000 7f32eb400640 1 -- 172.21.15.69:0/2130686698 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e410fbb0 con 0x7f32e410f210 2024-02-21T07:45:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.968+0000 7f32eb400640 1 --2- 172.21.15.69:0/2130686698 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32e410f210 0x7f32e40e3130 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32e40065d0 tx=0x7f32e002b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3430817a6847d5be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.968+0000 7f32eaa00640 1 -- 172.21.15.69:0/2130686698 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0031750 con 0x7f32e410f210 2024-02-21T07:45:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.969+0000 7f32eaa00640 1 -- 172.21.15.69:0/2130686698 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e00318b0 con 0x7f32e410f210 2024-02-21T07:45:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.969+0000 7f32eaa00640 1 -- 172.21.15.69:0/2130686698 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0031c80 con 0x7f32e410f210 2024-02-21T07:45:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.970+0000 7f32f2a00640 1 -- 172.21.15.69:0/2130686698 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32e410f210 msgr2=0x7f32e40e3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.970+0000 7f32f2a00640 1 --2- 172.21.15.69:0/2130686698 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32e410f210 0x7f32e40e3130 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32e40065d0 tx=0x7f32e002b7f0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.972+0000 7f32f0a00640 1 --2- 172.21.15.69:0/2130686698 >> v2:172.21.15.69:3300/0 conn(0x7f32e40e3670 0x7f32e410d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.973+0000 7f32f2a00640 1 -- 172.21.15.69:0/2130686698 shutdown_connections 2024-02-21T07:45:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.973+0000 7f32f2a00640 1 --2- 172.21.15.69:0/2130686698 >> v2:172.21.15.69:3300/0 conn(0x7f32e40e3670 0x7f32e410d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.973+0000 7f32f2a00640 1 --2- 172.21.15.69:0/2130686698 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32e410f210 0x7f32e40e3130 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.973+0000 7f32f2a00640 1 -- 172.21.15.69:0/2130686698 >> 172.21.15.69:0/2130686698 conn(0x7f32e4052e00 msgr2=0x7f32e4053210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.974+0000 7f32f2a00640 1 -- 172.21.15.69:0/2130686698 shutdown_connections 2024-02-21T07:45:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.974+0000 7f32f2a00640 1 -- 172.21.15.69:0/2130686698 wait complete. 2024-02-21T07:45:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.980+0000 7f32f2a00640 1 Processor -- start 2024-02-21T07:45:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.983+0000 7f32f2a00640 1 -- start start 2024-02-21T07:45:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.985+0000 7f32f2a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32e40e3670 0x7f32e40e0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.985+0000 7f32f2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32e41077c0 0x7f32e41a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.985+0000 7f32f2a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32e410f210 0x7f32e4199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.985+0000 7f32f2a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e419ac80 con 0x7f32e41077c0 2024-02-21T07:45:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.985+0000 7f32f2a00640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e40e1a70 con 0x7f32e40e3670 2024-02-21T07:45:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.985+0000 7f32f2a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e419a9a0 con 0x7f32e410f210 2024-02-21T07:45:30.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.985+0000 7f32ebe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32e40e3670 0x7f32e40e0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.986+0000 7f32ebe00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32e40e3670 0x7f32e40e0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40222/0 (socket says 172.21.15.69:40222) 2024-02-21T07:45:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.986+0000 7f32ebe00640 1 -- 172.21.15.69:0/3446457051 learned_addr learned my addr 172.21.15.69:0/3446457051 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.986+0000 7f32eb400640 1 --2- 172.21.15.69:0/3446457051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32e41077c0 0x7f32e41a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.986+0000 7f32ebe00640 1 -- 172.21.15.69:0/3446457051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32e410f210 msgr2=0x7f32e4199cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:45:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.986+0000 7f32ebe00640 1 --2- 172.21.15.69:0/3446457051 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f32e410f210 0x7f32e4199cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:30.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.986+0000 7f32ebe00640 1 -- 172.21.15.69:0/3446457051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32e41077c0 msgr2=0x7f32e41a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.995+0000 7f32ebe00640 1 --2- 172.21.15.69:0/3446457051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32e41077c0 0x7f32e41a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.998+0000 7f32ebe00640 1 -- 172.21.15.69:0/3446457051 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e0009400 con 0x7f32e40e3670 2024-02-21T07:45:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:30.998+0000 7f32eb400640 1 --2- 172.21.15.69:0/3446457051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32e41077c0 0x7f32e41a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.000+0000 7f32ebe00640 1 --2- 172.21.15.69:0/3446457051 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f32e40e3670 0x7f32e40e0120 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f32d800c3c0 tx=0x7f32d800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.000+0000 7f32dfe00640 1 -- 172.21.15.69:0/3446457051 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8005ce0 con 0x7f32e40e3670 2024-02-21T07:45:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.000+0000 7f32f2a00640 1 -- 172.21.15.69:0/3446457051 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e40e10d0 con 0x7f32e40e3670 2024-02-21T07:45:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.001+0000 7f32f2a00640 1 -- 172.21.15.69:0/3446457051 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e40e1690 con 0x7f32e40e3670 2024-02-21T07:45:31.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.001+0000 7f32dfe00640 1 -- 172.21.15.69:0/3446457051 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d8005e40 con 0x7f32e40e3670 2024-02-21T07:45:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.001+0000 7f32dfe00640 1 -- 172.21.15.69:0/3446457051 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d8005ce0 con 0x7f32e40e3670 2024-02-21T07:45:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.011+0000 7f32dfe00640 1 -- 172.21.15.69:0/3446457051 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f32d80070d0 con 0x7f32e40e3670 2024-02-21T07:45:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.013+0000 7f32dfe00640 1 --2- 172.21.15.69:0/3446457051 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f32cc09f080 0x7f32cc0a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.020+0000 7f32dfe00640 1 -- 172.21.15.69:0/3446457051 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f32d80c8ce0 con 0x7f32e40e3670 2024-02-21T07:45:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.021+0000 7f32f581d740 1 Processor -- start 2024-02-21T07:45:31.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.021+0000 7f32f581d740 1 -- start start 2024-02-21T07:45:31.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.022+0000 7f32eb400640 1 --2- 172.21.15.69:0/3446457051 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f32cc09f080 0x7f32cc0a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.024+0000 7f32eb400640 1 --2- 172.21.15.69:0/3446457051 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f32cc09f080 0x7f32cc0a1540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f32e0035000 tx=0x7f32e0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.027+0000 7f32f581d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef70230 0x55acdef2f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.028+0000 7f32f581d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdef34c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.028+0000 7f32f581d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef35150 0x55acdef70610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.028+0000 7f32f581d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdeef0620 con 0x55acdef70230 2024-02-21T07:45:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.029+0000 7f32f581d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdeea28c0 con 0x55acdefa4690 2024-02-21T07:45:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.029+0000 7f32f581d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdee9fdf0 con 0x55acdef35150 2024-02-21T07:45:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.029+0000 7f32eb400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdef34c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.029+0000 7f32eb400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdef34c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40232/0 (socket says 172.21.15.69:40232) 2024-02-21T07:45:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.029+0000 7f32eb400640 1 -- 172.21.15.69:0/1517336167 learned_addr learned my addr 172.21.15.69:0/1517336167 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:31.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.029+0000 7f32f0a00640 1 --2- 172.21.15.69:0/1517336167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef35150 0x55acdef70610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.030+0000 7f32eb400640 1 -- 172.21.15.69:0/1517336167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef35150 msgr2=0x55acdef70610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.030+0000 7f32eb400640 1 --2- 172.21.15.69:0/1517336167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef35150 0x55acdef70610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.030+0000 7f32eb400640 1 -- 172.21.15.69:0/1517336167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef70230 msgr2=0x55acdef2f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.030+0000 7f32eb400640 1 --2- 172.21.15.69:0/1517336167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef70230 0x55acdef2f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.030+0000 7f32eb400640 1 -- 172.21.15.69:0/1517336167 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acdee1cb00 con 0x55acdefa4690 2024-02-21T07:45:31.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.036+0000 7f32eb400640 1 --2- 172.21.15.69:0/1517336167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdef34c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f32e0031ba0 tx=0x7f32e0030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa7abb441550a9b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.038+0000 7f32d3e00640 1 -- 172.21.15.69:0/1517336167 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e003ec40 con 0x55acdefa4690 2024-02-21T07:45:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.039+0000 7f32d3e00640 1 -- 172.21.15.69:0/1517336167 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e0045040 con 0x55acdefa4690 2024-02-21T07:45:31.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.039+0000 7f32d3e00640 1 -- 172.21.15.69:0/1517336167 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0033440 con 0x55acdefa4690 2024-02-21T07:45:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.040+0000 7f32f581d740 1 -- 172.21.15.69:0/1517336167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 msgr2=0x55acdef34c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.040+0000 7f32f581d740 1 --2- 172.21.15.69:0/1517336167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdef34c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f32e0031ba0 tx=0x7f32e0030000 comp rx=0 tx=0).stop 2024-02-21T07:45:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.043+0000 7f32f581d740 1 -- 172.21.15.69:0/1517336167 shutdown_connections 2024-02-21T07:45:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.043+0000 7f32f581d740 1 --2- 172.21.15.69:0/1517336167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef35150 0x55acdef70610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.043+0000 7f32f581d740 1 --2- 172.21.15.69:0/1517336167 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdef34c10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.043+0000 7f32f581d740 1 --2- 172.21.15.69:0/1517336167 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef70230 0x55acdef2f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.043+0000 7f32f581d740 1 -- 172.21.15.69:0/1517336167 >> 172.21.15.69:0/1517336167 conn(0x55acdeefc4b0 msgr2=0x55acdef33e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:31.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.044+0000 7f32f581d740 1 -- 172.21.15.69:0/1517336167 shutdown_connections 2024-02-21T07:45:31.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.044+0000 7f32f581d740 1 -- 172.21.15.69:0/1517336167 wait complete. 2024-02-21T07:45:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.050+0000 7f32f581d740 1 -- start start 2024-02-21T07:45:31.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.050+0000 7f32f581d740 1 Processor -- start 2024-02-21T07:45:31.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.056+0000 7f32f581d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 0x55acdef72c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.056+0000 7f32f581d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef70230 0x55acdef601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.056+0000 7f32f581d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdefa6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.057+0000 7f32f0a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdefa6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.057+0000 7f32f0a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdefa6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40238/0 (socket says 172.21.15.69:40238) 2024-02-21T07:45:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.058+0000 7f32f581d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdee9b5d0 con 0x55acdef35150 2024-02-21T07:45:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.058+0000 7f32f581d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdee40b50 con 0x55acdefa4690 2024-02-21T07:45:31.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.058+0000 7f32f581d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdee407f0 con 0x55acdef70230 2024-02-21T07:45:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.058+0000 7f32eb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef70230 0x55acdef601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.067 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.057+0000 7f32ebe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 0x55acdef72c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.059+0000 7f32f0a00640 1 -- 172.21.15.69:0/3888190540 learned_addr learned my addr 172.21.15.69:0/3888190540 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:31.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.066+0000 7f32f581d740 10 client.0 _ll_register_callbacks cb 0x55acdee54550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.068+0000 7f32eb400640 1 -- 172.21.15.69:0/3888190540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 msgr2=0x55acdefa6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.068+0000 7f32eb400640 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdefa6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.068+0000 7f32eb400640 1 -- 172.21.15.69:0/3888190540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 msgr2=0x55acdef72c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.068+0000 7f32eb400640 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 0x55acdef72c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.068+0000 7f32eb400640 1 -- 172.21.15.69:0/3888190540 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e410fbb0 con 0x55acdef70230 2024-02-21T07:45:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.069+0000 7f32f0a00640 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdefa6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T07:45:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.071+0000 7f32f581d740 1 -- 172.21.15.69:0/3888190540 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55acdee6dcd0 con 0x55acdef70230 2024-02-21T07:45:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.071+0000 7f32d0c00640 10 client.6074 ms_handle_connect on v2:172.21.15.184:3300/0 2024-02-21T07:45:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.072+0000 7f32eb400640 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef70230 0x55acdef601f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f32e004d000 tx=0x7f32e0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c619a572633cfbf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.073+0000 7f32d0c00640 1 -- 172.21.15.69:0/3888190540 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0033b00 con 0x55acdef70230 2024-02-21T07:45:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.073+0000 7f32d0c00640 1 -- 172.21.15.69:0/3888190540 <== mon.2 v2:172.21.15.184:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f32e0033c60 con 0x55acdef70230 2024-02-21T07:45:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.074+0000 7f32d0c00640 1 -- 172.21.15.69:0/3888190540 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32e0033b00 con 0x55acdef70230 2024-02-21T07:45:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.074+0000 7f32f581d740 10 client.6074 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.074+0000 7f32f581d740 1 -- 172.21.15.69:0/3888190540 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({fsmap=26}) v3 -- 0x55acdee99c50 con 0x55acdef70230 2024-02-21T07:45:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.075+0000 7f32d0c00640 1 -- 172.21.15.69:0/3888190540 <== mon.2 v2:172.21.15.184:3300/0 4 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f32e0048070 con 0x55acdef70230 2024-02-21T07:45:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.075+0000 7f32f581d740 10 client.6074 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.075+0000 7f32f581d740 10 client.6074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:45:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.075+0000 7f32f581d740 20 client.6074 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.076+0000 7f32f581d740 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55acdef6a810 0x55acdef2e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.077+0000 7f32f581d740 4 client.6074 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T07:45:31.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.078+0000 7f32ebe00640 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55acdef6a810 0x55acdef2e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.078+0000 7f32f581d740 1 -- 172.21.15.69:0/3888190540 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55acdee91ce0 con 0x55acdef6a810 2024-02-21T07:45:31.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.080+0000 7f32ebe00640 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55acdef6a810 0x55acdef2e980 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f14f58f45b789dd6 server_cookie=deeee919325ae309 in_seq=0 out_seq=0 2024-02-21T07:45:31.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.080+0000 7f32d0c00640 10 client.6074 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.088+0000 7f32d0c00640 1 -- 172.21.15.69:0/3888190540 <== mds.0 v2:172.21.15.69:6838/3963425058 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55acdee91ce0 con 0x55acdef6a810 2024-02-21T07:45:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.088+0000 7f32d0c00640 10 client.6074 handle_command_reply: tid=0 2024-02-21T07:45:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.089+0000 7f32f581d740 1 client.6074 shutdown 2024-02-21T07:45:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.090+0000 7f32f581d740 1 -- 172.21.15.69:0/3888190540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef70230 msgr2=0x55acdef601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.090+0000 7f32f581d740 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef70230 0x55acdef601f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f32e004d000 tx=0x7f32e0004730 comp rx=0 tx=0).stop 2024-02-21T07:45:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.092+0000 7f32f581d740 1 -- 172.21.15.69:0/3888190540 shutdown_connections 2024-02-21T07:45:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.092+0000 7f32f581d740 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55acdef6a810 0x55acdef2e980 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.092+0000 7f32f581d740 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefa4690 0x55acdefa6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.092+0000 7f32f581d740 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdef70230 0x55acdef601f0 secure :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f32e004d000 tx=0x7f32e0004730 comp rx=0 tx=0).stop 2024-02-21T07:45:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.092+0000 7f32f581d740 1 --2- 172.21.15.69:0/3888190540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 0x55acdef72c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.092+0000 7f32f581d740 1 -- 172.21.15.69:0/3888190540 >> 172.21.15.69:0/3888190540 conn(0x55acdeefc4b0 msgr2=0x55acdef3b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.092+0000 7f32d0c00640 0 client.6074 ms_handle_reset on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.093+0000 7f32f581d740 1 -- 172.21.15.69:0/3888190540 shutdown_connections 2024-02-21T07:45:31.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.094+0000 7f32f581d740 1 -- 172.21.15.69:0/3888190540 wait complete. 2024-02-21T07:45:31.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.095+0000 7f32f581d740 20 client.6074 trim_cache size 0 max 16384 2024-02-21T07:45:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.138+0000 7f32f581d740 1 Processor -- start 2024-02-21T07:45:31.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.139+0000 7f32f581d740 1 -- start start 2024-02-21T07:45:31.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.146+0000 7f32f581d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 0x55acdef74630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.146+0000 7f32f581d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 0x55acdf003130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.150+0000 7f32f581d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdef757b0 0x55acdf0090a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.163 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.150+0000 7f32f581d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdebe3e60 con 0x55acdef35150 2024-02-21T07:45:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.150+0000 7f32f581d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdef6c830 con 0x55acdef757b0 2024-02-21T07:45:31.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.153+0000 7f32f581d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdef334b0 con 0x55acdefa4690 2024-02-21T07:45:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.153+0000 7f32f0a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdef757b0 0x55acdf0090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.153+0000 7f32ebe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 0x55acdef74630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.151+0000 7f32eb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 0x55acdf003130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.154+0000 7f32eb400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 0x55acdf003130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:37564/0 (socket says 172.21.15.69:37564) 2024-02-21T07:45:31.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.154+0000 7f32eb400640 1 -- 172.21.15.69:0/2574292369 learned_addr learned my addr 172.21.15.69:0/2574292369 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:31.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.155+0000 7f32ebe00640 1 -- 172.21.15.69:0/2574292369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 msgr2=0x55acdf003130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:31.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.155+0000 7f32ebe00640 1 --2- 172.21.15.69:0/2574292369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 0x55acdf003130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.156+0000 7f32ebe00640 1 -- 172.21.15.69:0/2574292369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdef757b0 msgr2=0x55acdf0090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.156+0000 7f32ebe00640 1 --2- 172.21.15.69:0/2574292369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdef757b0 0x55acdf0090a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.156+0000 7f32ebe00640 1 -- 172.21.15.69:0/2574292369 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acdef75bc0 con 0x55acdef35150 2024-02-21T07:45:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.158+0000 7f32f0a00640 1 --2- 172.21.15.69:0/2574292369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdef757b0 0x55acdf0090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T07:45:31.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.158+0000 7f32eb400640 1 --2- 172.21.15.69:0/2574292369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 0x55acdf003130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.158+0000 7f32ebe00640 1 --2- 172.21.15.69:0/2574292369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 0x55acdef74630 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f32d80c66b0 tx=0x7f32d8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4e2c9f636f3767 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.159+0000 7f32d3400640 1 -- 172.21.15.69:0/2574292369 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d80948c0 con 0x55acdef35150 2024-02-21T07:45:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.159+0000 7f32d3400640 1 -- 172.21.15.69:0/2574292369 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d8094b20 con 0x55acdef35150 2024-02-21T07:45:31.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.159+0000 7f32d3400640 1 -- 172.21.15.69:0/2574292369 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d80c6ba0 con 0x55acdef35150 2024-02-21T07:45:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.160+0000 7f32f581d740 1 -- 172.21.15.69:0/2574292369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 msgr2=0x55acdef74630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.160+0000 7f32f581d740 1 --2- 172.21.15.69:0/2574292369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 0x55acdef74630 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f32d80c66b0 tx=0x7f32d8009040 comp rx=0 tx=0).stop 2024-02-21T07:45:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.161+0000 7f32f581d740 1 -- 172.21.15.69:0/2574292369 shutdown_connections 2024-02-21T07:45:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.161+0000 7f32f581d740 1 --2- 172.21.15.69:0/2574292369 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdef757b0 0x55acdf0090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.161+0000 7f32f581d740 1 --2- 172.21.15.69:0/2574292369 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 0x55acdf003130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.161+0000 7f32f581d740 1 --2- 172.21.15.69:0/2574292369 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef35150 0x55acdef74630 secure :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f32d80c66b0 tx=0x7f32d8009040 comp rx=0 tx=0).stop 2024-02-21T07:45:31.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.161+0000 7f32f581d740 1 -- 172.21.15.69:0/2574292369 >> 172.21.15.69:0/2574292369 conn(0x55acdeefc4b0 msgr2=0x55acdef34850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:31.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.163+0000 7f32f581d740 1 -- 172.21.15.69:0/2574292369 shutdown_connections 2024-02-21T07:45:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.164+0000 7f32f581d740 1 -- 172.21.15.69:0/2574292369 wait complete. 2024-02-21T07:45:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.165+0000 7f32f581d740 1 -- start start 2024-02-21T07:45:31.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.165+0000 7f32f581d740 1 Processor -- start 2024-02-21T07:45:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.168+0000 7f32f581d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef757b0 0x55acdef72a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.169+0000 7f32f581d740 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 0x55acdf000080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.169+0000 7f32f581d740 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefc5400 0x55acdef73a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.170+0000 7f32f581d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdef60090 con 0x55acdef757b0 2024-02-21T07:45:31.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.170+0000 7f32f581d740 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdef5c5b0 con 0x55acdefc5400 2024-02-21T07:45:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.170+0000 7f32f581d740 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acdef6d640 con 0x55acdefa4690 2024-02-21T07:45:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.170+0000 7f32f0a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefc5400 0x55acdef73a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.170+0000 7f32f0a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefc5400 0x55acdef73a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40268/0 (socket says 172.21.15.69:40268) 2024-02-21T07:45:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.170+0000 7f32f0a00640 1 -- 172.21.15.69:0/3464370266 learned_addr learned my addr 172.21.15.69:0/3464370266 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:31.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.170+0000 7f32f581d740 10 client.0 _ll_register_callbacks cb 0x7f32e0036070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T07:45:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.171+0000 7f32eb400640 1 --2- 172.21.15.69:0/3464370266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 0x55acdf000080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.171+0000 7f32ebe00640 1 --2- 172.21.15.69:0/3464370266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef757b0 0x55acdef72a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.173+0000 7f32ebe00640 1 -- 172.21.15.69:0/3464370266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 msgr2=0x55acdf000080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.173+0000 7f32ebe00640 1 --2- 172.21.15.69:0/3464370266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 0x55acdf000080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.173+0000 7f32ebe00640 1 -- 172.21.15.69:0/3464370266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefc5400 msgr2=0x55acdef73a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.173+0000 7f32ebe00640 1 --2- 172.21.15.69:0/3464370266 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x55acdefc5400 0x55acdef73a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.173+0000 7f32ebe00640 1 -- 172.21.15.69:0/3464370266 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55acdee99c50 con 0x55acdef757b0 2024-02-21T07:45:31.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.174+0000 7f32eb400640 1 --2- 172.21.15.69:0/3464370266 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x55acdefa4690 0x55acdf000080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.174+0000 7f32d0c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-02-21T07:45:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.174+0000 7f32ebe00640 1 --2- 172.21.15.69:0/3464370266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acdef757b0 0x55acdef72a20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f32d80070a0 tx=0x7f32e003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fa1eef9a253ab0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.175+0000 7f32d0c00640 1 -- 172.21.15.69:0/3464370266 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d80ae1d0 con 0x55acdef757b0 2024-02-21T07:45:31.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.175+0000 7f32d0c00640 1 -- 172.21.15.69:0/3464370266 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f32d80ae330 con 0x55acdef757b0 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.175+0000 7f32f581d740 1 -- 172.21.15.69:0/3464370266 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55acdeec0d30 con 0x55acdef757b0 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.176+0000 7f32d0c00640 1 -- 172.21.15.69:0/3464370266 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32d80c6ba0 con 0x55acdef757b0 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.176+0000 7f32f581d740 10 client.5925 fetch_fsmap learned FSMap version 26 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.176+0000 7f32f581d740 1 -- 172.21.15.69:0/3464370266 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x7f32e40e1690 con 0x55acdef757b0 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.177+0000 7f32d0c00640 1 -- 172.21.15.69:0/3464370266 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55acdeec0d30 con 0x55acdef757b0 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.177+0000 7f32d0c00640 1 -- 172.21.15.69:0/3464370266 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 26) v1 ==== 7926+0+0 (secure 0 0 0) 0x7f32d80c6d00 con 0x55acdef757b0 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.177+0000 7f32f581d740 10 client.5925 fetch_fsmap finished waiting for FSMap version 26 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.177+0000 7f32f581d740 10 client.5925 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.a 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.177+0000 7f32f581d740 20 client.5925 populate_metadata read hostname 'smithi069' 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.177+0000 7f32f581d740 1 --2- 172.21.15.69:0/3464370266 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55acdefa5520 0x55acdef6cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.177+0000 7f32f581d740 4 client.5925 mds_command: new command op to 4378 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.177+0000 7f32f581d740 1 -- 172.21.15.69:0/3464370266 --> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55acdeb9b600 con 0x55acdefa5520 2024-02-21T07:45:31.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.184+0000 7f32eb400640 1 --2- 172.21.15.69:0/3464370266 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55acdefa5520 0x55acdef6cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.185+0000 7f32eb400640 1 --2- 172.21.15.69:0/3464370266 >> [v2:172.21.15.69:6838/3963425058,v1:172.21.15.69:6839/3963425058] conn(0x55acdefa5520 0x55acdef6cdd0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7864a64fce34c6dd server_cookie=ba64ae49664cca21 in_seq=0 out_seq=0 2024-02-21T07:45:31.198 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-02-21T07:45:31.185+0000 7f32d0c00640 10 client.5925 ms_handle_connect on v2:172.21.15.69:6838/3963425058 2024-02-21T07:45:31.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.295+0000 7f30d3400640 1 Processor -- start 2024-02-21T07:45:31.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.295+0000 7f30d3400640 1 -- start start 2024-02-21T07:45:31.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.296+0000 7f30d3400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f30cc188300 0x7f30cc186820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.296+0000 7f30d3400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f30cc18c3f0 0x7f30cc18c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.296+0000 7f30d3400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc0f5f70 con 0x7f30cc182a50 2024-02-21T07:45:31.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.296+0000 7f30d3400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc182e30 con 0x7f30cc18c3f0 2024-02-21T07:45:31.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.296+0000 7f30d3400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc186d60 con 0x7f30cc188300 2024-02-21T07:45:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.297+0000 7f30d0a00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f30cc182a50 0x7f30cc0f5860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:33128/0 (socket says 172.21.15.69:33128) 2024-02-21T07:45:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.297+0000 7f30d0a00640 1 -- 172.21.15.69:0/3910523820 learned_addr learned my addr 172.21.15.69:0/3910523820 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.297+0000 7f30d1400640 1 --2- 172.21.15.69:0/3910523820 >> v2:172.21.15.69:3300/0 conn(0x7f30cc18c3f0 0x7f30cc18c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.297+0000 7f30cbe00640 1 --2- 172.21.15.69:0/3910523820 >> v2:172.21.15.174:3300/0 conn(0x7f30cc188300 0x7f30cc186820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.297+0000 7f30d1400640 1 -- 172.21.15.69:0/3910523820 >> v2:172.21.15.174:3300/0 conn(0x7f30cc188300 msgr2=0x7f30cc186820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.297+0000 7f30d1400640 1 --2- 172.21.15.69:0/3910523820 >> v2:172.21.15.174:3300/0 conn(0x7f30cc188300 0x7f30cc186820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.297+0000 7f30d1400640 1 -- 172.21.15.69:0/3910523820 >> v1:172.21.15.69:6789/0 conn(0x7f30cc182a50 legacy=0x7f30cc0f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.297+0000 7f30d1400640 1 -- 172.21.15.69:0/3910523820 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc188780 con 0x7f30cc18c3f0 2024-02-21T07:45:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.297+0000 7f30cb400640 1 -- 172.21.15.69:0/3910523820 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957701994 0 0) 0x7f30c0001110 con 0x7f30cc182a50 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.298+0000 7f30d1400640 1 --2- 172.21.15.69:0/3910523820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30cc18c3f0 0x7f30cc18c860 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0ee9e0 tx=0x7f30c402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4011cdb22168d3c5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.299+0000 7f30cb400640 1 -- 172.21.15.69:0/3910523820 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c402cb40 con 0x7f30cc18c3f0 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.299+0000 7f30cb400640 1 -- 172.21.15.69:0/3910523820 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c402cca0 con 0x7f30cc18c3f0 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.299+0000 7f30cb400640 1 -- 172.21.15.69:0/3910523820 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4034660 con 0x7f30cc18c3f0 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.299+0000 7f30d3400640 1 -- 172.21.15.69:0/3910523820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30cc18c3f0 msgr2=0x7f30cc18c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.299+0000 7f30d3400640 1 --2- 172.21.15.69:0/3910523820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30cc18c3f0 0x7f30cc18c860 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0ee9e0 tx=0x7f30c402bd90 comp rx=0 tx=0).stop 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.299+0000 7f30d3400640 1 -- 172.21.15.69:0/3910523820 shutdown_connections 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.299+0000 7f30d3400640 1 --2- 172.21.15.69:0/3910523820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30cc18c3f0 0x7f30cc18c860 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.299+0000 7f30d3400640 1 --2- 172.21.15.69:0/3910523820 >> v2:172.21.15.174:3300/0 conn(0x7f30cc188300 0x7f30cc186820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.299+0000 7f30d3400640 1 -- 172.21.15.69:0/3910523820 >> 172.21.15.69:0/3910523820 conn(0x7f30cc0cf3b0 msgr2=0x7f30cc0cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.299+0000 7f30d3400640 1 -- 172.21.15.69:0/3910523820 shutdown_connections 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.300+0000 7f30d3400640 1 -- 172.21.15.69:0/3910523820 wait complete. 2024-02-21T07:45:31.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.301+0000 7f30d3400640 1 Processor -- start 2024-02-21T07:45:31.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.301+0000 7f30d3400640 1 -- start start 2024-02-21T07:45:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30d3400640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30cc182a50 0x7f30cc21f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30d3400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc188300 0x7f30cc168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30d3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30cc18c3f0 0x7f30cc169190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30d3400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc1708c0 con 0x7f30cc18c3f0 2024-02-21T07:45:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30d3400640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc170ba0 con 0x7f30cc182a50 2024-02-21T07:45:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30d3400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc2210c0 con 0x7f30cc188300 2024-02-21T07:45:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30d1400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30cc18c3f0 0x7f30cc169190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30d0a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30cc182a50 0x7f30cc21f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30d0a00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30cc182a50 0x7f30cc21f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40294/0 (socket says 172.21.15.69:40294) 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30d0a00640 1 -- 172.21.15.69:0/1445717916 learned_addr learned my addr 172.21.15.69:0/1445717916 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.303+0000 7f30cbe00640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc188300 0x7f30cc168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30d0a00640 1 -- 172.21.15.69:0/1445717916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc188300 msgr2=0x7f30cc168c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30d0a00640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc188300 0x7f30cc168c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30d0a00640 1 -- 172.21.15.69:0/1445717916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30cc18c3f0 msgr2=0x7f30cc169190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30d0a00640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30cc18c3f0 0x7f30cc169190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30d0a00640 1 -- 172.21.15.69:0/1445717916 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4009a70 con 0x7f30cc182a50 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30d1400640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30cc18c3f0 0x7f30cc169190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30d0a00640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30cc182a50 0x7f30cc21f020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f30c000c3f0 tx=0x7f30c000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30c8c00640 1 -- 172.21.15.69:0/1445717916 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c00074e0 con 0x7f30cc182a50 2024-02-21T07:45:31.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30c8c00640 1 -- 172.21.15.69:0/1445717916 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c0007640 con 0x7f30cc182a50 2024-02-21T07:45:31.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30d3400640 1 -- 172.21.15.69:0/1445717916 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc2213a0 con 0x7f30cc182a50 2024-02-21T07:45:31.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30c8c00640 1 -- 172.21.15.69:0/1445717916 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0004a20 con 0x7f30cc182a50 2024-02-21T07:45:31.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.304+0000 7f30d3400640 1 -- 172.21.15.69:0/1445717916 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc221960 con 0x7f30cc182a50 2024-02-21T07:45:31.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.305+0000 7f30d3400640 1 -- 172.21.15.69:0/1445717916 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc069d50 con 0x7f30cc182a50 2024-02-21T07:45:31.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.307+0000 7f30c8c00640 1 -- 172.21.15.69:0/1445717916 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f30c0004b80 con 0x7f30cc182a50 2024-02-21T07:45:31.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.308+0000 7f30c8c00640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f30ac09f0a0 0x7f30ac0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:31.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.309+0000 7f30c8c00640 1 -- 172.21.15.69:0/1445717916 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f30c0040e40 con 0x7f30cc182a50 2024-02-21T07:45:31.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.309+0000 7f30cbe00640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f30ac09f0a0 0x7f30ac0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:31.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.309+0000 7f30cbe00640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f30ac09f0a0 0x7f30ac0a1560 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f30cc08e0b0 tx=0x7f30b8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:31.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.311+0000 7f30c8c00640 1 -- 172.21.15.69:0/1445717916 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f30c0093820 con 0x7f30cc182a50 2024-02-21T07:45:31.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.531+0000 7f30d3400640 1 -- 172.21.15.69:0/1445717916 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f30cc0f5f70 con 0x7f30cc182a50 2024-02-21T07:45:31.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.531+0000 7f30c8c00640 1 -- 172.21.15.69:0/1445717916 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v31) v1 ==== 80+0+0 (secure 0 0 0) 0x7f30cc0f5f70 con 0x7f30cc182a50 2024-02-21T07:45:31.537 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2024-02-21T07:45:31.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 -- 172.21.15.69:0/1445717916 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f30ac09f0a0 msgr2=0x7f30ac0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f30ac09f0a0 0x7f30ac0a1560 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f30cc08e0b0 tx=0x7f30b8009190 comp rx=0 tx=0).stop 2024-02-21T07:45:31.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 -- 172.21.15.69:0/1445717916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30cc182a50 msgr2=0x7f30cc21f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30cc182a50 0x7f30cc21f020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f30c000c3f0 tx=0x7f30c000c8b0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 -- 172.21.15.69:0/1445717916 shutdown_connections 2024-02-21T07:45:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f30ac09f0a0 0x7f30ac0a1560 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30cc18c3f0 0x7f30cc169190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30cc188300 0x7f30cc168c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 --2- 172.21.15.69:0/1445717916 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f30cc182a50 0x7f30cc21f020 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 -- 172.21.15.69:0/1445717916 >> 172.21.15.69:0/1445717916 conn(0x7f30cc0cf3b0 msgr2=0x7f30cc0fa6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 -- 172.21.15.69:0/1445717916 shutdown_connections 2024-02-21T07:45:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:31.534+0000 7f30d3400640 1 -- 172.21.15.69:0/1445717916 wait complete. 2024-02-21T07:45:31.556 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-21T07:45:31.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:31.556 DEBUG:teuthology.orchestra.run.smithi069:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-02-21T07:45:32.108 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch/parisc/math-emu/sfsqrt.c: Cannot open: Input/output error 2024-02-21T07:45:32.108 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch/parisc/math-emu/sfsub.c: Cannot open: Input/output error 2024-02-21T07:45:32.108 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch/parisc/math-emu/sgl_float.h: Cannot open: Input/output error 2024-02-21T07:45:32.108 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch/parisc/math-emu: Cannot utime: Input/output error 2024-02-21T07:45:32.108 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch/parisc/mm: Cannot mkdir: Input/output error 2024-02-21T07:45:32.108 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch/parisc/mm/Makefile: Cannot open: Input/output error 2024-02-21T07:45:32.109 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch/parisc/mm/fault.c: Cannot open: Input/output error 2024-02-21T07:45:32.109 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch/parisc/mm/fixmap.c: Cannot open: Input/output error 2024-02-21T07:45:32.109 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch/parisc/mm/hugetlbpage.c: Cannot open: Input/output error 2024-02-21T07:45:32.109 INFO:tasks.workunit.client.0.smithi069.stderr:xz: (stdin): Read error: Stale file handle 2024-02-21T07:45:32.111 INFO:tasks.workunit.client.0.smithi069.stderr:tar: Unexpected EOF in archive 2024-02-21T07:45:32.111 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch/parisc: Cannot utime: Input/output error 2024-02-21T07:45:32.111 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11/arch: Cannot utime: Input/output error 2024-02-21T07:45:32.111 INFO:tasks.workunit.client.0.smithi069.stderr:tar: linux-6.5.11: Cannot utime: Input/output error 2024-02-21T07:45:32.111 INFO:tasks.workunit.client.0.smithi069.stderr:tar: Error is not recoverable: exiting now 2024-02-21T07:45:32.122 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-21T07:45:32.122 INFO:tasks.workunit:Stopping ['kernel_untar_build.sh'] on client.0... 2024-02-21T07:45:32.123 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-21T07:45:32.566 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:45:32.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:45:32.567 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-21T07:45:34.136 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test kernel_untar_build.sh) on smithi069 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' 2024-02-21T07:45:34.351 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5f9a3c37322949259cebed4bf5e6e252 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test kernel_untar_build.sh) on smithi069 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' 2024-02-21T07:45:34.354 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-02-21T07:45:34.364 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:45:34.388 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-02-21T07:45:34.398 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-02-21T07:45:34.398 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-02-21T07:45:34.402 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-02-21T07:45:34.432 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T07:45:34.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.623+0000 7fe492800640 1 Processor -- start 2024-02-21T07:45:34.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.623+0000 7fe492800640 1 -- start start 2024-02-21T07:45:34.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.625+0000 7fe492800640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c0f9e90 con 0x7fe48c0f9780 2024-02-21T07:45:34.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.625+0000 7fe492800640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c1869a0 con 0x7fe48c185da0 2024-02-21T07:45:34.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.625+0000 7fe492800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c186c80 con 0x7fe48c0f8bc0 2024-02-21T07:45:34.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.625+0000 7fe48b400640 1 --1- >> v1:172.21.15.174:6789/0 conn(0x7fe48c185da0 0x7fe48c0cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.174:6789/0 says I am v1:172.21.15.69:57678/0 (socket says 172.21.15.69:57678) 2024-02-21T07:45:34.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.625+0000 7fe48b400640 1 -- 172.21.15.69:0/2353365985 learned_addr learned my addr 172.21.15.69:0/2353365985 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:34.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 <== mon.1 v1:172.21.15.174:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190331419 0 0) 0x7fe48c1869a0 con 0x7fe48c185da0 2024-02-21T07:45:34.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 --> v1:172.21.15.174:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe470003520 con 0x7fe48c185da0 2024-02-21T07:45:34.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735769829 0 0) 0x7fe48c0f9e90 con 0x7fe48c0f9780 2024-02-21T07:45:34.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe48c1869a0 con 0x7fe48c0f9780 2024-02-21T07:45:34.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781079994 0 0) 0x7fe48c186c80 con 0x7fe48c0f8bc0 2024-02-21T07:45:34.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe48c0f9e90 con 0x7fe48c0f8bc0 2024-02-21T07:45:34.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 <== mon.1 v1:172.21.15.174:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4089584002 0 0) 0x7fe470003520 con 0x7fe48c185da0 2024-02-21T07:45:34.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 >> v1:172.21.15.184:6789/0 conn(0x7fe48c0f8bc0 legacy=0x7fe48c0f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:34.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 >> v1:172.21.15.69:6789/0 conn(0x7fe48c0f9780 legacy=0x7fe48c190270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:34.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 --> v1:172.21.15.174:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c186f60 con 0x7fe48c185da0 2024-02-21T07:45:34.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 <== mon.1 v1:172.21.15.174:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3782036952 0 0) 0x7fe47c001670 con 0x7fe48c185da0 2024-02-21T07:45:34.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 >> v1:172.21.15.174:6789/0 conn(0x7fe48c185da0 legacy=0x7fe48c0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:34.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe470003d10 0x7fe4700040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:34.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470004880 0x7fe470004d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:34.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470009970 0x7fe47000bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:34.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47000c2f0 con 0x7fe470004880 2024-02-21T07:45:34.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47000c460 con 0x7fe470003d10 2024-02-21T07:45:34.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47000c620 con 0x7fe470009970 2024-02-21T07:45:34.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48be00640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470009970 0x7fe47000bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:34.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.626+0000 7fe48aa00640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470004880 0x7fe470004d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:34.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.627+0000 7fe48b400640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe470003d10 0x7fe4700040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:34.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.627+0000 7fe48be00640 1 -- 172.21.15.69:0/2353365985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe470003d10 msgr2=0x7fe4700040f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:34.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.627+0000 7fe48be00640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe470003d10 0x7fe4700040f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.627+0000 7fe48be00640 1 -- 172.21.15.69:0/2353365985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470004880 msgr2=0x7fe470004d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T07:45:34.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.627+0000 7fe48be00640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470004880 0x7fe470004d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.627+0000 7fe48be00640 1 -- 172.21.15.69:0/2353365985 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe470003520 con 0x7fe470009970 2024-02-21T07:45:34.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.628+0000 7fe48be00640 1 -- 172.21.15.69:0/2353365985 reap_dead start 2024-02-21T07:45:34.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.629+0000 7fe48be00640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470009970 0x7fe47000bd60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe484001fa0 tx=0x7fe4700057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49361e01db2b12a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:34.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.629+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 <== mon.2 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484003b70 con 0x7fe470009970 2024-02-21T07:45:34.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.629+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 <== mon.2 v2:172.21.15.184:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484003d10 con 0x7fe470009970 2024-02-21T07:45:34.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.629+0000 7fe48a000640 1 -- 172.21.15.69:0/2353365985 <== mon.2 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484005310 con 0x7fe470009970 2024-02-21T07:45:34.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.629+0000 7fe492800640 1 -- 172.21.15.69:0/2353365985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470009970 msgr2=0x7fe47000bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:34.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.629+0000 7fe492800640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470009970 0x7fe47000bd60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe484001fa0 tx=0x7fe4700057f0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.630+0000 7fe492800640 1 -- 172.21.15.69:0/2353365985 shutdown_connections 2024-02-21T07:45:34.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.630+0000 7fe492800640 1 --2- 172.21.15.69:0/2353365985 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe470009970 0x7fe47000bd60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.630+0000 7fe492800640 1 -- 172.21.15.69:0/2353365985 >> 172.21.15.69:0/2353365985 conn(0x7fe48c071b80 msgr2=0x7fe48c0668e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:34.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.630+0000 7fe492800640 1 -- 172.21.15.69:0/2353365985 shutdown_connections 2024-02-21T07:45:34.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.630+0000 7fe492800640 1 -- 172.21.15.69:0/2353365985 wait complete. 2024-02-21T07:45:34.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.632+0000 7fe492800640 1 Processor -- start 2024-02-21T07:45:34.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.632+0000 7fe492800640 1 -- start start 2024-02-21T07:45:34.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.633+0000 7fe492800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470009970 0x7fe48c1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:34.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.633+0000 7fe492800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48c21ebd0 0x7fe48c21f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:34.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.633+0000 7fe492800640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe48c172930 0x7fe48c172db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:34.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.633+0000 7fe492800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c176150 con 0x7fe470009970 2024-02-21T07:45:34.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.633+0000 7fe492800640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c21f590 con 0x7fe48c172930 2024-02-21T07:45:34.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.633+0000 7fe492800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c173770 con 0x7fe48c21ebd0 2024-02-21T07:45:34.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.633+0000 7fe48b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470009970 0x7fe48c1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:34.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.633+0000 7fe48b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470009970 0x7fe48c1569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46744/0 (socket says 172.21.15.69:46744) 2024-02-21T07:45:34.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.633+0000 7fe48b400640 1 -- 172.21.15.69:0/3876475999 learned_addr learned my addr 172.21.15.69:0/3876475999 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:34.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.633+0000 7fe48be00640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe48c172930 0x7fe48c172db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:34.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.634+0000 7fe48b400640 1 -- 172.21.15.69:0/3876475999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48c21ebd0 msgr2=0x7fe48c21f050 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T07:45:34.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.634+0000 7fe48b400640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48c21ebd0 0x7fe48c21f050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.634+0000 7fe48b400640 1 -- 172.21.15.69:0/3876475999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe48c172930 msgr2=0x7fe48c172db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:34.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.634+0000 7fe48b400640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe48c172930 0x7fe48c172db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.634+0000 7fe48b400640 1 -- 172.21.15.69:0/3876475999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c173a50 con 0x7fe470009970 2024-02-21T07:45:34.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.634+0000 7fe48b400640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470009970 0x7fe48c1569d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe47c004fa0 tx=0x7fe47c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:34.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.634+0000 7fe483400640 1 -- 172.21.15.69:0/3876475999 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c00f720 con 0x7fe470009970 2024-02-21T07:45:34.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.634+0000 7fe483400640 1 -- 172.21.15.69:0/3876475999 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c00f880 con 0x7fe470009970 2024-02-21T07:45:34.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.634+0000 7fe483400640 1 -- 172.21.15.69:0/3876475999 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c00fc30 con 0x7fe470009970 2024-02-21T07:45:34.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.634+0000 7fe492800640 1 -- 172.21.15.69:0/3876475999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c173d30 con 0x7fe470009970 2024-02-21T07:45:34.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.635+0000 7fe492800640 1 -- 172.21.15.69:0/3876475999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c156f10 con 0x7fe470009970 2024-02-21T07:45:34.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.636+0000 7fe492800640 1 -- 172.21.15.69:0/3876475999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c174250 con 0x7fe470009970 2024-02-21T07:45:34.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.637+0000 7fe483400640 1 -- 172.21.15.69:0/3876475999 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7fe47c00fd90 con 0x7fe470009970 2024-02-21T07:45:34.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.639+0000 7fe483400640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46c09f0d0 0x7fe46c0a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:34.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.640+0000 7fe483400640 1 -- 172.21.15.69:0/3876475999 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe47c0c9b70 con 0x7fe470009970 2024-02-21T07:45:34.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.640+0000 7fe48aa00640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46c09f0d0 0x7fe46c0a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:34.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.641+0000 7fe48aa00640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46c09f0d0 0x7fe46c0a1590 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe4780011a0 tx=0x7fe478009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:34.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.643+0000 7fe483400640 1 -- 172.21.15.69:0/3876475999 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe48c174250 con 0x7fe470009970 2024-02-21T07:45:34.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.891+0000 7fe492800640 1 -- 172.21.15.69:0/3876475999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe48c0f9b60 con 0x7fe470009970 2024-02-21T07:45:34.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.893+0000 7fe483400640 1 -- 172.21.15.69:0/3876475999 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23736 (secure 0 0 0) 0x7fe48c0f9b60 con 0x7fe470009970 2024-02-21T07:45:34.899 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-02-21T07:45:34.900 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":31,"fsid":"c8bdd735-83bd-400f-baca-e501b49b60ea","created":"2024-02-21T07:41:42.336854+0000","modified":"2024-02-21T07:42:48.463144+0000","last_up_change":"2024-02-21T07:41:54.610033+0000","last_in_change":"2024-02-21T07:41:45.847042+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T07:41:56.520105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T07:42:00.759386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T07:42:01.409274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T07:42:05.025537+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a7097a2b-9e9d-4ed9-a5be-1ab3bb34a57e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6807","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6809","nonce":4247950924}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6811","nonce":4247950924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6815","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6817","nonce":4247950924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":4247950924},{"type":"v1","addr":"172.21.15.69:6813","nonce":4247950924}]},"public_addr":"172.21.15.69:6809/4247950924","cluster_addr":"172.21.15.69:6811/4247950924","heartbeat_back_addr":"172.21.15.69:6817/4247950924","heartbeat_front_addr":"172.21.15.69:6813/4247950924","state":["exists","up"]},{"osd":1,"uuid":"042d13f7-fe8c-4305-bb57-ac48d115867d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6808","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6810","nonce":3466097956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6812","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6813","nonce":3466097956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6816","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6817","nonce":3466097956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6814","nonce":3466097956},{"type":"v1","addr":"172.21.15.174:6815","nonce":3466097956}]},"public_addr":"172.21.15.174:6810/3466097956","cluster_addr":"172.21.15.174:6813/3466097956","heartbeat_back_addr":"172.21.15.174:6817/3466097956","heartbeat_front_addr":"172.21.15.174:6815/3466097956","state":["exists","up"]},{"osd":2,"uuid":"8de34f92-bca8-48b6-88ca-d99a70ebbab3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6825","nonce":825193265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6827","nonce":825193265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6830","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6831","nonce":825193265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6828","nonce":825193265},{"type":"v1","addr":"172.21.15.184:6829","nonce":825193265}]},"public_addr":"172.21.15.184:6825/825193265","cluster_addr":"172.21.15.184:6827/825193265","heartbeat_back_addr":"172.21.15.184:6831/825193265","heartbeat_front_addr":"172.21.15.184:6829/825193265","state":["exists","up"]},{"osd":3,"uuid":"ca765220-c544-477d-b62e-e46cfc2507a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6825","nonce":3267685751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6827","nonce":3267685751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6831","nonce":3267685751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":3267685751},{"type":"v1","addr":"172.21.15.69:6829","nonce":3267685751}]},"public_addr":"172.21.15.69:6825/3267685751","cluster_addr":"172.21.15.69:6827/3267685751","heartbeat_back_addr":"172.21.15.69:6831/3267685751","heartbeat_front_addr":"172.21.15.69:6829/3267685751","state":["exists","up"]},{"osd":4,"uuid":"ad332dc5-a949-4e4d-ba9b-22904c8a805b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6826","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6827","nonce":1000763984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6828","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6829","nonce":1000763984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6832","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6833","nonce":1000763984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6830","nonce":1000763984},{"type":"v1","addr":"172.21.15.174:6831","nonce":1000763984}]},"public_addr":"172.21.15.174:6827/1000763984","cluster_addr":"172.21.15.174:6829/1000763984","heartbeat_back_addr":"172.21.15.174:6833/1000763984","heartbeat_front_addr":"172.21.15.174:6831/1000763984","state":["exists","up"]},{"osd":5,"uuid":"2f062c18-b9e3-4229-8df3-88b1808c84a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6817","nonce":2071034595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6819","nonce":2071034595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6823","nonce":2071034595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":2071034595},{"type":"v1","addr":"172.21.15.184:6821","nonce":2071034595}]},"public_addr":"172.21.15.184:6817/2071034595","cluster_addr":"172.21.15.184:6819/2071034595","heartbeat_back_addr":"172.21.15.184:6823/2071034595","heartbeat_front_addr":"172.21.15.184:6821/2071034595","state":["exists","up"]},{"osd":6,"uuid":"721f268a-4c2f-419a-9569-de60c60a0164","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6801","nonce":1788647795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6803","nonce":1788647795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6808","nonce":1788647795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1788647795},{"type":"v1","addr":"172.21.15.69:6805","nonce":1788647795}]},"public_addr":"172.21.15.69:6801/1788647795","cluster_addr":"172.21.15.69:6803/1788647795","heartbeat_back_addr":"172.21.15.69:6808/1788647795","heartbeat_front_addr":"172.21.15.69:6805/1788647795","state":["exists","up"]},{"osd":7,"uuid":"5d0fa9bc-caaf-41d4-953a-cf4004402619","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6818","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6819","nonce":807358556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6820","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6821","nonce":807358556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6824","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6825","nonce":807358556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6822","nonce":807358556},{"type":"v1","addr":"172.21.15.174:6823","nonce":807358556}]},"public_addr":"172.21.15.174:6819/807358556","cluster_addr":"172.21.15.174:6821/807358556","heartbeat_back_addr":"172.21.15.174:6825/807358556","heartbeat_front_addr":"172.21.15.174:6823/807358556","state":["exists","up"]},{"osd":8,"uuid":"02d11b92-1af3-4228-9877-2171f46bf252","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6801","nonce":2169979443}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6803","nonce":2169979443}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6807","nonce":2169979443}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":2169979443},{"type":"v1","addr":"172.21.15.184:6805","nonce":2169979443}]},"public_addr":"172.21.15.184:6801/2169979443","cluster_addr":"172.21.15.184:6803/2169979443","heartbeat_back_addr":"172.21.15.184:6807/2169979443","heartbeat_front_addr":"172.21.15.184:6805/2169979443","state":["exists","up"]},{"osd":9,"uuid":"293e6d5e-a5fa-46f6-988b-d36b61d156b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6816","nonce":776969315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6819","nonce":776969315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6823","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6824","nonce":776969315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":776969315},{"type":"v1","addr":"172.21.15.69:6821","nonce":776969315}]},"public_addr":"172.21.15.69:6816/776969315","cluster_addr":"172.21.15.69:6819/776969315","heartbeat_back_addr":"172.21.15.69:6824/776969315","heartbeat_front_addr":"172.21.15.69:6821/776969315","state":["exists","up"]},{"osd":10,"uuid":"3cb5657f-5d84-4cf8-a50a-28ee1a03a271","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6802","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6803","nonce":1736166221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6804","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6805","nonce":1736166221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6809","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6811","nonce":1736166221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.174:6806","nonce":1736166221},{"type":"v1","addr":"172.21.15.174:6807","nonce":1736166221}]},"public_addr":"172.21.15.174:6803/1736166221","cluster_addr":"172.21.15.174:6805/1736166221","heartbeat_back_addr":"172.21.15.174:6811/1736166221","heartbeat_front_addr":"172.21.15.174:6807/1736166221","state":["exists","up"]},{"osd":11,"uuid":"7af2eeca-42fb-4513-a506-c63df777cd1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6809","nonce":1731856636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6811","nonce":1731856636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6815","nonce":1731856636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1731856636},{"type":"v1","addr":"172.21.15.184:6813","nonce":1731856636}]},"public_addr":"172.21.15.184:6809/1731856636","cluster_addr":"172.21.15.184:6811/1731856636","heartbeat_back_addr":"172.21.15.184:6815/1731856636","heartbeat_front_addr":"172.21.15.184:6813/1731856636","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.164760+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.936010+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.988675+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.259479+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.014460+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.046347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.110226+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.044343+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.878924+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.429903+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:50.955801+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T07:41:51.001261+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T07:45:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 -- 172.21.15.69:0/3876475999 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46c09f0d0 msgr2=0x7fe46c0a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46c09f0d0 0x7fe46c0a1590 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe4780011a0 tx=0x7fe478009040 comp rx=0 tx=0).stop 2024-02-21T07:45:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 -- 172.21.15.69:0/3876475999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470009970 msgr2=0x7fe48c1569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:34.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470009970 0x7fe48c1569d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe47c004fa0 tx=0x7fe47c0074f0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 -- 172.21.15.69:0/3876475999 shutdown_connections 2024-02-21T07:45:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7fe46c09f0d0 0x7fe46c0a1590 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7fe48c172930 0x7fe48c172db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe48c21ebd0 0x7fe48c21f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 --2- 172.21.15.69:0/3876475999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe470009970 0x7fe48c1569d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 -- 172.21.15.69:0/3876475999 >> 172.21.15.69:0/3876475999 conn(0x7fe48c071b80 msgr2=0x7fe48c0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:34.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 -- 172.21.15.69:0/3876475999 shutdown_connections 2024-02-21T07:45:34.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:34.896+0000 7fe492800640 1 -- 172.21.15.69:0/3876475999 wait complete. 2024-02-21T07:45:34.926 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T07:41:56.520105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T07:42:00.759386+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T07:42:01.409274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T07:42:05.025537+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T07:45:34.927 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T07:45:35.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.134+0000 7efe72000640 1 Processor -- start 2024-02-21T07:45:35.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.134+0000 7efe72000640 1 -- start start 2024-02-21T07:45:35.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.136+0000 7efe72000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efe6c0fb840 0x7efe6c18a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.136+0000 7efe72000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6c18bae0 con 0x7efe6c182b70 2024-02-21T07:45:35.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.136+0000 7efe72000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6c18abf0 con 0x7efe6c06ac20 2024-02-21T07:45:35.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.136+0000 7efe72000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6c18aed0 con 0x7efe6c0fb840 2024-02-21T07:45:35.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.136+0000 7efe70c00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7efe6c182b70 0x7efe6c189df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:33158/0 (socket says 172.21.15.69:33158) 2024-02-21T07:45:35.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.136+0000 7efe70c00640 1 -- 172.21.15.69:0/3433134265 learned_addr learned my addr 172.21.15.69:0/3433134265 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:35.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.136+0000 7efe6be00640 1 --2- 172.21.15.69:0/3433134265 >> v2:172.21.15.69:3300/0 conn(0x7efe6c0fb840 0x7efe6c18a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.137+0000 7efe6b400640 1 -- 172.21.15.69:0/3433134265 <== mon.2 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113750493 0 0) 0x7efe6c18abf0 con 0x7efe6c06ac20 2024-02-21T07:45:35.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.137+0000 7efe6b400640 1 -- 172.21.15.69:0/3433134265 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe54003520 con 0x7efe6c06ac20 2024-02-21T07:45:35.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.137+0000 7efe6b400640 1 -- 172.21.15.69:0/3433134265 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912156540 0 0) 0x7efe6c18bae0 con 0x7efe6c182b70 2024-02-21T07:45:35.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.137+0000 7efe6b400640 1 -- 172.21.15.69:0/3433134265 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe6c18abf0 con 0x7efe6c182b70 2024-02-21T07:45:35.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.137+0000 7efe6be00640 1 -- 172.21.15.69:0/3433134265 >> v1:172.21.15.184:6789/0 conn(0x7efe6c06ac20 legacy=0x7efe6c06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.137+0000 7efe6be00640 1 -- 172.21.15.69:0/3433134265 >> v1:172.21.15.69:6789/0 conn(0x7efe6c182b70 legacy=0x7efe6c189df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.137+0000 7efe6be00640 1 -- 172.21.15.69:0/3433134265 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c18b1b0 con 0x7efe6c0fb840 2024-02-21T07:45:35.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.138+0000 7efe6be00640 1 --2- 172.21.15.69:0/3433134265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c0fb840 0x7efe6c18a500 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efe580097a0 tx=0x7efe5802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80b4366b6c29edf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.138+0000 7efe6b400640 1 -- 172.21.15.69:0/3433134265 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58031830 con 0x7efe6c0fb840 2024-02-21T07:45:35.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.139+0000 7efe6b400640 1 -- 172.21.15.69:0/3433134265 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58031990 con 0x7efe6c0fb840 2024-02-21T07:45:35.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.139+0000 7efe6b400640 1 -- 172.21.15.69:0/3433134265 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58031d20 con 0x7efe6c0fb840 2024-02-21T07:45:35.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.139+0000 7efe72000640 1 -- 172.21.15.69:0/3433134265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c0fb840 msgr2=0x7efe6c18a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.139+0000 7efe72000640 1 --2- 172.21.15.69:0/3433134265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c0fb840 0x7efe6c18a500 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efe580097a0 tx=0x7efe5802b8d0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.139+0000 7efe72000640 1 -- 172.21.15.69:0/3433134265 shutdown_connections 2024-02-21T07:45:35.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.139+0000 7efe72000640 1 --2- 172.21.15.69:0/3433134265 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c0fb840 0x7efe6c18a500 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.139+0000 7efe72000640 1 -- 172.21.15.69:0/3433134265 >> 172.21.15.69:0/3433134265 conn(0x7efe6c0d2ae0 msgr2=0x7efe6c0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.139+0000 7efe72000640 1 -- 172.21.15.69:0/3433134265 shutdown_connections 2024-02-21T07:45:35.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.139+0000 7efe72000640 1 -- 172.21.15.69:0/3433134265 wait complete. 2024-02-21T07:45:35.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.141+0000 7efe72000640 1 Processor -- start 2024-02-21T07:45:35.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.142+0000 7efe72000640 1 -- start start 2024-02-21T07:45:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe72000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6c06ac20 0x7efe6c21f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe72000640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe6c0fb840 0x7efe6c21f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe72000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c182b70 0x7efe6c0d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe72000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c21fad0 con 0x7efe6c182b70 2024-02-21T07:45:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe72000640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c21ffa0 con 0x7efe6c0fb840 2024-02-21T07:45:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe72000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6c170dd0 con 0x7efe6c06ac20 2024-02-21T07:45:35.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe70c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6c06ac20 0x7efe6c21f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe71600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c182b70 0x7efe6c0d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe6be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe6c0fb840 0x7efe6c21f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe6be00640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe6c0fb840 0x7efe6c21f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.174:3300/0 says I am v2:172.21.15.69:40330/0 (socket says 172.21.15.69:40330) 2024-02-21T07:45:35.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe71600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c182b70 0x7efe6c0d4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46752/0 (socket says 172.21.15.69:46752) 2024-02-21T07:45:35.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe71600640 1 -- 172.21.15.69:0/761172212 learned_addr learned my addr 172.21.15.69:0/761172212 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:35.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.143+0000 7efe70c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6c06ac20 0x7efe6c21f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.69:37594/0 (socket says 172.21.15.69:37594) 2024-02-21T07:45:35.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe6be00640 1 -- 172.21.15.69:0/761172212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6c06ac20 msgr2=0x7efe6c21f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe6be00640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6c06ac20 0x7efe6c21f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe6be00640 1 -- 172.21.15.69:0/761172212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c182b70 msgr2=0x7efe6c0d4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe6be00640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c182b70 0x7efe6c0d4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe6be00640 1 -- 172.21.15.69:0/761172212 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe58009400 con 0x7efe6c0fb840 2024-02-21T07:45:35.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe6be00640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe6c0fb840 0x7efe6c21f590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efe58033000 tx=0x7efe580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe68c00640 1 -- 172.21.15.69:0/761172212 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5803a830 con 0x7efe6c0fb840 2024-02-21T07:45:35.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe68c00640 1 -- 172.21.15.69:0/761172212 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5803a9b0 con 0x7efe6c0fb840 2024-02-21T07:45:35.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe72000640 1 -- 172.21.15.69:0/761172212 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6c170af0 con 0x7efe6c0fb840 2024-02-21T07:45:35.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe68c00640 1 -- 172.21.15.69:0/761172212 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5803ad60 con 0x7efe6c0fb840 2024-02-21T07:45:35.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.144+0000 7efe72000640 1 -- 172.21.15.69:0/761172212 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6c0d3f50 con 0x7efe6c0fb840 2024-02-21T07:45:35.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.146+0000 7efe72000640 1 -- 172.21.15.69:0/761172212 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6c0cdbe0 con 0x7efe6c0fb840 2024-02-21T07:45:35.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.149+0000 7efe68c00640 1 -- 172.21.15.69:0/761172212 <== mon.1 v2:172.21.15.174:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7efe5804d440 con 0x7efe6c0fb840 2024-02-21T07:45:35.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.150+0000 7efe68c00640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe4c09f0a0 0x7efe4c0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.150+0000 7efe68c00640 1 -- 172.21.15.69:0/761172212 <== mon.1 v2:172.21.15.174:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7efe580ebb00 con 0x7efe6c0fb840 2024-02-21T07:45:35.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.150+0000 7efe70c00640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe4c09f0a0 0x7efe4c0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.151+0000 7efe70c00640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe4c09f0a0 0x7efe4c0a1560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efe60005880 tx=0x7efe60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.154+0000 7efe68c00640 1 -- 172.21.15.69:0/761172212 <== mon.1 v2:172.21.15.174:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7efe580b58e0 con 0x7efe6c0fb840 2024-02-21T07:45:35.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.398+0000 7efe72000640 1 -- 172.21.15.69:0/761172212 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe6c069c10 con 0x7efe6c0fb840 2024-02-21T07:45:35.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.398+0000 7efe68c00640 1 -- 172.21.15.69:0/761172212 <== mon.1 v2:172.21.15.174:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe58035020 con 0x7efe6c0fb840 2024-02-21T07:45:35.404 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-02-21T07:45:35.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 -- 172.21.15.69:0/761172212 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe4c09f0a0 msgr2=0x7efe4c0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe4c09f0a0 0x7efe4c0a1560 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efe60005880 tx=0x7efe60009040 comp rx=0 tx=0).stop 2024-02-21T07:45:35.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 -- 172.21.15.69:0/761172212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe6c0fb840 msgr2=0x7efe6c21f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe6c0fb840 0x7efe6c21f590 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efe58033000 tx=0x7efe580046c0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 -- 172.21.15.69:0/761172212 shutdown_connections 2024-02-21T07:45:35.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7efe4c09f0a0 0x7efe4c0a1560 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe6c182b70 0x7efe6c0d4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7efe6c0fb840 0x7efe6c21f590 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 --2- 172.21.15.69:0/761172212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe6c06ac20 0x7efe6c21f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 -- 172.21.15.69:0/761172212 >> 172.21.15.69:0/761172212 conn(0x7efe6c0d2ae0 msgr2=0x7efe6c06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 -- 172.21.15.69:0/761172212 shutdown_connections 2024-02-21T07:45:35.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.401+0000 7efe72000640 1 -- 172.21.15.69:0/761172212 wait complete. 2024-02-21T07:45:35.423 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T07:45:35.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.614+0000 7f26d5200640 1 Processor -- start 2024-02-21T07:45:35.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.614+0000 7f26d5200640 1 -- start start 2024-02-21T07:45:35.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.616+0000 7f26d5200640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f26d017f4f0 0x7f26d00d45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.616+0000 7f26d5200640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d018a4a0 con 0x7f26d00d6020 2024-02-21T07:45:35.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.616+0000 7f26d5200640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d00d4ca0 con 0x7f26d017f110 2024-02-21T07:45:35.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.616+0000 7f26d5200640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d00d4f80 con 0x7f26d017f4f0 2024-02-21T07:45:35.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.617+0000 7f26cfe00640 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f26d00d6020 0x7f26d01888a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:33160/0 (socket says 172.21.15.69:33160) 2024-02-21T07:45:35.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.617+0000 7f26cfe00640 1 -- 172.21.15.69:0/1371590632 learned_addr learned my addr 172.21.15.69:0/1371590632 (peer_addr_for_me v1:172.21.15.69:0/0) 2024-02-21T07:45:35.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.617+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1371590632 >> v2:172.21.15.174:3300/0 conn(0x7f26d017f4f0 0x7f26d00d45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.617+0000 7f26cea00640 1 -- 172.21.15.69:0/1371590632 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204321118 0 0) 0x7f26d018a4a0 con 0x7f26d00d6020 2024-02-21T07:45:35.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.617+0000 7f26cea00640 1 -- 172.21.15.69:0/1371590632 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b4003520 con 0x7f26d00d6020 2024-02-21T07:45:35.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.617+0000 7f26c6a00640 1 -- 172.21.15.69:0/1371590632 >> v1:172.21.15.174:6789/0 conn(0x7f26d017f110 legacy=0x7f26d0189d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.617+0000 7f26c6a00640 1 -- 172.21.15.69:0/1371590632 >> v1:172.21.15.69:6789/0 conn(0x7f26d00d6020 legacy=0x7f26d01888a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.617+0000 7f26c6a00640 1 -- 172.21.15.69:0/1371590632 --> v2:172.21.15.174:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d00d5260 con 0x7f26d017f4f0 2024-02-21T07:45:35.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.618+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1371590632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26d00d45d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f26b80097a0 tx=0x7f26b802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffe748e6532cdec2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.619+0000 7f26cea00640 1 -- 172.21.15.69:0/1371590632 <== mon.1 v2:172.21.15.174:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8030610 con 0x7f26d017f4f0 2024-02-21T07:45:35.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.619+0000 7f26cea00640 1 -- 172.21.15.69:0/1371590632 <== mon.1 v2:172.21.15.174:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b8030770 con 0x7f26d017f4f0 2024-02-21T07:45:35.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.619+0000 7f26cea00640 1 -- 172.21.15.69:0/1371590632 <== mon.1 v2:172.21.15.174:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8030ae0 con 0x7f26d017f4f0 2024-02-21T07:45:35.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.619+0000 7f26d5200640 1 -- 172.21.15.69:0/1371590632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f26d00d45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.619+0000 7f26d5200640 1 --2- 172.21.15.69:0/1371590632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26d00d45d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f26b80097a0 tx=0x7f26b802b960 comp rx=0 tx=0).stop 2024-02-21T07:45:35.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.619+0000 7f26d5200640 1 -- 172.21.15.69:0/1371590632 shutdown_connections 2024-02-21T07:45:35.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.619+0000 7f26d5200640 1 --2- 172.21.15.69:0/1371590632 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26d00d45d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.619+0000 7f26d5200640 1 -- 172.21.15.69:0/1371590632 >> 172.21.15.69:0/1371590632 conn(0x7f26d00d2c10 msgr2=0x7f26d00d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T07:45:35.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.619+0000 7f26d5200640 1 -- 172.21.15.69:0/1371590632 shutdown_connections 2024-02-21T07:45:35.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.619+0000 7f26d5200640 1 -- 172.21.15.69:0/1371590632 wait complete. 2024-02-21T07:45:35.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.621+0000 7f26d5200640 1 Processor -- start 2024-02-21T07:45:35.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.622+0000 7f26d5200640 1 -- start start 2024-02-21T07:45:35.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26d5200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26d00d6020 0x7f26d0172680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26d5200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f26d021ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26d5200640 1 --2- >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26d017bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26d5200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d0172ee0 con 0x7f26d00d6020 2024-02-21T07:45:35.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26d5200640 1 -- --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d01731c0 con 0x7f26d017f4f0 2024-02-21T07:45:35.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26d5200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d01734a0 con 0x7f26d017f110 2024-02-21T07:45:35.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26cf400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26d00d6020 0x7f26d0172680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26cf400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26d00d6020 0x7f26d0172680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46764/0 (socket says 172.21.15.69:46764) 2024-02-21T07:45:35.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 learned_addr learned my addr 172.21.15.69:0/1729834057 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-02-21T07:45:35.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26d017bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f26d021ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f26d021ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f26d021ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f26d017bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T07:45:35.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26d017bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.623+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8009400 con 0x7f26d00d6020 2024-02-21T07:45:35.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.624+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26d00d6020 0x7f26d0172680 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f26c000c870 tx=0x7f26c000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.624+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0003b70 con 0x7f26d00d6020 2024-02-21T07:45:35.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.624+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c0003cf0 con 0x7f26d00d6020 2024-02-21T07:45:35.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.624+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c000aa90 con 0x7f26d00d6020 2024-02-21T07:45:35.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.624+0000 7f26d5200640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d0173780 con 0x7f26d00d6020 2024-02-21T07:45:35.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.624+0000 7f26d5200640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d0173d40 con 0x7f26d00d6020 2024-02-21T07:45:35.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.626+0000 7f26d5200640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d00cfad0 con 0x7f26d00d6020 2024-02-21T07:45:35.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.627+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 134368+0+0 (secure 0 0 0) 0x7f26c000abf0 con 0x7f26d00d6020 2024-02-21T07:45:35.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.628+0000 7f26c7e00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26ac0a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.629+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f26c00c9990 con 0x7f26d00d6020 2024-02-21T07:45:35.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.629+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26ac0a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T07:45:35.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.630+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26ac0a1560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f26b8036000 tx=0x7f26b8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T07:45:35.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.632+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f26c0093710 con 0x7f26d00d6020 2024-02-21T07:45:35.788 INFO:tasks.ceph.osd.0:Sent signal 15 2024-02-21T07:45:35.789 INFO:tasks.ceph.osd.3:Sent signal 15 2024-02-21T07:45:35.789 INFO:tasks.ceph.osd.6:Sent signal 15 2024-02-21T07:45:35.789 INFO:tasks.ceph.osd.9:Sent signal 15 2024-02-21T07:45:35.790 INFO:tasks.ceph.osd.1:Sent signal 15 2024-02-21T07:45:35.790 INFO:tasks.ceph.osd.4:Sent signal 15 2024-02-21T07:45:35.790 INFO:tasks.ceph.osd.7:Sent signal 15 2024-02-21T07:45:35.791 INFO:tasks.ceph.osd.10:Sent signal 15 2024-02-21T07:45:35.791 INFO:tasks.ceph.osd.2:Sent signal 15 2024-02-21T07:45:35.791 INFO:tasks.ceph.osd.5:Sent signal 15 2024-02-21T07:45:35.791 INFO:tasks.ceph.osd.8:Sent signal 15 2024-02-21T07:45:35.792 INFO:tasks.ceph.osd.11:Sent signal 15 2024-02-21T07:45:35.792 INFO:tasks.ceph.mds.a:Sent signal 15 2024-02-21T07:45:35.792 INFO:tasks.ceph.mds.d:Sent signal 15 2024-02-21T07:45:35.792 INFO:tasks.ceph.mds.g:Sent signal 15 2024-02-21T07:45:35.793 INFO:tasks.ceph.mds.j:Sent signal 15 2024-02-21T07:45:35.793 INFO:tasks.ceph.mds.b:Sent signal 15 2024-02-21T07:45:35.793 INFO:tasks.ceph.mds.e:Sent signal 15 2024-02-21T07:45:35.793 INFO:tasks.ceph.mds.h:Sent signal 15 2024-02-21T07:45:35.794 INFO:tasks.ceph.mds.k:Sent signal 15 2024-02-21T07:45:35.794 INFO:tasks.ceph.mds.c:Sent signal 15 2024-02-21T07:45:35.794 INFO:tasks.ceph.mds.i:Sent signal 15 2024-02-21T07:45:35.794 INFO:tasks.ceph.mds.l:Sent signal 15 2024-02-21T07:45:35.795 INFO:tasks.ceph.mon.a:Sent signal 15 2024-02-21T07:45:35.795 INFO:tasks.ceph.mon.b:Sent signal 15 2024-02-21T07:45:35.795 INFO:tasks.ceph.mon.c:Sent signal 15 2024-02-21T07:45:35.795 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-02-21T07:45:35.796 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-02-21T07:45:35.796 INFO:tasks.ceph.mgr.z:Sent signal 15 2024-02-21T07:45:35.797 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-02-21T07:45:35.785+0000 7f2a1dc51640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 39103) UID: 0 2024-02-21T07:45:35.797 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-02-21T07:45:35.785+0000 7f2a1dc51640 -1 osd.1 31 *** Got signal Terminated *** 2024-02-21T07:45:35.797 INFO:tasks.ceph.osd.1.smithi174.stderr:2024-02-21T07:45:35.785+0000 7f2a1dc51640 -1 osd.1 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.797 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-02-21T07:45:35.785+0000 7f4598a84640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 39106) UID: 0 2024-02-21T07:45:35.797 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-02-21T07:45:35.785+0000 7f4598a84640 -1 osd.4 31 *** Got signal Terminated *** 2024-02-21T07:45:35.798 INFO:tasks.ceph.osd.4.smithi174.stderr:2024-02-21T07:45:35.785+0000 7f4598a84640 -1 osd.4 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.798 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-02-21T07:45:35.785+0000 7fa0c29c4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 39105) UID: 0 2024-02-21T07:45:35.798 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-02-21T07:45:35.785+0000 7fa0c29c4640 -1 osd.7 31 *** Got signal Terminated *** 2024-02-21T07:45:35.799 INFO:tasks.ceph.osd.7.smithi174.stderr:2024-02-21T07:45:35.785+0000 7fa0c29c4640 -1 osd.7 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.799 INFO:tasks.ceph.osd.10.smithi174.stderr:2024-02-21T07:45:35.785+0000 7f5f52702640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 10 (PID: 39109) UID: 0 2024-02-21T07:45:35.799 INFO:tasks.ceph.osd.10.smithi174.stderr:2024-02-21T07:45:35.785+0000 7f5f52702640 -1 osd.10 31 *** Got signal Terminated *** 2024-02-21T07:45:35.799 INFO:tasks.ceph.osd.10.smithi174.stderr:2024-02-21T07:45:35.785+0000 7f5f52702640 -1 osd.10 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.800 INFO:tasks.ceph.mds.b.smithi174.stderr:2024-02-21T07:45:35.788+0000 7f368dcf1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 44017) UID: 0 2024-02-21T07:45:35.800 INFO:tasks.ceph.mds.b.smithi174.stderr:2024-02-21T07:45:35.788+0000 7f368dcf1640 -1 mds.b *** got signal Terminated *** 2024-02-21T07:45:35.800 INFO:tasks.ceph.mds.e.smithi174.stderr:2024-02-21T07:45:35.788+0000 7fd5a9312640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i e (PID: 44016) UID: 0 2024-02-21T07:45:35.800 INFO:tasks.ceph.mds.e.smithi174.stderr:2024-02-21T07:45:35.788+0000 7fd5a9312640 -1 mds.e *** got signal Terminated *** 2024-02-21T07:45:35.801 INFO:tasks.ceph.mds.h.smithi174.stderr:2024-02-21T07:45:35.789+0000 7fb74811c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i h (PID: 44018) UID: 0 2024-02-21T07:45:35.801 INFO:tasks.ceph.mds.h.smithi174.stderr:2024-02-21T07:45:35.789+0000 7fb74811c640 -1 mds.h *** got signal Terminated *** 2024-02-21T07:45:35.801 INFO:tasks.ceph.mds.k.smithi174.stderr:2024-02-21T07:45:35.789+0000 7f86e2327640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i k (PID: 44022) UID: 0 2024-02-21T07:45:35.801 INFO:tasks.ceph.mds.k.smithi174.stderr:2024-02-21T07:45:35.789+0000 7f86e2327640 -1 mds.k *** got signal Terminated *** 2024-02-21T07:45:35.802 INFO:tasks.ceph.mon.b.smithi174.stderr:2024-02-21T07:45:35.790+0000 7f2b50dc8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 38867) UID: 0 2024-02-21T07:45:35.802 INFO:tasks.ceph.mon.b.smithi174.stderr:2024-02-21T07:45:35.790+0000 7f2b50dc8640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-02-21T07:45:35.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2024-02-21T07:45:35.784+0000 7ff976e00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 37752) UID: 0 2024-02-21T07:45:35.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2024-02-21T07:45:35.784+0000 7ff976e00640 -1 osd.0 31 *** Got signal Terminated *** 2024-02-21T07:45:35.803 INFO:tasks.ceph.osd.0.smithi069.stderr:2024-02-21T07:45:35.784+0000 7ff976e00640 -1 osd.0 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.803 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-02-21T07:45:35.786+0000 7fda7f924640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 39037) UID: 0 2024-02-21T07:45:35.804 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-02-21T07:45:35.786+0000 7fda7f924640 -1 osd.2 31 *** Got signal Terminated *** 2024-02-21T07:45:35.804 INFO:tasks.ceph.osd.2.smithi184.stderr:2024-02-21T07:45:35.786+0000 7fda7f924640 -1 osd.2 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.804 INFO:tasks.ceph.osd.3.smithi069.stderr:2024-02-21T07:45:35.784+0000 7fe1ab800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 37757) UID: 0 2024-02-21T07:45:35.804 INFO:tasks.ceph.osd.3.smithi069.stderr:2024-02-21T07:45:35.784+0000 7fe1ab800640 -1 osd.3 31 *** Got signal Terminated *** 2024-02-21T07:45:35.804 INFO:tasks.ceph.osd.3.smithi069.stderr:2024-02-21T07:45:35.784+0000 7fe1ab800640 -1 osd.3 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.805 INFO:tasks.ceph.osd.6.smithi069.stderr:2024-02-21T07:45:35.785+0000 7efd03e00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 37758) UID: 0 2024-02-21T07:45:35.805 INFO:tasks.ceph.osd.6.smithi069.stderr:2024-02-21T07:45:35.785+0000 7efd03e00640 -1 osd.6 31 *** Got signal Terminated *** 2024-02-21T07:45:35.805 INFO:tasks.ceph.osd.6.smithi069.stderr:2024-02-21T07:45:35.785+0000 7efd03e00640 -1 osd.6 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.806 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-02-21T07:45:35.786+0000 7fd7ad945640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 39039) UID: 0 2024-02-21T07:45:35.806 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-02-21T07:45:35.786+0000 7fd7ad945640 -1 osd.5 31 *** Got signal Terminated *** 2024-02-21T07:45:35.806 INFO:tasks.ceph.osd.5.smithi184.stderr:2024-02-21T07:45:35.786+0000 7fd7ad945640 -1 osd.5 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.806 INFO:tasks.ceph.osd.9.smithi069.stderr:2024-02-21T07:45:35.785+0000 7fdcd8200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 9 (PID: 37761) UID: 0 2024-02-21T07:45:35.806 INFO:tasks.ceph.osd.9.smithi069.stderr:2024-02-21T07:45:35.785+0000 7fdcd8200640 -1 osd.9 31 *** Got signal Terminated *** 2024-02-21T07:45:35.807 INFO:tasks.ceph.osd.9.smithi069.stderr:2024-02-21T07:45:35.785+0000 7fdcd8200640 -1 osd.9 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.807 INFO:tasks.ceph.osd.8.smithi184.stderr:2024-02-21T07:45:35.787+0000 7ff68f6e3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 8 (PID: 39042) UID: 0 2024-02-21T07:45:35.807 INFO:tasks.ceph.osd.8.smithi184.stderr:2024-02-21T07:45:35.787+0000 7ff68f6e3640 -1 osd.8 31 *** Got signal Terminated *** 2024-02-21T07:45:35.807 INFO:tasks.ceph.osd.8.smithi184.stderr:2024-02-21T07:45:35.787+0000 7ff68f6e3640 -1 osd.8 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.808 INFO:tasks.ceph.mds.a.smithi069.stderr:2024-02-21T07:45:35.787+0000 7f62a6600640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 43217) UID: 0 2024-02-21T07:45:35.808 INFO:tasks.ceph.mds.a.smithi069.stderr:2024-02-21T07:45:35.787+0000 7f62a6600640 -1 mds.a *** got signal Terminated *** 2024-02-21T07:45:35.808 INFO:tasks.ceph.mds.g.smithi069.stderr:2024-02-21T07:45:35.788+0000 7f78e4e00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i g (PID: 43221) UID: 0 2024-02-21T07:45:35.808 INFO:tasks.ceph.mds.g.smithi069.stderr:2024-02-21T07:45:35.788+0000 7f78e4e00640 -1 mds.g *** got signal Terminated *** 2024-02-21T07:45:35.809 INFO:tasks.ceph.osd.11.smithi184.stderr:2024-02-21T07:45:35.787+0000 7fe3417e2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 11 (PID: 39044) UID: 0 2024-02-21T07:45:35.809 INFO:tasks.ceph.osd.11.smithi184.stderr:2024-02-21T07:45:35.787+0000 7fe3417e2640 -1 osd.11 31 *** Got signal Terminated *** 2024-02-21T07:45:35.809 INFO:tasks.ceph.osd.11.smithi184.stderr:2024-02-21T07:45:35.787+0000 7fe3417e2640 -1 osd.11 31 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-21T07:45:35.809 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:45:35.788+0000 7f3fb3200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 43218) UID: 0 2024-02-21T07:45:35.810 INFO:tasks.ceph.mds.d.smithi069.stderr:2024-02-21T07:45:35.788+0000 7f3fb3200640 -1 mds.d *** got signal Terminated *** 2024-02-21T07:45:35.810 INFO:tasks.ceph.mds.c.smithi184.stderr:2024-02-21T07:45:35.790+0000 7f6e7135b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 44680) UID: 0 2024-02-21T07:45:35.810 INFO:tasks.ceph.mds.c.smithi184.stderr:2024-02-21T07:45:35.790+0000 7f6e7135b640 -1 mds.c *** got signal Terminated *** 2024-02-21T07:45:35.810 INFO:tasks.ceph.mds.j.smithi069.stderr:2024-02-21T07:45:35.788+0000 7ff0a5800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i j (PID: 43223) UID: 0 2024-02-21T07:45:35.811 INFO:tasks.ceph.mds.j.smithi069.stderr:2024-02-21T07:45:35.788+0000 7ff0a5800640 -1 mds.j *** got signal Terminated *** 2024-02-21T07:45:35.811 INFO:tasks.ceph.mds.i.smithi184.stderr:2024-02-21T07:45:35.790+0000 7f75b9443640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i i (PID: 44685) UID: 0 2024-02-21T07:45:35.811 INFO:tasks.ceph.mds.i.smithi184.stderr:2024-02-21T07:45:35.790+0000 7f75b9443640 -1 mds.i *** got signal Terminated *** 2024-02-21T07:45:35.812 INFO:tasks.ceph.mon.a.smithi069.stderr:2024-02-21T07:45:35.790+0000 7f120a000640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 37500) UID: 0 2024-02-21T07:45:35.812 INFO:tasks.ceph.mon.a.smithi069.stderr:2024-02-21T07:45:35.790+0000 7f120a000640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-21T07:45:35.812 INFO:tasks.ceph.mds.l.smithi184.stderr:2024-02-21T07:45:35.790+0000 7f6a8dacb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i l (PID: 44687) UID: 0 2024-02-21T07:45:35.813 INFO:tasks.ceph.mds.l.smithi184.stderr:2024-02-21T07:45:35.790+0000 7f6a8dacb640 -1 mds.l *** got signal Terminated *** 2024-02-21T07:45:35.813 INFO:tasks.ceph.mon.c.smithi184.stderr:2024-02-21T07:45:35.791+0000 7f1bfe904640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 38338) UID: 0 2024-02-21T07:45:35.813 INFO:tasks.ceph.mon.c.smithi184.stderr:2024-02-21T07:45:35.791+0000 7f1bfe904640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-02-21T07:45:35.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.800+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26d00d6020 msgr2=0x7f26d0172680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-02-21T07:45:35.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.800+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26d00d6020 msgr2=0x7f26d0172680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-21T07:45:35.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.800+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26d00d6020 0x7f26d0172680 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f26c000c870 tx=0x7f26c000cd30 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T07:45:35.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.800+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26d00d6020 0x7f26d0172680 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f26c000c870 tx=0x7f26c000cd30 comp rx=0 tx=0).stop 2024-02-21T07:45:35.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.800+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26d00d6020 msgr2=0x7f26d0172680 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-02-21T07:45:35.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.800+0000 7f26c7e00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26d00d6020 0x7f26d0172680 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26c7e00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f26ac0abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26c7e00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f26ac0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26c7e00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26ac0b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:35.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b18a0 con 0x7f26ac0a9980 2024-02-21T07:45:35.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b19e0 con 0x7f26d017f4f0 2024-02-21T07:45:35.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b1b70 con 0x7f26d017f110 2024-02-21T07:45:35.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f26ac0ae530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:35.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f26ac0ae530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:35.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f26ac0abd90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:35.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f26ac0abd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:35.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f26ac0b0f20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:35.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.801+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26ac0b0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:35.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.812+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26ac0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-02-21T07:45:35.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.812+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26ac0a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-21T07:45:35.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.812+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26ac0a1560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f26b8036000 tx=0x7f26b8008030 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T07:45:35.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.812+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26ac0a1560 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f26b8036000 tx=0x7f26b8008030 comp rx=0 tx=0).stop 2024-02-21T07:45:35.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.812+0000 7f26c7e00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26ac0a1560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-02-21T07:45:35.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:35.812+0000 7f26c7e00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26ac0a1560 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:35.997 INFO:tasks.ceph.mgr.z.smithi184.stderr:daemon-helper: command crashed with signal 15 2024-02-21T07:45:35.998 INFO:tasks.ceph.mgr.x.smithi069.stderr:daemon-helper: command crashed with signal 15 2024-02-21T07:45:36.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.002+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f26ac0ae530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:36.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.002+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f26ac0ae530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:36.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.002+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f26ac0abd90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:36.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.002+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f26ac0abd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:36.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.002+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f26ac0b0f20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:36.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.002+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26ac0b0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:36.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.403+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f26ac0abd90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:36.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.403+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f26ac0ae530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:36.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.403+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f26ac0abd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:36.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.403+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f26ac0ae530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:36.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.403+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f26ac0b0f20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:36.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.403+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26ac0b0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:36.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.629+0000 7f26c5600640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:36.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.629+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:45:36.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.629+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:36.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.830+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:45:36.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:36.830+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:37.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:37.204+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f26ac0abd90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:37.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:37.204+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f26ac0abd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:37.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:37.204+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f26ac0ae530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:37.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:37.204+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f26ac0ae530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:37.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:37.204+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f26ac0b0f20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:37.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:37.204+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26ac0b0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:37.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:37.231+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:45:37.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:37.231+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:38.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.033+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:45:38.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.033+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.623+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f26ac0ae530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.623+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f26ac0ae530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.623+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f26ac0b0f20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.623+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f26ac0b0f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:38.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.623+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f26ac0abd90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:38.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.623+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f26ac0abd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:38.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.623+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:38.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.623+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f269c007c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:38.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.624+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c00a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:38.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.624+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b18a0 con 0x7f26ac0a9980 2024-02-21T07:45:38.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.624+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b19e0 con 0x7f26d017f4f0 2024-02-21T07:45:38.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.624+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b1b70 con 0x7f26d017f110 2024-02-21T07:45:38.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.624+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:38.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.624+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:38.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.624+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f269c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:38.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.624+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:38.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.624+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f269c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:38.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.624+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:38.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.825+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f269c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:38.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.825+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:38.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.825+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f269c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:38.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.825+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:38.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.825+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:38.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:38.825+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:39.226+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f269c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:39.226+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f269c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:39.226+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:39.226+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:39.226+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:39.226+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:39.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:39.635+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:45:39.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:39.635+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:45:40.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:40.028+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f269c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:40.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:40.028+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f269c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:40.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:40.028+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:40.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:40.028+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:40.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:40.028+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:40.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:40.028+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:41.630+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f269c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:41.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:41.630+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f269c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:45:41.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:41.631+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:41.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:41.631+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:45:41.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:41.631+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:41.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:41.631+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:45:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:42.838+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:45:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:42.838+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:45:43.369 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:43.377 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:43.380 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:45:44.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:44.833+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f269c007c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:44.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:44.833+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f269c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:45:44.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:44.834+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:44.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:44.834+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:45:44.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:44.834+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c00a350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:44.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:44.834+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:45:45.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c00a350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:45.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c00a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:45.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 msgr2=0x7f269c007c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:45.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26ac0a9980 0x7f269c007c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:45.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c0082f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:45.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b18a0 con 0x7f269c00ad10 2024-02-21T07:45:45.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b19e0 con 0x7f26d017f4f0 2024-02-21T07:45:45.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b1b70 con 0x7f26d017f110 2024-02-21T07:45:45.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:45.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.374+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:45.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.375+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:45.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.375+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:45.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.375+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c0082f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:45.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.375+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c0082f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:45.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.576+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:45.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.576+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:45.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.576+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:45.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.576+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:45.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.576+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c0082f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:45.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.576+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c0082f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:45.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.977+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:45.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.977+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:45.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.977+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:45.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.977+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:45.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.978+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c0082f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:45.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:45.978+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c0082f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:46.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:46.778+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:46.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:46.778+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:46.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:46.778+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:46.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:46.778+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:46.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:46.779+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c0082f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:46.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:46.779+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c0082f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:48.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:48.380+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:48.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:48.380+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:45:48.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:48.380+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c0082f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:48.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:48.380+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:48.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:48.381+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c0082f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:45:48.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:48.381+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:45:49.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:49.245+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:45:49.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:49.245+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:45:51.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:51.583+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:51.583+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:45:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:51.584+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c0082f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:51.584+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c0082f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:45:51.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:51.584+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:51.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:51.584+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:45:55.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c0082f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:55.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c0082f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:55.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f26d017f4f0 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:45:55.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:45:55.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:45:55.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b18a0 con 0x7f269c00ad10 2024-02-21T07:45:55.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b19e0 con 0x7f269c008830 2024-02-21T07:45:55.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b1b70 con 0x7f26d017f110 2024-02-21T07:45:55.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:55.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:55.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:55.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:55.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:55.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.500+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:45:55.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.701+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:55.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.701+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:55.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.701+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:55.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.701+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:55.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.701+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:55.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:55.701+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:45:56.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.102+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:56.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.102+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:56.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.102+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:56.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.102+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:56.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.102+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:56.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.102+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:45:56.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.903+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:56.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.903+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.903+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.903+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.904+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:56.904+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:45:58.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:58.505+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:45:58.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:58.505+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:45:58.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:58.505+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:45:58.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:58.505+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:45:58.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:58.505+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:45:58.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:45:58.505+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:46:01.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:01.709+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:01.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:01.709+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:46:01.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:01.709+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:01.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:01.709+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:01.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:01.709+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:46:01.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:01.709+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:46:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:02.058+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:46:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:02.058+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:46:08.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:08.116+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:08.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:08.116+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:08.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:08.116+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:46:08.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:08.116+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:46:08.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:08.116+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:08.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:08.116+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:46:10.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:46:10.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:10.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:46:10.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:10.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 msgr2=0x7f269c00d100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:46:10.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c00ad10 0x7f269c00d100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:10.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:10.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:10.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:10.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b18a0 con 0x7f269c009690 2024-02-21T07:46:10.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b19e0 con 0x7f269c008830 2024-02-21T07:46:10.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b1b70 con 0x7f26d017f110 2024-02-21T07:46:10.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:10.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:46:10.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:10.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:46:10.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:10.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.688+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:46:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.889+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:10.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.889+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:10.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.889+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:46:10.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.889+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:46:10.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.889+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:10.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:10.890+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:46:11.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:11.290+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:11.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:11.290+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:46:11.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:11.290+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:11.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:11.290+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:46:11.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:11.291+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:11.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:11.291+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:46:12.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:12.092+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:12.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:12.092+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:12.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:12.092+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:46:12.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:12.092+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:46:12.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:12.092+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:12.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:12.092+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:46:13.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:13.693+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:13.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:13.693+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:46:13.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:13.694+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:13.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:13.694+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:46:13.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:13.694+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:13.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:13.694+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:46:13.755 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:13.764 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:13.767 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:16.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:16.898+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:16.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:16.898+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:46:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:16.898+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:16.898+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:46:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:16.898+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:16.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:16.898+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:46:17.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:17.070+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:46:17.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:17.070+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:46:23.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:23.305+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:23.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:23.305+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:46:23.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:23.305+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:23.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:23.305+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:46:23.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:23.305+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:23.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:23.305+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:46:32.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:32.086+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:46:32.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:32.086+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:46:33.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:46:33.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:33.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:46:33.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:46:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:46:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:46:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b18a0 con 0x7f269c009690 2024-02-21T07:46:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b19e0 con 0x7f269c008830 2024-02-21T07:46:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.469+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b1b70 con 0x7f26d017f110 2024-02-21T07:46:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.470+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.470+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.470+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:46:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.470+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:46:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.470+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.470+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:46:33.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.671+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:33.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.671+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:33.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.671+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:46:33.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.671+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:46:33.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.671+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:33.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:33.671+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:46:34.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.072+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:34.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.072+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:46:34.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.072+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:34.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.072+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:46:34.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.073+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:34.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.073+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:46:34.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.873+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:34.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.873+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:46:34.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.873+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:34.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.873+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:46:34.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.874+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:34.874+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:46:36.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:36.475+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:36.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:36.475+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:46:36.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:36.475+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:36.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:36.475+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:36.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:36.476+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:46:36.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:36.476+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:46:39.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:39.678+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:39.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:39.678+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:46:39.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:39.679+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:39.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:39.679+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:46:39.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:39.679+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:39.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:39.679+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:46:43.888 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:43.896 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:43.899 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:46:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:46.085+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:46.085+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:46:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:46.085+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:46.085+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:46:46.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:46.086+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:46.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:46.086+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:46:47.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:47.101+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:46:47.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:47.101+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:46:58.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:58.899+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:46:58.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:58.899+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:46:58.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:58.899+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:46:58.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:58.899+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:46:58.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:58.899+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:46:58.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:46:58.899+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:47:02.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:02.117+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:47:02.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:02.117+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:47:03.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.469+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:47:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.469+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.469+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:47:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.469+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c008830 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c005620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:47:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c005620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 0x7f269c00a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:03.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c009150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b18a0 con 0x7f269c009690 2024-02-21T07:47:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b19e0 con 0x7f269c009d10 2024-02-21T07:47:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b1b70 con 0x7f26d017f110 2024-02-21T07:47:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:03.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.470+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:03.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.671+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:03.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.671+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:03.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.671+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:03.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.671+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:03.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.671+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:03.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:03.671+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:04.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.072+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:04.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.072+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.072+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.072+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.072+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.072+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:04.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.873+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:04.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.873+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:04.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.873+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:04.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.873+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:04.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.874+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:04.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:04.874+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:06.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:06.475+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:06.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:06.475+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:47:06.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:06.475+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:06.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:06.475+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:47:06.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:06.476+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:06.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:06.476+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-21T07:47:09.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:09.680+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:09.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:09.680+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:47:09.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:09.680+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:09.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:09.680+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:09.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:09.680+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:47:09.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:09.680+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-02-21T07:47:14.032 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:14.041 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:14.043 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:16.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:16.082+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:16.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:16.082+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:47:16.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:16.085+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:16.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:16.085+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:47:16.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:16.086+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:16.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:16.086+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 12.800000 2024-02-21T07:47:17.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:17.132+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:47:17.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:17.132+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:47:28.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:28.896+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:28.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:28.896+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:47:28.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:28.898+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:28.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:28.898+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:47:28.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:28.898+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:28.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:28.898+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:47:32.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:32.148+0000 7f26c6a00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 msgr2=0x7f26d017d480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:6800/1264070995 2024-02-21T07:47:32.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:32.148+0000 7f26c6a00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:6800/1264070995,v1:172.21.15.174:6801/1264070995] conn(0x7f26ac09f0a0 0x7f26d017d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 15.000000 2024-02-21T07:47:33.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:47:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:47:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c009d10 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c009150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T07:47:33.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c009150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c003610 0x7f269c00f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c00a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b18a0 con 0x7f269c009690 2024-02-21T07:47:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b19e0 con 0x7f269c003610 2024-02-21T07:47:33.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26c6000640 1 -- 172.21.15.69:0/1729834057 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0b1b70 con 0x7f26d017f110 2024-02-21T07:47:33.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.470+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c003610 msgr2=0x7f269c00f110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:33.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.471+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c003610 0x7f269c00f110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:33.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.471+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:33.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.471+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:33.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.471+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:33.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.471+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:33.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.672+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:33.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.672+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c003610 msgr2=0x7f269c00f110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:33.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.672+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c003610 0x7f269c00f110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:33.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.672+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:33.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.672+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:33.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:33.672+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:34.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.073+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:34.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.073+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:34.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.073+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c003610 msgr2=0x7f269c00f110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:34.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.073+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c003610 0x7f269c00f110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:34.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.073+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:34.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.073+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:34.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.874+0000 7f26cfe00640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 msgr2=0x7f269c00a0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:34.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.874+0000 7f26cfe00640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f269c009690 0x7f269c00a0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:34.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.874+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c003610 msgr2=0x7f269c00f110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:34.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.874+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.174:3300/0,v1:172.21.15.174:6789/0] conn(0x7f269c003610 0x7f269c00f110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:34.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.874+0000 7f26cf400640 1 -- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 msgr2=0x7f269c008c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:34.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:34.874+0000 7f26cf400640 1 --2- 172.21.15.69:0/1729834057 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26d017f110 0x7f269c008c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:35.516 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-02-21T07:47:35.517 INFO:tasks.check_counter.ceph_manager:Failed to get pg_num from pool cephfs_metadata, ignoring 2024-02-21T07:47:35.518 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T07:47:35.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.729+0000 7f1958800640 1 Processor -- start 2024-02-21T07:47:35.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.729+0000 7f1958800640 1 -- start start 2024-02-21T07:47:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.731+0000 7f1958800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 0x7f1950186bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.731+0000 7f1958800640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1950183ea0 2024-02-21T07:47:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.731+0000 7f1958800640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f19500ee640 2024-02-21T07:47:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.731+0000 7f1958800640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f19500f5890 2024-02-21T07:47:35.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.732+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1950183ea0 legacy=0x7f19501846e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:35.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.732+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 msgr2=0x7f1950186bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:35.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.732+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 0x7f1950186bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:35.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.732+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19500ee640 legacy=0x7f19500eead0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:35.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.933+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1950183ea0 legacy=0x7f19501846e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:35.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.933+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19500ee640 legacy=0x7f19500eead0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:35.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.933+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 msgr2=0x7f1950186bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:35.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:35.933+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 0x7f1950186bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:36.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:36.334+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19500ee640 legacy=0x7f19500eead0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:36.334+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1950183ea0 legacy=0x7f19501846e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:36.334+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 msgr2=0x7f1950186bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:36.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:36.334+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 0x7f1950186bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:37.135+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 msgr2=0x7f1950186bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:37.135+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19500ee640 legacy=0x7f19500eead0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:37.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:37.135+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 0x7f1950186bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:37.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:37.135+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1950183ea0 legacy=0x7f19501846e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:38.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 msgr2=0x7f1950186bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:38.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19500f5890 0x7f1950186bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:38.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19500ee640 legacy=0x7f19500eead0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:38.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1950183ea0 legacy=0x7f19501846e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:38.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 0x7f1934005b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:38.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 0x7f193400c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:38.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950185390 con 0x7f1934006170 2024-02-21T07:47:38.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f19340036d0 2024-02-21T07:47:38.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f1934009f00 2024-02-21T07:47:38.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934006170 legacy=0x7f1934008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:38.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 msgr2=0x7f193400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:38.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 msgr2=0x7f1934005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:38.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 0x7f193400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:38.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.732+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 0x7f1934005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:38.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.933+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934006170 legacy=0x7f1934008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:38.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.933+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 msgr2=0x7f193400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:38.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.933+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 msgr2=0x7f1934005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:38.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.933+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 0x7f193400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:38.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:38.933+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 0x7f1934005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:39.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:39.334+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934006170 legacy=0x7f1934008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:39.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:39.334+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 msgr2=0x7f193400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:39.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:39.334+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 msgr2=0x7f1934005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:39.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:39.334+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 0x7f193400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:39.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:39.334+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 0x7f1934005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:40.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:40.135+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934006170 legacy=0x7f1934008630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:40.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:40.135+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 msgr2=0x7f193400c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:40.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:40.135+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 0x7f193400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:40.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:40.135+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 msgr2=0x7f1934005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:40.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:40.135+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 0x7f1934005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:41.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 msgr2=0x7f193400c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:41.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934009f00 0x7f193400c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:41.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 msgr2=0x7f1934005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:41.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19340036d0 0x7f1934005b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:41.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934006170 legacy=0x7f1934008630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:41.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:47:41.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:41.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f193400d6b0 2024-02-21T07:47:41.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950185390 con 0x7f193400cb20 2024-02-21T07:47:41.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934005be0 2024-02-21T07:47:41.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f193400d6b0 legacy=0x7f19340065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:41.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f193400cb20 legacy=0x7f193400cf00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:41.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:41.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.733+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:41.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.934+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f193400d6b0 legacy=0x7f19340065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:41.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.934+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f193400cb20 legacy=0x7f193400cf00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:41.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.934+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:41.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:41.934+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:42.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:42.335+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f193400d6b0 legacy=0x7f19340065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:42.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:42.335+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f193400cb20 legacy=0x7f193400cf00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:42.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:42.335+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:42.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:42.335+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:43.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:43.136+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f193400d6b0 legacy=0x7f19340065a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:43.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:43.136+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:43.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:43.136+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f193400cb20 legacy=0x7f193400cf00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:43.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:43.136+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:44.211 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:44.219 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:44.223 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:47:44.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:44.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:44.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f193400cb20 legacy=0x7f193400cf00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:44.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f193400d6b0 legacy=0x7f19340065a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:44.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 0x7f1934015230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:44.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 0x7f1934017c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:44.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934007f20 2024-02-21T07:47:44.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934012e40 2024-02-21T07:47:44.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f1934015830 2024-02-21T07:47:44.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 msgr2=0x7f1934015230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:44.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934007f20 legacy=0x7f1934008390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:44.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 msgr2=0x7f1934017c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:44.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 0x7f1934015230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:44.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.733+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 0x7f1934017c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:44.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.934+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 msgr2=0x7f1934015230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.934+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934007f20 legacy=0x7f1934008390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.934+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 0x7f1934015230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.934+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 msgr2=0x7f1934017c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:44.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:44.934+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 0x7f1934017c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:45.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:45.335+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934007f20 legacy=0x7f1934008390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:45.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:45.335+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 msgr2=0x7f1934015230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:45.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:45.335+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 0x7f1934015230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:45.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:45.335+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 msgr2=0x7f1934017c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:45.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:45.335+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 0x7f1934017c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:46.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:46.137+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934007f20 legacy=0x7f1934008390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:46.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:46.137+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 msgr2=0x7f1934015230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:46.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:46.137+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 0x7f1934015230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:46.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:46.137+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 msgr2=0x7f1934017c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:46.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:46.137+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 0x7f1934017c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:47.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 msgr2=0x7f1934017c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:47.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015830 0x7f1934017c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:47.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 msgr2=0x7f1934015230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:47.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012e40 0x7f1934015230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:47.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934007f20 legacy=0x7f1934008390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:47.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:47:47.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:47.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 0x7f193400cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:47.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 0x7f1934017c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:47.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934008390 2024-02-21T07:47:47.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f1934005be0 2024-02-21T07:47:47.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340088d0 con 0x7f193400d060 2024-02-21T07:47:47.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 msgr2=0x7f193400cb20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:47.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:47.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 msgr2=0x7f1934017c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:47.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 0x7f193400cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:47.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 0x7f1934017c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:47.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.734+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:47.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.935+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 msgr2=0x7f193400cb20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:47.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.935+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 msgr2=0x7f1934017c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:47.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.935+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 0x7f193400cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:47.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.935+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:47.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.935+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 0x7f1934017c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:47.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:47.935+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:48.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:48.336+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 msgr2=0x7f193400cb20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:48.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:48.336+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 0x7f193400cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:48.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:48.336+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 msgr2=0x7f1934017c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:48.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:48.336+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 0x7f1934017c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:48.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:48.336+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:48.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:48.336+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:49.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:49.137+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 msgr2=0x7f193400cb20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:49.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:49.137+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 msgr2=0x7f1934017c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:49.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:49.137+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 0x7f193400cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:49.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:49.137+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:49.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:49.137+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 0x7f1934017c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:49.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:49.137+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 msgr2=0x7f1934017c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d060 0x7f1934017c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 msgr2=0x7f193400cb20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008390 0x7f193400cb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934018320 2024-02-21T07:47:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f19340152d0 2024-02-21T07:47:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950185390 con 0x7f1934018eb0 2024-02-21T07:47:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934018320 legacy=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934018eb0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.735+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340152d0 legacy=0x7f1934011dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:50.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.936+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934018320 legacy=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:50.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.936+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934018eb0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:50.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:50.936+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340152d0 legacy=0x7f1934011dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:51.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:51.337+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934018320 legacy=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:51.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:51.337+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340152d0 legacy=0x7f1934011dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:51.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:51.337+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934018eb0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:52.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:52.139+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934018320 legacy=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:52.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:52.139+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340152d0 legacy=0x7f1934011dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:52.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:52.139+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934018eb0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:53.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.735+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934018eb0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:53.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.735+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340152d0 legacy=0x7f1934011dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:53.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.735+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934018320 legacy=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:53.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.735+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:47:53.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.735+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:47:53.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.735+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 0x7f193400c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:53.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.736+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:53.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.736+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f19340127e0 2024-02-21T07:47:53.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.736+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934005be0 2024-02-21T07:47:53.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.736+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f19340152d0 2024-02-21T07:47:53.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.736+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340127e0 legacy=0x7f193401c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:53.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.736+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:53.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.736+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:53.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.736+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:53.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.736+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.937+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340127e0 legacy=0x7f193401c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.937+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.937+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.937+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:53.937+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:54.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:54.337+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:54.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:54.337+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:54.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:54.337+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340127e0 legacy=0x7f193401c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:54.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:54.337+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:54.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:54.337+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:55.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:55.138+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:47:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:55.138+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340127e0 legacy=0x7f193401c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:55.138+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:55.138+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:55.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:55.138+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:56.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:56.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340152d0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:56.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:56.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:56.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340127e0 legacy=0x7f193401c3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:56.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:56.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934008370 2024-02-21T07:47:56.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934018eb0 2024-02-21T07:47:56.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934017c20 2024-02-21T07:47:56.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934008370 legacy=0x7f1934019370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:56.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:56.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:56.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.735+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934018eb0 legacy=0x7f193400cb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:56.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.936+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:56.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.936+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934008370 legacy=0x7f1934019370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:56.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.936+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:56.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:56.937+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934018eb0 legacy=0x7f193400cb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:57.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:57.337+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:57.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:57.337+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934008370 legacy=0x7f1934019370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:57.337+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:47:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:57.338+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934018eb0 legacy=0x7f193400cb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:58.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:58.138+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:58.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:58.138+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934008370 legacy=0x7f1934019370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:47:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:58.138+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:47:58.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:58.139+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934018eb0 legacy=0x7f193400cb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:47:59.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.735+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:59.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.735+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:47:59.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.735+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934018eb0 legacy=0x7f193400cb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:59.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.735+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934008370 legacy=0x7f1934019370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:47:59.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.735+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:47:59.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.735+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:59.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.735+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:47:59.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.736+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934008370 2024-02-21T07:47:59.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.736+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934017c20 2024-02-21T07:47:59.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.736+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f1934005be0 2024-02-21T07:47:59.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.736+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:59.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.736+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:59.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.736+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:59.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.736+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008370 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:59.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.736+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:47:59.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.937+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:47:59.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.937+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:47:59.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.937+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008370 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:47:59.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.937+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:47:59.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:47:59.937+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:00.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:00.338+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:00.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:00.338+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:00.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:00.338+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:00.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:00.338+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008370 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:00.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:00.338+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:01.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:01.139+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:01.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:01.139+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:01.139+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:01.139+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008370 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:01.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:01.139+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:02.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008370 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:02.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f193400c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934018eb0 2024-02-21T07:48:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f19340127b0 2024-02-21T07:48:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f193400d1f0 2024-02-21T07:48:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934018eb0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.736+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:02.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.737+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:02.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.937+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934018eb0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:02.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.937+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:02.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.938+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:02.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:02.938+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:03.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:03.338+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934018eb0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:03.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:03.338+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:03.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:03.339+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:03.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:03.339+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:04.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:04.139+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934018eb0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:04.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:04.139+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:04.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:04.140+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:04.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:04.140+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:05.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.736+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:05.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.736+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f193400c380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:05.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.736+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:05.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.736+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934018eb0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:05.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.736+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:05.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.736+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:05.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.736+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:05.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.737+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934015240 2024-02-21T07:48:05.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.737+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f19340127b0 2024-02-21T07:48:05.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.737+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934017c20 2024-02-21T07:48:05.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.737+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015240 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:05.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.737+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:05.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.737+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:05.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.737+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:05.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.938+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015240 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:05.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.938+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:05.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.938+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:05.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:05.938+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:06.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:06.339+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015240 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:06.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:06.339+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:06.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:06.339+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:06.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:06.339+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:07.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:07.140+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015240 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:07.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:07.140+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:07.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:07.140+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:07.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:07.140+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:08.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:08.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:08.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:08.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015240 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934008370 2024-02-21T07:48:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934005be0 2024-02-21T07:48:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f193400d1f0 2024-02-21T07:48:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008370 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.737+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:08.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.738+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:08.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.738+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:08.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.939+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:08.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.939+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008370 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:08.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.939+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:08.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.939+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:08.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:08.939+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:09.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:09.340+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:09.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:09.340+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008370 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:09.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:09.340+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:09.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:09.340+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:09.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:09.340+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:10.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:10.141+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008370 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:10.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:10.141+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:10.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:10.141+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:10.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:10.141+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:10.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:10.141+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:11.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:11.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:11.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:11.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934005be0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:11.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008370 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:11.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:11.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:11.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934005be0 2024-02-21T07:48:11.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934008370 2024-02-21T07:48:11.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f193400d1f0 2024-02-21T07:48:11.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:11.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008370 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:11.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:11.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.738+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:11.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.939+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:11.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.939+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008370 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:11.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.939+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:11.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:11.939+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:12.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:12.340+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008370 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:12.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:12.340+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:12.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:12.340+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:12.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:12.340+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:13.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:13.141+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008370 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:13.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:13.141+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:13.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:13.141+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:13.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:13.141+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:14.365 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:14.373 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:14.375 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:14.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400c320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:14.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:14.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008370 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:14.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:14.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:14.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:14.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934015230 2024-02-21T07:48:14.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934017c20 2024-02-21T07:48:14.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f19340127b0 2024-02-21T07:48:14.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:14.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015230 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:14.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.738+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:14.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.739+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:14.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.739+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:14.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.939+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015230 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:14.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.939+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:14.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.939+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:14.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.940+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:14.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:14.940+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:15.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:15.340+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015230 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:15.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:15.340+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:15.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:15.340+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:15.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:15.341+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:15.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:15.341+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:16.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:16.141+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015230 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:16.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:16.141+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:16.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:16.141+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:16.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:16.142+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:16.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:16.142+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:17.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:17.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:17.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:17.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:17.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015230 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:17.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:17.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:17.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:17.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f19340071d0 2024-02-21T07:48:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934015230 2024-02-21T07:48:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934017c20 2024-02-21T07:48:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f193401d390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.739+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:17.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.940+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f193401d390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:17.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.940+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:17.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.940+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:17.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:17.940+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:18.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:18.341+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f193401d390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:18.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:18.341+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:18.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:18.341+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:18.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:18.341+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:19.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:19.142+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f193401d390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:19.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:19.142+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:19.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:19.142+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:19.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:19.142+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:20.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:20.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:20.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f193401d390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:20.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:20.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:20.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f19340127b0 2024-02-21T07:48:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f193400d1f0 2024-02-21T07:48:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f1934005be0 2024-02-21T07:48:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.739+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.740+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.740+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:20.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.941+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:20.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.941+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:20.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.941+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:20.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.941+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:20.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:20.941+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:21.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:21.342+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:21.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:21.342+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:21.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:21.342+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:21.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:21.342+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:21.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:21.342+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:22.143+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:22.143+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:22.143+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:22.143+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:22.143+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:23.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400c320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:23.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934005be0 0x7f193400c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:23.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:23.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400d1f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:23.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:23.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:23.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:23.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f19340075b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:23.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:23.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f19340071d0 2024-02-21T07:48:23.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934005be0 2024-02-21T07:48:23.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f1934008350 2024-02-21T07:48:23.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:23.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:23.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:23.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:23.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.740+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:23.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.941+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:23.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.941+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:23.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.941+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:23.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.941+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:23.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:23.941+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:24.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:24.342+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:24.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:24.342+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:24.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:24.342+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:24.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:24.342+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:24.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:24.342+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:25.143+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:25.143+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:25.143+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:25.143+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:25.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:25.143+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:26.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934017c20 2024-02-21T07:48:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f19340127b0 2024-02-21T07:48:26.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934015230 2024-02-21T07:48:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934017c20 legacy=0x7f1934006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:26.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.741+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:26.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.942+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934017c20 legacy=0x7f1934006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:26.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.942+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:26.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.942+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:26.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:26.942+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:27.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:27.343+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934017c20 legacy=0x7f1934006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:27.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:27.343+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:27.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:27.343+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:27.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:27.343+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:28.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:28.144+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934017c20 legacy=0x7f1934006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:28.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:28.144+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:28.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:28.144+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:28.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:28.144+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:29.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:29.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:29.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:29.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934017c20 legacy=0x7f1934006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:29.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:29.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:29.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:29.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f19340071d0 2024-02-21T07:48:29.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934005be0 2024-02-21T07:48:29.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934008350 2024-02-21T07:48:29.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:29.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:29.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:29.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.741+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:29.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.942+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:29.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.942+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:29.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.942+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:29.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:29.942+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:30.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:30.343+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:30.343+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:30.343+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:30.343+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:31.144+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:31.144+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:31.144+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:31.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:31.144+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:32.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:32.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:32.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:32.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:32.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:32.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f193400c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:32.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f19340127b0 2024-02-21T07:48:32.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934017c20 2024-02-21T07:48:32.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f1934015230 2024-02-21T07:48:32.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f193400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:32.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:32.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:32.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f193400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:32.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.742+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.943+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f193400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:32.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.943+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f193400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.943+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.943+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:32.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:32.943+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:33.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:33.344+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f193400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:33.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:33.344+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f193400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:33.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:33.344+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:33.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:33.344+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:33.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:33.344+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:34.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:34.146+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f193400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:34.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:34.146+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f193400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:34.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:34.146+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:34.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:34.146+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:34.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:34.146+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:35.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.742+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:35.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.742+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:35.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.742+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f193400c2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:35.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.742+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f193400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:35.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.742+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f19340127b0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:35.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.742+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:35.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.742+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:35.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.742+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:35.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.743+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f19340071d0 2024-02-21T07:48:35.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.743+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934005be0 2024-02-21T07:48:35.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.743+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934008350 2024-02-21T07:48:35.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.743+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:35.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.743+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:35.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.743+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:35.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.743+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:35.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.944+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:35.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.944+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:35.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.944+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:35.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:35.944+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:36.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:36.345+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:36.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:36.345+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:36.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:36.345+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:36.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:36.345+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:37.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:37.146+0000 7f1955400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:37.147+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:37.147+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:37.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:37.147+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:38.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f19340071d0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934015230 2024-02-21T07:48:38.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934017c20 2024-02-21T07:48:38.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f19340127b0 2024-02-21T07:48:38.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:38.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:38.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:38.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.742+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f1934006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:38.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.743+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:38.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.943+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:38.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.943+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:38.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.944+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:38.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.944+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f1934006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:38.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:38.944+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:39.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:39.344+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:39.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:39.344+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:39.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:39.345+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f1934006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:39.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:39.345+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:39.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:39.345+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:40.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:40.145+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:40.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:40.145+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:40.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:40.146+0000 7f1956800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f1934006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:40.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:40.146+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:40.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:40.146+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:41.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:41.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 msgr2=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:41.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934017c20 0x7f1934006580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:41.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f1934006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:41.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:41.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:41.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:41.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f193400d1f0 2024-02-21T07:48:41.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934008350 2024-02-21T07:48:41.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.742+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f19340127b0 2024-02-21T07:48:41.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.743+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f193400d1f0 legacy=0x7f193401d390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:41.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.743+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:41.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.743+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:41.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.743+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:41.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.743+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.944+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.944+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f193400d1f0 legacy=0x7f193401d390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.944+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.944+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:41.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:41.944+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:42.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:42.345+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:42.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:42.345+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:42.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:42.345+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f193400d1f0 legacy=0x7f193401d390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:42.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:42.345+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:42.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:42.345+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:43.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:43.146+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f193400d1f0 legacy=0x7f193401d390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:43.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:43.146+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:43.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:43.146+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:43.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:43.146+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:43.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:43.146+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:44.510 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:44.518 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:44.521 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:48:44.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:44.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f19340127b0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 msgr2=0x7f19340075b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:44.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008350 0x7f19340075b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:44.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f193400d1f0 legacy=0x7f193401d390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:44.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:44.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934017c20 2024-02-21T07:48:44.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934005be0 2024-02-21T07:48:44.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934015230 2024-02-21T07:48:44.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:44.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934017c20 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:44.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:44.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.743+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.944+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934017c20 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.944+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.944+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:44.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:44.944+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:45.345+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934017c20 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:45.345+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:45.345+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:45.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:45.345+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:46.146+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934017c20 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:46.146+0000 7f1956800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:46.146+0000 7f1956800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:46.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:46.146+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:47.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.743+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 msgr2=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.743+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f1934006c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.743+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.743+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934017c20 legacy=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.743+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.743+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.743+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:47.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.743+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934005be0 2024-02-21T07:48:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.743+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934008350 2024-02-21T07:48:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.743+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f193400d1f0 2024-02-21T07:48:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.744+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.744+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934005be0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.744+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.744+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:47.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.744+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:47.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.945+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934005be0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:47.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.945+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:47.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.945+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:47.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.945+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:47.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:47.945+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:48.346+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:48.346+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934005be0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:48.346+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:48.346+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:48.346+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:49.147+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:49.147+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934005be0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:49.147+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:49.147+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:49.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:49.148+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:50.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:50.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:50.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:50.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:50.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934005be0 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:50.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f193400c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:50.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f19340073a0 2024-02-21T07:48:50.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934012770 2024-02-21T07:48:50.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934015230 2024-02-21T07:48:50.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340073a0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:50.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:50.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 msgr2=0x7f193400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:50.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.744+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f193400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:50.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.945+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:50.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.945+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 msgr2=0x7f193400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:50.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.945+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340073a0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:50.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:50.945+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f193400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:51.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:51.346+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:51.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:51.346+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 msgr2=0x7f193400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:51.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:51.346+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340073a0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:51.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:51.346+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f193400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:52.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:52.147+0000 7f1955e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 msgr2=0x7f193400c2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:52.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:52.147+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:52.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:52.147+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340073a0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:52.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:52.147+0000 7f1955e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f193400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:53.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 msgr2=0x7f193400c2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:53.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f193400c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:53.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f1934006c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:53.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f19340073a0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:53.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:53.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:53.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:53.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:53.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934005be0 2024-02-21T07:48:53.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934008350 2024-02-21T07:48:53.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.744+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f193400d1f0 2024-02-21T07:48:53.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.745+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:53.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.745+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:53.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.745+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:53.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.745+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:53.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.745+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:53.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.946+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:53.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.946+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:53.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.946+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:53.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.946+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:53.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:53.946+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:54.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:54.347+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:54.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:54.347+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:54.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:54.347+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:54.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:54.347+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:54.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:54.347+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:55.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:55.148+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:48:55.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:55.148+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:55.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:55.148+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:48:55.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:55.148+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:55.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:55.149+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400d1f0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:56.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008350 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f1934007590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f193400b2f0 2024-02-21T07:48:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934012770 2024-02-21T07:48:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934015230 2024-02-21T07:48:56.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:56.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f193400b2f0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:56.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:56.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.745+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:56.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.946+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f193400b2f0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:56.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.946+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:56.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.946+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:56.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:56.946+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:48:57.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:57.347+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f193400b2f0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:57.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:57.347+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:57.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:57.347+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:57.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:57.347+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:48:58.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:58.148+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f193400b2f0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:48:58.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:58.148+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:58.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:58.148+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:48:58.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:58.148+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:59.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.745+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 msgr2=0x7f1934007590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:59.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.745+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934015230 0x7f1934007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:48:59.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.745+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:59.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.745+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f193400b2f0 legacy=0x7f1934011d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:48:59.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.745+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:59.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.745+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:48:59.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.745+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:48:59.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.745+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934005be0 2024-02-21T07:48:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.745+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934012770 2024-02-21T07:48:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.745+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934008330 2024-02-21T07:48:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.746+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.746+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.746+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:59.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.746+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:48:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.947+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:48:59.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.947+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:48:59.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.947+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:48:59.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:48:59.947+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:00.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:00.348+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:00.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:00.348+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:00.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:00.348+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:00.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:00.348+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:01.149+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:01.149+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:01.149+0000 7f1955e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:01.149+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f193400cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 0x7f193400a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f193400d0c0 2024-02-21T07:49:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934015230 2024-02-21T07:49:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f1934007590 2024-02-21T07:49:02.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:02.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:02.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 msgr2=0x7f193400a9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:02.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 0x7f193400a9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:02.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.746+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f193400d0c0 legacy=0x7f193400a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:02.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.947+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:02.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.947+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:02.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.947+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 msgr2=0x7f193400a9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:02.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.947+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 0x7f193400a9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:02.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:02.947+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f193400d0c0 legacy=0x7f193400a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:03.348+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:03.348+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:03.348+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 msgr2=0x7f193400a9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:03.348+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 0x7f193400a9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:03.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:03.348+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f193400d0c0 legacy=0x7f193400a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:04.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:04.149+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:04.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:04.149+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:04.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:04.149+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 msgr2=0x7f193400a9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:04.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:04.149+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 0x7f193400a9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:04.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:04.149+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f193400d0c0 legacy=0x7f193400a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:05.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 msgr2=0x7f193400a9f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:05.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934007590 0x7f193400a9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:05.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:05.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934015230 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:05.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f193400d0c0 legacy=0x7f193400a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:49:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934012770 2024-02-21T07:49:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934008330 2024-02-21T07:49:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934005be0 2024-02-21T07:49:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:05.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.747+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:05.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.948+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:05.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.948+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:05.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.948+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:05.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:05.948+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:06.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:06.349+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:06.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:06.349+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:06.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:06.349+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:06.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:06.349+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:07.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:07.150+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:07.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:07.150+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:07.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:07.150+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:07.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:07.150+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:08.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:08.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:08.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:08.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:08.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:08.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 0x7f19340070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:08.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934015230 2024-02-21T07:49:08.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934006c90 2024-02-21T07:49:08.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f193400b2f0 2024-02-21T07:49:08.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:08.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 msgr2=0x7f19340070a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:08.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:08.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 0x7f19340070a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:08.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.747+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:08.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.948+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:08.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.948+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:08.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.948+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 msgr2=0x7f19340070a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:08.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.948+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:08.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:08.948+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 0x7f19340070a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:09.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:09.349+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:09.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:09.349+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:09.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:09.349+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:09.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:09.349+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 msgr2=0x7f19340070a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:09.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:09.349+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 0x7f19340070a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:10.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:10.150+0000 7f1955400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:10.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:10.150+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:10.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:10.150+0000 7f1955400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:10.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:10.150+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 msgr2=0x7f19340070a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:10.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:10.150+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 0x7f19340070a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:11.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:11.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:11.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 msgr2=0x7f19340070a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:11.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934006c90 0x7f19340070a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:11.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:11.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:49:11.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:11.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:11.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:49:11.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934012770 2024-02-21T07:49:11.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934005be0 2024-02-21T07:49:11.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f193400b2f0 2024-02-21T07:49:11.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:11.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:11.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:11.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:11.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.748+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:11.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.949+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:11.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.949+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:11.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.949+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:11.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.949+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:11.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:11.949+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:12.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:12.350+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:12.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:12.350+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:12.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:12.350+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:12.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:12.350+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:12.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:12.350+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:13.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:13.151+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:13.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:13.151+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:13.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:13.151+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:13.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:13.151+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:13.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:13.151+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:14.666 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:14.675 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:14.678 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:14.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.747+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:14.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.747+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:14.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.747+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:14.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.747+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934005be0 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:14.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.747+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934012770 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:14.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.747+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:14.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.748+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934015230 2024-02-21T07:49:14.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.748+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934008330 2024-02-21T07:49:14.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.748+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f19340070a0 2024-02-21T07:49:14.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.748+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:14.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.748+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:14.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.748+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 msgr2=0x7f1934007480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:14.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.748+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:14.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.949+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:14.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.949+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:14.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.949+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 msgr2=0x7f1934007480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:14.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:14.949+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:15.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:15.350+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:15.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:15.350+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 msgr2=0x7f1934007480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:15.350+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:15.350+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:16.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:16.151+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:16.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:16.151+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 msgr2=0x7f1934007480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:16.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:16.151+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:16.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:16.151+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:17.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 msgr2=0x7f1934007480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:17.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:17.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:17.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:17.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:49:17.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:17.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:49:17.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934005be0 2024-02-21T07:49:17.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934008330 2024-02-21T07:49:17.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f193400b2f0 2024-02-21T07:49:17.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:17.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:17.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:17.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.749+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:17.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.950+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:17.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.950+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:17.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.950+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:17.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:17.950+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:18.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:18.351+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:18.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:18.351+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:18.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:18.351+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:18.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:18.351+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:19.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:19.153+0000 7f1955400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:19.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:19.153+0000 7f1955e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:19.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:19.153+0000 7f1955e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:19.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:19.153+0000 7f1956800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.749+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.749+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.749+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934008330 legacy=0x7f1934008de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.749+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.749+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 0x7f193400cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.749+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.749+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934015230 2024-02-21T07:49:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.749+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934012770 2024-02-21T07:49:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.749+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f19340070a0 2024-02-21T07:49:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.750+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.750+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.750+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.750+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 msgr2=0x7f1934007480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.750+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:20.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.951+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:20.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.951+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:20.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.951+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:20.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.951+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 msgr2=0x7f1934007480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:20.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:20.951+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:21.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:21.352+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:21.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:21.352+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:21.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:21.352+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:21.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:21.352+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 msgr2=0x7f1934007480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:21.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:21.352+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:22.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:22.152+0000 7f1955e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:22.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:22.152+0000 7f1956800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:22.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:22.152+0000 7f1955e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:22.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:22.152+0000 7f1955400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 msgr2=0x7f1934007480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:22.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:22.152+0000 7f1955400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:23.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 msgr2=0x7f1934007480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:23.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f19340070a0 0x7f1934007480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:23.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:23.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934012770 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:23.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934015230 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:23.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:49:23.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:23.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934006c90 legacy=0x7f1934010d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:23.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934006c90 2024-02-21T07:49:23.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:49:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340125a0 con 0x7f1934005be0 2024-02-21T07:49:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f193400b2f0 2024-02-21T07:49:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.749+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:23.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.750+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:23.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.950+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934006c90 legacy=0x7f1934010d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:23.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.950+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:23.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.951+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:23.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:23.951+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:24.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:24.351+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934006c90 legacy=0x7f1934010d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:24.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:24.351+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:24.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:24.352+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:24.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:24.352+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:25.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:25.152+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934006c90 legacy=0x7f1934010d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:25.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:25.152+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:25.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:25.153+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:25.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:25.153+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:26.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.749+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:26.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.749+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f193400b2f0 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:26.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.749+0000 7f194b400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934005be0 legacy=0x7f19340094f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:26.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.749+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934006c90 legacy=0x7f1934010d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:26.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.749+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f193400cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:26.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.749+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 0x7f1934007070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:26.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.749+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934012770 2024-02-21T07:49:26.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.749+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934008330 2024-02-21T07:49:26.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.749+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f1934008d40 2024-02-21T07:49:26.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.750+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:26.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.750+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:26.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.750+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:26.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.750+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 msgr2=0x7f1934007070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:26.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.750+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 0x7f1934007070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:26.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.951+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:26.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.951+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:26.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.951+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:26.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.951+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 msgr2=0x7f1934007070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:26.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:26.951+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 0x7f1934007070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:27.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:27.352+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:27.352+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:27.352+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:27.352+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 msgr2=0x7f1934007070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:27.352+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 0x7f1934007070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:28.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:28.153+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:28.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:28.153+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:28.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:28.153+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:28.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:28.153+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 msgr2=0x7f1934007070 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:28.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:28.153+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 0x7f1934007070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:29.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f194b400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 msgr2=0x7f1934007070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:29.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1934008d40 0x7f1934007070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:29.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:29.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:29.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f194b400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934012770 legacy=0x7f1934006580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:29.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:49:29.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f1956800640 1 -- reap_dead start 2024-02-21T07:49:29.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:29.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 0x7f193400cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:29.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f194b400640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934005be0 2024-02-21T07:49:29.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f194b400640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f1934008330 2024-02-21T07:49:29.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f194b400640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193400db20 con 0x7f1934008d40 2024-02-21T07:49:29.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:29.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934005be0 legacy=0x7f1934009120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:29.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:29.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.750+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:29.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.751+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:29.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.951+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:29.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.951+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934005be0 legacy=0x7f1934009120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:29.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.951+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:29.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.952+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:29.952+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:30.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:30.352+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:30.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:30.352+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934005be0 legacy=0x7f1934009120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:30.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:30.352+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:30.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:30.353+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:30.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:30.353+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:31.153+0000 7f1955400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:31.153+0000 7f1955e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934005be0 legacy=0x7f1934009120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:31.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:31.153+0000 7f1955400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:31.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:31.154+0000 7f1956800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:31.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:31.154+0000 7f1956800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:32.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.750+0000 7f194b400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 msgr2=0x7f193400cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:32.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.750+0000 7f194b400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1934008d40 0x7f193400cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:32.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.750+0000 7f194b400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 msgr2=0x7f1934018700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:32.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.750+0000 7f194b400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934008330 0x7f1934018700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:32.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.750+0000 7f194b400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1934005be0 legacy=0x7f1934009120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:32.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.750+0000 7f194b400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400c2f0 0x7f1934010d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:32.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.750+0000 7f194b400640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19501850b0 con 0x7f1934007590 2024-02-21T07:49:32.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.750+0000 7f194b400640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950184df0 con 0x7f1934015230 2024-02-21T07:49:32.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.750+0000 7f194b400640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950186010 con 0x7f193400c2f0 2024-02-21T07:49:32.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.751+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934007590 legacy=0x7f193401a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:32.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.751+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f193401a2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:32.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.751+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400c2f0 msgr2=0x7f1934010d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:32.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.751+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400c2f0 0x7f1934010d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:32.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.952+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f193401a2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:32.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.952+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934007590 legacy=0x7f193401a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:32.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.952+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400c2f0 msgr2=0x7f1934010d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:32.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:32.952+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400c2f0 0x7f1934010d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:33.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:33.353+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f193401a2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:33.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:33.353+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934007590 legacy=0x7f193401a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:33.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:33.353+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400c2f0 msgr2=0x7f1934010d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:33.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:33.353+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400c2f0 0x7f1934010d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:34.154+0000 7f1955400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1934007590 legacy=0x7f193401a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:34.154+0000 7f1956800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f193400c2f0 msgr2=0x7f1934010d70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:34.154+0000 7f1955e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1934015230 legacy=0x7f193401a2a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:34.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:34.154+0000 7f1956800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f193400c2f0 0x7f1934010d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:35.628 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-02-21T07:49:35.629 INFO:tasks.check_counter.ceph_manager:Failed to get pg_num from pool cephfs_data, ignoring 2024-02-21T07:49:35.630 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T07:49:35.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.845+0000 7fb1d3800640 1 Processor -- start 2024-02-21T07:49:35.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.845+0000 7fb1d3800640 1 -- start start 2024-02-21T07:49:35.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.847+0000 7fb1d3800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1cc183670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:35.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.847+0000 7fb1d3800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 0x7fb1cc0cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:35.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.847+0000 7fb1d3800640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1cc185cc0 2024-02-21T07:49:35.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.847+0000 7fb1d3800640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1cc1850e0 2024-02-21T07:49:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.847+0000 7fb1d3800640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1cc17f700 2024-02-21T07:49:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.847+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 msgr2=0x7fb1cc0cf750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.847+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 msgr2=0x7fb1cc183670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.847+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 0x7fb1cc0cf750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.847+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1cc183670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:35.847+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1cc185cc0 legacy=0x7fb1cc186130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:36.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:36.048+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 msgr2=0x7fb1cc0cf750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:36.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:36.048+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 msgr2=0x7fb1cc183670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:36.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:36.048+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1cc185cc0 legacy=0x7fb1cc186130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:36.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:36.048+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 0x7fb1cc0cf750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:36.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:36.048+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1cc183670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:36.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:36.449+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 msgr2=0x7fb1cc0cf750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:36.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:36.449+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 0x7fb1cc0cf750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:36.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:36.449+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1cc185cc0 legacy=0x7fb1cc186130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:36.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:36.449+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 msgr2=0x7fb1cc183670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:36.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:36.449+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1cc183670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:37.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:37.250+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1cc185cc0 legacy=0x7fb1cc186130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:37.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:37.250+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 msgr2=0x7fb1cc183670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:37.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:37.250+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1cc183670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:37.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:37.250+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 msgr2=0x7fb1cc0cf750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:37.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:37.250+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 0x7fb1cc0cf750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:38.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.847+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 msgr2=0x7fb1cc183670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:38.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.847+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1cc183670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:38.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.847+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 msgr2=0x7fb1cc0cf750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:38.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.847+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1cc1850e0 0x7fb1cc0cf750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:38.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.847+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1cc185cc0 legacy=0x7fb1cc186130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:38.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.847+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 0x7fb1ac0098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:38.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.847+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac009f90 2024-02-21T07:49:38.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.848+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac0036c0 2024-02-21T07:49:38.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.848+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac0073e0 2024-02-21T07:49:38.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.848+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009f90 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:38.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.848+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac0036c0 legacy=0x7fb1ac005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:38.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.848+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 msgr2=0x7fb1ac0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:38.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:38.848+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 0x7fb1ac0098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:39.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:39.049+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009f90 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:39.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:39.049+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 msgr2=0x7fb1ac0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:39.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:39.049+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac0036c0 legacy=0x7fb1ac005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:39.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:39.049+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 0x7fb1ac0098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:39.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:39.450+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 msgr2=0x7fb1ac0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:39.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:39.450+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009f90 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:39.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:39.450+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac0036c0 legacy=0x7fb1ac005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:39.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:39.450+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 0x7fb1ac0098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:40.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:40.251+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009f90 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:40.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:40.251+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 msgr2=0x7fb1ac0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:40.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:40.251+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 0x7fb1ac0098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:40.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:40.251+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac0036c0 legacy=0x7fb1ac005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:41.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 msgr2=0x7fb1ac0098a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:41.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0073e0 0x7fb1ac0098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:41.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac0036c0 legacy=0x7fb1ac005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:41.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009f90 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:41.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:49:41.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1ac005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:41.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac00dd00 2024-02-21T07:49:41.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac00e8f0 2024-02-21T07:49:41.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1cc17f700 2024-02-21T07:49:41.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:49:41.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00dd00 legacy=0x7fb1ac00e140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:41.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:41.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.848+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00e8f0 legacy=0x7fb1ac0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:41.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:41.849+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:42.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:42.049+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00dd00 legacy=0x7fb1ac00e140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:42.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:42.050+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:42.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:42.050+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00e8f0 legacy=0x7fb1ac0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:42.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:42.050+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:42.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:42.450+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00dd00 legacy=0x7fb1ac00e140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:42.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:42.451+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:42.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:42.451+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00e8f0 legacy=0x7fb1ac0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:42.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:42.451+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:43.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:43.251+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00dd00 legacy=0x7fb1ac00e140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:43.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:43.252+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:43.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:43.252+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00e8f0 legacy=0x7fb1ac0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:43.252+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:44.793 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:44.802 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:44.805 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:49:44.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.848+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:44.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.848+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1cc17f700 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:44.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.848+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00e8f0 legacy=0x7fb1ac0162f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.848+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00dd00 legacy=0x7fb1ac00e140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.848+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 0x7fb1ac009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.848+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.848+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac006790 2024-02-21T07:49:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.848+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac0062e0 2024-02-21T07:49:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.848+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac006c40 2024-02-21T07:49:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.849+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac006790 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:44.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.849+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 msgr2=0x7fb1ac009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.849+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 msgr2=0x7fb1ac019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.849+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:44.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:44.849+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 0x7fb1ac009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:45.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:45.050+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 msgr2=0x7fb1ac009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:45.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:45.050+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 0x7fb1ac009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:45.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:45.050+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac006790 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:45.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:45.050+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 msgr2=0x7fb1ac019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:45.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:45.050+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:45.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:45.451+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 msgr2=0x7fb1ac009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:45.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:45.451+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 0x7fb1ac009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:45.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:45.451+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 msgr2=0x7fb1ac019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:45.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:45.451+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac006790 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:45.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:45.451+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:46.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:46.252+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 msgr2=0x7fb1ac009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:46.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:46.252+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 0x7fb1ac009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:46.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:46.252+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 msgr2=0x7fb1ac019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:46.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:46.252+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac006790 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:46.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:46.253+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:47.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 msgr2=0x7fb1ac019ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:47.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:47.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 msgr2=0x7fb1ac009840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:47.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0062e0 0x7fb1ac009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:47.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac006790 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:47.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:49:47.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:47.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac01a000 2024-02-21T07:49:47.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac00e8f0 2024-02-21T07:49:47.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac006c40 2024-02-21T07:49:47.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 msgr2=0x7fb1ac019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:47.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00e8f0 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:47.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:47.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:47.849+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:48.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:48.050+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:48.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:48.050+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 msgr2=0x7fb1ac019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:48.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:48.050+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00e8f0 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:48.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:48.050+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:48.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:48.451+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:48.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:48.451+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00e8f0 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:48.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:48.451+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 msgr2=0x7fb1ac019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:48.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:48.451+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:49.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:49.253+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:49.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:49.253+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 msgr2=0x7fb1ac019ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:49.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:49.253+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00e8f0 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:49.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:49.253+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:50.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 msgr2=0x7fb1ac019ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:50.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac006c40 0x7fb1ac019ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:50.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00e8f0 legacy=0x7fb1ac00c450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:50.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:50.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac009840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:50.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac00d0a0 2024-02-21T07:49:50.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00e140 2024-02-21T07:49:50.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac00cc20 2024-02-21T07:49:50.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d0a0 legacy=0x7fb1ac00d4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:50.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:50.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:50.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:50.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:50.850+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:51.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:51.051+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:51.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:51.051+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:51.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:51.051+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d0a0 legacy=0x7fb1ac00d4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:51.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:51.051+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:51.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:51.051+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:51.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:51.452+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:51.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:51.452+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:51.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:51.452+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d0a0 legacy=0x7fb1ac00d4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:51.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:51.452+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:51.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:51.452+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:52.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:52.253+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac009840 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:52.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:52.253+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:52.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:52.253+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d0a0 legacy=0x7fb1ac00d4b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:52.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:52.253+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:52.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:52.253+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:53.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac009840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac009840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d0a0 legacy=0x7fb1ac00d4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:49:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:49:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac00d0a0 2024-02-21T07:49:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac01a000 2024-02-21T07:49:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac006c40 2024-02-21T07:49:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d0a0 legacy=0x7fb1ac00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:53.850+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006c40 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:54.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:54.051+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:54.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:54.051+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d0a0 legacy=0x7fb1ac00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:54.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:54.051+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006c40 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:54.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:54.452+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:54.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:54.452+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d0a0 legacy=0x7fb1ac00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:54.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:54.452+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006c40 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:55.254+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:55.254+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d0a0 legacy=0x7fb1ac00d480 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:49:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:55.254+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006c40 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:56.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006c40 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:56.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:56.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d0a0 legacy=0x7fb1ac00d480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:56.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:56.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:56.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 0x7fb1ac01c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:56.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00cc20 2024-02-21T07:49:56.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac00e140 2024-02-21T07:49:56.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac01c930 con 0x7fb1ac00f900 2024-02-21T07:49:56.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:56.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:56.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:56.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:56.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:56.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:56.851+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:49:57.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.052+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:57.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.052+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:57.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.052+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:57.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.052+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:57.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.052+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:57.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.052+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:49:57.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.453+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:57.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.453+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:57.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.453+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:57.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.453+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:57.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.453+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:57.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:57.453+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:49:58.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:58.255+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:49:58.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:58.255+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:58.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:58.255+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:58.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:58.255+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:49:58.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:58.255+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:58.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:58.255+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:49:59.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f900 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:49:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:49:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:49:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:49:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac01a000 2024-02-21T07:49:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac006c40 2024-02-21T07:49:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00e140 2024-02-21T07:49:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:49:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:49:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006c40 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:49:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:49:59.851+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:00.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:00.052+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006c40 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:00.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:00.052+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:00.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:00.052+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:00.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:00.052+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:00.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:00.453+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006c40 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:00.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:00.453+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:00.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:00.453+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:00.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:00.453+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:01.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:01.255+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006c40 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:01.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:01.255+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:01.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:01.255+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:01.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:01.255+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006c40 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:02.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 0x7fb1ac01c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac00cc20 2024-02-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00f8e0 2024-02-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac00d7b0 2024-02-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00cc20 legacy=0x7fb1ac00d0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:02.852+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:03.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:03.053+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:03.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:03.053+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:03.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:03.053+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:03.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:03.053+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:03.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:03.053+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00cc20 legacy=0x7fb1ac00d0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:03.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:03.454+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:03.454+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:03.454+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:03.454+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00cc20 legacy=0x7fb1ac00d0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:03.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:03.454+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:04.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:04.255+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:04.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:04.255+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00cc20 legacy=0x7fb1ac00d0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:04.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:04.255+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:04.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:04.255+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:04.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:04.256+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:05.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:05.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:05.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:05.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f8e0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:05.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00cc20 legacy=0x7fb1ac00d0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:05.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:05.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:05.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:05.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac01a000 2024-02-21T07:50:05.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00e140 2024-02-21T07:50:05.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac00d7b0 2024-02-21T07:50:05.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.851+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:05.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.852+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:05.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.852+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:05.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.852+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:05.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.852+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:05.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:05.852+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:06.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:06.053+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:06.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:06.053+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:06.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:06.053+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:06.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:06.053+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:06.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:06.053+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:06.454+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:06.454+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:06.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:06.454+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:06.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:06.454+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:06.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:06.454+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:07.255+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:07.255+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:07.255+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:07.255+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:07.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:07.255+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:08.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 0x7fb1ac01c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:08.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac00f840 2024-02-21T07:50:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac00cc20 2024-02-21T07:50:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac006ba0 2024-02-21T07:50:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f840 legacy=0x7fb1ac00d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00cc20 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:08.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:08.852+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:09.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:09.053+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f840 legacy=0x7fb1ac00d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:09.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:09.053+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00cc20 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:09.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:09.053+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:09.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:09.053+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:09.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:09.454+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f840 legacy=0x7fb1ac00d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:09.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:09.454+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00cc20 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:09.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:09.454+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:09.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:09.454+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:10.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:10.255+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:10.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:10.255+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:10.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:10.255+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f840 legacy=0x7fb1ac00d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:10.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:10.255+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00cc20 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:11.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:11.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac006ba0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:11.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00cc20 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:11.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f840 legacy=0x7fb1ac00d060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:11.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:11.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:11.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac009880 2024-02-21T07:50:11.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac01a000 2024-02-21T07:50:11.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00e140 2024-02-21T07:50:11.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:11.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.852+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009880 legacy=0x7fb1ac018330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:11.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.853+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:11.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.853+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:11.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:11.853+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:12.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:12.054+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009880 legacy=0x7fb1ac018330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:12.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:12.054+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:12.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:12.054+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:12.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:12.054+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:12.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:12.455+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009880 legacy=0x7fb1ac018330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:12.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:12.455+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:12.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:12.455+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:12.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:12.455+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:13.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:13.256+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009880 legacy=0x7fb1ac018330 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:13.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:13.256+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:13.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:13.257+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:13.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:13.257+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:14.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.852+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00c3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:14.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:14.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.852+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:14.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.852+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009880 legacy=0x7fb1ac018330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:14.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.852+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac019a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:14.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.853+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac006ba0 2024-02-21T07:50:14.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.853+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00cc20 2024-02-21T07:50:14.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.853+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac00d7b0 2024-02-21T07:50:14.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.853+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:14.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.853+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:14.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.853+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006ba0 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:14.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.853+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:14.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:14.853+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:14.955 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:14.964 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:14.966 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:15.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:15.054+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006ba0 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:15.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:15.054+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:15.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:15.054+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:15.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:15.054+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:15.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:15.054+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:15.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:15.455+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:15.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:15.455+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:15.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:15.455+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006ba0 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:15.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:15.455+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:15.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:15.455+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:16.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:16.256+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:16.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:16.256+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006ba0 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:16.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:16.256+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:16.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:16.257+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:16.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:16.257+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:17.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:17.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:17.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 msgr2=0x7fb1ac019a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:17.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00cc20 0x7fb1ac019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:17.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006ba0 legacy=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:17.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:17.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:17.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:17.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:17.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac01a000 2024-02-21T07:50:17.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00e140 2024-02-21T07:50:17.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac00d7b0 2024-02-21T07:50:17.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:17.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:17.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:17.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.853+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:17.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:17.854+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:18.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:18.054+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:18.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:18.054+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:18.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:18.055+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:18.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:18.055+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:18.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:18.055+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:18.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:18.455+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:18.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:18.455+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:18.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:18.456+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:18.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:18.456+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:18.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:18.456+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:19.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:19.256+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:19.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:19.256+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:19.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:19.257+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:19.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:19.257+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:19.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:19.257+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:20.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 msgr2=0x7fb1ac01d2b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:20.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d7b0 0x7fb1ac01d2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:20.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:20.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00e140 0x7fb1ac00d020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:20.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:20.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:20.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac009840 2024-02-21T07:50:20.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac006ba0 2024-02-21T07:50:20.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00cc00 2024-02-21T07:50:20.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009840 legacy=0x7fb1ac00ef40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:20.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:20.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006ba0 legacy=0x7fb1ac00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:20.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:20.854+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:21.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:21.055+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009840 legacy=0x7fb1ac00ef40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:21.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:21.055+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006ba0 legacy=0x7fb1ac00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:21.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:21.055+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:21.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:21.055+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:21.456+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009840 legacy=0x7fb1ac00ef40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:21.456+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:21.456+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006ba0 legacy=0x7fb1ac00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:21.456+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:22.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:22.257+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009840 legacy=0x7fb1ac00ef40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:22.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:22.257+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:22.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:22.257+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006ba0 legacy=0x7fb1ac00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:22.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:22.257+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:23.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:23.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:23.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac006ba0 legacy=0x7fb1ac00e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:23.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac009840 legacy=0x7fb1ac00ef40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:23.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:23.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:23.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac01a000 2024-02-21T07:50:23.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:23.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac00c3d0 2024-02-21T07:50:23.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00cc00 2024-02-21T07:50:23.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:23.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:23.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac0192f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:23.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:23.854+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:24.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:24.055+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:24.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:24.055+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:24.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:24.055+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac0192f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:24.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:24.055+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:24.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:24.456+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:24.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:24.456+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac0192f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:24.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:24.456+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:24.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:24.456+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:25.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:25.257+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:25.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:25.257+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac0192f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:25.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:25.257+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:25.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:25.258+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:26.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.854+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:26.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.854+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00cc00 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:26.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.854+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac0192f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:26.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.854+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:26.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.854+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.854+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac019a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:26.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.854+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac00e140 2024-02-21T07:50:26.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.854+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00f840 2024-02-21T07:50:26.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.854+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac00d730 2024-02-21T07:50:26.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.854+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:26.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.855+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:26.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.855+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac019a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:26.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.855+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac019a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:26.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:26.855+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00e140 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:27.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:27.056+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00e140 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:27.056+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:27.056+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:27.056+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac019a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:27.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:27.056+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac019a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:27.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:27.457+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00e140 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:27.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:27.457+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:27.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:27.457+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:27.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:27.457+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac019a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:27.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:27.457+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac019a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:28.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:28.258+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00e140 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:28.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:28.258+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:28.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:28.258+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:28.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:28.258+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac019a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:28.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:28.258+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac019a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:29.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac019a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:29.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac019a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:29.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:29.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00e140 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:29.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 0x7fb1ac005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:29.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:29.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac01a000 2024-02-21T07:50:29.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac00c3d0 2024-02-21T07:50:29.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac007830 2024-02-21T07:50:29.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:29.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:29.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:29.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:29.855+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:30.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:30.056+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:30.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:30.056+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:30.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:30.056+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:30.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:30.056+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:30.457+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:30.457+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:30.457+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:30.457+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:31.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:31.258+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:31.258+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:31.258+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:31.258+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:32.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:32.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac007830 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:32.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:32.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:32.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:32.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:32.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac00cc00 2024-02-21T07:50:32.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00f840 2024-02-21T07:50:32.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac00e140 2024-02-21T07:50:32.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00cc00 legacy=0x7fb1ac009350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:32.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:32.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:32.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.855+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:32.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:32.856+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:33.056+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00cc00 legacy=0x7fb1ac009350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:33.056+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:33.056+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:33.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:33.057+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:33.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:33.057+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:33.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:33.457+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00cc00 legacy=0x7fb1ac009350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:33.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:33.457+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:33.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:33.457+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:33.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:33.458+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:33.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:33.458+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:34.258+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00cc00 legacy=0x7fb1ac009350 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:34.258+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:34.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:34.258+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:34.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:34.259+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:34.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:34.259+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f840 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00cc00 legacy=0x7fb1ac009350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac00d020 2024-02-21T07:50:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac01a000 2024-02-21T07:50:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac0192d0 2024-02-21T07:50:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.855+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.856+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.856+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:35.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.856+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d020 legacy=0x7fb1ac00d400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:35.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:35.856+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:36.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:36.057+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:36.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:36.057+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:36.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:36.057+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d020 legacy=0x7fb1ac00d400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:36.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:36.057+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:36.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:36.458+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:36.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:36.458+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:36.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:36.458+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d020 legacy=0x7fb1ac00d400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:36.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:36.458+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:37.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:37.259+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:37.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:37.259+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:37.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:37.259+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d020 legacy=0x7fb1ac00d400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:37.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:37.259+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:38.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:38.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:38.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:38.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00d020 legacy=0x7fb1ac00d400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:38.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:38.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 0x7fb1ac005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:38.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac00c3d0 2024-02-21T07:50:38.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00e140 2024-02-21T07:50:38.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac019c10 2024-02-21T07:50:38.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:38.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:38.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:38.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:38.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:38.856+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:39.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:39.057+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:39.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:39.057+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:39.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:39.057+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:39.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:39.057+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:39.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:39.057+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:39.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:39.458+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:39.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:39.458+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:39.458+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:39.458+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:39.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:39.458+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:40.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:40.260+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:40.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:40.260+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00e830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:40.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:40.260+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:40.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:40.260+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:40.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:40.260+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:41.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:41.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac019c10 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:41.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00e140 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:41.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00e830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:41.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:41.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:41.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac01a000 2024-02-21T07:50:41.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac0192d0 2024-02-21T07:50:41.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac0077f0 2024-02-21T07:50:41.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:41.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:41.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:41.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:41.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:41.857+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:42.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:42.058+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:42.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:42.058+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:42.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:42.058+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:42.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:42.058+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:42.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:42.058+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:42.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:42.459+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:42.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:42.459+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:42.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:42.459+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:42.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:42.459+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:42.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:42.459+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:43.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:43.260+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:43.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:43.260+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:43.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:43.260+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:43.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:43.260+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:43.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:43.261+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:44.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:44.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:44.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:44.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:44.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:44.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 0x7fb1ac01d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:44.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac00c3d0 2024-02-21T07:50:44.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac00f840 2024-02-21T07:50:44.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00d730 2024-02-21T07:50:44.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:44.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00f840 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:44.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:44.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:44.857+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:45.058+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:45.058+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00f840 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:45.058+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:45.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:45.058+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:45.117 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:45.125 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:45.128 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:50:45.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:45.459+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00f840 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:45.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:45.459+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:45.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:45.459+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:45.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:45.459+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:46.261+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:46.261+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:46.261+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00f840 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:46.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:46.261+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:47.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac01d1f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:47.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00d730 0x7fb1ac01d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:47.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00f840 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:47.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:47.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:47.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac00c3d0 2024-02-21T07:50:47.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac01a000 2024-02-21T07:50:47.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:47.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184040 con 0x7fb1ac009350 2024-02-21T07:50:47.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:47.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac009350 legacy=0x7fb1ac021fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:47.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:47.858+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:48.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:48.059+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:48.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:48.059+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac009350 legacy=0x7fb1ac021fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:48.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:48.059+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:48.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:48.460+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:48.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:48.460+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac009350 legacy=0x7fb1ac021fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:48.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:48.460+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:49.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:49.260+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:49.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:49.260+0000 7fb1cbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac009350 legacy=0x7fb1ac021fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:49.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:49.260+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:50.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.857+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac009350 legacy=0x7fb1ac021fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:50.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.857+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01a000 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:50.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.857+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00d020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:50.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.857+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:50.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.857+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac0196d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:50.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.857+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:50.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.857+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac0077f0 2024-02-21T07:50:50.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.857+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac00d730 2024-02-21T07:50:50.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.857+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac01c930 con 0x7fb1ac0192d0 2024-02-21T07:50:50.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.858+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:50.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.858+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:50.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.858+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:50.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.858+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:50.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.858+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:50.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:50.858+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:51.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.059+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:51.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.059+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:51.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.059+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:51.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.059+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:51.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.059+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:51.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.059+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:51.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.460+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:51.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.460+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:51.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.460+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:51.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.460+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:51.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.460+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:51.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:51.460+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:52.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:52.261+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:52.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:52.261+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:52.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:52.261+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:52.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:52.261+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:52.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:52.261+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:52.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:52.261+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:53.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:53.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac0192d0 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:53.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 msgr2=0x7fb1ac0196d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:53.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00d730 0x7fb1ac0196d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 msgr2=0x7fb1ac01c3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac0077f0 0x7fb1ac01c3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac01c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac00c3d0 2024-02-21T07:50:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac01c550 2024-02-21T07:50:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00f9a0 2024-02-21T07:50:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:53.858+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:54.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:54.059+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:54.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:54.059+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:54.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:54.059+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:54.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:54.059+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:54.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:54.460+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:54.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:54.460+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:54.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:54.460+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:54.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:54.460+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:55.261+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:55.261+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:55.261+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:55.261+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:56.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.858+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:56.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.858+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:56.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.858+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac01cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:56.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.858+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:56.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.858+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:56.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.858+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 0x7fb1ac017290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:56.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.858+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac0097d0 2024-02-21T07:50:56.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.858+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac01d1f0 2024-02-21T07:50:56.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.858+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac009350 2024-02-21T07:50:56.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.859+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac0097d0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:56.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.859+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:56.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.859+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 msgr2=0x7fb1ac017290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:56.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.859+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:56.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:56.859+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 0x7fb1ac017290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:50:57.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:57.060+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 msgr2=0x7fb1ac017290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:57.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:57.060+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 0x7fb1ac017290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:57.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:57.060+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:57.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:57.060+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac0097d0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:57.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:57.060+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:50:57.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:57.461+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 msgr2=0x7fb1ac017290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:57.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:57.461+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 0x7fb1ac017290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:57.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:57.461+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:57.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:57.461+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac0097d0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:57.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:57.461+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:50:58.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:58.262+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 msgr2=0x7fb1ac017290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:50:58.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:58.262+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 0x7fb1ac017290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:58.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:58.262+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:50:58.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:58.262+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac0097d0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:50:58.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:58.262+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:50:59.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac005bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:59.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac005bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:59.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 msgr2=0x7fb1ac017290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01d1f0 0x7fb1ac017290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:50:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac0097d0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:50:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:50:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:50:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac00f9a0 2024-02-21T07:50:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac005bd0 2024-02-21T07:50:59.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00c3d0 2024-02-21T07:50:59.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f9a0 legacy=0x7fb1ac01cac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:50:59.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:50:59.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac005bd0 legacy=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:50:59.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:50:59.859+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:00.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:00.060+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f9a0 legacy=0x7fb1ac01cac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:00.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:00.060+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac005bd0 legacy=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:00.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:00.060+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:00.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:00.060+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:00.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:00.461+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f9a0 legacy=0x7fb1ac01cac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:00.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:00.461+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac005bd0 legacy=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:00.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:00.461+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:00.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:00.461+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:01.262+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f9a0 legacy=0x7fb1ac01cac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:01.262+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:01.262+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac005bd0 legacy=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:01.262+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:02.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.859+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.859+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.859+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac005bd0 legacy=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.859+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f9a0 legacy=0x7fb1ac01cac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.859+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac013020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.859+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 0x7fb1ac013970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.859+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac01d1d0 2024-02-21T07:51:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.859+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac013560 2024-02-21T07:51:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.859+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac009350 2024-02-21T07:51:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.860+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01d1d0 legacy=0x7fb1ac008c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.860+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.860+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 msgr2=0x7fb1ac013970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.860+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:02.860+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 0x7fb1ac013970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:03.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:03.061+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 msgr2=0x7fb1ac013970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:03.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:03.061+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:03.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:03.061+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01d1d0 legacy=0x7fb1ac008c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:03.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:03.061+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 0x7fb1ac013970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:03.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:03.061+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:03.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:03.462+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 msgr2=0x7fb1ac013970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:03.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:03.462+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 0x7fb1ac013970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:03.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:03.462+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:03.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:03.462+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01d1d0 legacy=0x7fb1ac008c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:03.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:03.462+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:04.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:04.263+0000 7fb1d1800640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 msgr2=0x7fb1ac013970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:04.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:04.263+0000 7fb1d1800640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 0x7fb1ac013970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:04.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:04.263+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:04.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:04.263+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01d1d0 legacy=0x7fb1ac008c40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:04.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:04.263+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:05.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:05.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac009350 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:05.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 msgr2=0x7fb1ac013970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:05.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac013560 0x7fb1ac013970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:05.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac01d1d0 legacy=0x7fb1ac008c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:05.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:51:05.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:51:05.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac00cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:05.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac00f9a0 2024-02-21T07:51:05.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac00c3d0 2024-02-21T07:51:05.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac005bd0 2024-02-21T07:51:05.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac01cac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:05.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f9a0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:05.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:05.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:05.860+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:06.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:06.061+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac01cac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:06.061+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f9a0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:06.061+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:06.061+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:06.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:06.462+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f9a0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:06.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:06.462+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac01cac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:06.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:06.462+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:06.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:06.462+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:07.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:07.263+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f9a0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:07.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:07.263+0000 7fb1d0e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac01cac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:07.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:07.263+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:07.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:07.263+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:08.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.860+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.860+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.860+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac01cac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.860+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00f9a0 legacy=0x7fb1ac007c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.860+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 0x7fb1ac01c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.860+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 0x7fb1ac012010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.860+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac012550 2024-02-21T07:51:08.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.860+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac01c550 2024-02-21T07:51:08.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.860+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac009350 2024-02-21T07:51:08.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.860+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 msgr2=0x7fb1ac012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:08.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.861+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 0x7fb1ac012010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:08.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.861+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac012550 legacy=0x7fb1ac012960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:08.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.861+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:08.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:08.861+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:09.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:09.062+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 msgr2=0x7fb1ac012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:09.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:09.062+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 0x7fb1ac012010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:09.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:09.062+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac012550 legacy=0x7fb1ac012960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:09.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:09.062+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:09.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:09.062+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:09.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:09.463+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 msgr2=0x7fb1ac012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:09.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:09.463+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 0x7fb1ac012010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:09.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:09.463+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:09.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:09.463+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:09.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:09.463+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac012550 legacy=0x7fb1ac012960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:10.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:10.264+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 msgr2=0x7fb1ac012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:10.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:10.264+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 0x7fb1ac012010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:10.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:10.264+0000 7fb1d0e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:10.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:10.264+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac012550 legacy=0x7fb1ac012960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:10.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:10.264+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:11.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:11.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009350 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:11.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 msgr2=0x7fb1ac012010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:11.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac01c550 0x7fb1ac012010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:11.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac012550 legacy=0x7fb1ac012960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:11.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:51:11.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:51:11.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:11.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:11.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac00c3d0 2024-02-21T07:51:11.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00f9a0 2024-02-21T07:51:11.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac005bd0 2024-02-21T07:51:11.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:11.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:11.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:11.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:11.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:11.861+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:12.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:12.062+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:12.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:12.062+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:12.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:12.062+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:12.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:12.062+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:12.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:12.062+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:12.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:12.463+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:12.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:12.463+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:12.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:12.463+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:12.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:12.463+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:12.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:12.463+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:13.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:13.264+0000 7fb1cbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:13.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:13.264+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:13.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:13.264+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:13.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:13.264+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:13.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:13.264+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:14.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:14.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:14.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:14.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:14.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:14.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:14.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac01c550 2024-02-21T07:51:14.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac009330 2024-02-21T07:51:14.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac013730 2024-02-21T07:51:14.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac007c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:14.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:14.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:14.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:14.862+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:15.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:15.063+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac007c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:15.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:15.063+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:15.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:15.063+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:15.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:15.063+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:15.254 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:15.264 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:15.267 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:15.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:15.464+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac007c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:15.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:15.464+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:15.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:15.464+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:15.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:15.464+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:16.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:16.265+0000 7fb1d0e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac007c10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:16.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:16.265+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:16.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:16.265+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:16.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:16.265+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:17.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:17.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:17.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac012010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac007c10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:51:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac009330 2024-02-21T07:51:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00f9a0 2024-02-21T07:51:17.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac005bd0 2024-02-21T07:51:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac0187a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:17.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:17.862+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:18.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:18.063+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:18.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:18.063+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:18.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:18.063+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:18.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:18.063+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac0187a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:18.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:18.063+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:18.464+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:18.464+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:18.464+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:18.464+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac0187a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:18.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:18.464+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:19.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:19.265+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:19.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:19.265+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:19.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:19.265+0000 7fb1d1800640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:19.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:19.265+0000 7fb1cbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac0187a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:19.273 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:19.265+0000 7fb1d1800640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:20.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:20.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac005bd0 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:20.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:20.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:20.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac0187a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:20.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:20.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac00c3d0 2024-02-21T07:51:20.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac01c550 2024-02-21T07:51:20.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac013730 2024-02-21T07:51:20.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:20.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:20.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:20.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:20.862+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:21.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:21.063+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:21.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:21.063+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:21.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:21.063+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:21.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:21.063+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:21.464+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:21.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:21.464+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:21.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:21.464+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:21.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:21.464+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:22.266+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:22.266+0000 7fb1d1800640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:22.266+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:22.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:22.266+0000 7fb1d1800640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:23.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:23.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:23.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac01c550 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:23.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00c3d0 legacy=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:23.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:51:23.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac009330 2024-02-21T07:51:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac013b50 2024-02-21T07:51:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac013730 2024-02-21T07:51:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac013b50 legacy=0x7fb1ac008c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:23.863+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:24.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:24.064+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:24.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:24.064+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:24.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:24.064+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac013b50 legacy=0x7fb1ac008c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:24.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:24.064+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:24.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:24.465+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:24.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:24.465+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:24.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:24.465+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:24.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:24.465+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac013b50 legacy=0x7fb1ac008c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:25.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:25.266+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:25.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:25.266+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:25.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:25.266+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:25.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:25.266+0000 7fb1d0e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac013b50 legacy=0x7fb1ac008c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:26.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1ca000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 msgr2=0x7fb1ac018260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:26.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac013730 0x7fb1ac018260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:26.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac013b50 legacy=0x7fb1ac008c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:26.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1ca000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac009330 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:26.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:26.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:26.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac00e830 2024-02-21T07:51:26.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00c3d0 2024-02-21T07:51:26.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac00f9a0 2024-02-21T07:51:26.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00e830 legacy=0x7fb1ac00ec10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:26.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:26.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:26.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:26.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:26.863+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:27.064+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00e830 legacy=0x7fb1ac00ec10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:27.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:27.064+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:27.064+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:27.064+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:27.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:27.064+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:27.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:27.465+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:27.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:27.465+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:27.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:27.465+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00e830 legacy=0x7fb1ac00ec10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:27.465+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:27.465+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:28.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:28.266+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:28.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:28.266+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:28.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:28.266+0000 7fb1d1800640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00e830 legacy=0x7fb1ac00ec10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:28.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:28.267+0000 7fb1cbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:28.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:28.267+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1ca000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:29.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3d0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac00e830 legacy=0x7fb1ac00ec10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:51:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1ca000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc184c50 con 0x7fb1ac005bd0 2024-02-21T07:51:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1d1800640 1 -- reap_dead start 2024-02-21T07:51:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1ca000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac01d9c0 con 0x7fb1ac013b50 2024-02-21T07:51:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1ca000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00f9a0 2024-02-21T07:51:29.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac013b50 legacy=0x7fb1ac008c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:29.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:29.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac005bd0 legacy=0x7fb1ac0187a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:29.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:29.864+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:30.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:30.065+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac005bd0 legacy=0x7fb1ac0187a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:30.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:30.065+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:30.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:30.065+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac013b50 legacy=0x7fb1ac008c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:30.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:30.065+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:30.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:30.466+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac005bd0 legacy=0x7fb1ac0187a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:30.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:30.466+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:30.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:30.466+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:30.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:30.466+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac013b50 legacy=0x7fb1ac008c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:31.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:31.267+0000 7fb1cbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac005bd0 legacy=0x7fb1ac0187a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:31.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:31.268+0000 7fb1d0e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:31.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:31.268+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:31.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:31.268+0000 7fb1d1800640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac013b50 legacy=0x7fb1ac008c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.864+0000 7fb1ca000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 msgr2=0x7fb1ac013020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.864+0000 7fb1ca000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7fb1ac00f9a0 0x7fb1ac013020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.864+0000 7fb1ca000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7fb1ac013b50 legacy=0x7fb1ac008c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.864+0000 7fb1ca000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7fb1ac005bd0 legacy=0x7fb1ac0187a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.864+0000 7fb1ca000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3b0 0x7fb1ac00cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:32.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.864+0000 7fb1ca000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009330 0x7fb1ac01c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.864+0000 7fb1ca000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac00fdb0 con 0x7fb1ac013560 2024-02-21T07:51:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.864+0000 7fb1ca000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc185560 con 0x7fb1ac00c3b0 2024-02-21T07:51:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.864+0000 7fb1ca000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc183d60 con 0x7fb1ac009330 2024-02-21T07:51:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.865+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3b0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.865+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3b0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.865+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac013560 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.865+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009330 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:32.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:32.865+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009330 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:33.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:33.066+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3b0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:33.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:33.066+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3b0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:33.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:33.066+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac013560 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:33.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:33.066+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009330 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:33.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:33.066+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009330 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:33.466+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3b0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:33.466+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3b0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:33.466+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac013560 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:33.466+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009330 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:33.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:33.466+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009330 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:34.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:34.267+0000 7fb1d0e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3b0 msgr2=0x7fb1ac00cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:34.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:34.267+0000 7fb1d0e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb1ac00c3b0 0x7fb1ac00cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:34.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:34.267+0000 7fb1d1800640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7fb1ac013560 legacy=0x7fb1ac01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:34.271 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:34.267+0000 7fb1cbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009330 msgr2=0x7fb1ac01c010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:34.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:34.267+0000 7fb1cbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7fb1ac009330 0x7fb1ac01c010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:35.746 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-02-21T07:51:35.747 INFO:tasks.check_counter.ceph_manager:Failed to get pg_num from pool cephfs_data_ec, ignoring 2024-02-21T07:51:35.748 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-02-21T07:51:35.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:35.957+0000 7f1385e00640 1 Processor -- start 2024-02-21T07:51:35.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:35.957+0000 7f1385e00640 1 -- start start 2024-02-21T07:51:35.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:35.959+0000 7f1385e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 0x7f1380184580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:35.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:35.959+0000 7f1385e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1380184ac0 2024-02-21T07:51:35.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:35.959+0000 7f1385e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138017fa50 con 0x7f138017f670 2024-02-21T07:51:35.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:35.959+0000 7f1385e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f138006e5b0 2024-02-21T07:51:35.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:35.959+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1380184ac0 legacy=0x7f1380188b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:35.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:35.959+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f138017f670 legacy=0x7f138006dea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:35.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:35.959+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 msgr2=0x7f1380184580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:35.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:35.959+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 0x7f1380184580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:36.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:36.160+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f138017f670 legacy=0x7f138006dea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:36.160+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 msgr2=0x7f1380184580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:36.160+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1380184ac0 legacy=0x7f1380188b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:36.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:36.160+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 0x7f1380184580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:36.561+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1380184ac0 legacy=0x7f1380188b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:36.561+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 msgr2=0x7f1380184580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:36.561+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 0x7f1380184580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:36.561+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f138017f670 legacy=0x7f138006dea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:37.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:37.362+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1380184ac0 legacy=0x7f1380188b60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:37.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:37.362+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 msgr2=0x7f1380184580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:37.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:37.362+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 0x7f1380184580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:37.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:37.362+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f138017f670 legacy=0x7f138006dea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.959+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 msgr2=0x7f1380184580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.959+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f138006e5b0 0x7f1380184580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.959+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f138017f670 legacy=0x7f138006dea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.959+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1380184ac0 legacy=0x7f1380188b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.959+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 0x7f1360009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.959+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 0x7f136000c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.959+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f13600036d0 2024-02-21T07:51:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.959+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360009f00 2024-02-21T07:51:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.959+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360007350 2024-02-21T07:51:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.960+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 msgr2=0x7f1360009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.960+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600036d0 legacy=0x7f1360005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.960+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 0x7f1360009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.960+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 msgr2=0x7f136000c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:38.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:38.960+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 0x7f136000c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:39.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:39.161+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 msgr2=0x7f136000c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:39.161+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600036d0 legacy=0x7f1360005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:39.161+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 msgr2=0x7f1360009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:39.161+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 0x7f136000c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:39.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:39.161+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 0x7f1360009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:39.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:39.562+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600036d0 legacy=0x7f1360005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:39.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:39.562+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 msgr2=0x7f136000c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:39.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:39.562+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 0x7f136000c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:39.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:39.562+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 msgr2=0x7f1360009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:39.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:39.562+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 0x7f1360009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:40.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:40.363+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600036d0 legacy=0x7f1360005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:40.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:40.363+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 msgr2=0x7f136000c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:40.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:40.363+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 0x7f136000c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:40.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:40.363+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 msgr2=0x7f1360009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:40.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:40.363+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 0x7f1360009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 msgr2=0x7f1360009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360007350 0x7f1360009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 msgr2=0x7f136000c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:41.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360009f00 0x7f136000c3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600036d0 legacy=0x7f1360005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:51:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:51:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 0x7f136000b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f136000cb00 2024-02-21T07:51:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f136000d690 2024-02-21T07:51:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f13600098d0 2024-02-21T07:51:41.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d690 legacy=0x7f1360005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:41.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 msgr2=0x7f136000b2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:41.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000cb00 legacy=0x7f136000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:41.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:41.960+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 0x7f136000b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:42.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:42.161+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d690 legacy=0x7f1360005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:42.162+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 msgr2=0x7f136000b2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:42.162+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 0x7f136000b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:42.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:42.162+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000cb00 legacy=0x7f136000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:42.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:42.562+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d690 legacy=0x7f1360005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:42.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:42.563+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 msgr2=0x7f136000b2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:42.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:42.563+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 0x7f136000b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:42.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:42.563+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000cb00 legacy=0x7f136000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:43.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:43.363+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d690 legacy=0x7f1360005b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:43.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:43.364+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 msgr2=0x7f136000b2f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:43.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:43.364+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 0x7f136000b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:43.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:43.364+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000cb00 legacy=0x7f136000cee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:44.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.960+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 msgr2=0x7f136000b2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:44.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.960+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f13600098d0 0x7f136000b2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:44.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.960+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d690 legacy=0x7f1360005b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:44.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.960+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000cb00 legacy=0x7f136000cee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:44.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.960+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 0x7f1360017420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:44.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.960+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 0x7f1360019dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:44.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.960+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138017fa50 con 0x7f136000bb40 2024-02-21T07:51:44.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.960+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360015030 2024-02-21T07:51:44.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.960+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360017960 2024-02-21T07:51:44.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.961+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136000bb40 legacy=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:44.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.961+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 msgr2=0x7f1360017420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:44.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.961+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 0x7f1360017420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:44.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.961+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 msgr2=0x7f1360019dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:44.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:44.961+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 0x7f1360019dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:45.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:45.162+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136000bb40 legacy=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:45.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:45.162+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 msgr2=0x7f1360019dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:45.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:45.162+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 msgr2=0x7f1360017420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:45.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:45.162+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 0x7f1360019dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:45.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:45.162+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 0x7f1360017420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:45.389 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:45.397 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:45.401 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:51:45.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:45.563+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136000bb40 legacy=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:45.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:45.563+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 msgr2=0x7f1360017420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:45.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:45.563+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 msgr2=0x7f1360019dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:45.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:45.563+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 0x7f1360017420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:45.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:45.563+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 0x7f1360019dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:46.364+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136000bb40 legacy=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:46.364+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 msgr2=0x7f1360017420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:46.364+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 msgr2=0x7f1360019dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:46.364+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 0x7f1360017420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:46.364+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 0x7f1360019dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:47.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 msgr2=0x7f1360019dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:47.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017960 0x7f1360019dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:47.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 msgr2=0x7f1360017420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:47.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360015030 0x7f1360017420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:47.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136000bb40 legacy=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:47.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:51:47.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 0x7f136000cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:47.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:47.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:47.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136000d020 2024-02-21T07:51:47.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360006250 2024-02-21T07:51:47.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fbc0 con 0x7f13600098d0 2024-02-21T07:51:47.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:47.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:47.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.961+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 msgr2=0x7f136000cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:47.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.962+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:47.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.962+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 0x7f136000cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:47.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:47.962+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:48.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.162+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:48.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.162+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:48.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.163+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:48.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.163+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 msgr2=0x7f136000cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:48.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.164+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 0x7f136000cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:48.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.164+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:48.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.563+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:48.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.563+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:48.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.565+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 msgr2=0x7f136000cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:48.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.565+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:48.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.565+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 0x7f136000cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:48.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:48.565+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:49.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:49.364+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:49.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:49.364+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:49.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:49.367+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 msgr2=0x7f136000cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:49.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:49.367+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 0x7f136000cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:49.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:49.367+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:49.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:49.367+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.961+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 msgr2=0x7f136000cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:50.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.961+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600098d0 0x7f136000cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.961+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.961+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.961+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.961+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:50.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.962+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1360017420 2024-02-21T07:51:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.962+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138017fa50 con 0x7f1360006b90 2024-02-21T07:51:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.962+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360006b90 legacy=0x7f136001a490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.962+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000b2f0 legacy=0x7f136001aba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:50.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.962+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f136000b2f0 2024-02-21T07:51:50.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:50.962+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360017420 legacy=0x7f1360014020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:51.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:51.163+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360006b90 legacy=0x7f136001a490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:51.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:51.163+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000b2f0 legacy=0x7f136001aba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:51.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:51.163+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360017420 legacy=0x7f1360014020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:51.564+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360017420 legacy=0x7f1360014020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:51.564+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000b2f0 legacy=0x7f136001aba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:51.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:51.564+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360006b90 legacy=0x7f136001a490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:52.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:52.365+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360017420 legacy=0x7f1360014020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:52.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:52.365+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360006b90 legacy=0x7f136001a490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:52.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:52.365+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000b2f0 legacy=0x7f136001aba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:53.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000b2f0 legacy=0x7f136001aba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:53.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360006b90 legacy=0x7f136001a490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:53.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360017420 legacy=0x7f1360014020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:53.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:53.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:53.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:51:53.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f1360019d50 2024-02-21T07:51:53.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136000d020 2024-02-21T07:51:53.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360006250 2024-02-21T07:51:53.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:51:53.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:53.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:53.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f137ea00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:53.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f137ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:53.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:53.963+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360019d50 legacy=0x7f1360005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:54.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:54.164+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:54.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:54.164+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:54.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:54.164+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360019d50 legacy=0x7f1360005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:54.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:54.164+0000 7f137ea00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:54.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:54.164+0000 7f137ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:54.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:54.565+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:54.565+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:54.565+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360019d50 legacy=0x7f1360005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:54.565+0000 7f137ea00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:54.565+0000 7f137ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:55.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:55.366+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:51:55.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:55.366+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:55.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:55.366+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360019d50 legacy=0x7f1360005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:51:55.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:55.367+0000 7f137ea00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:51:55.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:55.367+0000 7f137ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:56.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:56.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:56.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000bf20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:56.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000bf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:56.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360019d50 legacy=0x7f1360005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:56.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 0x7f1360016830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:56.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f13600098d0 2024-02-21T07:51:56.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f136000cae0 2024-02-21T07:51:56.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360016420 2024-02-21T07:51:56.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600098d0 legacy=0x7f136001a490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:56.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 msgr2=0x7f1360016830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:56.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.963+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000cae0 legacy=0x7f136001aba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:56.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:56.964+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 0x7f1360016830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:51:57.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:57.164+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600098d0 legacy=0x7f136001a490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:57.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:57.165+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000cae0 legacy=0x7f136001aba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:57.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:57.165+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 msgr2=0x7f1360016830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:57.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:57.165+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 0x7f1360016830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:51:57.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:57.565+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600098d0 legacy=0x7f136001a490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:57.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:57.566+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000cae0 legacy=0x7f136001aba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:57.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:57.566+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 msgr2=0x7f1360016830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:57.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:57.566+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 0x7f1360016830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:51:58.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:58.366+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600098d0 legacy=0x7f136001a490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:58.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:58.367+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000cae0 legacy=0x7f136001aba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:58.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:58.367+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 msgr2=0x7f1360016830 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:58.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:58.367+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 0x7f1360016830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:51:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.963+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 msgr2=0x7f1360016830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.963+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360016420 0x7f1360016830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:51:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.963+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000cae0 legacy=0x7f136001aba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.963+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600098d0 legacy=0x7f136001a490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:51:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.963+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:51:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.963+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:51:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.963+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138017fa50 con 0x7f1360019d50 2024-02-21T07:51:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.963+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f136000d020 2024-02-21T07:51:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.963+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360006250 2024-02-21T07:51:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.963+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:51:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.964+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:51:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.964+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:51:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:51:59.964+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:00.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:00.165+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:00.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:00.165+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:00.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:00.165+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:00.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:00.165+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:00.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:00.566+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:00.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:00.566+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:00.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:00.566+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:00.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:00.566+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:01.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:01.367+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:01.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:01.367+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:01.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:01.367+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:01.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:01.367+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:02.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:02.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006250 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:02.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:02.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:02.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 0x7f1360012010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 0x7f1360014a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:02.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f136000bf20 2024-02-21T07:52:02.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360017430 2024-02-21T07:52:02.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360012550 2024-02-21T07:52:02.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000bf20 legacy=0x7f1360005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:02.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 msgr2=0x7f1360012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:02.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 0x7f1360012010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:02.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 msgr2=0x7f1360014a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:02.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:02.964+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 0x7f1360014a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:03.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:03.165+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 msgr2=0x7f1360012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:03.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:03.165+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 0x7f1360012010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:03.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:03.165+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 msgr2=0x7f1360014a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:03.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:03.165+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000bf20 legacy=0x7f1360005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:03.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:03.165+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 0x7f1360014a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:03.566+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 msgr2=0x7f1360012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:03.566+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 0x7f1360012010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:03.566+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 msgr2=0x7f1360014a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:03.566+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 0x7f1360014a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:03.566+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000bf20 legacy=0x7f1360005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:04.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:04.367+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 msgr2=0x7f1360012010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:04.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:04.367+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 0x7f1360012010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:04.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:04.367+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 msgr2=0x7f1360014a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:04.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:04.367+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 0x7f1360014a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:04.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:04.367+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000bf20 legacy=0x7f1360005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 msgr2=0x7f1360014a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360012550 0x7f1360014a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 msgr2=0x7f1360012010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017430 0x7f1360012010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000bf20 legacy=0x7f1360005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 0x7f1360006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138017fa50 con 0x7f1360019d50 2024-02-21T07:52:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f136001f8d0 2024-02-21T07:52:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136000d020 2024-02-21T07:52:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136001f8d0 legacy=0x7f1360021cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:05.964+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:06.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:06.165+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:06.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:06.165+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136001f8d0 legacy=0x7f1360021cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:06.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:06.165+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:06.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:06.165+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:06.566+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:06.566+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136001f8d0 legacy=0x7f1360021cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:06.566+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:06.566+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:07.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:07.367+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:07.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:07.367+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:07.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:07.367+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136001f8d0 legacy=0x7f1360021cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:07.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:07.367+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:08.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:08.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000d020 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:08.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136001f8d0 legacy=0x7f1360021cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:08.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:08.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 0x7f136001a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:08.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 0x7f1360014990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:08.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f136000a2e0 2024-02-21T07:52:08.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360006230 2024-02-21T07:52:08.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360017430 2024-02-21T07:52:08.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 msgr2=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:08.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000a2e0 legacy=0x7f136000a730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:08.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 0x7f136001a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:08.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 msgr2=0x7f1360014990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:08.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:08.965+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 0x7f1360014990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:09.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:09.166+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 msgr2=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:09.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:09.166+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 0x7f136001a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:09.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:09.166+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000a2e0 legacy=0x7f136000a730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:09.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:09.166+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 msgr2=0x7f1360014990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:09.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:09.166+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 0x7f1360014990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:09.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:09.567+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 msgr2=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:09.567+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 0x7f136001a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:09.567+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000a2e0 legacy=0x7f136000a730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:09.567+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 msgr2=0x7f1360014990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:09.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:09.567+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 0x7f1360014990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:10.371 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:10.369+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 msgr2=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:10.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:10.369+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 0x7f136001a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:10.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:10.369+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000a2e0 legacy=0x7f136000a730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:10.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:10.369+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 msgr2=0x7f1360014990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:10.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:10.369+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 0x7f1360014990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:11.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.964+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 msgr2=0x7f1360014990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:11.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.964+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360017430 0x7f1360014990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:11.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.964+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 msgr2=0x7f136001a470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:11.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.964+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360006230 0x7f136001a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:11.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.964+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000a2e0 legacy=0x7f136000a730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:11.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:11.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 0x7f1360006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:11.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f136001a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:11.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138017fa50 con 0x7f136000d020 2024-02-21T07:52:11.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136000add0 2024-02-21T07:52:11.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360006230 2024-02-21T07:52:11.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:11.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 msgr2=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:11.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:11.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f136001a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:11.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:11.965+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:12.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:12.166+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 msgr2=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:12.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:12.166+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:12.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:12.167+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f136001a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:12.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:12.167+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:12.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:12.167+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:12.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:12.568+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 msgr2=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:12.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:12.568+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f136001a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:12.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:12.568+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:12.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:12.568+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:12.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:12.568+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:13.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:13.369+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 msgr2=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:13.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:13.369+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f136001a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:13.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:13.369+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:13.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:13.369+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:13.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:13.369+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:14.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.966+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:14.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.966+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006230 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.966+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 msgr2=0x7f136001a470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:14.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.966+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f136001a470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:14.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.966+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:14.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.966+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 0x7f136001a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:14.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.966+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1360011fd0 2024-02-21T07:52:14.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.966+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138017fa50 con 0x7f1360017420 2024-02-21T07:52:14.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.966+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360019d60 2024-02-21T07:52:14.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.966+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f1360005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:14.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.967+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360011fd0 legacy=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:14.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.967+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 msgr2=0x7f136001a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:14.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:14.967+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 0x7f136001a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:15.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:15.168+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360011fd0 legacy=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:15.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:15.168+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 msgr2=0x7f136001a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:15.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:15.168+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 0x7f136001a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:15.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:15.168+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f1360005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:15.545 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:15.553 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:15.556 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:15.569+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 msgr2=0x7f136001a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:15.569+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f1360005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:15.569+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 0x7f136001a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:15.569+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360011fd0 legacy=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:16.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:16.370+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 msgr2=0x7f136001a9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:16.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:16.370+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360011fd0 legacy=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:16.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:16.370+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 0x7f136001a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:16.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:16.370+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f1360005ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:17.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.965+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 msgr2=0x7f136001a9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:17.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.965+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d60 0x7f136001a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:17.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.965+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f1360005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:17.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.966+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360011fd0 legacy=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:17.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.966+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:17.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.966+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:17.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.966+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f1360014b00 2024-02-21T07:52:17.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.966+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1360006230 2024-02-21T07:52:17.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.966+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f138017fa50 con 0x7f136000d020 2024-02-21T07:52:17.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.966+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:17.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.966+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360014b00 legacy=0x7f13600228f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:17.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:17.966+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360006230 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:18.167+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360014b00 legacy=0x7f13600228f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:18.167+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:18.167+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360006230 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:18.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:18.568+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360014b00 legacy=0x7f13600228f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:18.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:18.568+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360006230 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:18.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:18.568+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:19.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:19.369+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360014b00 legacy=0x7f13600228f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:19.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:19.369+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360006230 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:19.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:19.370+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:20.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.966+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:20.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.966+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360006230 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:20.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.966+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360014b00 legacy=0x7f13600228f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:20.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.966+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:20.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.966+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:20.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.966+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f1360018d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:20.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.966+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360005ac0 2024-02-21T07:52:20.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.966+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360017420 2024-02-21T07:52:20.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.966+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fbc0 con 0x7f136000add0 2024-02-21T07:52:20.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.967+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:20.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.967+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:20.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.967+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360018d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:20.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.967+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:20.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.967+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f1360018d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:20.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:20.967+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:21.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.168+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360018d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:21.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.168+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f1360018d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:21.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.168+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:21.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.168+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:21.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.168+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:21.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.168+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.569+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360018d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.569+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f1360018d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.569+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.569+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.569+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:21.569+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:22.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:22.370+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360018d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:22.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:22.370+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f1360018d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:22.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:22.371+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:22.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:22.371+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:22.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:22.371+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:22.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:22.371+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:23.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:23.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:23.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001ab80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:23.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:23.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360018d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:23.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f1360018d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:23.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:23.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 0x7f1360019670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:23.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f1360014b00 2024-02-21T07:52:23.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:23.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f136000d020 2024-02-21T07:52:23.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360019290 2024-02-21T07:52:23.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 msgr2=0x7f1360019670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:23.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 0x7f1360019670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:23.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360014b00 legacy=0x7f1360013fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:23.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:23.967+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:24.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:24.168+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 msgr2=0x7f1360019670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:24.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:24.168+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 0x7f1360019670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:24.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:24.168+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360014b00 legacy=0x7f1360013fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:24.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:24.168+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:24.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:24.569+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360014b00 legacy=0x7f1360013fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:24.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:24.569+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 msgr2=0x7f1360019670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:24.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:24.569+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 0x7f1360019670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:24.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:24.569+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:25.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:25.370+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360014b00 legacy=0x7f1360013fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:25.370+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 msgr2=0x7f1360019670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:25.370+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 0x7f1360019670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:25.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:25.370+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:26.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.967+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 msgr2=0x7f1360019670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:26.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.967+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019290 0x7f1360019670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:26.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.967+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.967+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360014b00 legacy=0x7f1360013fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.967+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 0x7f1360018d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.967+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.967+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1360019bb0 2024-02-21T07:52:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.967+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136000add0 2024-02-21T07:52:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.967+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f13600146f0 2024-02-21T07:52:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.968+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 msgr2=0x7f1360018d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.968+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:26.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.968+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 0x7f1360018d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:26.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.968+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:26.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:26.968+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360019bb0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:27.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:27.169+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 msgr2=0x7f1360018d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:27.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:27.169+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:27.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:27.169+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360019bb0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:27.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:27.169+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 0x7f1360018d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:27.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:27.169+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:27.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:27.570+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:27.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:27.570+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:27.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:27.570+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 msgr2=0x7f1360018d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:27.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:27.570+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360019bb0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:27.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:27.570+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 0x7f1360018d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:28.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:28.371+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:28.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:28.371+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:28.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:28.372+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 msgr2=0x7f1360018d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:28.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:28.372+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 0x7f1360018d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:28.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:28.372+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360019bb0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:29.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 msgr2=0x7f1360018d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:29.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f13600146f0 0x7f1360018d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:29.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136000add0 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:29.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360019bb0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:29.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:29.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:29.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f1360006650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:29.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f136000d020 2024-02-21T07:52:29.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360014b00 2024-02-21T07:52:29.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360005ac0 2024-02-21T07:52:29.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:29.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:29.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:29.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.968+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:29.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:29.969+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:30.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:30.169+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:30.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:30.169+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:30.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:30.169+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:30.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:30.170+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:30.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:30.170+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:30.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:30.570+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:30.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:30.570+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:30.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:30.570+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:30.571+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:30.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:30.571+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:31.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:31.371+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:31.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:31.371+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:31.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:31.371+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:31.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:31.372+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:31.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:31.373+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:32.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.968+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:32.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.968+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:32.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.968+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 msgr2=0x7f1360006650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:32.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.968+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f1360006650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:32.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.968+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:32.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.968+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136000ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:32.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.968+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f136001ab80 2024-02-21T07:52:32.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.968+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f1360017420 2024-02-21T07:52:32.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.968+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360019d50 2024-02-21T07:52:32.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.969+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ab80 legacy=0x7f1360013fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:32.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.969+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000ac00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:32.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.969+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:32.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:32.969+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136000ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:33.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:33.170+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ab80 legacy=0x7f1360013fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:33.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:33.170+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:33.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:33.170+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000ac00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:33.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:33.170+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136000ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:33.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:33.571+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ab80 legacy=0x7f1360013fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:33.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:33.571+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:33.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:33.571+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000ac00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:33.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:33.571+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136000ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:34.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:34.372+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ab80 legacy=0x7f1360013fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:34.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:34.373+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:34.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:34.373+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000ac00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:34.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:34.373+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136000ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:35.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000ac00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:35.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136000ac00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:35.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f136001a470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:35.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ab80 legacy=0x7f1360013fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:35.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:35.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:35.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:35.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f1360017420 2024-02-21T07:52:35.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f136000d020 2024-02-21T07:52:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360006650 2024-02-21T07:52:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f136001a410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:35.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:35.969+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:36.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:36.170+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:36.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:36.170+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:36.170+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f136001a410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:36.170+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:36.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:36.571+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f136001a410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:36.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:36.571+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:36.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:36.571+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:36.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:36.571+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:37.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:37.372+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f136001a410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:37.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:37.372+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:37.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:37.372+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:37.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:37.372+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000d020 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360017420 legacy=0x7f136001a410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 0x7f136001ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f1360011fd0 2024-02-21T07:52:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136000ac00 2024-02-21T07:52:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360005ac0 2024-02-21T07:52:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f137ea00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360019d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 msgr2=0x7f136001ab20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360011fd0 legacy=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f137ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:38.970+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 0x7f136001ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:39.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:39.171+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 msgr2=0x7f136001ab20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:39.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:39.171+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360011fd0 legacy=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:39.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:39.171+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 0x7f136001ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:39.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:39.171+0000 7f137ea00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360019d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:39.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:39.171+0000 7f137ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:39.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:39.572+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 msgr2=0x7f136001ab20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:39.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:39.572+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360011fd0 legacy=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:39.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:39.572+0000 7f137ea00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360019d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:39.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:39.572+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 0x7f136001ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:39.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:39.572+0000 7f137ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:40.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:40.373+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360011fd0 legacy=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:40.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:40.373+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 msgr2=0x7f136001ab20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:40.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:40.373+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 0x7f136001ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:40.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:40.373+0000 7f137ea00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360019d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:40.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:40.373+0000 7f137ea00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:41.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360019d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:41.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:41.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 msgr2=0x7f136001ab20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:41.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000ac00 0x7f136001ab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:41.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360011fd0 legacy=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:41.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:41.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f13600228f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:41.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:41.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:41.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f1360011fd0 2024-02-21T07:52:41.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360014b00 2024-02-21T07:52:41.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360006650 2024-02-21T07:52:41.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 msgr2=0x7f13600228f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:41.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f13600228f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:41.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:41.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:41.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:41.970+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:42.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:42.171+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 msgr2=0x7f13600228f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:42.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:42.171+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f13600228f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:42.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:42.171+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:42.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:42.171+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:42.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:42.171+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:42.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:42.572+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 msgr2=0x7f13600228f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:42.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:42.572+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f13600228f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:42.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:42.572+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:42.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:42.573+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:42.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:42.573+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:43.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:43.373+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 msgr2=0x7f13600228f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:43.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:43.373+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f13600228f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:43.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:43.374+0000 7f137e000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:43.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:43.374+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:43.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:43.374+0000 7f137e000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:44.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:44.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:44.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 msgr2=0x7f13600228f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:44.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360014b00 0x7f13600228f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:44.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:44.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f13600143f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:44.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f136001ab20 2024-02-21T07:52:44.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f136000d020 2024-02-21T07:52:44.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360017420 2024-02-21T07:52:44.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ab20 legacy=0x7f1360004ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:44.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:44.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136001a410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:44.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:44.971+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f13600143f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:45.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:45.172+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ab20 legacy=0x7f1360004ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:45.172+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:45.172+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136001a410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:45.172+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f13600143f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:45.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:45.573+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ab20 legacy=0x7f1360004ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:45.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:45.573+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:45.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:45.573+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f13600143f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:45.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:45.573+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136001a410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:45.715 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:45.723 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:45.726 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:52:46.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:46.374+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ab20 legacy=0x7f1360004ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:46.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:46.375+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:46.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:46.375+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f13600143f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:46.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:46.375+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136001a410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:47.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f13600143f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:47.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f13600143f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:47.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136001a410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:47.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ab20 legacy=0x7f1360004ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:47.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:47.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:47.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136001a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:47.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1360011fd0 2024-02-21T07:52:47.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136000d020 2024-02-21T07:52:47.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360006650 2024-02-21T07:52:47.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:47.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:47.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:47.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:47.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:47.971+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:48.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:48.172+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:48.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:48.172+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:48.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:48.172+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:48.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:48.172+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:48.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:48.172+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:48.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:48.573+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:48.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:48.573+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:48.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:48.573+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:48.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:48.573+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:48.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:48.573+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:49.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:49.374+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:49.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:49.374+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:49.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:49.375+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:49.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:49.375+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:49.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:49.375+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:50.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006650 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f136001a930 2024-02-21T07:52:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1360016b30 2024-02-21T07:52:50.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360005ac0 2024-02-21T07:52:50.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001a930 legacy=0x7f1360015410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:50.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360016b30 legacy=0x7f1360016f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:50.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360019d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:50.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:50.972+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:51.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:51.173+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001a930 legacy=0x7f1360015410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:51.173+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360019d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:51.173+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360016b30 legacy=0x7f1360016f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:51.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:51.173+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:51.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:51.574+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001a930 legacy=0x7f1360015410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:51.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:51.574+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360019d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:51.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:51.574+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:51.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:51.575+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360016b30 legacy=0x7f1360016f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:52.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:52.375+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001a930 legacy=0x7f1360015410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:52.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:52.375+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360019d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:52.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:52.375+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:52.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:52.376+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360016b30 legacy=0x7f1360016f40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:53.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 msgr2=0x7f1360019d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:53.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360005ac0 0x7f1360019d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:53.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360016b30 legacy=0x7f1360016f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001a930 legacy=0x7f1360015410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 0x7f136001ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f136000d020 2024-02-21T07:52:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f1360011fd0 2024-02-21T07:52:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360006630 2024-02-21T07:52:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136000d020 legacy=0x7f136000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:53.972+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:54.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:54.173+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136000d020 legacy=0x7f136000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:54.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:54.173+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:54.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:54.173+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:54.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:54.173+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:54.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:54.574+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136000d020 legacy=0x7f136000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:54.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:54.575+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:54.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:54.575+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:54.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:54.575+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:55.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:55.375+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136000d020 legacy=0x7f136000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:52:55.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:55.376+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:55.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:55.377+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:52:55.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:55.377+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:56.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:56.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360006630 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:56.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:56.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136000d020 legacy=0x7f136000da70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:56.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:56.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:56.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1360019d50 2024-02-21T07:52:56.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360005ac0 2024-02-21T07:52:56.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360017420 2024-02-21T07:52:56.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:56.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:56.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360019d50 legacy=0x7f136000f190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:56.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:56.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:56.973+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:57.174+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:57.174+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:57.174+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:57.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:57.174+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:52:57.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:57.175+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360019d50 legacy=0x7f136000f190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:57.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:57.575+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:57.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:57.575+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:57.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:57.575+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:57.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:57.575+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:52:57.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:57.577+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360019d50 legacy=0x7f136000f190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:58.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:58.377+0000 7f137ea00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:58.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:58.377+0000 7f137ea00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:58.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:58.377+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:58.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:58.377+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:52:58.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:58.379+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360019d50 legacy=0x7f136000f190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:52:59.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:52:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360019d50 legacy=0x7f136000f190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:52:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:59.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:52:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f1360011fd0 2024-02-21T07:52:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:52:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360005ac0 2024-02-21T07:52:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.973+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360017420 2024-02-21T07:52:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.974+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:52:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.974+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:52:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.974+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:52:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.974+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:52:59.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:52:59.974+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:00.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:00.175+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:00.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:00.175+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:00.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:00.175+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:00.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:00.175+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:00.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:00.175+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:00.576+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:00.576+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:00.576+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:00.576+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:00.576+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:01.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:01.376+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:01.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:01.376+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:01.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:01.376+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:01.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:01.376+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:01.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:01.376+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360005ac0 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1360006630 2024-02-21T07:53:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f136000d020 2024-02-21T07:53:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360019d50 2024-02-21T07:53:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360006630 legacy=0x7f136000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.973+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:02.974+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136000f190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:03.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:03.174+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360006630 legacy=0x7f136000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:03.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:03.174+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:03.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:03.174+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:03.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:03.175+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136000f190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:03.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:03.575+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360006630 legacy=0x7f136000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:03.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:03.575+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:03.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:03.575+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:03.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:03.576+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136000f190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:04.376+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360006630 legacy=0x7f136000da70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:04.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:04.377+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:04.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:04.377+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:04.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:04.377+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136000f190 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:05.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:05.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:05.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000d020 legacy=0x7f136000f190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:05.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360006630 legacy=0x7f136000da70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:05.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:53:05.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:05.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f13600143c0 2024-02-21T07:53:05.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:53:05.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1360011fd0 2024-02-21T07:53:05.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360019d50 2024-02-21T07:53:05.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.973+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600143c0 legacy=0x7f13600147a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:05.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.974+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:05.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.974+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:05.974+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:06.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:06.174+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600143c0 legacy=0x7f13600147a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:06.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:06.175+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:06.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:06.175+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:06.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:06.175+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:06.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:06.575+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600143c0 legacy=0x7f13600147a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:06.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:06.576+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:06.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:06.576+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:06.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:06.576+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:07.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:07.376+0000 7f137e000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600143c0 legacy=0x7f13600147a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:07.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:07.378+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:07.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:07.378+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:07.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:07.378+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:08.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001ad70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:08.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f1360019d50 0x7f136001ad70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:08.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360011fd0 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:08.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600143c0 legacy=0x7f13600147a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:08.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:08.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:08.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f1360005ac0 2024-02-21T07:53:08.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136000d020 2024-02-21T07:53:08.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f1360017420 2024-02-21T07:53:08.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:08.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:08.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360005ac0 legacy=0x7f136000ea80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:08.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:08.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:08.974+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:09.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:09.175+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:09.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:09.175+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:09.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:09.175+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:09.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:09.175+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360005ac0 legacy=0x7f136000ea80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:09.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:09.175+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:09.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:09.576+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:09.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:09.576+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:09.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:09.576+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:09.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:09.576+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360005ac0 legacy=0x7f136000ea80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:09.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:09.576+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:10.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:10.377+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:10.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:10.377+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:10.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:10.377+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:10.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:10.377+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360005ac0 legacy=0x7f136000ea80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:10.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:10.377+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:11.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 msgr2=0x7f136001a3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:11.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360017420 0x7f136001a3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:11.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:11.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f1360005ac0 legacy=0x7f136000ea80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:11.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:53:11.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:53:11.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136001a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:11.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f136001ad10 2024-02-21T07:53:11.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360019d50 2024-02-21T07:53:11.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f136000d020 2024-02-21T07:53:11.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.974+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:11.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.975+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001a3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:11.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.975+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:11.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.975+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ad10 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:11.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:11.975+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136001a3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:12.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:12.176+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ad10 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:12.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:12.176+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:12.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:12.176+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001a3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:12.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:12.176+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136001a3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:12.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:12.176+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:12.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:12.577+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ad10 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:12.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:12.577+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:12.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:12.577+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001a3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:12.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:12.577+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:12.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:12.577+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136001a3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:13.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:13.378+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ad10 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:13.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:13.378+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:13.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:13.378+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001a3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:13.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:13.378+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136001a3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:13.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:13.378+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:14.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:14.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:14.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 msgr2=0x7f136001a3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:14.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f1360019d50 0x7f136001a3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:14.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f136001ad10 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:14.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:14.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f136000ea80 2024-02-21T07:53:14.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f1360012fe0 2024-02-21T07:53:14.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360017420 2024-02-21T07:53:14.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:14.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:14.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:14.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:14.975+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360012fe0 legacy=0x7f13600133c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:15.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:15.176+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:15.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:15.176+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:15.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:15.176+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:15.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:15.177+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360012fe0 legacy=0x7f13600133c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:15.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:15.577+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:15.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:15.577+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:15.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:15.577+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:15.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:15.578+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360012fe0 legacy=0x7f13600133c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:15.867 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:15.876 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:15.879 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:16.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:16.378+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:16.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:16.378+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:16.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:16.378+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:16.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:16.379+0000 7f137f400640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360012fe0 legacy=0x7f13600133c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:17.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:17.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:17.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360012fe0 legacy=0x7f13600133c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:17.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:17.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:53:17.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:17.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:17.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f136000ea80 2024-02-21T07:53:17.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360017420 2024-02-21T07:53:17.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:53:17.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f136000d020 2024-02-21T07:53:17.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:17.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:17.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.975+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:17.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.976+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:17.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:17.976+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:18.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:18.176+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:18.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:18.176+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:18.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:18.178+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:18.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:18.178+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:18.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:18.178+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:18.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:18.577+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:18.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:18.577+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:18.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:18.579+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:18.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:18.579+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:18.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:18.579+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:19.378+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:19.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:19.378+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:19.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:19.381+0000 7f137f400640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:19.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:19.381+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:19.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:19.381+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:20.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:20.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d020 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:20.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:20.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360017420 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:20.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:20.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:20.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f1360019d50 2024-02-21T07:53:20.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f136001ad10 2024-02-21T07:53:20.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136001a3a0 2024-02-21T07:53:20.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f1360013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:20.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 msgr2=0x7f1360012fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:20.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.976+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:20.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:20.977+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136001ad10 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:21.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:21.177+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f1360013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:21.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:21.177+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 msgr2=0x7f1360012fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:21.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:21.177+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:21.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:21.178+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136001ad10 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:21.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:21.578+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f1360013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:21.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:21.578+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 msgr2=0x7f1360012fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:21.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:21.578+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:21.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:21.580+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136001ad10 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:22.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:22.379+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f1360013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:22.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:22.380+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 msgr2=0x7f1360012fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:22.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:22.380+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:22.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:22.381+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136001ad10 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:23.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 msgr2=0x7f1360012fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:23.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:23.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136001ad10 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:23.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f1360019d50 legacy=0x7f1360013520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:23.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:53:23.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:23.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f13600218e0 2024-02-21T07:53:23.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:53:23.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f136000ea80 2024-02-21T07:53:23.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136001a3a0 2024-02-21T07:53:23.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:23.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 msgr2=0x7f1360012fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:23.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.976+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:23.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:23.977+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600218e0 legacy=0x7f1360023cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:24.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:24.177+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 msgr2=0x7f1360012fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:24.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:24.177+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:24.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:24.177+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:24.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:24.178+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600218e0 legacy=0x7f1360023cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:24.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:24.578+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:24.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:24.578+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 msgr2=0x7f1360012fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:24.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:24.578+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:24.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:24.579+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600218e0 legacy=0x7f1360023cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:25.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:25.380+0000 7f137ea00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:25.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:25.380+0000 7f137e000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 msgr2=0x7f1360012fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:25.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:25.380+0000 7f137e000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:25.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:25.380+0000 7f137f400640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600218e0 legacy=0x7f1360023cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:26.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 msgr2=0x7f1360012fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:26.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001a3a0 0x7f1360012fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600218e0 legacy=0x7f1360023cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f1360017420 2024-02-21T07:53:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360019d50 2024-02-21T07:53:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f136001ad10 2024-02-21T07:53:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:26.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360017420 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:26.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:26.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:26.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:26.977+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:27.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:27.178+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:27.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:27.178+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:27.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:27.178+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360017420 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:27.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:27.178+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:27.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:27.178+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:27.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:27.579+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:27.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:27.579+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:27.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:27.579+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:27.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:27.579+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360017420 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:27.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:27.579+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:28.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:28.380+0000 7f137f400640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:28.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:28.380+0000 7f137f400640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:28.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:28.381+0000 7f137e000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360017420 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:28.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:28.381+0000 7f137ea00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:28.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:28.381+0000 7f137ea00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:29.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f1377e00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:29.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f1377e00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:29.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:29.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f1377e00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f1360017420 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:29.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:53:29.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f137f400640 1 -- reap_dead start 2024-02-21T07:53:29.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:29.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f1377e00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13800f8e90 con 0x7f13600218e0 2024-02-21T07:53:29.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f1377e00640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1380186580 con 0x7f136001a3a0 2024-02-21T07:53:29.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f1377e00640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f136001ad10 2024-02-21T07:53:29.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600218e0 legacy=0x7f1360013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:29.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:29.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.977+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136001a3a0 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:29.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:29.978+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:30.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:30.178+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600218e0 legacy=0x7f1360013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:30.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:30.179+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:30.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:30.179+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136001a3a0 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:30.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:30.179+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:30.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:30.579+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600218e0 legacy=0x7f1360013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:30.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:30.580+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136001a3a0 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:30.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:30.580+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:30.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:30.580+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:31.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:31.380+0000 7f137ea00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600218e0 legacy=0x7f1360013520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:31.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:31.381+0000 7f137e000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136001a3a0 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:31.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:31.382+0000 7f137f400640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:31.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:31.382+0000 7f137f400640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:32.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f1377e00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 msgr2=0x7f136000a6c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:32.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f1377e00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f136001ad10 0x7f136000a6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:32.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f1377e00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f136001a3a0 legacy=0x7f1360005ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:32.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f1377e00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f13600218e0 legacy=0x7f1360013520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:32.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f1377e00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:32.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f1377e00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d000 0x7f1360016420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:32.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f1377e00640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136001b2b0 con 0x7f136000ea80 2024-02-21T07:53:32.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f1377e00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138006ea60 con 0x7f1360019d50 2024-02-21T07:53:32.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f1377e00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136000fd30 con 0x7f136000d000 2024-02-21T07:53:32.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:32.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d000 msgr2=0x7f1360016420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:32.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:32.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d000 0x7f1360016420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:32.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:32.978+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:33.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:33.179+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:33.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:33.179+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d000 msgr2=0x7f1360016420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:33.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:33.179+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:33.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:33.179+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:33.182 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:33.179+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d000 0x7f1360016420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:33.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:33.580+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:33.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:33.580+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:33.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:33.580+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d000 msgr2=0x7f1360016420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:33.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:33.580+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:33.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:33.580+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d000 0x7f1360016420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:34.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:34.381+0000 7f137e000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 msgr2=0x7f136000f5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:34.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:34.381+0000 7f137e000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1360019d50 0x7f136000f5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:34.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:34.381+0000 7f137f400640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f136000d000 msgr2=0x7f1360016420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:34.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:34.381+0000 7f137ea00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f136000ea80 legacy=0x7f136000eee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:34.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:34.381+0000 7f137f400640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f136000d000 0x7f1360016420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:35.858 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-02-21T07:53:35.859 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/check_counter.py", line 62, in end active_mgr = json.loads(mon_manager.raw_cluster_cmd("mgr", "dump", "--format=json-pretty"))["active_name"] File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty' 2024-02-21T07:53:35.870 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-21T07:53:35.881 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-21T07:53:35.881 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:53:35.882 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:53:35.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053793,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-9 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-02-21T07:53:35.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:53:35.943 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-02-21T07:53:36.041 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-21T07:53:36.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:53:36.041 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-21T07:53:36.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:53:36.137 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2024-02-21T07:53:36.259 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-21T07:53:36.260 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-02-21T07:53:36.260 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T07:53:36.305 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053793,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-9 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 2024-02-21T07:53:36.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:53:36.306 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-02-21T07:53:36.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T07:53:36.397 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2024-02-21T07:53:36.496 INFO:teuthology.orchestra.run.smithi069.stderr:Cannot find device "ceph-brx" 2024-02-21T07:53:36.500 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:53:36.501 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-21T07:53:36.512 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-21T07:53:36.513 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T07:53:36.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.724+0000 7f9d03a00640 1 Processor -- start 2024-02-21T07:53:36.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.724+0000 7f9d03a00640 1 -- start start 2024-02-21T07:53:36.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.726+0000 7f9d03a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 0x7f9cfc18ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:36.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.726+0000 7f9d03a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 0x7f9cfc0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:36.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.726+0000 7f9d03a00640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cfc186210 2024-02-21T07:53:36.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.726+0000 7f9d03a00640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cfc189510 2024-02-21T07:53:36.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.726+0000 7f9d03a00640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cfc18b1a0 2024-02-21T07:53:36.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.726+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cfc186210 legacy=0x7f9cfc188e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:36.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.726+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 msgr2=0x7f9cfc18ac60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:36.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.726+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 msgr2=0x7f9cfc0cc210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:36.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.726+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 0x7f9cfc18ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:36.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.726+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 0x7f9cfc0cc210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:36.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.927+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cfc186210 legacy=0x7f9cfc188e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:36.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.927+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 msgr2=0x7f9cfc18ac60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:36.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.927+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 msgr2=0x7f9cfc0cc210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:36.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.927+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 0x7f9cfc18ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:36.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:36.927+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 0x7f9cfc0cc210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:37.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:37.328+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cfc186210 legacy=0x7f9cfc188e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:37.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:37.328+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 msgr2=0x7f9cfc18ac60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:37.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:37.328+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 0x7f9cfc18ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:37.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:37.328+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 msgr2=0x7f9cfc0cc210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:37.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:37.329+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 0x7f9cfc0cc210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:38.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:38.129+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cfc186210 legacy=0x7f9cfc188e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:38.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:38.129+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 msgr2=0x7f9cfc18ac60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:38.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:38.129+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 0x7f9cfc18ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:38.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:38.130+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 msgr2=0x7f9cfc0cc210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:38.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:38.130+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 0x7f9cfc0cc210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 msgr2=0x7f9cfc0cc210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cfc18b1a0 0x7f9cfc0cc210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 msgr2=0x7f9cfc18ac60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cfc189510 0x7f9cfc18ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cfc186210 legacy=0x7f9cfc188e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:39.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 0x7f9cdc00d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:39.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc0036c0 2024-02-21T07:53:39.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc0073e0 2024-02-21T07:53:39.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00b170 2024-02-21T07:53:39.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0036c0 legacy=0x7f9cdc005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:39.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:39.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc0073e0 legacy=0x7f9cdc0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:39.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.727+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:39.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.928+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc0073e0 legacy=0x7f9cdc0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:39.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.928+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:39.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.928+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0036c0 legacy=0x7f9cdc005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:39.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:39.928+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:40.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:40.329+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc0073e0 legacy=0x7f9cdc0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:40.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:40.329+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:40.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:40.329+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0036c0 legacy=0x7f9cdc005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:40.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:40.329+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:41.130+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc0073e0 legacy=0x7f9cdc0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:41.130+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0036c0 legacy=0x7f9cdc005b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:41.130+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:41.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:41.130+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:42.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:42.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b170 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:42.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc0073e0 legacy=0x7f9cdc0098a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:42.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0036c0 legacy=0x7f9cdc005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:42.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:53:42.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 0x7f9cdc00d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:42.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:53:42.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 0x7f9cdc0098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:42.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc00e560 2024-02-21T07:53:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00dcc0 2024-02-21T07:53:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc00e140 2024-02-21T07:53:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 msgr2=0x7f9cdc0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 0x7f9cdc0098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00e560 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:42.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.728+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.929+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 msgr2=0x7f9cdc0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.929+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 0x7f9cdc0098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.930+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:42.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.930+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00e560 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:42.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:42.930+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:43.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:43.330+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 msgr2=0x7f9cdc0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:43.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:43.330+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 0x7f9cdc0098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:43.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:43.331+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:43.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:43.331+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00e560 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:43.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:43.331+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:44.132+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 msgr2=0x7f9cdc0098a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:44.132+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 0x7f9cdc0098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:44.132+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00e560 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:44.132+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:44.132+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:45.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.727+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 msgr2=0x7f9cdc0098a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:45.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.727+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00e140 0x7f9cdc0098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:45.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.727+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:45.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.727+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00dcc0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:45.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.727+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00e560 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:45.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.728+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 0x7f9cdc014120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:45.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.728+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc00a070 2024-02-21T07:53:45.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.728+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc014660 2024-02-21T07:53:45.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.728+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00ab60 2024-02-21T07:53:45.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.728+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:45.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.728+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00a070 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:45.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.728+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:45.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.728+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc014660 legacy=0x7f9cdc016a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:45.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.929+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00a070 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:45.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.929+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:45.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.929+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc014660 legacy=0x7f9cdc016a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:45.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:45.929+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:46.010 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:46.018 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:46.021 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:53:46.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:46.330+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00a070 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:46.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:46.330+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:46.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:46.330+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc014660 legacy=0x7f9cdc016a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:46.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:46.330+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:47.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:47.131+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00a070 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:47.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:47.131+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:47.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:47.131+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc014660 legacy=0x7f9cdc016a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:47.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:47.131+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:48.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.728+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:48.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.728+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00ab60 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:48.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.728+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc014660 legacy=0x7f9cdc016a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:48.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.728+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00a070 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:48.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.728+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:53:48.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.728+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:53:48.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.728+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:48.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.728+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc0182b0 2024-02-21T07:53:48.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.728+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc00e140 2024-02-21T07:53:48.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.728+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018ea0 2024-02-21T07:53:48.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.729+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00e140 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:48.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.729+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:48.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.729+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0182b0 legacy=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:48.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.729+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:48.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.930+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0182b0 legacy=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:48.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.930+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:48.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.930+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00e140 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:48.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:48.930+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:49.331+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0182b0 legacy=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:49.331+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00e140 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:49.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:49.331+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:49.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:49.331+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:50.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:50.132+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0182b0 legacy=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:50.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:50.132+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00e140 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:50.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:50.132+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:50.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:50.133+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:51.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:51.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00e140 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0182b0 legacy=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 0x7f9cdc006ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 0x7f9cdc014120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc00dcc0 2024-02-21T07:53:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc0097d0 2024-02-21T07:53:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc00f3e0 2024-02-21T07:53:51.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:51.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.729+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.930+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.930+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.930+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.930+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:51.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:51.930+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:52.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:52.331+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:52.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:52.331+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:52.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:52.331+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:52.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:52.331+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:52.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:52.331+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:53.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:53.132+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:53.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:53.132+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:53.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:53.132+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:53.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:53.133+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:53.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:53.133+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:54.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:54.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00f3e0 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:54.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:54.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0097d0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:54.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:54.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc016670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:54.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:53:54.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:54.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc00dcc0 2024-02-21T07:53:54.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00f7f0 2024-02-21T07:53:54.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.729+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc018ea0 2024-02-21T07:53:54.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.730+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 msgr2=0x7f9cdc016670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:54.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.730+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:54.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.730+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc016670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:54.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.730+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:54.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.730+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:54.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.931+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 msgr2=0x7f9cdc016670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:54.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.931+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:54.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.931+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc016670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:54.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.931+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:54.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:54.931+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:55.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:55.332+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 msgr2=0x7f9cdc016670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:55.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:55.332+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc016670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:55.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:55.332+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:55.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:55.332+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:55.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:55.332+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:56.133+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 msgr2=0x7f9cdc016670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:53:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:56.133+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc016670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:56.133+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:53:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:56.133+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:53:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:56.133+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:53:57.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:57.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:57.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 msgr2=0x7f9cdc016670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:57.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc016670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:53:57.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:53:57.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 0x7f9cdc014120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:53:57.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc016bb0 2024-02-21T07:53:57.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc00f3e0 2024-02-21T07:53:57.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00e0a0 2024-02-21T07:53:57.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:57.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:57.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc016bb0 legacy=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:57.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.730+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:53:57.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.931+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc016bb0 legacy=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:57.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.931+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.931+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:57.931+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:53:58.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:58.332+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc016bb0 legacy=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:58.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:58.332+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:58.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:58.332+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:58.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:58.332+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:53:59.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:59.133+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc016bb0 legacy=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:53:59.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:59.133+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:53:59.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:59.133+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:53:59.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:53:59.133+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:00.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 msgr2=0x7f9cdc014120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:00.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00e0a0 0x7f9cdc014120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:00.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:00.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc016bb0 legacy=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:00.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:00.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:00.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc00dcc0 2024-02-21T07:54:00.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc0182b0 2024-02-21T07:54:00.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc018ea0 2024-02-21T07:54:00.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.730+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:00.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.731+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:00.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.731+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:00.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.731+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:00.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.731+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:00.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.731+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:00.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.932+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:00.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.932+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:00.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.932+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:00.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.932+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:00.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:00.932+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:01.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:01.333+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:01.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:01.333+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:01.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:01.333+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:01.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:01.333+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:01.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:01.333+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:02.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:02.134+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:02.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:02.134+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:02.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:02.134+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:02.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:02.135+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:02.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:02.135+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:03.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:03.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:03.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:03.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:03.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:03.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc006ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:03.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc00f3e0 2024-02-21T07:54:03.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc0192c0 2024-02-21T07:54:03.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00f7f0 2024-02-21T07:54:03.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:03.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:03.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0192c0 legacy=0x7f9cdc0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:03.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.731+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:03.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.932+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:03.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.932+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:03.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.932+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:03.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:03.932+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0192c0 legacy=0x7f9cdc0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:04.333+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:04.333+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:04.333+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:04.333+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0192c0 legacy=0x7f9cdc0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:05.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:05.134+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:05.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:05.134+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:05.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:05.134+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:05.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:05.135+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0192c0 legacy=0x7f9cdc0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:06.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:06.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00f7f0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:06.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0192c0 legacy=0x7f9cdc0196d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:06.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:06.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:06.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 0x7f9cdc015130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:06.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:06.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc00dcc0 2024-02-21T07:54:06.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc019de0 2024-02-21T07:54:06.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc0182b0 2024-02-21T07:54:06.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.731+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:06.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.732+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 msgr2=0x7f9cdc015130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:06.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.732+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:06.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.732+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 0x7f9cdc015130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:06.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.732+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:06.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.732+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:06.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.933+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 msgr2=0x7f9cdc015130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:06.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.933+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:06.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.933+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:06.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.933+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 0x7f9cdc015130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:06.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:06.933+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:07.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:07.334+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 msgr2=0x7f9cdc015130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:07.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:07.334+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 0x7f9cdc015130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:07.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:07.334+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:07.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:07.334+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:07.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:07.334+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:08.135+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 msgr2=0x7f9cdc015130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:08.135+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 0x7f9cdc015130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:08.135+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:08.135+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:08.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:08.136+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:09.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0186f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:09.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0186f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 msgr2=0x7f9cdc015130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019de0 0x7f9cdc015130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ecd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc0192c0 2024-02-21T07:54:09.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc00f3e0 2024-02-21T07:54:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018ea0 2024-02-21T07:54:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0192c0 legacy=0x7f9cdc0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:09.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.732+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:09.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.933+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0192c0 legacy=0x7f9cdc0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:09.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.933+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:09.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.933+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:09.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:09.933+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:10.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:10.334+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0192c0 legacy=0x7f9cdc0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:10.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:10.334+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:10.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:10.334+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:10.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:10.334+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:11.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:11.135+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0192c0 legacy=0x7f9cdc0196d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:11.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:11.135+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:11.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:11.135+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:11.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:11.135+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:12.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:12.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018ea0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:12.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00f3e0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:12.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0192c0 legacy=0x7f9cdc0196d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:12.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:12.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:12.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc019de0 2024-02-21T07:54:12.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc00dcc0 2024-02-21T07:54:12.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc0182b0 2024-02-21T07:54:12.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019de0 legacy=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:12.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:12.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.732+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:12.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.733+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:12.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.934+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019de0 legacy=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:12.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.934+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:12.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.934+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:12.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:12.934+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:13.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:13.335+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:13.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:13.335+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019de0 legacy=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:13.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:13.335+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:13.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:13.335+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:14.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:14.136+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:14.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:14.136+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:14.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:14.136+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019de0 legacy=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:14.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:14.136+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019de0 legacy=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 0x7f9cdc0186c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 0x7f9cdc015490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc0196a0 2024-02-21T07:54:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc0150b0 2024-02-21T07:54:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc018d70 2024-02-21T07:54:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 msgr2=0x7f9cdc0186c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 0x7f9cdc0186c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 msgr2=0x7f9cdc015490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0196a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.733+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 0x7f9cdc015490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:15.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.934+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 msgr2=0x7f9cdc0186c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.934+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0196a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.934+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 msgr2=0x7f9cdc015490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.934+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 0x7f9cdc0186c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:15.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:15.934+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 0x7f9cdc015490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:16.149 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:16.158 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:16.163 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:16.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:16.335+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 msgr2=0x7f9cdc015490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:16.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:16.335+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0196a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:16.335+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 0x7f9cdc015490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:16.335+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 msgr2=0x7f9cdc0186c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:16.335+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 0x7f9cdc0186c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:17.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:17.136+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 msgr2=0x7f9cdc015490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:17.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:17.136+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0196a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:17.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:17.136+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 0x7f9cdc015490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:17.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:17.136+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 msgr2=0x7f9cdc0186c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:17.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:17.136+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 0x7f9cdc0186c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:18.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 msgr2=0x7f9cdc0186c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:18.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018d70 0x7f9cdc0186c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 msgr2=0x7f9cdc015490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:18.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc0150b0 0x7f9cdc015490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:18.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0196a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:18.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:18.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:18.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc0159d0 2024-02-21T07:54:18.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc0182b0 2024-02-21T07:54:18.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc00a450 2024-02-21T07:54:18.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:18.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0159d0 legacy=0x7f9cdc015db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:18.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:18.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:18.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:18.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.733+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:18.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.934+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0159d0 legacy=0x7f9cdc015db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:18.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.934+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:18.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.934+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:18.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.934+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:18.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:18.934+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:19.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:19.335+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:19.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:19.335+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0159d0 legacy=0x7f9cdc015db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:19.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:19.335+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:19.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:19.335+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:19.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:19.335+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:20.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:20.137+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0159d0 legacy=0x7f9cdc015db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:20.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:20.137+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:20.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:20.137+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:20.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:20.137+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:20.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:20.137+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:21.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.733+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:21.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.733+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:21.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.733+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00d630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:21.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.733+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00d630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:21.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.733+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0159d0 legacy=0x7f9cdc015db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:21.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.733+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:21.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.733+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc019d80 2024-02-21T07:54:21.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.733+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc00dcc0 2024-02-21T07:54:21.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.733+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018cd0 2024-02-21T07:54:21.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.734+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.734+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.734+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc0140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:21.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.734+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:21.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.935+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:21.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.935+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc0140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:21.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.935+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:21.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:21.935+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:22.336+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc0140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:22.336+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:22.336+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:22.336+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:23.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:23.137+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc0140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:23.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:23.137+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:23.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:23.137+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:23.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:23.137+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:24.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:24.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:24.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00dcc0 legacy=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:24.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc0140a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc016a00 2024-02-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00a450 2024-02-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc018cd0 2024-02-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016a00 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:24.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:24.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:24.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:24.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.734+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:24.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.935+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016a00 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:24.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.935+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:24.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.935+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:24.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.935+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:24.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:24.935+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:25.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:25.336+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:25.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:25.336+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:25.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:25.336+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016a00 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:25.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:25.336+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:25.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:25.336+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:26.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:26.138+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016a00 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:26.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:26.138+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:26.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:26.138+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:26.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:26.138+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:26.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:26.138+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:27.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:27.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:27.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:27.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00a450 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:27.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016a00 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:27.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:27.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc019d80 2024-02-21T07:54:27.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc015f70 2024-02-21T07:54:27.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc0182b0 2024-02-21T07:54:27.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:27.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:27.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.735+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc015f70 legacy=0x7f9cdc0140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:27.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.736+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:27.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.936+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:27.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.937+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc015f70 legacy=0x7f9cdc0140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:27.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.937+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:27.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:27.937+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:28.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:28.337+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:28.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:28.338+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:28.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:28.338+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:28.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:28.339+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc015f70 legacy=0x7f9cdc0140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:29.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:29.137+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:29.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:29.138+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:29.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:29.138+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:29.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:29.139+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc015f70 legacy=0x7f9cdc0140a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.734+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.734+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.734+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc015f70 legacy=0x7f9cdc0140a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.734+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:30.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.734+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:30.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.734+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:30.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.734+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc019d80 2024-02-21T07:54:30.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.734+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc00d5f0 2024-02-21T07:54:30.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.734+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc0182b0 2024-02-21T07:54:30.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.734+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:30.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.735+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc01e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:30.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.735+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:30.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.735+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:30.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.735+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:30.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.936+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc01e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:30.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.936+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:30.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.936+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:30.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:30.936+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:31.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:31.337+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc01e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:31.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:31.337+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:31.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:31.337+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:31.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:31.337+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:32.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:32.138+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc01e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:32.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:32.138+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:32.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:32.138+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:32.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:32.138+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:33.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc00ec60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:33.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc00ec60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:33.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc01e3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:33.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:33.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:33.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:33.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc015f70 2024-02-21T07:54:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018cd0 2024-02-21T07:54:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc00a450 2024-02-21T07:54:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc015f70 legacy=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.735+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:33.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.936+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc015f70 legacy=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:33.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.936+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:33.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.936+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:33.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.936+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:33.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:33.936+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:34.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:34.337+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:34.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:34.337+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc015f70 legacy=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:34.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:34.337+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:34.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:34.337+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:34.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:34.337+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:35.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:35.138+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:35.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:35.138+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:35.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:35.138+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:35.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:35.138+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:35.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:35.139+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc015f70 legacy=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:36.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.735+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:36.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.735+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:36.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:36.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.735+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc015f70 legacy=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:36.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.735+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:36.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:36.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.735+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc00d5f0 2024-02-21T07:54:36.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.735+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc016bd0 2024-02-21T07:54:36.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.735+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018cd0 2024-02-21T07:54:36.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.736+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:36.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.736+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016bd0 legacy=0x7f9cdc01e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:36.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.736+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc014080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:36.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.736+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:36.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.937+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:36.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.937+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc014080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:36.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.937+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016bd0 legacy=0x7f9cdc01e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:36.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:36.937+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:37.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:37.338+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:37.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:37.338+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc014080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:37.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:37.338+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016bd0 legacy=0x7f9cdc01e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:37.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:37.338+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:38.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:38.139+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc014080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:38.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:38.139+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:38.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:38.139+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016bd0 legacy=0x7f9cdc01e3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:38.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:38.140+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:39.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.735+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:39.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:39.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.735+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016bd0 legacy=0x7f9cdc01e3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.735+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc014080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0164c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.735+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.735+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc019d80 2024-02-21T07:54:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.735+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00a450 2024-02-21T07:54:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.735+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc0182b0 2024-02-21T07:54:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.736+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.736+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:39.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.736+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:39.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.736+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:39.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.736+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:39.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.937+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:39.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.937+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:39.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.937+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:39.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.937+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:39.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:39.937+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:40.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:40.338+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:40.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:40.338+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:40.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:40.338+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:40.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:40.338+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:40.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:40.338+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:41.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:41.139+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:41.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:41.139+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:41.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:41.139+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:41.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:41.140+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:41.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:41.140+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:42.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 msgr2=0x7f9cdc0164c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0182b0 0x7f9cdc0164c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00a450 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019d80 legacy=0x7f9cdc015860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:42.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:42.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 0x7f9cdc0149a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:42.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc00d5f0 2024-02-21T07:54:42.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc0164c0 2024-02-21T07:54:42.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc012070 2024-02-21T07:54:42.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:42.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:42.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:42.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:42.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:42.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.736+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:42.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.937+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:42.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.937+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:42.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.937+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:42.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.937+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:42.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:42.937+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:43.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:43.338+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:43.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:43.338+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:43.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:43.338+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:43.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:43.338+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:43.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:43.338+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:44.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:44.139+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:44.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:44.139+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:44.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:44.139+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:44.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:44.139+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:44.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:44.140+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:45.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.736+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:45.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.736+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.736+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:45.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.736+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0164c0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:45.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.736+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ec40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:45.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.736+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.736+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc015860 2024-02-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.736+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc019ce0 2024-02-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.736+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018cd0 2024-02-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.736+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc015860 legacy=0x7f9cdc0168c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.737+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.737+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:45.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.737+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:45.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.938+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc015860 legacy=0x7f9cdc0168c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:45.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.938+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.938+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:45.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:45.938+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:46.287 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:46.296 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:46.299 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:54:46.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:46.339+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc015860 legacy=0x7f9cdc0168c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:46.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:46.339+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:46.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:46.339+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:46.339+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:47.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:47.140+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc015860 legacy=0x7f9cdc0168c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:47.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:47.140+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:47.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:47.140+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:47.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:47.140+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:48.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:48.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:48.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:48.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc015860 legacy=0x7f9cdc0168c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:48.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:48.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:48.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:48.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc00d5f0 2024-02-21T07:54:48.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018cd0 2024-02-21T07:54:48.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:48.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc012070 2024-02-21T07:54:48.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:48.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:48.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:48.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:48.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.737+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:48.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.938+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:48.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.938+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:48.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.938+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:48.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.938+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:48.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:48.938+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:49.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:49.339+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:49.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:49.339+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:49.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:49.339+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:49.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:49.339+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:49.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:49.339+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:50.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:50.141+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ec40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:50.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:50.141+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:50.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:50.141+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:50.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:50.141+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:50.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:50.141+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:51.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:51.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:51.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:51.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ec40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc015860 2024-02-21T07:54:51.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc0164c0 2024-02-21T07:54:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc019ce0 2024-02-21T07:54:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc015860 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:51.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:51.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.737+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc0164c0 legacy=0x7f9cdc0168c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:51.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.938+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:51.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.938+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:51.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.938+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc015860 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:51.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:51.939+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc0164c0 legacy=0x7f9cdc0168c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:52.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:52.339+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:52.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:52.339+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:52.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:52.339+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc015860 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:52.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:52.340+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc0164c0 legacy=0x7f9cdc0168c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:53.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:53.140+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:53.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:53.140+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:53.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:53.140+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc015860 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:53.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:53.141+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc0164c0 legacy=0x7f9cdc0168c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:54.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:54.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:54.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc0164c0 legacy=0x7f9cdc0168c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:54.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc015860 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:54.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:54:54.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:54.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:54.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:54:54.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc019ce0 2024-02-21T07:54:54.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc018cd0 2024-02-21T07:54:54.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc0164c0 con 0x7f9cdc012070 2024-02-21T07:54:54.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:54.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:54.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:54.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:54.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:54.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.738+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:54:54.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.939+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:54.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.939+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:54.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.939+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:54.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.939+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:54.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.939+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:54.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:54.939+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:54:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:55.340+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:55.340+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:55.340+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:55.340+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:55.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:55.340+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:55.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:55.340+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:54:56.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:56.141+0000 7f9d01a00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:54:56.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:56.141+0000 7f9d01a00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:56.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:56.141+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:54:56.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:56.141+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:56.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:56.142+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:54:56.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:56.142+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:54:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 msgr2=0x7f9cdc014460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc012070 0x7f9cdc014460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:57.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:54:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:54:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc00d5f0 2024-02-21T07:54:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc0168c0 2024-02-21T07:54:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc00fe10 con 0x7f9cdc00b5a0 2024-02-21T07:54:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.738+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0168c0 legacy=0x7f9cdc00ec10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:57.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.939+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:57.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.940+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0168c0 legacy=0x7f9cdc00ec10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:57.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:57.940+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:58.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:58.340+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:58.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:58.341+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0168c0 legacy=0x7f9cdc00ec10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:58.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:58.341+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:54:59.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:59.141+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:54:59.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:59.142+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0168c0 legacy=0x7f9cdc00ec10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:54:59.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:54:59.142+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:00.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:00.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc0168c0 legacy=0x7f9cdc00ec10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:00.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:00.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:55:00.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:00.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc016620 con 0x7f9cdc00b9b0 2024-02-21T07:55:00.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc00b5a0 2024-02-21T07:55:00.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc019ce0 2024-02-21T07:55:00.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:00.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00b9b0 legacy=0x7f9cdc00bd90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:00.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:00.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.739+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:00.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.940+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:00.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.940+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:00.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.940+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00b9b0 legacy=0x7f9cdc00bd90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:00.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:00.940+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:01.341+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:01.341+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:01.341+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00b9b0 legacy=0x7f9cdc00bd90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:01.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:01.341+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:02.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:02.142+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:02.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:02.142+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:02.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:02.142+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:02.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:02.142+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00b9b0 legacy=0x7f9cdc00bd90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:03.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc0149a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:03.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc0149a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:03.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00b9b0 legacy=0x7f9cdc00bd90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc00d5f0 2024-02-21T07:55:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018cd0 2024-02-21T07:55:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc005ab0 2024-02-21T07:55:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ebf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:03.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:03.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:03.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:03.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.739+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:03.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.940+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:03.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.940+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ebf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:03.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.940+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:03.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.940+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:03.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:03.940+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:04.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:04.341+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:04.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:04.341+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ebf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:04.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:04.341+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:04.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:04.341+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:04.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:04.341+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:05.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:05.143+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ebf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:05.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:05.143+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:05.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:05.143+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:05.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:05.143+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:05.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:05.143+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:06.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:06.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:06.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:06.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:06.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00d5f0 legacy=0x7f9cdc00ebf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:06.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:55:06.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:06.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc016620 con 0x7f9cdc00b5a0 2024-02-21T07:55:06.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc00b9b0 2024-02-21T07:55:06.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc005ab0 2024-02-21T07:55:06.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.739+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:06.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.740+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00b9b0 legacy=0x7f9cdc014080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:06.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.740+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:06.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.740+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:06.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.941+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:06.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.941+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:06.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.941+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:06.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:06.941+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00b9b0 legacy=0x7f9cdc014080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:07.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:07.342+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:07.342+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:07.342+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00b9b0 legacy=0x7f9cdc014080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:07.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:07.342+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:08.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:08.143+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:08.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:08.143+0000 7f9d01000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:08.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:08.143+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00b9b0 legacy=0x7f9cdc014080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:08.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:08.143+0000 7f9d01000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:09.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.739+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.739+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc005ab0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.739+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00b9b0 legacy=0x7f9cdc014080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.739+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc00b5a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.740+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.740+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc00ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.740+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc00cda0 2024-02-21T07:55:09.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.740+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc019ce0 2024-02-21T07:55:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.740+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc018cd0 2024-02-21T07:55:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.740+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc00ebf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.740+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc00ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.740+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00cda0 legacy=0x7f9cdc00d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.740+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:09.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.740+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:09.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.941+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc00ebf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:09.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.941+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc00ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:09.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.941+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00cda0 legacy=0x7f9cdc00d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:09.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.941+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:09.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:09.941+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:10.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:10.342+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc00ebf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:10.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:10.342+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc00ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:10.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:10.342+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00cda0 legacy=0x7f9cdc00d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:10.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:10.342+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:10.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:10.342+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:11.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:11.144+0000 7f9cfbe00640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc00ebf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:11.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:11.144+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc00ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:11.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:11.144+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00cda0 legacy=0x7f9cdc00d1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:11.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:11.144+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:11.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:11.145+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:12.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc018690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:12.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc018690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc00ebf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:12.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc00ebf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:12.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc00cda0 legacy=0x7f9cdc00d1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:12.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc006400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:55:12.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:55:12.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:12.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc016620 con 0x7f9cdc018cd0 2024-02-21T07:55:12.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc0157a0 2024-02-21T07:55:12.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc00b5a0 2024-02-21T07:55:12.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 msgr2=0x7f9cdc006400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:12.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.741+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:12.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.742+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc006400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:12.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.742+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:12.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.742+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:12.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.942+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:12.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.942+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 msgr2=0x7f9cdc006400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:12.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.942+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc006400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:12.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.942+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:12.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:12.942+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:13.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:13.343+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:13.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:13.343+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 msgr2=0x7f9cdc006400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:13.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:13.343+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc006400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:13.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:13.343+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:13.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:13.343+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:14.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:14.144+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:14.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:14.144+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 msgr2=0x7f9cdc006400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:14.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:14.144+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc006400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:14.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:14.144+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:14.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:14.144+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.740+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc005ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.740+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.740+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 msgr2=0x7f9cdc006400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.740+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc006400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.740+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.741+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 0x7f9cdc00ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.741+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc005ab0 2024-02-21T07:55:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.741+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc016620 con 0x7f9cdc019ce0 2024-02-21T07:55:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.741+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018690 2024-02-21T07:55:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.741+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc006940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.741+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc005ab0 legacy=0x7f9cdc00c990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.741+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.741+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 0x7f9cdc00ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:15.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.942+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc006940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:15.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.942+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc005ab0 legacy=0x7f9cdc00c990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:15.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.942+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:15.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:15.942+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 0x7f9cdc00ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:16.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:16.343+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc005ab0 legacy=0x7f9cdc00c990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:16.343+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:16.343+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 0x7f9cdc00ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:16.344+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc006940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:16.477 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:16.485 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:16.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:17.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:17.145+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc005ab0 legacy=0x7f9cdc00c990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:17.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:17.145+0000 7f9d01000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc006940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:17.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:17.145+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:17.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:17.145+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 0x7f9cdc00ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:18.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:18.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018690 0x7f9cdc00ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:18.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc006940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:18.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc005ab0 legacy=0x7f9cdc00c990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:18.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:55:18.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:18.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:55:18.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc00d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:18.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc00d1b0 2024-02-21T07:55:18.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00b5a0 2024-02-21T07:55:18.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc0157a0 2024-02-21T07:55:18.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.741+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc005e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:18.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.742+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 msgr2=0x7f9cdc00d590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:18.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.742+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d1b0 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:18.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.742+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:18.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.742+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc00d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:18.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.943+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc005e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:18.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.943+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d1b0 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:18.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.943+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 msgr2=0x7f9cdc00d590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:18.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.943+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:18.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:18.943+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc00d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:19.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:19.344+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc005e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:19.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:19.344+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 msgr2=0x7f9cdc00d590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:19.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:19.344+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d1b0 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:19.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:19.344+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:19.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:19.344+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc00d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:20.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:20.145+0000 7f9d01000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc005e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:20.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:20.145+0000 7f9cfbe00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d1b0 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:20.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:20.145+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 msgr2=0x7f9cdc00d590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:20.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:20.145+0000 7f9d01000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:20.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:20.145+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc00d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:21.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.741+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 msgr2=0x7f9cdc00d590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:21.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.741+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc0157a0 0x7f9cdc00d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:21.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.741+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc005e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:21.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.741+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc005e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:21.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.741+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d1b0 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:21.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.742+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:21.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.742+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc019ce0 2024-02-21T07:55:21.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.742+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc018cd0 2024-02-21T07:55:21.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.742+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018690 2024-02-21T07:55:21.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.742+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc006400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:21.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.742+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:21.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.742+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:21.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.742+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.943+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc006400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:21.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.943+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.943+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:21.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:21.943+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:22.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:22.344+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc006400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:22.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:22.344+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:22.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:22.344+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:22.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:22.344+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:23.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:23.145+0000 7f9d01a00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc006400 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:23.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:23.145+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:23.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:23.145+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:23.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:23.145+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:24.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.742+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:24.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.742+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:24.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.742+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:24.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.742+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc019ce0 legacy=0x7f9cdc006400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:24.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.742+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:55:24.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.742+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc00c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:24.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.742+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc016620 con 0x7f9cdc00d1b0 2024-02-21T07:55:24.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.742+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:55:24.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.742+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc0cd1d0 con 0x7f9cdc018cd0 2024-02-21T07:55:24.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.742+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00b5a0 2024-02-21T07:55:24.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.743+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc00c990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:24.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.743+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d1b0 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:24.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.743+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc00c990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:24.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.743+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:24.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.944+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:24.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.944+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d1b0 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:24.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.944+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc00c990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:24.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:24.944+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc00c990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:25.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:25.345+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:25.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:25.345+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d1b0 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:25.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:25.345+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc00c990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:25.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:25.345+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc00c990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:26.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:26.146+0000 7f9d01a00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:26.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:26.147+0000 7f9cfbe00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc00c990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:26.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:26.147+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc00c990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:26.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:26.147+0000 7f9d01000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d1b0 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:27.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 msgr2=0x7f9cdc00c990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc00b5a0 0x7f9cdc00c990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9cfa000640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc018cd0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9cfa000640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc00d1b0 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 0x7f9cdc005ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc0157a0 2024-02-21T07:55:27.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc018690 2024-02-21T07:55:27.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc017cb0 2024-02-21T07:55:27.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0157a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:27.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00d590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:27.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:27.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 msgr2=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:27.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.743+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 0x7f9cdc005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:27.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.944+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0157a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:27.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.944+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00d590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:27.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.944+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:27.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.944+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 msgr2=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:27.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:27.944+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 0x7f9cdc005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:28.345+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00d590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:28.345+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0157a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:28.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:28.345+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:28.345+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 msgr2=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:28.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:28.346+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 0x7f9cdc005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:29.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:29.146+0000 7f9cfbe00640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0157a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:29.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:29.146+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00d590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:29.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:29.146+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:29.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:29.147+0000 7f9d01a00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 msgr2=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:29.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:29.147+0000 7f9d01a00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 0x7f9cdc005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:30.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 msgr2=0x7f9cdc005ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:30.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc017cb0 0x7f9cdc005ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:30.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9cfa000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 msgr2=0x7f9cdc00d590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:30.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc018690 0x7f9cdc00d590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc0157a0 legacy=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:55:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9d01a00640 1 -- reap_dead start 2024-02-21T07:55:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc00a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc006ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9cfa000640 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc016620 con 0x7f9cdc017cb0 2024-02-21T07:55:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9cfa000640 1 -- --> v2:172.21.15.174:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc019ce0 2024-02-21T07:55:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9cfa000640 1 -- --> v2:172.21.15.184:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc06dcd0 con 0x7f9cdc018cd0 2024-02-21T07:55:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.743+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc017cb0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.744+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.745+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.745+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc00a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:30.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.745+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:30.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.945+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc017cb0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:30.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.946+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:30.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.946+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:30.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.946+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc00a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:30.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:30.946+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:31.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:31.346+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc017cb0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:31.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:31.347+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:31.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:31.347+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:31.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:31.347+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc00a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:31.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:31.347+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:32.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:32.147+0000 7f9d01000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc017cb0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.69:6789/0 2024-02-21T07:55:32.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:32.148+0000 7f9d01a00640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.174:3300/0 2024-02-21T07:55:32.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:32.148+0000 7f9d01a00640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:32.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:32.148+0000 7f9cfbe00640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.184:3300/0 2024-02-21T07:55:32.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:32.148+0000 7f9cfbe00640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc00a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:33.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9cfa000640 1 -- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 msgr2=0x7f9cdc00a450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:33.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9cfa000640 1 --2- >> v2:172.21.15.184:3300/0 conn(0x7f9cdc018cd0 0x7f9cdc00a450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:33.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9cfa000640 1 -- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 msgr2=0x7f9cdc006ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:33.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9cfa000640 1 --2- >> v2:172.21.15.174:3300/0 conn(0x7f9cdc019ce0 0x7f9cdc006ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T07:55:33.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9cfa000640 1 -- >> v1:172.21.15.69:6789/0 conn(0x7f9cdc017cb0 legacy=0x7f9cdc00ebb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T07:55:33.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9cfa000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00d110 0x7f9cdc00d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T07:55:33.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9cfa000640 1 -- --> v1:172.21.15.174:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cfc1865f0 con 0x7f9cdc017790 2024-02-21T07:55:33.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9cfa000640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc016620 con 0x7f9cdc016ca0 2024-02-21T07:55:33.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9cfa000640 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cfc1899c0 con 0x7f9cdc00d110 2024-02-21T07:55:33.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00d110 msgr2=0x7f9cdc00d4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:33.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016ca0 legacy=0x7f9cdc017080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:33.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc017790 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:33.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.744+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00d110 0x7f9cdc00d4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T07:55:33.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.945+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00d110 msgr2=0x7f9cdc00d4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:33.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.945+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016ca0 legacy=0x7f9cdc017080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:33.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.945+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc017790 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:33.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:33.945+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00d110 0x7f9cdc00d4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T07:55:34.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:34.346+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00d110 msgr2=0x7f9cdc00d4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:34.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:34.346+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016ca0 legacy=0x7f9cdc017080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:34.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:34.346+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc017790 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:34.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:34.346+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00d110 0x7f9cdc00d4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T07:55:35.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:35.147+0000 7f9d01000640 1 -- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00d110 msgr2=0x7f9cdc00d4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.69:3300/0 2024-02-21T07:55:35.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:35.147+0000 7f9d01000640 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9cdc00d110 0x7f9cdc00d4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T07:55:35.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:35.147+0000 7f9cfbe00640 1 -- >> v1:172.21.15.184:6789/0 conn(0x7f9cdc016ca0 legacy=0x7f9cdc017080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.184:6789/0 2024-02-21T07:55:35.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-02-21T07:55:35.147+0000 7f9d01a00640 1 -- >> v1:172.21.15.174:6789/0 conn(0x7f9cdc017790 legacy=0x7f9cdc015090 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.174:6789/0 2024-02-21T07:55:36.625 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-02-21T07:55:36.626 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-02-21T07:55:36.639 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-21T07:55:36.639 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-21T07:55:36.639 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.693 INFO:tasks.ceph.mds.a:Stopped 2024-02-21T07:55:36.693 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-21T07:55:36.693 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.693 INFO:tasks.ceph.mds.d:Stopped 2024-02-21T07:55:36.694 DEBUG:tasks.ceph.mds.g:waiting for process to exit 2024-02-21T07:55:36.694 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.694 INFO:tasks.ceph.mds.g:Stopped 2024-02-21T07:55:36.694 DEBUG:tasks.ceph.mds.j:waiting for process to exit 2024-02-21T07:55:36.694 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.694 INFO:tasks.ceph.mds.j:Stopped 2024-02-21T07:55:36.695 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-21T07:55:36.695 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.695 INFO:tasks.ceph.mds.b:Stopped 2024-02-21T07:55:36.695 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-02-21T07:55:36.695 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.695 INFO:tasks.ceph.mds.e:Stopped 2024-02-21T07:55:36.695 DEBUG:tasks.ceph.mds.h:waiting for process to exit 2024-02-21T07:55:36.696 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.696 INFO:tasks.ceph.mds.h:Stopped 2024-02-21T07:55:36.696 DEBUG:tasks.ceph.mds.k:waiting for process to exit 2024-02-21T07:55:36.696 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.696 INFO:tasks.ceph.mds.k:Stopped 2024-02-21T07:55:36.696 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-21T07:55:36.697 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.697 INFO:tasks.ceph.mds.c:Stopped 2024-02-21T07:55:36.697 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-02-21T07:55:36.697 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.697 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:55:36.697 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi184 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f' 2024-02-21T07:55:36.710 INFO:tasks.ceph.mds.f:Stopped 2024-02-21T07:55:36.710 DEBUG:tasks.ceph.mds.i:waiting for process to exit 2024-02-21T07:55:36.710 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.713 INFO:tasks.ceph.mds.i:Stopped 2024-02-21T07:55:36.713 DEBUG:tasks.ceph.mds.l:waiting for process to exit 2024-02-21T07:55:36.713 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.714 INFO:tasks.ceph.mds.l:Stopped 2024-02-21T07:55:36.714 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-21T07:55:36.714 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-21T07:55:36.714 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.714 INFO:tasks.ceph.osd.0:Stopped 2024-02-21T07:55:36.715 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-21T07:55:36.715 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.715 INFO:tasks.ceph.osd.3:Stopped 2024-02-21T07:55:36.715 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-21T07:55:36.715 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.715 INFO:tasks.ceph.osd.6:Stopped 2024-02-21T07:55:36.716 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-02-21T07:55:36.716 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.717 INFO:tasks.ceph.osd.9:Stopped 2024-02-21T07:55:36.717 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-21T07:55:36.717 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.717 INFO:tasks.ceph.osd.1:Stopped 2024-02-21T07:55:36.717 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-21T07:55:36.717 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.718 INFO:tasks.ceph.osd.4:Stopped 2024-02-21T07:55:36.718 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-21T07:55:36.718 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.718 INFO:tasks.ceph.osd.7:Stopped 2024-02-21T07:55:36.719 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2024-02-21T07:55:36.719 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.719 INFO:tasks.ceph.osd.10:Stopped 2024-02-21T07:55:36.720 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-21T07:55:36.720 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.720 INFO:tasks.ceph.osd.2:Stopped 2024-02-21T07:55:36.720 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-21T07:55:36.720 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.720 INFO:tasks.ceph.osd.5:Stopped 2024-02-21T07:55:36.721 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2024-02-21T07:55:36.721 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.721 INFO:tasks.ceph.osd.8:Stopped 2024-02-21T07:55:36.721 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2024-02-21T07:55:36.721 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.721 INFO:tasks.ceph.osd.11:Stopped 2024-02-21T07:55:36.721 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-21T07:55:36.722 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-21T07:55:36.722 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:55:36.722 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2024-02-21T07:55:36.734 INFO:tasks.ceph.mgr.x:Stopped 2024-02-21T07:55:36.734 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-21T07:55:36.734 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.734 INFO:tasks.ceph.mgr.y:Stopped 2024-02-21T07:55:36.735 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2024-02-21T07:55:36.735 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:55:36.735 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi184 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z' 2024-02-21T07:55:36.753 INFO:tasks.ceph.mgr.z:Stopped 2024-02-21T07:55:36.753 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-21T07:55:36.753 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-21T07:55:36.753 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.754 INFO:tasks.ceph.mon.a:Stopped 2024-02-21T07:55:36.754 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-21T07:55:36.754 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.754 INFO:tasks.ceph.mon.b:Stopped 2024-02-21T07:55:36.754 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-21T07:55:36.754 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T07:55:36.755 INFO:tasks.ceph.mon.c:Stopped 2024-02-21T07:55:36.755 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-21T07:55:36.756 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-02-21T07:55:36.864 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:55:36.864 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-21T07:55:37.059 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:55:37.059 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-21T07:55:37.214 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:55:37.215 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-21T07:55:37.359 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:55:37.360 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2024-02-21T07:55:37.523 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:55:37.524 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-21T07:55:37.636 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:55:37.636 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-21T07:55:37.703 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:55:37.704 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-21T07:55:37.770 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:55:37.770 DEBUG:teuthology.orchestra.run.smithi174:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2024-02-21T07:55:37.827 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:55:37.827 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-21T07:55:38.062 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:55:38.062 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-21T07:55:38.129 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:55:38.129 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2024-02-21T07:55:38.193 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:55:38.193 DEBUG:teuthology.orchestra.run.smithi184:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2024-02-21T07:55:38.249 INFO:tasks.ceph:Archiving mon data... 2024-02-21T07:55:38.251 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/data/mon.a.tgz 2024-02-21T07:55:38.251 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2024-02-21T07:55:38.306 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.1GucZQYFOr 2024-02-21T07:55:38.307 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1GucZQYFOr 2024-02-21T07:55:38.500 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.1GucZQYFOr 2024-02-21T07:55:38.650 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.1GucZQYFOr is 502KB 2024-02-21T07:55:38.761 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.1GucZQYFOr 2024-02-21T07:55:38.817 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/data/mon.b.tgz 2024-02-21T07:55:38.817 DEBUG:teuthology.orchestra.run.smithi174:> mktemp 2024-02-21T07:55:38.835 INFO:teuthology.orchestra.run.smithi174.stdout:/tmp/tmp.0hTBVfXg5J 2024-02-21T07:55:38.836 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0hTBVfXg5J 2024-02-21T07:55:39.312 DEBUG:teuthology.orchestra.run.smithi174:> sudo chmod 0666 /tmp/tmp.0hTBVfXg5J 2024-02-21T07:55:39.397 DEBUG:teuthology.orchestra.remote:smithi174:/tmp/tmp.0hTBVfXg5J is 692KB 2024-02-21T07:55:39.498 DEBUG:teuthology.orchestra.run.smithi174:> rm -fr /tmp/tmp.0hTBVfXg5J 2024-02-21T07:55:39.512 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/data/mon.c.tgz 2024-02-21T07:55:39.512 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-02-21T07:55:39.530 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.R3w1j3CYnH 2024-02-21T07:55:39.531 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.R3w1j3CYnH 2024-02-21T07:55:39.800 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.R3w1j3CYnH 2024-02-21T07:55:39.886 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.R3w1j3CYnH is 692KB 2024-02-21T07:55:39.987 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.R3w1j3CYnH 2024-02-21T07:55:40.001 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-21T07:55:40.001 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T07:55:40.009 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T07:55:40.012 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T07:55:40.148 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T07:55:40.163 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T07:55:40.179 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T07:55:40.180 INFO:tasks.ceph:Archiving crash dumps... 2024-02-21T07:55:40.182 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/remote/smithi069/crash 2024-02-21T07:55:40.183 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T07:55:40.275 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/remote/smithi174/crash 2024-02-21T07:55:40.277 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T07:55:40.306 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/remote/smithi184/crash 2024-02-21T07:55:40.307 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T07:55:40.334 INFO:tasks.ceph:Shutting down logrotate 2024-02-21T07:55:40.334 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:40.342 DEBUG:teuthology.orchestra.run.smithi174:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:40.350 DEBUG:teuthology.orchestra.run.smithi184:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:40.496 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:40.594 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:40.625 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T07:55:40.651 INFO:tasks.ceph:Compressing logs... 2024-02-21T07:55:40.652 DEBUG:teuthology.orchestra.run.smithi069:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T07:55:40.660 DEBUG:teuthology.orchestra.run.smithi174:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T07:55:40.667 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T07:55:40.693 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2024-02-21T07:55:40.693 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T07:55:40.697 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-21T07:55:40.697 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-21T07:55:40.697 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-21T07:55:40.697 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.k.log 2024-02-21T07:55:40.697 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.h.log 2024-02-21T07:55:40.698 INFO:teuthology.orchestra.run.smithi174.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-21T07:55:40.698 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-21T07:55:40.698 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-02-21T07:55:40.698 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-21T07:55:40.698 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mds.e.log: 93.1% -- replaced with /var/log/ceph/ceph-mds.k.log.gz 2024-02-21T07:55:40.700 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T07:55:40.700 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mgr.y.log: 93.1% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-02-21T07:55:40.700 INFO:teuthology.orchestra.run.smithi174.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-21T07:55:40.701 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T07:55:40.717 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38576.log 2024-02-21T07:55:40.717 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38776.log 2024-02-21T07:55:40.728 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38576.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.l.log 2024-02-21T07:55:40.728 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38536.log 2024-02-21T07:55:40.728 INFO:teuthology.orchestra.run.smithi184.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38576.log.gz 2024-02-21T07:55:40.728 INFO:teuthology.orchestra.run.smithi184.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38776.log.gz 2024-02-21T07:55:40.728 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T07:55:40.728 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38536.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.i.log 2024-02-21T07:55:40.728 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.38736.log 2024-02-21T07:55:40.728 INFO:teuthology.orchestra.run.smithi184.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38536.log.gz 2024-02-21T07:55:40.729 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38856.log 2024-02-21T07:55:40.729 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38736.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2024-02-21T07:55:40.729 INFO:teuthology.orchestra.run.smithi184.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38736.log.gz 2024-02-21T07:55:40.729 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5/var/log/ceph/ceph-client.admin.38856.log: --verbose -- /var/log/ceph/ceph-mgr.z.log 2024-02-21T07:55:40.729 INFO:teuthology.orchestra.run.smithi184.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-21T07:55:40.729 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2024-02-21T07:55:40.729 INFO:teuthology.orchestra.run.smithi184.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38856.log.gz 2024-02-21T07:55:40.729 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-21T07:55:40.729 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mgr.z.log: /var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38896.log 2024-02-21T07:55:40.730 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38616.log 2024-02-21T07:55:40.730 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38816.log 2024-02-21T07:55:40.730 INFO:teuthology.orchestra.run.smithi184.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38896.log.gz 2024-02-21T07:55:40.730 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38616.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-02-21T07:55:40.730 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38816.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38616.log.gz 2024-02-21T07:55:40.730 INFO:teuthology.orchestra.run.smithi184.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38816.log.gz 2024-02-21T07:55:40.730 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38938.log 2024-02-21T07:55:40.730 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38496.log 2024-02-21T07:55:40.730 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38938.log: /var/log/ceph/ceph-mds.f.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38938.log.gz 2024-02-21T07:55:40.731 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38656.log 2024-02-21T07:55:40.731 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38496.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38496.log.gz 2024-02-21T07:55:40.731 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T07:55:40.731 INFO:teuthology.orchestra.run.smithi184.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mgr.z.log.gz 2024-02-21T07:55:40.731 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38656.log: gzip -5 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38656.log.gz 2024-02-21T07:55:40.731 INFO:teuthology.orchestra.run.smithi184.stderr: --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-21T07:55:40.731 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-02-21T07:55:40.731 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-osd.2.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T07:55:40.731 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38696.log 2024-02-21T07:55:40.733 INFO:teuthology.orchestra.run.smithi174.stderr:/var/log/ceph/ceph-mon.b.log: 93.9% -- replaced with /var/log/ceph/ceph-mds.h.log.gz 2024-02-21T07:55:40.742 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46362.log 2024-02-21T07:55:40.743 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54444.log 2024-02-21T07:55:40.743 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-21T07:55:40.745 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-client.admin.38696.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38696.log.gz 2024-02-21T07:55:40.745 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47821.log 2024-02-21T07:55:40.745 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46362.log.gz 2024-02-21T07:55:40.745 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.54444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2024-02-21T07:55:40.746 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47821.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47821.log.gz 2024-02-21T07:55:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-21T07:55:40.747 INFO:teuthology.orchestra.run.smithi069.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.54444.log.gz 2024-02-21T07:55:40.747 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49638.log 2024-02-21T07:55:40.748 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2024-02-21T07:55:40.748 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51873.log 2024-02-21T07:55:40.749 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47677.log 2024-02-21T07:55:40.749 INFO:teuthology.orchestra.run.smithi069.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49638.log.gz 2024-02-21T07:55:40.750 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53969.log 2024-02-21T07:55:40.751 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47677.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-21T07:55:40.751 INFO:teuthology.orchestra.run.smithi069.stderr: 90.7% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51873.log.gz -- replaced with /var/log/ceph/ceph-client.admin.47677.log.gz 2024-02-21T07:55:40.751 INFO:teuthology.orchestra.run.smithi069.stderr: 2024-02-21T07:55:40.752 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52248.log 2024-02-21T07:55:40.753 INFO:teuthology.orchestra.run.smithi069.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.53969.log.gz 2024-02-21T07:55:40.754 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53906.log 2024-02-21T07:55:40.755 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46383.log 2024-02-21T07:55:40.755 INFO:teuthology.orchestra.run.smithi069.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.52248.log.gz 2024-02-21T07:55:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53906.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53906.log.gz 2024-02-21T07:55:40.759 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47779.log 2024-02-21T07:55:40.760 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43452.log 2024-02-21T07:55:40.760 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46383.log: /var/log/ceph/ceph-client.admin.47779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46878.log 2024-02-21T07:55:40.760 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47779.log.gz 2024-02-21T07:55:40.760 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46383.log.gz 2024-02-21T07:55:40.761 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44811.log 2024-02-21T07:55:40.761 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43452.log.gz 2024-02-21T07:55:40.764 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46878.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46878.log.gz 2024-02-21T07:55:40.765 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51638.log 2024-02-21T07:55:40.765 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48801.log 2024-02-21T07:55:40.765 INFO:teuthology.orchestra.run.smithi069.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44811.log.gz 2024-02-21T07:55:40.765 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44853.log 2024-02-21T07:55:40.766 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48801.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51638.log.gz 2024-02-21T07:55:40.766 INFO:teuthology.orchestra.run.smithi069.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48801.log.gz 2024-02-21T07:55:40.766 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53682.log 2024-02-21T07:55:40.766 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43690.log 2024-02-21T07:55:40.767 INFO:teuthology.orchestra.run.smithi174.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-21T07:55:40.774 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44853.log: /var/log/ceph/ceph-client.admin.53682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52116.log 2024-02-21T07:55:40.774 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44853.log.gz 2024-02-21T07:55:40.775 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43690.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53682.log.gz 2024-02-21T07:55:40.775 INFO:teuthology.orchestra.run.smithi069.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43690.log.gz 2024-02-21T07:55:40.775 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43094.log 2024-02-21T07:55:40.775 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45596.log 2024-02-21T07:55:40.775 INFO:teuthology.orchestra.run.smithi069.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52116.log.gz 2024-02-21T07:55:40.776 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46859.log 2024-02-21T07:55:40.776 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43094.log.gz 2024-02-21T07:55:40.776 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45596.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45596.log.gz 2024-02-21T07:55:40.776 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52050.log 2024-02-21T07:55:40.776 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49344.log 2024-02-21T07:55:40.777 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46859.log.gz 2024-02-21T07:55:40.777 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46865.log 2024-02-21T07:55:40.777 INFO:teuthology.orchestra.run.smithi069.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52050.log.gz 2024-02-21T07:55:40.777 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45205.log 2024-02-21T07:55:40.777 INFO:teuthology.orchestra.run.smithi069.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49344.log.gz 2024-02-21T07:55:40.778 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46865.log.gz 2024-02-21T07:55:40.778 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47415.log 2024-02-21T07:55:40.781 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47508.log 2024-02-21T07:55:40.781 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45205.log.gz 2024-02-21T07:55:40.781 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49596.log 2024-02-21T07:55:40.781 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47415.log.gz 2024-02-21T07:55:40.781 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47508.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47508.log.gz 2024-02-21T07:55:40.782 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45943.log 2024-02-21T07:55:40.782 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53550.log 2024-02-21T07:55:40.782 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49596.log.gz 2024-02-21T07:55:40.782 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45943.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45943.log.gz 2024-02-21T07:55:40.782 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44189.log 2024-02-21T07:55:40.782 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43402.log 2024-02-21T07:55:40.783 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44189.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53550.log.gz 2024-02-21T07:55:40.783 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44189.log.gz 2024-02-21T07:55:40.783 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45079.log 2024-02-21T07:55:40.783 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50565.log 2024-02-21T07:55:40.784 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43402.log.gz 2024-02-21T07:55:40.784 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45121.log 2024-02-21T07:55:40.785 INFO:teuthology.orchestra.run.smithi069.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45079.log.gz 2024-02-21T07:55:40.785 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49470.log 2024-02-21T07:55:40.785 INFO:teuthology.orchestra.run.smithi069.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50565.log.gz 2024-02-21T07:55:40.786 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49262.log 2024-02-21T07:55:40.786 INFO:teuthology.orchestra.run.smithi069.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45121.log.gz 2024-02-21T07:55:40.787 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52866.log 2024-02-21T07:55:40.787 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49470.log.gz 2024-02-21T07:55:40.788 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49262.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49262.log.gz 2024-02-21T07:55:40.788 INFO:teuthology.orchestra.run.smithi069.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47252.log 2024-02-21T07:55:40.789 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47863.log 2024-02-21T07:55:40.789 INFO:teuthology.orchestra.run.smithi069.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52866.log.gz 2024-02-21T07:55:40.790 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47252.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.47252.log.gz /var/log/ceph/ceph-client.admin.53864.log 2024-02-21T07:55:40.790 INFO:teuthology.orchestra.run.smithi069.stderr: 2024-02-21T07:55:40.791 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52446.log 2024-02-21T07:55:40.791 INFO:teuthology.orchestra.run.smithi069.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47863.log.gz 2024-02-21T07:55:40.792 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53948.log 2024-02-21T07:55:40.792 INFO:teuthology.orchestra.run.smithi069.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53864.log.gz 2024-02-21T07:55:40.793 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54797.log 2024-02-21T07:55:40.793 INFO:teuthology.orchestra.run.smithi069.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52446.log.gz 2024-02-21T07:55:40.794 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48157.log 2024-02-21T07:55:40.794 INFO:teuthology.orchestra.run.smithi069.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53948.log.gz 2024-02-21T07:55:40.795 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.54797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-02-21T07:55:40.797 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ceph-mon.c.log: 94.3% -- replaced with /var/log/ceph/ceph-mds.i.log.gz 2024-02-21T07:55:40.798 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48157.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48157.log.gz 2024-02-21T07:55:40.798 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47501.log 2024-02-21T07:55:40.798 INFO:teuthology.orchestra.run.smithi069.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.54797.log.gz 2024-02-21T07:55:40.798 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53310.log 88.4% 2024-02-21T07:55:40.799 INFO:teuthology.orchestra.run.smithi069.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gz 2024-02-21T07:55:40.799 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47501.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.47501.log.gz 2024-02-21T07:55:40.799 INFO:teuthology.orchestra.run.smithi069.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50058.log 2024-02-21T07:55:40.800 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54023.log 2024-02-21T07:55:40.800 INFO:teuthology.orchestra.run.smithi069.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53310.log.gz 2024-02-21T07:55:40.801 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50058.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50058.log.gz -5 2024-02-21T07:55:40.801 INFO:teuthology.orchestra.run.smithi069.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53177.log 2024-02-21T07:55:40.802 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.54023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48541.log 2024-02-21T07:55:40.802 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54023.log.gz 2024-02-21T07:55:40.803 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46376.log 2024-02-21T07:55:40.803 INFO:teuthology.orchestra.run.smithi069.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53177.log.gz 2024-02-21T07:55:40.804 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52558.log 2024-02-21T07:55:40.804 INFO:teuthology.orchestra.run.smithi069.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48541.log.gz 2024-02-21T07:55:40.805 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46374.log 2024-02-21T07:55:40.805 INFO:teuthology.orchestra.run.smithi069.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46376.log.gz 2024-02-21T07:55:40.806 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2024-02-21T07:55:40.806 INFO:teuthology.orchestra.run.smithi069.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.52558.log.gz 2024-02-21T07:55:40.809 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46374.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46374.log.gz 2024-02-21T07:55:40.809 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50100.log 2024-02-21T07:55:40.810 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50871.log 2024-02-21T07:55:40.810 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2024-02-21T07:55:40.810 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45985.log 2024-02-21T07:55:40.811 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50100.log.gz 2024-02-21T07:55:40.816 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45901.log 2024-02-21T07:55:40.816 INFO:teuthology.orchestra.run.smithi069.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50871.log.gz 2024-02-21T07:55:40.817 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45985.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45985.log.gz 2024-02-21T07:55:40.817 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49932.log 2024-02-21T07:55:40.817 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45901.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45901.log.gz -5 2024-02-21T07:55:40.817 INFO:teuthology.orchestra.run.smithi069.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2024-02-21T07:55:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46359.log 2024-02-21T07:55:40.818 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49932.log.gz 2024-02-21T07:55:40.818 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48073.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.46379.log -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz 2024-02-21T07:55:40.818 INFO:teuthology.orchestra.run.smithi069.stderr: 2024-02-21T07:55:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53418.log 2024-02-21T07:55:40.819 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46359.log.gz 2024-02-21T07:55:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46379.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46379.log.gz 2024-02-21T07:55:40.819 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43346.log 2024-02-21T07:55:40.821 INFO:teuthology.orchestra.run.smithi184.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.l.log.gz 2024-02-21T07:55:40.828 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53418.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T07:55:40.828 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43346.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53418.log.gz 2024-02-21T07:55:40.828 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43346.log.gz 2024-02-21T07:55:40.828 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49890.log 2024-02-21T07:55:40.829 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45409.log 2024-02-21T07:55:40.829 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49890.log: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-21T07:55:40.829 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54564.log 2024-02-21T07:55:40.829 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49890.log.gz 2024-02-21T07:55:40.829 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50446.log 2024-02-21T07:55:40.830 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45409.log.gz 2024-02-21T07:55:40.830 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.54564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51069.log 2024-02-21T07:55:40.830 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44639.log 2024-02-21T07:55:40.830 INFO:teuthology.orchestra.run.smithi069.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50446.log.gz 2024-02-21T07:55:40.830 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46870.log 2024-02-21T07:55:40.831 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51069.log: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.54564.log.gz 2024-02-21T07:55:40.831 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46122.log 2024-02-21T07:55:40.831 INFO:teuthology.orchestra.run.smithi069.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51069.log.gz 2024-02-21T07:55:40.837 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52692.log 2024-02-21T07:55:40.837 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46870.log.gz 2024-02-21T07:55:40.837 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46122.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.44639.log.gz 2024-02-21T07:55:40.837 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48031.log 2024-02-21T07:55:40.838 INFO:teuthology.orchestra.run.smithi069.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46122.log.gz 2024-02-21T07:55:40.838 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51177.log 2024-02-21T07:55:40.838 INFO:teuthology.orchestra.run.smithi069.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52692.log.gz 2024-02-21T07:55:40.838 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50016.log 2024-02-21T07:55:40.838 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48031.log.gz 2024-02-21T07:55:40.838 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47256.log 2024-02-21T07:55:40.838 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50016.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51177.log.gz 2024-02-21T07:55:40.838 INFO:teuthology.orchestra.run.smithi069.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50016.log.gz 2024-02-21T07:55:40.838 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43602.log 2024-02-21T07:55:40.839 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43785.log 2024-02-21T07:55:40.839 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47256.log.gz 2024-02-21T07:55:40.839 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43602.log: gzip -5 87.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.43602.log.gz -- 2024-02-21T07:55:40.839 INFO:teuthology.orchestra.run.smithi069.stderr: /var/log/ceph/ceph-client.admin.46356.log 2024-02-21T07:55:40.841 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48241.log 2024-02-21T07:55:40.841 INFO:teuthology.orchestra.run.smithi069.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43785.log.gz 2024-02-21T07:55:40.841 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50262.log 2024-02-21T07:55:40.841 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46356.log.gz 2024-02-21T07:55:40.841 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48475.log 2024-02-21T07:55:40.841 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48241.log.gz 2024-02-21T07:55:40.842 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49806.log 2024-02-21T07:55:40.846 INFO:teuthology.orchestra.run.smithi069.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.50262.log.gz 2024-02-21T07:55:40.846 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52380.log 2024-02-21T07:55:40.846 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49806.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48475.log.gz 2024-02-21T07:55:40.846 INFO:teuthology.orchestra.run.smithi069.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49806.log.gz 2024-02-21T07:55:40.846 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43552.log 2024-02-21T07:55:40.847 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48673.log 2024-02-21T07:55:40.847 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43552.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52380.log.gz 2024-02-21T07:55:40.847 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43552.log.gz 2024-02-21T07:55:40.849 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46889.log 2024-02-21T07:55:40.849 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48607.log 2024-02-21T07:55:40.849 INFO:teuthology.orchestra.run.smithi069.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48673.log.gz 2024-02-21T07:55:40.849 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43913.log 2024-02-21T07:55:40.849 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46889.log.gz 2024-02-21T07:55:40.850 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53376.log 2024-02-21T07:55:40.851 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43913.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48607.log.gz 2024-02-21T07:55:40.851 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47947.log 2024-02-21T07:55:40.852 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43913.log.gz 2024-02-21T07:55:40.852 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48409.log 2024-02-21T07:55:40.853 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53376.log.gz 2024-02-21T07:55:40.854 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47947.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47947.log.gz 2024-02-21T07:55:40.854 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52493.log 2024-02-21T07:55:40.854 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54142.log 2024-02-21T07:55:40.855 INFO:teuthology.orchestra.run.smithi069.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.48409.log.gz 2024-02-21T07:55:40.856 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46867.log 2024-02-21T07:55:40.857 INFO:teuthology.orchestra.run.smithi069.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52493.log.gz 2024-02-21T07:55:40.857 INFO:teuthology.orchestra.run.smithi069.stderr:gzip/var/log/ceph/ceph-client.admin.54142.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46382.log 2024-02-21T07:55:40.858 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54142.log.gz 2024-02-21T07:55:40.859 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45859.log 2024-02-21T07:55:40.859 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46867.log.gz 2024-02-21T07:55:40.860 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49386.log 2024-02-21T07:55:40.860 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46382.log.gz 2024-02-21T07:55:40.861 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45247.log 2024-02-21T07:55:40.861 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45859.log.gz 2024-02-21T07:55:40.862 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49764.log 2024-02-21T07:55:40.862 INFO:teuthology.orchestra.run.smithi069.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49386.log.gz 2024-02-21T07:55:40.863 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45648.log 2024-02-21T07:55:40.863 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45247.log.gz 2024-02-21T07:55:40.864 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51445.log 2024-02-21T07:55:40.864 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49764.log.gz 2024-02-21T07:55:40.866 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45367.log 2024-02-21T07:55:40.866 INFO:teuthology.orchestra.run.smithi069.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45648.log.gz 2024-02-21T07:55:40.866 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45775.log 2024-02-21T07:55:40.867 INFO:teuthology.orchestra.run.smithi069.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51445.log.gz 2024-02-21T07:55:40.868 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51135.log 2024-02-21T07:55:40.868 INFO:teuthology.orchestra.run.smithi069.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45367.log.gz 2024-02-21T07:55:40.869 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49848.log 2024-02-21T07:55:40.869 INFO:teuthology.orchestra.run.smithi069.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45775.log.gz 2024-02-21T07:55:40.870 INFO:teuthology.orchestra.run.smithi174.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-02-21T07:55:40.871 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52624.log 2024-02-21T07:55:40.871 INFO:teuthology.orchestra.run.smithi069.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51135.log.gz 2024-02-21T07:55:40.872 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49848.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.g.log 2024-02-21T07:55:40.872 INFO:teuthology.orchestra.run.smithi069.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49848.log.gz 2024-02-21T07:55:40.872 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49722.log 2024-02-21T07:55:40.873 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-mds.g.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.52624.log.gz 2024-02-21T07:55:40.874 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52734.log 2024-02-21T07:55:40.876 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53243.log 2024-02-21T07:55:40.876 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49722.log.gz 2024-02-21T07:55:40.877 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45493.log 2024-02-21T07:55:40.877 INFO:teuthology.orchestra.run.smithi069.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52734.log.gz 2024-02-21T07:55:40.878 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47323.log 2024-02-21T07:55:40.879 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45493.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53243.log.gz 2024-02-21T07:55:40.880 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46367.log 2024-02-21T07:55:40.880 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45493.log.gz 2024-02-21T07:55:40.881 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52800.log 2024-02-21T07:55:40.881 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47323.log.gz 2024-02-21T07:55:40.882 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47264.log 2024-02-21T07:55:40.883 INFO:teuthology.orchestra.run.smithi069.stderr: 88.8%/var/log/ceph/ceph-client.admin.52800.log: -- replaced with /var/log/ceph/ceph-client.admin.46367.log.gz 2024-02-21T07:55:40.883 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.j.log 2024-02-21T07:55:40.885 INFO:teuthology.orchestra.run.smithi069.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52800.log.gz 2024-02-21T07:55:40.885 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43646.log 2024-02-21T07:55:40.885 INFO:teuthology.orchestra.run.smithi069.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47264.log.gz 2024-02-21T07:55:40.886 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54342.log 2024-02-21T07:55:40.888 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43646.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-21T07:55:40.888 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43646.log.gz 2024-02-21T07:55:40.889 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.54342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2024-02-21T07:55:40.891 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45691.log 2024-02-21T07:55:40.892 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50631.log: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.54342.log.gz 2024-02-21T07:55:40.892 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2024-02-21T07:55:40.894 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37512.log 2024-02-21T07:55:40.894 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45691.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45691.log.gz 2024-02-21T07:55:40.894 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51375.log 2024-02-21T07:55:40.895 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.37512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49428.log 2024-02-21T07:55:40.896 INFO:teuthology.orchestra.run.smithi069.stderr: 89.2%/var/log/ceph/ceph-client.admin.51375.log: -- replaced with /var/log/ceph/ceph-client.admin.37512.log.gz 2024-02-21T07:55:40.896 INFO:teuthology.orchestra.run.smithi069.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51375.log.gz 2024-02-21T07:55:40.897 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50376.log 2024-02-21T07:55:40.897 INFO:teuthology.orchestra.run.smithi069.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49428.log.gz 2024-02-21T07:55:40.898 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51309.log 2024-02-21T07:55:40.900 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50142.log 2024-02-21T07:55:40.900 INFO:teuthology.orchestra.run.smithi069.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50376.log.gz 2024-02-21T07:55:40.901 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51686.log 2024-02-21T07:55:40.901 INFO:teuthology.orchestra.run.smithi069.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51309.log.gz 2024-02-21T07:55:40.902 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50494.log 2024-02-21T07:55:40.902 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50142.log.gz 2024-02-21T07:55:40.903 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51686.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51686.log.gz 2024-02-21T07:55:40.904 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53064.log 2024-02-21T07:55:40.905 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53822.log 2024-02-21T07:55:40.905 INFO:teuthology.orchestra.run.smithi069.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50494.log.gz 2024-02-21T07:55:40.906 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51003.log 2024-02-21T07:55:40.907 INFO:teuthology.orchestra.run.smithi069.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53064.log.gz 2024-02-21T07:55:40.908 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53822.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53822.log.gz 2024-02-21T07:55:40.908 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49554.log 2024-02-21T07:55:40.908 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46868.log 2024-02-21T07:55:40.910 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49554.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.51003.log.gz 2024-02-21T07:55:40.911 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49554.log.gz 2024-02-21T07:55:40.911 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37767.log 2024-02-21T07:55:40.912 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46868.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46868.log.gz 2024-02-21T07:55:40.912 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49974.log 2024-02-21T07:55:40.913 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49302.log/var/log/ceph/ceph-client.admin.37767.log: 2024-02-21T07:55:40.914 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37767.log.gz 2024-02-21T07:55:40.914 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49974.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49974.log.gz 2024-02-21T07:55:40.915 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46360.log 2024-02-21T07:55:40.916 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49302.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49302.log.gz 2024-02-21T07:55:40.917 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52008.log 2024-02-21T07:55:40.918 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43997.log 2024-02-21T07:55:40.918 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46360.log.gz 2024-02-21T07:55:40.919 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52008.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-21T07:55:40.919 INFO:teuthology.orchestra.run.smithi069.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52008.log.gz 2024-02-21T07:55:40.921 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51243.log 2024-02-21T07:55:40.921 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43997.log.gz 2024-02-21T07:55:40.923 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.51243.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.51243.log.gz 2024-02-21T07:55:40.924 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51591.log 2024-02-21T07:55:40.925 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43741.log 2024-02-21T07:55:40.927 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51591.log: 93.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-21T07:55:40.927 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48199.log 2024-02-21T07:55:40.927 INFO:teuthology.orchestra.run.smithi069.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51591.log.gz 2024-02-21T07:55:40.928 INFO:teuthology.orchestra.run.smithi184.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-21T07:55:40.928 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2024-02-21T07:55:40.928 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43741.log.gz 2024-02-21T07:55:40.929 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48199.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48199.log.gz 2024-02-21T07:55:40.930 INFO:teuthology.orchestra.run.smithi174.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-21T07:55:40.931 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45544.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2024-02-21T07:55:40.931 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31177.log 2024-02-21T07:55:40.932 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46028.log 2024-02-21T07:55:40.933 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph.tmp-client.admin.31177.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31177.log.gz 2024-02-21T07:55:40.934 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54226.log 2024-02-21T07:55:40.935 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51942.log 2024-02-21T07:55:40.935 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46028.log.gz 2024-02-21T07:55:40.936 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.54226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44895.log 2024-02-21T07:55:40.938 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51942.log: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.54226.log.gz 2024-02-21T07:55:40.938 INFO:teuthology.orchestra.run.smithi069.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.51942.log.gz 2024-02-21T07:55:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44895.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44895.log.gz 2024-02-21T07:55:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47432.log 2024-02-21T07:55:40.940 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47478.log 2024-02-21T07:55:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47989.log 2024-02-21T07:55:40.942 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47432.log.gz 2024-02-21T07:55:40.942 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47478.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47478.log.gz 2024-02-21T07:55:40.944 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47989.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47989.log.gz 2024-02-21T07:55:40.945 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46882.log 2024-02-21T07:55:40.945 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52998.log 2024-02-21T07:55:40.947 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46882.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46882.log.gz 2024-02-21T07:55:40.947 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45817.log 2024-02-21T07:55:40.948 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43871.log 2024-02-21T07:55:40.949 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45817.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52998.log.gz 2024-02-21T07:55:40.949 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-21T07:55:40.950 INFO:teuthology.orchestra.run.smithi069.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45817.log.gz 2024-02-21T07:55:40.951 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44979.log 2024-02-21T07:55:40.951 INFO:teuthology.orchestra.run.smithi069.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43871.log.gz 2024-02-21T07:55:40.952 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44081.log 2024-02-21T07:55:40.954 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44979.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44979.log.gz 2024-02-21T07:55:40.954 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46885.log/var/log/ceph/ceph-client.admin.44081.log: 2024-02-21T07:55:40.955 INFO:teuthology.orchestra.run.smithi069.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44081.log.gz 2024-02-21T07:55:40.956 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50185.log 2024-02-21T07:55:40.958 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46885.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46885.log.gz 2024-02-21T07:55:40.958 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43829.log 2024-02-21T07:55:40.959 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50185.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50185.log.gz 2024-02-21T07:55:40.960 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49512.log 2024-02-21T07:55:40.961 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43829.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43829.log.gz 2024-02-21T07:55:40.962 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52932.log 2024-02-21T07:55:40.963 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49512.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49512.log.gz 2024-02-21T07:55:40.964 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45163.log 2024-02-21T07:55:40.965 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52932.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52932.log.gz 2024-02-21T07:55:40.966 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45163.log: -- /var/log/ceph/ceph-client.admin.45021.log 2024-02-21T07:55:40.967 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45163.log.gz 2024-02-21T07:55:40.968 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T07:55:40.969 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45021.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45021.log.gz 2024-02-21T07:55:40.970 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5/var/log/ceph/ceph.log: --verbose -- /var/log/ceph/ceph-client.admin.44937.log 2024-02-21T07:55:40.972 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T07:55:40.973 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54184.log 2024-02-21T07:55:40.974 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44937.log.gz 2024-02-21T07:55:40.975 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44123.log 2024-02-21T07:55:40.976 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.54184.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54184.log.gz 2024-02-21T07:55:40.977 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53616.log/var/log/ceph/ceph-client.admin.44123.log: 2024-02-21T07:55:40.979 INFO:teuthology.orchestra.run.smithi069.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44123.log.gz 2024-02-21T07:55:40.979 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50739.log 2024-02-21T07:55:40.980 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53616.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.53616.log.gz 2024-02-21T07:55:40.981 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5/var/log/ceph/ceph-client.admin.50739.log: --verbose -- /var/log/ceph/ceph-client.admin.45289.log 2024-02-21T07:55:40.982 INFO:teuthology.orchestra.run.smithi069.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50739.log.gz 2024-02-21T07:55:40.983 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52314.log 2024-02-21T07:55:40.984 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45289.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45289.log.gz 2024-02-21T07:55:40.985 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52182.log 2024-02-21T07:55:40.987 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.52314.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52314.log.gz 2024-02-21T07:55:40.988 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5/var/log/ceph/ceph-client.admin.52182.log: --verbose -- /var/log/ceph/ceph-client.admin.47267.log 2024-02-21T07:55:40.989 INFO:teuthology.orchestra.run.smithi069.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52182.log.gz 2024-02-21T07:55:40.990 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48325.log 2024-02-21T07:55:40.991 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47267.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47267.log.gz 2024-02-21T07:55:40.992 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47905.log 2024-02-21T07:55:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48325.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48325.log.gz 2024-02-21T07:55:40.993 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2024-02-21T07:55:40.995 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47905.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47905.log.gz 2024-02-21T07:55:40.995 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48115.log 2024-02-21T07:55:40.998 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-osd.9.log: /var/log/ceph/ceph-client.admin.48115.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48115.log.gz 2024-02-21T07:55:40.999 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53484.log 2024-02-21T07:55:41.001 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50673.log 2024-02-21T07:55:41.003 INFO:teuthology.orchestra.run.smithi069.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.53484.log.gz 2024-02-21T07:55:41.005 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45733.log 2024-02-21T07:55:41.007 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50673.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50673.log.gz 2024-02-21T07:55:41.010 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43228.log 2024-02-21T07:55:41.011 INFO:teuthology.orchestra.run.smithi069.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45733.log.gz 2024-02-21T07:55:41.012 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47737.log 2024-02-21T07:55:41.017 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43228.log: /var/log/ceph/ceph-client.admin.47737.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51525.log 2024-02-21T07:55:41.017 INFO:teuthology.orchestra.run.smithi069.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43228.log.gz 2024-02-21T07:55:41.018 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47737.log.gz 2024-02-21T07:55:41.019 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47429.log 2024-02-21T07:55:41.024 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.51525.log: /var/log/ceph/ceph-client.admin.47429.log: 90.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43502.log 2024-02-21T07:55:41.026 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51525.log.gz 2024-02-21T07:55:41.026 INFO:teuthology.orchestra.run.smithi069.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-02-21T07:55:41.027 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37894.log 2024-02-21T07:55:41.032 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.37894.log: /var/log/ceph/ceph-client.admin.43502.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45451.log 2024-02-21T07:55:41.033 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43502.log.gz 2024-02-21T07:55:41.033 INFO:teuthology.orchestra.run.smithi069.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37894.log.gz 2024-02-21T07:55:41.035 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46877.log 2024-02-21T07:55:41.038 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46877.log: /var/log/ceph/ceph-client.admin.45451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48283.log 2024-02-21T07:55:41.040 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45451.log.gz 2024-02-21T07:55:41.041 INFO:teuthology.orchestra.run.smithi069.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46877.log.gz 2024-02-21T07:55:41.042 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50937.log 2024-02-21T07:55:41.048 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50937.log: /var/log/ceph/ceph-client.admin.48283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53780.log 2024-02-21T07:55:41.048 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48283.log.gz 2024-02-21T07:55:41.049 INFO:teuthology.orchestra.run.smithi069.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.50937.log.gz 2024-02-21T07:55:41.049 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53130.log 2024-02-21T07:55:41.051 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46078.log 2024-02-21T07:55:41.053 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.53780.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-02-21T07:55:41.055 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6%/var/log/ceph/ceph-client.admin.53130.log: /var/log/ceph/ceph-client.admin.46078.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53130.log.gz 2024-02-21T07:55:41.058 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6%/var/log/ceph/ceph-mds.d.log: -- replaced with /var/log/ceph/ceph-client.admin.53780.log.gz 2024-02-21T07:55:41.059 INFO:teuthology.orchestra.run.smithi069.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46078.log.gz 2024-02-21T07:55:41.059 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46378.log 2024-02-21T07:55:41.064 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47237.log 2024-02-21T07:55:41.065 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46385.log 2024-02-21T07:55:41.066 INFO:teuthology.orchestra.run.smithi069.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-21T07:55:41.066 INFO:teuthology.orchestra.run.smithi069.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46378.log.gz 2024-02-21T07:55:41.068 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47237.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47237.log.gz 2024-02-21T07:55:41.069 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49680.log 2024-02-21T07:55:41.072 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46385.log: /var/log/ceph/ceph-client.admin.49680.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-21T07:55:41.073 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46385.log.gz 2024-02-21T07:55:41.074 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46874.log 2024-02-21T07:55:41.078 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-mds.a.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49680.log.gz 2024-02-21T07:55:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46874.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46874.log.gz 2024-02-21T07:55:41.081 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48367.log 2024-02-21T07:55:41.082 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50805.log 2024-02-21T07:55:41.084 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48367.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48367.log.gz 2024-02-21T07:55:41.086 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49115.log 2024-02-21T07:55:41.092 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.50805.log: 91.0%/var/log/ceph/ceph-client.0.49115.log: -- replaced with /var/log/ceph/ceph-client.admin.50805.log.gz 2024-02-21T07:55:41.093 INFO:teuthology.orchestra.run.smithi069.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49115.log.gz 2024-02-21T07:55:41.171 INFO:teuthology.orchestra.run.smithi184.stderr: 95.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-02-21T07:55:41.280 INFO:teuthology.orchestra.run.smithi069.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.j.log.gz 2024-02-21T07:55:41.656 INFO:teuthology.orchestra.run.smithi069.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mds.g.log.gz 2024-02-21T07:55:42.167 INFO:teuthology.orchestra.run.smithi184.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-02-21T07:55:43.347 INFO:teuthology.orchestra.run.smithi174.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2024-02-21T07:55:44.272 INFO:teuthology.orchestra.run.smithi174.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-21T07:55:44.841 INFO:teuthology.orchestra.run.smithi184.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2024-02-21T07:55:44.899 INFO:teuthology.orchestra.run.smithi069.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-21T07:55:44.988 INFO:teuthology.orchestra.run.smithi174.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-21T07:55:45.086 INFO:teuthology.orchestra.run.smithi184.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2024-02-21T07:55:45.656 INFO:teuthology.orchestra.run.smithi069.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-21T07:55:45.773 INFO:teuthology.orchestra.run.smithi069.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-02-21T07:55:46.034 INFO:teuthology.orchestra.run.smithi184.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-21T07:55:46.574 INFO:teuthology.orchestra.run.smithi184.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-21T07:55:46.576 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-21T07:55:46.577 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m5.871s 2024-02-21T07:55:46.577 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m21.173s 2024-02-21T07:55:46.577 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m0.675s 2024-02-21T07:55:46.676 INFO:teuthology.orchestra.run.smithi174.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-21T07:55:46.678 INFO:teuthology.orchestra.run.smithi174.stderr: 2024-02-21T07:55:46.678 INFO:teuthology.orchestra.run.smithi174.stderr:real 0m5.998s 2024-02-21T07:55:46.678 INFO:teuthology.orchestra.run.smithi174.stderr:user 0m16.465s 2024-02-21T07:55:46.678 INFO:teuthology.orchestra.run.smithi174.stderr:sys 0m0.557s 2024-02-21T07:55:46.862 INFO:teuthology.orchestra.run.smithi069.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-21T07:55:47.122 INFO:teuthology.orchestra.run.smithi069.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2024-02-21T07:56:03.408 INFO:teuthology.orchestra.run.smithi069.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-02-21T07:56:03.411 INFO:teuthology.orchestra.run.smithi069.stderr: 2024-02-21T07:56:03.412 INFO:teuthology.orchestra.run.smithi069.stderr:real 0m22.708s 2024-02-21T07:56:03.412 INFO:teuthology.orchestra.run.smithi069.stderr:user 0m46.241s 2024-02-21T07:56:03.412 INFO:teuthology.orchestra.run.smithi069.stderr:sys 0m3.969s 2024-02-21T07:56:03.414 INFO:tasks.ceph:Archiving logs... 2024-02-21T07:56:03.415 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/remote/smithi069/log 2024-02-21T07:56:03.416 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T07:56:10.074 DEBUG:teuthology.misc:Transferring archived files from smithi174:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/remote/smithi174/log 2024-02-21T07:56:10.075 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T07:56:12.880 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/remote/smithi184/log 2024-02-21T07:56:12.881 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T07:56:16.236 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-02-21T07:56:16.250 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-21T07:56:16.263 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-02-21T07:56:16.268 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-21T07:56:16.268 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T07:56:16.280 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T07:56:16.283 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T07:56:16.450 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-21T07:56:16.465 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-21T07:56:16.465 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T07:56:16.473 DEBUG:teuthology.orchestra.run.smithi174:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T07:56:16.476 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T07:56:16.490 INFO:teuthology.orchestra.run.smithi174.stderr:bash: line 1: ntpq: command not found 2024-02-21T07:56:16.492 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-02-21T07:56:16.495 INFO:teuthology.orchestra.run.smithi174.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T07:56:16.495 INFO:teuthology.orchestra.run.smithi174.stdout:=============================================================================== 2024-02-21T07:56:16.495 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 +1206us[+1209us] +/- 123ms 2024-02-21T07:56:16.495 INFO:teuthology.orchestra.run.smithi174.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -608us[ -605us] +/- 73ms 2024-02-21T07:56:16.495 INFO:teuthology.orchestra.run.smithi174.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 -26us[ -26us] +/- 77ms 2024-02-21T07:56:16.496 INFO:teuthology.orchestra.run.smithi174.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:56:16.497 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T07:56:16.497 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-02-21T07:56:16.497 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 26 +1161us[+1189us] +/- 123ms 2024-02-21T07:56:16.497 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv02.front.sepia.ceph.com 3 6 377 24 -627us[ -599us] +/- 73ms 2024-02-21T07:56:16.498 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 -57us[ -29us] +/- 77ms 2024-02-21T07:56:16.498 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:56:16.521 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2024-02-21T07:56:16.530 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T07:56:16.531 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2024-02-21T07:56:16.531 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 27 +1161us[+1161us] +/- 123ms 2024-02-21T07:56:16.531 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv02.front.sepia.ceph.com 3 6 377 28 -616us[ -554us] +/- 73ms 2024-02-21T07:56:16.531 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 -46us[ -46us] +/- 77ms 2024-02-21T07:56:16.531 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T07:56:16.532 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-21T07:56:16.542 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-21T07:56:16.543 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-21T07:56:16.571 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T07:56:16.787 DEBUG:teuthology.orchestra.run.smithi174:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T07:56:16.860 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T07:56:16.932 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T07:56:17.034 INFO:teuthology.orchestra.run.smithi069.stdout:type=AVC msg=audit(1708500755.378:191): avc: denied { checkpoint_restore } for pid=1143 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-02-21T07:56:17.035 INFO:teuthology.orchestra.run.smithi069.stdout:type=AVC msg=audit(1708500755.378:192): avc: denied { checkpoint_restore } for pid=1144 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-02-21T07:56:17.036 DEBUG:teuthology.task.selinux:ubuntu@smithi069.front.sepia.ceph.com has 2 denials 2024-02-21T07:56:17.036 DEBUG:teuthology.orchestra.run.smithi174:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T07:56:17.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:56:17.072 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T07:56:17.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:56:17.106 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi069.front.sepia.ceph.com: ['type=AVC msg=audit(1708500755.378:192): avc: denied { checkpoint_restore } for pid=1144 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1', 'type=AVC msg=audit(1708500755.378:191): avc: denied { checkpoint_restore } for pid=1143 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-02-21T07:56:17.114 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-21T07:56:17.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-21T07:56:17.171 INFO:teuthology.task.internal:Duration was 1422.489887 seconds 2024-02-21T07:56:17.171 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-21T07:56:17.221 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-21T07:56:17.221 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T07:56:17.232 DEBUG:teuthology.orchestra.run.smithi174:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T07:56:17.234 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T07:56:17.281 INFO:teuthology.orchestra.run.smithi174.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T07:56:17.281 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T07:56:17.384 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T07:56:17.716 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-21T07:56:17.717 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2024-02-21T07:56:17.717 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T07:56:17.777 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi174.front.sepia.ceph.com 2024-02-21T07:56:17.777 DEBUG:teuthology.orchestra.run.smithi174:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T07:56:17.811 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-02-21T07:56:17.811 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T07:56:17.841 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-21T07:56:17.841 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T07:56:17.848 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T07:56:17.854 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T07:56:17.939 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-21T07:56:17.940 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T07:56:17.945 DEBUG:teuthology.orchestra.run.smithi174:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T07:56:17.947 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T07:56:18.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-21T07:56:18.138 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-21T07:56:18.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T07:56:18.230 DEBUG:teuthology.orchestra.run.smithi174:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T07:56:18.257 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T07:56:18.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-21T07:56:18.299 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T07:56:18.308 DEBUG:teuthology.orchestra.run.smithi174:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T07:56:18.310 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T07:56:18.333 INFO:teuthology.orchestra.run.smithi174.stdout:kernel.core_pattern = core 2024-02-21T07:56:18.351 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-02-21T07:56:18.409 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2024-02-21T07:56:18.458 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T07:56:18.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:56:18.507 DEBUG:teuthology.orchestra.run.smithi174:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T07:56:18.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:56:18.522 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T07:56:18.536 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi184.front.sepia.ceph.com, flagging run as failed 2024-02-21T07:56:18.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-21T07:56:18.547 INFO:teuthology.task.internal:Transferring archived files... 2024-02-21T07:56:18.548 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/remote/smithi069 2024-02-21T07:56:18.548 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T07:56:18.658 DEBUG:teuthology.misc:Transferring archived files from smithi174:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/remote/smithi174 2024-02-21T07:56:18.658 DEBUG:teuthology.orchestra.run.smithi174:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T07:56:18.696 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/remote/smithi184 2024-02-21T07:56:18.696 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T07:56:38.093 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-02-21T07:56:38.106 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301/remote/smithi184/coredump/1708501520.44690.core.gz: gzip compressed data, was "1708501520.44690.core", last modified: Wed Feb 21 07:56:18 2024, max compression, original size modulo 2^32 301068288 2024-02-21T07:56:38.107 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2024-02-21T07:56:39.388 INFO:teuthology.task.internal: core looks like: /tmp/tmpus2yyrzl: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mds -f --cluster ceph -i f', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mds', platform: 'x86_64' 2024-02-21T07:56:39.419 INFO:teuthology.task.internal: dump_program: ceph-mds -f --cluster ceph -i f 2024-02-21T07:56:39.420 DEBUG:teuthology.orchestra.run.smithi184:> which 'ceph-mds -f --cluster ceph -i f' 2024-02-21T07:56:39.439 INFO:teuthology.orchestra.run.smithi184.stderr:/usr/bin/which: invalid option -- 'f' 2024-02-21T07:56:39.439 INFO:teuthology.orchestra.run.smithi184.stderr:/usr/bin/which: unrecognized option '--cluster' 2024-02-21T07:56:39.439 INFO:teuthology.orchestra.run.smithi184.stderr:/usr/bin/which: no f in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2024-02-21T07:56:39.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:56:39.441 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph-mds 2024-02-21T07:56:39.441 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph 2024-02-21T07:56:39.442 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi184 with status 1: "which 'ceph-mds -f --cluster ceph -i f'" 2024-02-21T07:56:39.462 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-21T07:56:39.477 INFO:teuthology.task.internal:Not uploading archives. 2024-02-21T07:56:39.477 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-21T07:56:39.518 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-21T07:56:39.518 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T07:56:39.532 DEBUG:teuthology.orchestra.run.smithi174:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T07:56:39.535 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T07:56:39.549 INFO:teuthology.orchestra.run.smithi174.stdout: 262162 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest 2024-02-21T07:56:39.550 INFO:teuthology.orchestra.run.smithi174.stdout: 262163 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest/archive 2024-02-21T07:56:39.550 INFO:teuthology.orchestra.run.smithi174.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest/archive/syslog 2024-02-21T07:56:39.550 INFO:teuthology.orchestra.run.smithi174.stdout: 262347 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Feb 21 07:32 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-02-21T07:56:39.550 INFO:teuthology.orchestra.run.smithi174.stdout: 262175 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Feb 21 07:32 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-02-21T07:56:39.550 INFO:teuthology.orchestra.run.smithi174.stdout: 262174 180 -rw-r--r-- 1 ubuntu ubuntu 181740 Feb 21 07:56 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T07:56:39.550 INFO:teuthology.orchestra.run.smithi174.stdout: 262333 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest/archive/audit 2024-02-21T07:56:39.551 INFO:teuthology.orchestra.run.smithi174.stdout: 262348 120 -rw------- 1 ubuntu ubuntu 118890 Feb 21 07:56 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-02-21T07:56:39.552 INFO:teuthology.orchestra.run.smithi174.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-02-21T07:56:39.552 INFO:teuthology.orchestra.run.smithi184.stdout: 262162 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest 2024-02-21T07:56:39.552 INFO:teuthology.orchestra.run.smithi184.stdout: 262163 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest/archive 2024-02-21T07:56:39.552 INFO:teuthology.orchestra.run.smithi184.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest/archive/syslog 2024-02-21T07:56:39.553 INFO:teuthology.orchestra.run.smithi184.stdout: 262333 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Feb 21 07:32 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-02-21T07:56:39.553 INFO:teuthology.orchestra.run.smithi184.stdout: 262175 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Feb 21 07:32 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-02-21T07:56:39.553 INFO:teuthology.orchestra.run.smithi184.stdout: 262174 180 -rw-r--r-- 1 ubuntu ubuntu 183880 Feb 21 07:56 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T07:56:39.553 INFO:teuthology.orchestra.run.smithi184.stdout: 394692 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest/archive/audit 2024-02-21T07:56:39.553 INFO:teuthology.orchestra.run.smithi184.stdout: 394974 120 -rw------- 1 ubuntu ubuntu 121733 Feb 21 07:56 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-02-21T07:56:39.553 INFO:teuthology.orchestra.run.smithi184.stdout: 262164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 07:45 /home/ubuntu/cephtest/archive/coredump 2024-02-21T07:56:39.553 INFO:teuthology.orchestra.run.smithi184.stdout: 262367 74992 -rw------- 1 root root 301068288 Feb 21 07:45 /home/ubuntu/cephtest/archive/coredump/1708501520.44690.core 2024-02-21T07:56:39.554 INFO:teuthology.orchestra.run.smithi184.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-02-21T07:56:39.581 INFO:teuthology.orchestra.run.smithi069.stdout: 393249 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest 2024-02-21T07:56:39.582 INFO:teuthology.orchestra.run.smithi069.stdout: 393250 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest/archive 2024-02-21T07:56:39.582 INFO:teuthology.orchestra.run.smithi069.stdout: 393254 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest/archive/syslog 2024-02-21T07:56:39.582 INFO:teuthology.orchestra.run.smithi069.stdout: 393395 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Feb 21 07:32 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-02-21T07:56:39.582 INFO:teuthology.orchestra.run.smithi069.stdout: 393314 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Feb 21 07:32 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-02-21T07:56:39.582 INFO:teuthology.orchestra.run.smithi069.stdout: 393262 196 -rw-r--r-- 1 ubuntu ubuntu 196948 Feb 21 07:56 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T07:56:39.583 INFO:teuthology.orchestra.run.smithi069.stdout: 524569 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 07:56 /home/ubuntu/cephtest/archive/audit 2024-02-21T07:56:39.583 INFO:teuthology.orchestra.run.smithi069.stdout: 524571 152 -rw------- 1 ubuntu ubuntu 153280 Feb 21 07:56 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-02-21T07:56:39.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T07:56:39.585 INFO:teuthology.orchestra.run.smithi069.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-02-21T07:56:39.585 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2777, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2609, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 2375, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1630, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_vshankar_ceph_e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb/qa/tasks/ceph_manager.py", line 1621, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-02-21T07:56:39.601 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-21T07:56:39.613 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-21T07:56:39.646 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi069 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-02-21T07:56:39.646 INFO:teuthology.nuke:Checking targets against current locks 2024-02-21T07:56:39.680 DEBUG:teuthology.nuke:shortname: smithi069 2024-02-21T07:56:39.680 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T07:56:39.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:22:52.272506', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBHqD5EK2yCiwOjAZxCfdzCeP4fXnHVdzOm305i/XJOfBihHKusmYaV/m0rfq90k9SjzILGIZzwRHuWAMZzQxyY='} 2024-02-21T07:56:39.710 DEBUG:teuthology.nuke:shortname: smithi174 2024-02-21T07:56:39.710 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T07:56:39.737 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:22:52.276349', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLyl1QxUPZ2qST+PVV1yvkS7iRSEfafL4VLsc9yLcB6dsuwUMrAWlKY6pOfhPOkGdSD/h/UkclT3yuRPz72pnrs='} 2024-02-21T07:56:39.741 DEBUG:teuthology.nuke:shortname: smithi184 2024-02-21T07:56:39.741 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T07:56:39.764 INFO:teuthology.orchestra.console.smithi069:Power off 2024-02-21T07:56:39.764 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T07:56:39.777 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-21_07:17:34-fs:workload-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569301', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 07:22:52.277621', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCQUfEnugbQAcMUc0mD6LDCzK6L+jT7U5qrbfNZAmYYVekRdSqMWqEYZfytwXlcGkG0AGTfViiq3xaq5vCI3QxA='} 2024-02-21T07:56:39.789 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2024-02-21T07:56:39.789 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:56:39.810 INFO:teuthology.orchestra.console.smithi174:Power off 2024-02-21T07:56:39.810 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T07:56:39.823 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-02-21T07:56:39.833 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-02-21T07:56:39.833 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:56:39.854 INFO:teuthology.orchestra.console.smithi184:Power off 2024-02-21T07:56:39.854 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T07:56:39.864 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-02-21T07:56:39.876 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-02-21T07:56:39.877 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:56:39.900 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-02-21T07:56:43.825 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:56:43.865 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:56:43.901 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:56:43.937 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-02-21T07:56:43.977 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-02-21T07:56:44.013 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-02-21T07:56:47.941 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:56:47.978 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:56:48.014 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:56:48.052 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-02-21T07:56:48.090 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-02-21T07:56:48.125 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-02-21T07:56:48.152 INFO:teuthology.orchestra.console.smithi069:Power off completed 2024-02-21T07:56:48.191 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-02-21T07:56:52.128 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:56:52.242 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-02-21T07:56:52.343 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-02-21T07:56:52.451 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1130e053228021b1be9cac260b5ed52c5a9027c5 description: fs:workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} duration: 1422.4898872375488 failure_reason: 'Command failed (workunit test kernel_untar_build.sh) on smithi069 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e96e3d6862ee9161eb8aa9ba1dc0988359a5c4cb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh''' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5f9a3c37322949259cebed4bf5e6e252 status: fail success: false 2024-02-21T07:56:52.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:56:52.539 INFO:teuthology.run:FAIL